2023-11-08T12:10:14.071 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T12:10:14.072 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --archive /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947 --owner scheduled_neesingh@teuthology --verbose --name neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi -- /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/orig.config.yaml 2023-11-08T12:10:14.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T12:10:14.202 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947 branch: wip-neesingh-testing-54557 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7451947' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-neesingh-testing-54557 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: b820560f30d310ab2570761b9a294523225d6998 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b820560f30d310ab2570761b9a294523225d6998 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: issue_54557 sha1: aa63d47e911f728a17b611e016a29a682d602ec3 owner: scheduled_neesingh@teuthology priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 456 sha1: b820560f30d310ab2570761b9a294523225d6998 sleep_before_teardown: 0 suite: fs suite_branch: issue_54557 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: aa63d47e911f728a17b611e016a29a682d602ec3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-08_12:02:26 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714 2023-11-08T12:10:14.203 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa; will attempt to use it 2023-11-08T12:10:14.204 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa/tasks 2023-11-08T12:10:14.204 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-08T12:10:14.209 INFO:teuthology.task.internal:Checking packages... 2023-11-08T12:10:14.234 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b820560f30d310ab2570761b9a294523225d6998' 2023-11-08T12:10:14.234 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-08T12:10:14.235 INFO:teuthology.packaging:ref: None 2023-11-08T12:10:14.235 INFO:teuthology.packaging:tag: None 2023-11-08T12:10:14.235 INFO:teuthology.packaging:branch: wip-neesingh-testing-54557 2023-11-08T12:10:14.236 INFO:teuthology.packaging:sha1: b820560f30d310ab2570761b9a294523225d6998 2023-11-08T12:10:14.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-neesingh-testing-54557 2023-11-08T12:10:14.372 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2698-gb820560f-1focal 2023-11-08T12:10:14.372 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-08T12:10:14.380 INFO:teuthology.task.internal:no buildpackages task found 2023-11-08T12:10:14.381 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-08T12:10:14.396 INFO:teuthology.task.internal:Saving configuration 2023-11-08T12:10:14.413 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-08T12:10:14.421 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T12:10:14.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 12:04:30.860348', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-08T12:10:14.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 12:04:30.858920', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-08T12:10:14.465 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-08T12:10:14.474 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-08T12:10:14.474 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-08T12:10:14.475 INFO:teuthology.run_tasks:Running task console_log... 2023-11-08T12:10:14.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7bd3dc3b80>, signals=[15]) 2023-11-08T12:10:14.551 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-08T12:10:14.559 INFO:teuthology.task.internal:Opening connections... 2023-11-08T12:10:14.560 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:10:14.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:10:14.612 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:10:14.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:10:14.672 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-08T12:10:14.679 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-11-08T12:10:14.690 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-11-08T12:10:14.691 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-11-08T12:10:14.696 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2023-11-08T12:10:14.696 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-08T12:10:14.697 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2023-11-08T12:10:14.697 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2023-11-08T12:10:14.697 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-08T12:10:14.697 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="20.04" 2023-11-08T12:10:14.697 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T12:10:14.697 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T12:10:14.698 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T12:10:14.698 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T12:10:14.698 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=focal 2023-11-08T12:10:14.698 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=focal 2023-11-08T12:10:14.699 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-08T12:10:14.717 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-11-08T12:10:14.750 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-11-08T12:10:14.751 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-11-08T12:10:14.800 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-11-08T12:10:14.801 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-08T12:10:14.801 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-11-08T12:10:14.801 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-11-08T12:10:14.801 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-08T12:10:14.801 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-11-08T12:10:14.802 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T12:10:14.802 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T12:10:14.802 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T12:10:14.802 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T12:10:14.802 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-11-08T12:10:14.803 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-11-08T12:10:14.803 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-11-08T12:10:14.825 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-08T12:10:14.838 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-08T12:10:14.847 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-08T12:10:14.847 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2023-11-08T12:10:14.851 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-11-08T12:10:14.856 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-08T12:10:14.865 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-08T12:10:14.866 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2023-11-08T12:10:14.868 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-11-08T12:10:14.912 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-08T12:10:14.967 INFO:teuthology.run_tasks:Running task kernel... 2023-11-08T12:10:14.983 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-08T12:10:14.984 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-08T12:10:14.984 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-08T12:10:14.985 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-08T12:10:14.986 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-08T12:10:14.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:10:14.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-11-08T12:10:14.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:10:14.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-11-08T12:10:15.198 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-08T12:10:15.198 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3b796cfe2969fb2f2d017e8146dccc1ef582e837"... 2023-11-08T12:10:15.199 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-11-08T12:10:15.205 INFO:teuthology.orchestra.run.smithi112.stdout:5.4.0-124-generic 2023-11-08T12:10:15.206 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-08T12:10:15.206 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-08T12:10:15.207 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-08T12:10:15.207 DEBUG:teuthology.orchestra.run.smithi112:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-08T12:10:15.222 DEBUG:teuthology.task.kernel:sha1 for client.1 is 3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-08T12:10:15.222 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "3b796cfe2969fb2f2d017e8146dccc1ef582e837"... 2023-11-08T12:10:15.222 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-11-08T12:10:15.229 INFO:teuthology.orchestra.run.smithi133.stdout:5.4.0-124-generic 2023-11-08T12:10:15.229 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-08T12:10:15.229 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-08T12:10:15.230 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-08T12:10:15.230 DEBUG:teuthology.orchestra.run.smithi133:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-08T12:10:15.264 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-08T12:10:15.287 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-08T12:10:15.383 INFO:teuthology.orchestra.run.smithi112.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-08T12:10:15.385 DEBUG:teuthology.orchestra.run.smithi112:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-08T12:10:15.406 INFO:teuthology.orchestra.run.smithi133.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-08T12:10:15.408 DEBUG:teuthology.orchestra.run.smithi133:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-08T12:10:15.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-08T12:10:15.429 DEBUG:teuthology.orchestra.run.smithi112:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-08T12:10:15.437 DEBUG:teuthology.orchestra.run.smithi133:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-08T12:10:15.452 DEBUG:teuthology.orchestra.run.smithi133:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-08T12:11:26.410 INFO:teuthology.orchestra.run.smithi133.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-08T12:11:26.411 INFO:teuthology.orchestra.run.smithi133.stderr: * [new branch] main -> origin/main 2023-11-08T12:11:26.470 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190312 -> 20190312 2023-11-08T12:11:26.470 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190416 -> 20190416 2023-11-08T12:11:26.470 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190514 -> 20190514 2023-11-08T12:11:26.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190618 -> 20190618 2023-11-08T12:11:26.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190717 -> 20190717 2023-11-08T12:11:26.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190815 -> 20190815 2023-11-08T12:11:26.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190923 -> 20190923 2023-11-08T12:11:26.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20191022 -> 20191022 2023-11-08T12:11:26.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20191215 -> 20191215 2023-11-08T12:11:26.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200122 -> 20200122 2023-11-08T12:11:26.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200316 -> 20200316 2023-11-08T12:11:26.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200421 -> 20200421 2023-11-08T12:11:26.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200519 -> 20200519 2023-11-08T12:11:26.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200619 -> 20200619 2023-11-08T12:11:26.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200721 -> 20200721 2023-11-08T12:11:26.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200817 -> 20200817 2023-11-08T12:11:26.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200918 -> 20200918 2023-11-08T12:11:26.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201022 -> 20201022 2023-11-08T12:11:26.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201118 -> 20201118 2023-11-08T12:11:26.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201218 -> 20201218 2023-11-08T12:11:26.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210208 -> 20210208 2023-11-08T12:11:26.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210315 -> 20210315 2023-11-08T12:11:26.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210511 -> 20210511 2023-11-08T12:11:26.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210716 -> 20210716 2023-11-08T12:11:26.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210818 -> 20210818 2023-11-08T12:11:26.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210919 -> 20210919 2023-11-08T12:11:26.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20211027 -> 20211027 2023-11-08T12:11:26.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20211216 -> 20211216 2023-11-08T12:11:26.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220209 -> 20220209 2023-11-08T12:11:26.479 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220310 -> 20220310 2023-11-08T12:11:26.479 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220411 -> 20220411 2023-11-08T12:11:26.480 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220509 -> 20220509 2023-11-08T12:11:26.480 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220610 -> 20220610 2023-11-08T12:11:26.480 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220708 -> 20220708 2023-11-08T12:11:26.480 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220815 -> 20220815 2023-11-08T12:11:26.481 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220913 -> 20220913 2023-11-08T12:11:26.481 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221012 -> 20221012 2023-11-08T12:11:26.481 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221109 -> 20221109 2023-11-08T12:11:26.481 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221214 -> 20221214 2023-11-08T12:11:26.481 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230117 -> 20230117 2023-11-08T12:11:26.482 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230210 -> 20230210 2023-11-08T12:11:26.482 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230310 -> 20230310 2023-11-08T12:11:26.482 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230404 -> 20230404 2023-11-08T12:11:26.482 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230515 -> 20230515 2023-11-08T12:11:26.483 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230625 -> 20230625 2023-11-08T12:11:26.483 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230804 -> 20230804 2023-11-08T12:11:26.483 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230919 -> 20230919 2023-11-08T12:11:26.483 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20231030 -> 20231030 2023-11-08T12:11:27.476 INFO:teuthology.orchestra.run.smithi112.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-08T12:11:27.476 INFO:teuthology.orchestra.run.smithi112.stderr: * [new branch] main -> origin/main 2023-11-08T12:11:27.539 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190312 -> 20190312 2023-11-08T12:11:27.539 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190416 -> 20190416 2023-11-08T12:11:27.540 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190514 -> 20190514 2023-11-08T12:11:27.540 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190618 -> 20190618 2023-11-08T12:11:27.540 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190717 -> 20190717 2023-11-08T12:11:27.540 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190815 -> 20190815 2023-11-08T12:11:27.541 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20190923 -> 20190923 2023-11-08T12:11:27.541 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20191022 -> 20191022 2023-11-08T12:11:27.541 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20191215 -> 20191215 2023-11-08T12:11:27.541 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200122 -> 20200122 2023-11-08T12:11:27.542 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200316 -> 20200316 2023-11-08T12:11:27.542 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200421 -> 20200421 2023-11-08T12:11:27.542 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200519 -> 20200519 2023-11-08T12:11:27.542 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200619 -> 20200619 2023-11-08T12:11:27.542 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200721 -> 20200721 2023-11-08T12:11:27.543 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200817 -> 20200817 2023-11-08T12:11:27.543 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20200918 -> 20200918 2023-11-08T12:11:27.543 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20201022 -> 20201022 2023-11-08T12:11:27.543 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20201118 -> 20201118 2023-11-08T12:11:27.544 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20201218 -> 20201218 2023-11-08T12:11:27.544 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210208 -> 20210208 2023-11-08T12:11:27.544 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210315 -> 20210315 2023-11-08T12:11:27.544 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210511 -> 20210511 2023-11-08T12:11:27.544 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210716 -> 20210716 2023-11-08T12:11:27.545 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210818 -> 20210818 2023-11-08T12:11:27.545 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20210919 -> 20210919 2023-11-08T12:11:27.545 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20211027 -> 20211027 2023-11-08T12:11:27.545 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20211216 -> 20211216 2023-11-08T12:11:27.545 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220209 -> 20220209 2023-11-08T12:11:27.546 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220310 -> 20220310 2023-11-08T12:11:27.546 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220411 -> 20220411 2023-11-08T12:11:27.546 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220509 -> 20220509 2023-11-08T12:11:27.546 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220610 -> 20220610 2023-11-08T12:11:27.546 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220708 -> 20220708 2023-11-08T12:11:27.547 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220815 -> 20220815 2023-11-08T12:11:27.547 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20220913 -> 20220913 2023-11-08T12:11:27.547 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20221012 -> 20221012 2023-11-08T12:11:27.547 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20221109 -> 20221109 2023-11-08T12:11:27.547 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20221214 -> 20221214 2023-11-08T12:11:27.548 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230117 -> 20230117 2023-11-08T12:11:27.548 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230210 -> 20230210 2023-11-08T12:11:27.548 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230310 -> 20230310 2023-11-08T12:11:27.548 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230404 -> 20230404 2023-11-08T12:11:27.548 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230515 -> 20230515 2023-11-08T12:11:27.549 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230625 -> 20230625 2023-11-08T12:11:27.549 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230804 -> 20230804 2023-11-08T12:11:27.549 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20230919 -> 20230919 2023-11-08T12:11:27.549 INFO:teuthology.orchestra.run.smithi112.stderr: * [new tag] 20231030 -> 20231030 2023-11-08T12:11:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:Updating files: 52% (1656/3177) Updating files: 53% (1684/3177) Updating files: 54% (1716/3177) Updating files: 55% (1748/3177) Updating files: 56% (1780/3177) Updating files: 57% (1811/3177) Updating files: 58% (1843/3177) Updating files: 59% (1875/3177) Updating files: 60% (1907/3177) Updating files: 61% (1938/3177) Updating files: 62% (1970/3177) Updating files: 63% (2002/3177) Updating files: 64% (2034/3177) Updating files: 65% (2066/3177) Updating files: 66% (2097/3177) Updating files: 66% (2119/3177) Updating files: 67% (2129/3177) Updating files: 68% (2161/3177) Updating files: 69% (2193/3177) Updating files: 70% (2224/3177) Updating files: 71% (2256/3177) Updating files: 72% (2288/3177) Updating files: 73% (2320/3177) Updating files: 74% (2351/3177) Updating files: 75% (2383/3177) Updating files: 76% (2415/3177) Updating files: 77% (2447/3177) Updating files: 78% (2479/3177) Updating files: 79% (2510/3177) Updating files: 80% (2542/3177) Updating files: 81% (2574/3177) Updating files: 82% (2606/3177) Updating files: 83% (2637/3177) Updating files: 84% (2669/3177) Updating files: 85% (2701/3177) Updating files: 86% (2733/3177) Updating files: 87% (2764/3177) Updating files: 88% (2796/3177) Updating files: 89% (2828/3177) Updating files: 90% (2860/3177) Updating files: 91% (2892/3177) Updating files: 92% (2923/3177) Updating files: 93% (2955/3177) Updating files: 94% (2987/3177) Updating files: 95% (3019/3177) Updating files: 96% (3050/3177) Updating files: 97% (3082/3177) Updating files: 98% (3114/3177) Updating files: 99% (3146/3177) Updating files: 100% (3177/3177) Updating files: 100% (3177/3177), done. 2023-11-08T12:11:30.151 INFO:teuthology.orchestra.run.smithi133.stdout:HEAD is now at 2340796d Merge branch 'main' into 'main' 2023-11-08T12:11:30.167 INFO:teuthology.task.kernel:Downloading kernel 3b796cfe2969fb2f2d017e8146dccc1ef582e837 on client.1... 2023-11-08T12:11:30.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-08T12:11:30.313 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/ 2023-11-08T12:11:30.313 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g3b796cfe2969_6.6.0-rc5-g3b796cfe2969-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/ --input-file=- 2023-11-08T12:11:30.316 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi133.front.sepia.ceph.com to complete... 2023-11-08T12:11:31.201 INFO:teuthology.orchestra.run.smithi112.stderr:Updating files: 52% (1657/3177) Updating files: 53% (1684/3177) Updating files: 54% (1716/3177) Updating files: 55% (1748/3177) Updating files: 56% (1780/3177) Updating files: 57% (1811/3177) Updating files: 58% (1843/3177) Updating files: 59% (1875/3177) Updating files: 60% (1907/3177) Updating files: 61% (1938/3177) Updating files: 62% (1970/3177) Updating files: 63% (2002/3177) Updating files: 64% (2034/3177) Updating files: 65% (2066/3177) Updating files: 66% (2097/3177) Updating files: 66% (2119/3177) Updating files: 67% (2129/3177) Updating files: 68% (2161/3177) Updating files: 69% (2193/3177) Updating files: 70% (2224/3177) Updating files: 71% (2256/3177) Updating files: 72% (2288/3177) Updating files: 73% (2320/3177) Updating files: 74% (2351/3177) Updating files: 75% (2383/3177) Updating files: 76% (2415/3177) Updating files: 77% (2447/3177) Updating files: 78% (2479/3177) Updating files: 79% (2510/3177) Updating files: 80% (2542/3177) Updating files: 81% (2574/3177) Updating files: 82% (2606/3177) Updating files: 83% (2637/3177) Updating files: 84% (2669/3177) Updating files: 85% (2701/3177) Updating files: 86% (2733/3177) Updating files: 87% (2764/3177) Updating files: 88% (2796/3177) Updating files: 89% (2828/3177) Updating files: 90% (2860/3177) Updating files: 91% (2892/3177) Updating files: 92% (2923/3177) Updating files: 93% (2955/3177) Updating files: 94% (2987/3177) Updating files: 95% (3019/3177) Updating files: 96% (3050/3177) Updating files: 97% (3082/3177) Updating files: 98% (3114/3177) Updating files: 99% (3146/3177) Updating files: 100% (3177/3177) Updating files: 100% (3177/3177), done. 2023-11-08T12:11:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:HEAD is now at 2340796d Merge branch 'main' into 'main' 2023-11-08T12:11:31.221 INFO:teuthology.task.kernel:Downloading kernel 3b796cfe2969fb2f2d017e8146dccc1ef582e837 on client.0... 2023-11-08T12:11:31.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-08T12:11:31.372 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/ 2023-11-08T12:11:31.372 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g3b796cfe2969_6.6.0-rc5-g3b796cfe2969-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/ --input-file=- 2023-11-08T12:11:31.375 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi112.front.sepia.ceph.com to complete... 2023-11-08T12:11:31.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08 12:11:31 URL:https://1.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/linux-image-6.6.0-rc5-g3b796cfe2969_6.6.0-rc5-g3b796cfe2969-1_amd64.deb [38912044/38912044] -> "/tmp/linux-image.deb" [1] 2023-11-08T12:11:31.887 INFO:teuthology.orchestra.run.smithi133.stderr:FINISHED --2023-11-08 12:11:31-- 2023-11-08T12:11:31.887 INFO:teuthology.orchestra.run.smithi133.stderr:Total wall clock time: 1.5s 2023-11-08T12:11:31.887 INFO:teuthology.orchestra.run.smithi133.stderr:Downloaded: 1 files, 37M in 1.4s (26.6 MB/s) 2023-11-08T12:11:31.888 INFO:teuthology.task.kernel:Installing kernel 3b796cfe2969fb2f2d017e8146dccc1ef582e837 on client.1... 2023-11-08T12:11:31.889 DEBUG:teuthology.orchestra.run.smithi133:> sudo dpkg -i /tmp/linux-image.deb 2023-11-08T12:11:32.193 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g3b796cfe2969. 2023-11-08T12:11:33.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08 12:11:33 URL:https://1.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/linux-image-6.6.0-rc5-g3b796cfe2969_6.6.0-rc5-g3b796cfe2969-1_amd64.deb [38912044/38912044] -> "/tmp/linux-image.deb" [1] 2023-11-08T12:11:33.328 INFO:teuthology.orchestra.run.smithi112.stderr:FINISHED --2023-11-08 12:11:33-- 2023-11-08T12:11:33.328 INFO:teuthology.orchestra.run.smithi112.stderr:Total wall clock time: 1.9s 2023-11-08T12:11:33.328 INFO:teuthology.orchestra.run.smithi112.stderr:Downloaded: 1 files, 37M in 1.5s (25.1 MB/s) 2023-11-08T12:11:33.330 INFO:teuthology.task.kernel:Installing kernel 3b796cfe2969fb2f2d017e8146dccc1ef582e837 on client.0... 2023-11-08T12:11:33.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo dpkg -i /tmp/linux-image.deb 2023-11-08T12:11:33.612 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g3b796cfe2969. 2023-11-08T12:11:33.966 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-08T12:11:33.970 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-08T12:11:34.084 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-6.6.0-rc5-g3b796cfe2969 (6.6.0-rc5-g3b796cfe2969-1) ... 2023-11-08T12:11:35.326 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-08T12:11:35.331 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-08T12:11:35.487 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-6.6.0-rc5-g3b796cfe2969 (6.6.0-rc5-g3b796cfe2969-1) ... 2023-11-08T12:11:36.979 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-6.6.0-rc5-g3b796cfe2969 (6.6.0-rc5-g3b796cfe2969-1) ... 2023-11-08T12:11:37.123 INFO:teuthology.orchestra.run.smithi133.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:11:38.513 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-6.6.0-rc5-g3b796cfe2969 (6.6.0-rc5-g3b796cfe2969-1) ... 2023-11-08T12:11:38.638 INFO:teuthology.orchestra.run.smithi112.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:01.993 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-11-08T12:12:02.003 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-08T12:12:02.028 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-11-08T12:12:02.420 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:02.834 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-08T12:12:02.847 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-08T12:12:04.107 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2023-11-08T12:12:04.123 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-08T12:12:04.155 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2023-11-08T12:12:04.495 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:04.519 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:04.888 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-08T12:12:04.901 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-08T12:12:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-11-08T12:12:05.156 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-deb -c /tmp/linux-image.deb 2023-11-08T12:12:05.166 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./ 2023-11-08T12:12:05.166 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./boot/ 2023-11-08T12:12:05.167 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4415097 2023-11-07 03:19 ./boot/System.map-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:05.181 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 169233 2023-11-07 03:19 ./boot/config-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:05.182 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11352928 2023-11-07 03:19 ./boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:05.203 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/ 2023-11-08T12:12:05.204 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/ 2023-11-08T12:12:05.204 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/postinst.d/ 2023-11-08T12:12:05.204 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/postrm.d/ 2023-11-08T12:12:05.204 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/preinst.d/ 2023-11-08T12:12:05.204 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/prerm.d/ 2023-11-08T12:12:05.205 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/ 2023-11-08T12:12:05.205 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/ 2023-11-08T12:12:05.205 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/ 2023-11-08T12:12:05.205 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/ 2023-11-08T12:12:05.205 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/ 2023-11-08T12:12:05.206 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/ 2023-11-08T12:12:05.206 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/ 2023-11-08T12:12:05.206 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 490233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-08T12:12:05.209 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-08T12:12:05.209 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-08T12:12:05.209 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-08T12:12:05.209 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-08T12:12:05.209 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-08T12:12:05.210 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 152241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-08T12:12:05.210 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-08T12:12:05.210 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-08T12:12:05.210 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-08T12:12:05.211 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-08T12:12:05.211 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-08T12:12:05.211 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-08T12:12:05.211 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-08T12:12:05.211 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-08T12:12:05.212 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-08T12:12:05.212 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-08T12:12:05.212 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-08T12:12:05.212 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-08T12:12:05.212 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-08T12:12:05.213 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/ 2023-11-08T12:12:05.213 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/ 2023-11-08T12:12:05.213 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/mce/ 2023-11-08T12:12:05.213 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-08T12:12:05.213 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpuid.ko 2023-11-08T12:12:05.214 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/msr.ko 2023-11-08T12:12:05.214 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/ 2023-11-08T12:12:05.214 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 353761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-08T12:12:05.214 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 881713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-08T12:12:05.214 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2276817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm.ko 2023-11-08T12:12:05.273 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ 2023-11-08T12:12:05.274 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/af_alg.ko 2023-11-08T12:12:05.274 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/algif_hash.ko 2023-11-08T12:12:05.274 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/algif_skcipher.ko 2023-11-08T12:12:05.275 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ansi_cprng.ko 2023-11-08T12:12:05.275 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/anubis.ko 2023-11-08T12:12:05.275 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/arc4.ko 2023-11-08T12:12:05.275 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/asymmetric_keys/ 2023-11-08T12:12:05.275 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-08T12:12:05.276 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/ 2023-11-08T12:12:05.276 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_memcpy.ko 2023-11-08T12:12:05.276 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_pq.ko 2023-11-08T12:12:05.276 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-08T12:12:05.276 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_tx.ko 2023-11-08T12:12:05.277 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_xor.ko 2023-11-08T12:12:05.277 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/raid6test.ko 2023-11-08T12:12:05.277 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/authenc.ko 2023-11-08T12:12:05.277 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/authencesn.ko 2023-11-08T12:12:05.277 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blake2b_generic.ko 2023-11-08T12:12:05.277 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blowfish_common.ko 2023-11-08T12:12:05.278 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blowfish_generic.ko 2023-11-08T12:12:05.278 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/camellia_generic.ko 2023-11-08T12:12:05.278 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast5_generic.ko 2023-11-08T12:12:05.278 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast6_generic.ko 2023-11-08T12:12:05.279 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast_common.ko 2023-11-08T12:12:05.279 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ccm.ko 2023-11-08T12:12:05.279 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cmac.ko 2023-11-08T12:12:05.279 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crc32_generic.ko 2023-11-08T12:12:05.279 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cryptd.ko 2023-11-08T12:12:05.280 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_engine.ko 2023-11-08T12:12:05.280 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_simd.ko 2023-11-08T12:12:05.280 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_user.ko 2023-11-08T12:12:05.280 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cts.ko 2023-11-08T12:12:05.280 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/des_generic.ko 2023-11-08T12:12:05.280 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/dh_generic.ko 2023-11-08T12:12:05.281 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/echainiv.ko 2023-11-08T12:12:05.281 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/essiv.ko 2023-11-08T12:12:05.281 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/fcrypt.ko 2023-11-08T12:12:05.281 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/khazad.ko 2023-11-08T12:12:05.281 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lrw.ko 2023-11-08T12:12:05.282 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lz4.ko 2023-11-08T12:12:05.282 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lz4hc.ko 2023-11-08T12:12:05.282 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/md4.ko 2023-11-08T12:12:05.282 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/michael_mic.ko 2023-11-08T12:12:05.282 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/pcbc.ko 2023-11-08T12:12:05.283 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/pcrypt.ko 2023-11-08T12:12:05.283 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/rmd160.ko 2023-11-08T12:12:05.283 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/seed.ko 2023-11-08T12:12:05.283 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/serpent_generic.ko 2023-11-08T12:12:05.283 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 149193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/tcrypt.ko 2023-11-08T12:12:05.284 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/tea.ko 2023-11-08T12:12:05.284 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/twofish_common.ko 2023-11-08T12:12:05.284 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/twofish_generic.ko 2023-11-08T12:12:05.284 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/vmac.ko 2023-11-08T12:12:05.285 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/wp512.ko 2023-11-08T12:12:05.285 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xcbc.ko 2023-11-08T12:12:05.285 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xor.ko 2023-11-08T12:12:05.285 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xts.ko 2023-11-08T12:12:05.285 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xxhash_generic.ko 2023-11-08T12:12:05.286 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ 2023-11-08T12:12:05.286 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/ 2023-11-08T12:12:05.286 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_extlog.ko 2023-11-08T12:12:05.286 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-08T12:12:05.286 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_pad.ko 2023-11-08T12:12:05.287 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/apei/ 2023-11-08T12:12:05.287 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/apei/einj.ko 2023-11-08T12:12:05.287 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/ec_sys.ko 2023-11-08T12:12:05.287 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/platform_profile.ko 2023-11-08T12:12:05.287 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/sbs.ko 2023-11-08T12:12:05.288 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/sbshc.ko 2023-11-08T12:12:05.288 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/video.ko 2023-11-08T12:12:05.288 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ 2023-11-08T12:12:05.288 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/acard-ahci.ko 2023-11-08T12:12:05.288 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 88865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ahci.ko 2023-11-08T12:12:05.289 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ahci_platform.ko 2023-11-08T12:12:05.289 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 88289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/libahci.ko 2023-11-08T12:12:05.289 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/libahci_platform.ko 2023-11-08T12:12:05.289 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_acpi.ko 2023-11-08T12:12:05.289 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ali.ko 2023-11-08T12:12:05.289 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_amd.ko 2023-11-08T12:12:05.290 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_artop.ko 2023-11-08T12:12:05.290 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_atiixp.ko 2023-11-08T12:12:05.290 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_atp867x.ko 2023-11-08T12:12:05.290 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cmd640.ko 2023-11-08T12:12:05.291 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cmd64x.ko 2023-11-08T12:12:05.291 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cypress.ko 2023-11-08T12:12:05.291 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_efar.ko 2023-11-08T12:12:05.291 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt366.ko 2023-11-08T12:12:05.291 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt37x.ko 2023-11-08T12:12:05.292 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-08T12:12:05.292 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-08T12:12:05.292 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_it8213.ko 2023-11-08T12:12:05.292 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_it821x.ko 2023-11-08T12:12:05.292 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_jmicron.ko 2023-11-08T12:12:05.293 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_legacy.ko 2023-11-08T12:12:05.293 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_marvell.ko 2023-11-08T12:12:05.293 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_mpiix.ko 2023-11-08T12:12:05.293 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_netcell.ko 2023-11-08T12:12:05.293 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ninja32.ko 2023-11-08T12:12:05.293 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ns87410.ko 2023-11-08T12:12:05.294 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ns87415.ko 2023-11-08T12:12:05.294 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_oldpiix.ko 2023-11-08T12:12:05.294 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_opti.ko 2023-11-08T12:12:05.294 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_optidma.ko 2023-11-08T12:12:05.295 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pcmcia.ko 2023-11-08T12:12:05.295 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-08T12:12:05.295 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-08T12:12:05.295 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_piccolo.ko 2023-11-08T12:12:05.295 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_radisys.ko 2023-11-08T12:12:05.296 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_rdc.ko 2023-11-08T12:12:05.296 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_rz1000.ko 2023-11-08T12:12:05.296 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sch.ko 2023-11-08T12:12:05.296 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_serverworks.ko 2023-11-08T12:12:05.296 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sil680.ko 2023-11-08T12:12:05.296 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sl82c105.ko 2023-11-08T12:12:05.297 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_triflex.ko 2023-11-08T12:12:05.297 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_via.ko 2023-11-08T12:12:05.297 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pdc_adma.ko 2023-11-08T12:12:05.297 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_inic162x.ko 2023-11-08T12:12:05.297 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_mv.ko 2023-11-08T12:12:05.298 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_nv.ko 2023-11-08T12:12:05.298 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_promise.ko 2023-11-08T12:12:05.298 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_qstor.ko 2023-11-08T12:12:05.298 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sil.ko 2023-11-08T12:12:05.298 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sil24.ko 2023-11-08T12:12:05.299 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sis.ko 2023-11-08T12:12:05.299 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_svw.ko 2023-11-08T12:12:05.299 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sx4.ko 2023-11-08T12:12:05.299 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_uli.ko 2023-11-08T12:12:05.299 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_via.ko 2023-11-08T12:12:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_vsc.ko 2023-11-08T12:12:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/auxdisplay/ 2023-11-08T12:12:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/auxdisplay/ks0108.ko 2023-11-08T12:12:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/bcma/ 2023-11-08T12:12:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/bcma/bcma.ko 2023-11-08T12:12:05.301 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/ 2023-11-08T12:12:05.301 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/aoe/ 2023-11-08T12:12:05.301 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/aoe/aoe.ko 2023-11-08T12:12:05.301 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/drbd/ 2023-11-08T12:12:05.301 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 965585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/drbd/drbd.ko 2023-11-08T12:12:05.302 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 173225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/floppy.ko 2023-11-08T12:12:05.302 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/mtip32xx/ 2023-11-08T12:12:05.302 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-08T12:12:05.302 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/nbd.ko 2023-11-08T12:12:05.302 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/null_blk/ 2023-11-08T12:12:05.303 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 110449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/null_blk/null_blk.ko 2023-11-08T12:12:05.303 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 98193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/pktcdvd.ko 2023-11-08T12:12:05.303 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/rbd.ko 2023-11-08T12:12:05.303 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/xen-blkback/ 2023-11-08T12:12:05.303 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 98145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-08T12:12:05.304 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/zram/ 2023-11-08T12:12:05.304 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/zram/zram.ko 2023-11-08T12:12:05.304 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ 2023-11-08T12:12:05.304 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/applicom.ko 2023-11-08T12:12:05.304 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hangcheck-timer.ko 2023-11-08T12:12:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/ 2023-11-08T12:12:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-08T12:12:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-08T12:12:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-08T12:12:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/via-rng.ko 2023-11-08T12:12:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-08T12:12:05.306 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ 2023-11-08T12:12:05.306 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-08T12:12:05.306 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 148601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-08T12:12:05.306 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-08T12:12:05.307 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 139313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-08T12:12:05.307 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-08T12:12:05.307 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-08T12:12:05.307 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/lp.ko 2023-11-08T12:12:05.307 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/mwave/ 2023-11-08T12:12:05.307 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/mwave/mwave.ko 2023-11-08T12:12:05.308 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/nvram.ko 2023-11-08T12:12:05.308 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ppdev.ko 2023-11-08T12:12:05.308 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tlclk.ko 2023-11-08T12:12:05.308 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/ 2023-11-08T12:12:05.308 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-08T12:12:05.309 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-08T12:12:05.309 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-08T12:12:05.309 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-08T12:12:05.309 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-08T12:12:05.309 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-08T12:12:05.309 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-08T12:12:05.310 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/ 2023-11-08T12:12:05.310 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-08T12:12:05.310 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-08T12:12:05.310 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-08T12:12:05.311 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/ 2023-11-08T12:12:05.311 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-palmas.ko 2023-11-08T12:12:05.311 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-si5351.ko 2023-11-08T12:12:05.311 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-twl6040.ko 2023-11-08T12:12:05.311 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-wm831x.ko 2023-11-08T12:12:05.312 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/ 2023-11-08T12:12:05.312 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-08T12:12:05.312 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-08T12:12:05.312 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-08T12:12:05.312 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ 2023-11-08T12:12:05.312 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ 2023-11-08T12:12:05.313 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-08T12:12:05.313 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 243025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ccp.ko 2023-11-08T12:12:05.313 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/ 2023-11-08T12:12:05.313 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/ 2023-11-08T12:12:05.313 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-08T12:12:05.314 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 438761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-08T12:12:05.314 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-08T12:12:05.314 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-08T12:12:05.314 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/padlock-aes.ko 2023-11-08T12:12:05.314 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/padlock-sha.ko 2023-11-08T12:12:05.315 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/virtio/ 2023-11-08T12:12:05.315 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-08T12:12:05.315 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dca/ 2023-11-08T12:12:05.315 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dca/dca.ko 2023-11-08T12:12:05.315 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ 2023-11-08T12:12:05.316 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/dw/ 2023-11-08T12:12:05.316 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-08T12:12:05.316 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ioat/ 2023-11-08T12:12:05.316 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-08T12:12:05.316 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/ 2023-11-08T12:12:05.317 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 79953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/amd64_edac.ko 2023-11-08T12:12:05.317 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/e752x_edac.ko 2023-11-08T12:12:05.317 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/edac_mce_amd.ko 2023-11-08T12:12:05.317 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i3000_edac.ko 2023-11-08T12:12:05.317 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i3200_edac.ko 2023-11-08T12:12:05.317 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i5100_edac.ko 2023-11-08T12:12:05.318 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i5400_edac.ko 2023-11-08T12:12:05.318 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i7300_edac.ko 2023-11-08T12:12:05.318 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i7core_edac.ko 2023-11-08T12:12:05.318 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i82975x_edac.ko 2023-11-08T12:12:05.318 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/ie31200_edac.ko 2023-11-08T12:12:05.319 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/sb_edac.ko 2023-11-08T12:12:05.319 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/x38_edac.ko 2023-11-08T12:12:05.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/ 2023-11-08T12:12:05.319 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-gpio.ko 2023-11-08T12:12:05.319 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max14577.ko 2023-11-08T12:12:05.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max77693.ko 2023-11-08T12:12:05.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max8997.ko 2023-11-08T12:12:05.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-palmas.ko 2023-11-08T12:12:05.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-08T12:12:05.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-08T12:12:05.321 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/ 2023-11-08T12:12:05.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-08T12:12:05.321 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/efi/ 2023-11-08T12:12:05.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-08T12:12:05.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-08T12:12:05.322 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/ 2023-11-08T12:12:05.322 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-08T12:12:05.322 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-08T12:12:05.322 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-arizona.ko 2023-11-08T12:12:05.322 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-da9052.ko 2023-11-08T12:12:05.323 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-da9055.ko 2023-11-08T12:12:05.323 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-dln2.ko 2023-11-08T12:12:05.323 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-08T12:12:05.323 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-generic.ko 2023-11-08T12:12:05.323 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-ich.ko 2023-11-08T12:12:05.324 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-08T12:12:05.324 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-kempld.ko 2023-11-08T12:12:05.324 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-08T12:12:05.324 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max7300.ko 2023-11-08T12:12:05.324 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max730x.ko 2023-11-08T12:12:05.325 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max732x.ko 2023-11-08T12:12:05.325 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-08T12:12:05.325 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-08T12:12:05.325 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-08T12:12:05.325 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-08T12:12:05.325 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-sch.ko 2023-11-08T12:12:05.326 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-08T12:12:05.326 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-08T12:12:05.326 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-08T12:12:05.326 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-08T12:12:05.326 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-08T12:12:05.327 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-vx855.ko 2023-11-08T12:12:05.327 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-08T12:12:05.327 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-08T12:12:05.327 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-08T12:12:05.327 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/ 2023-11-08T12:12:05.328 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-a4tech.ko 2023-11-08T12:12:05.328 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-apple.ko 2023-11-08T12:12:05.328 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-appleir.ko 2023-11-08T12:12:05.328 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-aureal.ko 2023-11-08T12:12:05.328 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-axff.ko 2023-11-08T12:12:05.329 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-belkin.ko 2023-11-08T12:12:05.329 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cherry.ko 2023-11-08T12:12:05.329 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-chicony.ko 2023-11-08T12:12:05.329 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cp2112.ko 2023-11-08T12:12:05.329 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cypress.ko 2023-11-08T12:12:05.330 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-dr.ko 2023-11-08T12:12:05.330 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-elecom.ko 2023-11-08T12:12:05.330 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-elo.ko 2023-11-08T12:12:05.330 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-emsff.ko 2023-11-08T12:12:05.330 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ezkey.ko 2023-11-08T12:12:05.331 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gaff.ko 2023-11-08T12:12:05.331 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-generic.ko 2023-11-08T12:12:05.331 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gt683r.ko 2023-11-08T12:12:05.331 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gyration.ko 2023-11-08T12:12:05.331 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-08T12:12:05.332 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-08T12:12:05.332 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtekff.ko 2023-11-08T12:12:05.332 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-hyperv.ko 2023-11-08T12:12:05.332 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-icade.ko 2023-11-08T12:12:05.332 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-kensington.ko 2023-11-08T12:12:05.332 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-keytouch.ko 2023-11-08T12:12:05.333 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-kye.ko 2023-11-08T12:12:05.333 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lcpower.ko 2023-11-08T12:12:05.333 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-led.ko 2023-11-08T12:12:05.333 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lenovo.ko 2023-11-08T12:12:05.333 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lg-g15.ko 2023-11-08T12:12:05.334 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-08T12:12:05.334 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-08T12:12:05.334 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech.ko 2023-11-08T12:12:05.334 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-magicmouse.ko 2023-11-08T12:12:05.334 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-microsoft.ko 2023-11-08T12:12:05.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-monterey.ko 2023-11-08T12:12:05.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-multitouch.ko 2023-11-08T12:12:05.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ntrig.ko 2023-11-08T12:12:05.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ortek.ko 2023-11-08T12:12:05.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-penmount.ko 2023-11-08T12:12:05.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-petalynx.ko 2023-11-08T12:12:05.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-picolcd.ko 2023-11-08T12:12:05.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-pl.ko 2023-11-08T12:12:05.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-plantronics.ko 2023-11-08T12:12:05.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-primax.ko 2023-11-08T12:12:05.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-rmi.ko 2023-11-08T12:12:05.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-08T12:12:05.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-common.ko 2023-11-08T12:12:05.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-08T12:12:05.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-08T12:12:05.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-08T12:12:05.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-08T12:12:05.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-08T12:12:05.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-08T12:12:05.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-08T12:12:05.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-08T12:12:05.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-08T12:12:05.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat.ko 2023-11-08T12:12:05.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-saitek.ko 2023-11-08T12:12:05.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-samsung.ko 2023-11-08T12:12:05.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-08T12:12:05.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sjoy.ko 2023-11-08T12:12:05.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sony.ko 2023-11-08T12:12:05.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-speedlink.ko 2023-11-08T12:12:05.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-steelseries.ko 2023-11-08T12:12:05.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sunplus.ko 2023-11-08T12:12:05.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-08T12:12:05.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-tivo.ko 2023-11-08T12:12:05.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-tmff.ko 2023-11-08T12:12:05.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-topseed.ko 2023-11-08T12:12:05.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-twinhan.ko 2023-11-08T12:12:05.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-uclogic.ko 2023-11-08T12:12:05.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-waltop.ko 2023-11-08T12:12:05.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 143473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-wiimote.ko 2023-11-08T12:12:05.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-xinmo.ko 2023-11-08T12:12:05.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-zpff.ko 2023-11-08T12:12:05.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-zydacron.ko 2023-11-08T12:12:05.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 267825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid.ko 2023-11-08T12:12:05.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/uhid.ko 2023-11-08T12:12:05.343 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/ 2023-11-08T12:12:05.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-08T12:12:05.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-08T12:12:05.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-08T12:12:05.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 217873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/wacom.ko 2023-11-08T12:12:05.344 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/ 2023-11-08T12:12:05.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_balloon.ko 2023-11-08T12:12:05.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_utils.ko 2023-11-08T12:12:05.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 305465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_vmbus.ko 2023-11-08T12:12:05.345 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ 2023-11-08T12:12:05.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/abituguru.ko 2023-11-08T12:12:05.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/abituguru3.ko 2023-11-08T12:12:05.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-08T12:12:05.346 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ad7414.ko 2023-11-08T12:12:05.346 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ad7418.ko 2023-11-08T12:12:05.346 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adc128d818.ko 2023-11-08T12:12:05.346 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1025.ko 2023-11-08T12:12:05.347 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1026.ko 2023-11-08T12:12:05.347 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1029.ko 2023-11-08T12:12:05.347 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1031.ko 2023-11-08T12:12:05.347 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm9240.ko 2023-11-08T12:12:05.347 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ads7828.ko 2023-11-08T12:12:05.348 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7410.ko 2023-11-08T12:12:05.348 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7411.ko 2023-11-08T12:12:05.348 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7462.ko 2023-11-08T12:12:05.348 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7470.ko 2023-11-08T12:12:05.348 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7475.ko 2023-11-08T12:12:05.349 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7x10.ko 2023-11-08T12:12:05.349 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/amc6821.ko 2023-11-08T12:12:05.349 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/applesmc.ko 2023-11-08T12:12:05.349 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asb100.ko 2023-11-08T12:12:05.349 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asc7621.ko 2023-11-08T12:12:05.350 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-08T12:12:05.350 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/atxp1.ko 2023-11-08T12:12:05.350 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/coretemp.ko 2023-11-08T12:12:05.350 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-08T12:12:05.350 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-08T12:12:05.350 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-08T12:12:05.351 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/dme1737.ko 2023-11-08T12:12:05.351 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ds1621.ko 2023-11-08T12:12:05.351 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ds620.ko 2023-11-08T12:12:05.351 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc1403.ko 2023-11-08T12:12:05.351 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc2103.ko 2023-11-08T12:12:05.352 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc6w201.ko 2023-11-08T12:12:05.352 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f71805f.ko 2023-11-08T12:12:05.352 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f71882fg.ko 2023-11-08T12:12:05.352 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f75375s.ko 2023-11-08T12:12:05.352 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/fam15h_power.ko 2023-11-08T12:12:05.353 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/fschmd.ko 2023-11-08T12:12:05.353 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/g760a.ko 2023-11-08T12:12:05.353 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/g762.ko 2023-11-08T12:12:05.353 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/gl518sm.ko 2023-11-08T12:12:05.353 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/gl520sm.ko 2023-11-08T12:12:05.354 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/hih6130.ko 2023-11-08T12:12:05.354 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-08T12:12:05.354 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/i5500_temp.ko 2023-11-08T12:12:05.354 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/i5k_amb.ko 2023-11-08T12:12:05.354 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ibmaem.ko 2023-11-08T12:12:05.355 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ibmpex.ko 2023-11-08T12:12:05.355 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ina209.ko 2023-11-08T12:12:05.355 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ina2xx.ko 2023-11-08T12:12:05.355 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 130449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/it87.ko 2023-11-08T12:12:05.355 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/jc42.ko 2023-11-08T12:12:05.356 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/k10temp.ko 2023-11-08T12:12:05.356 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/k8temp.ko 2023-11-08T12:12:05.356 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lineage-pem.ko 2023-11-08T12:12:05.356 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm63.ko 2023-11-08T12:12:05.356 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm73.ko 2023-11-08T12:12:05.356 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm75.ko 2023-11-08T12:12:05.357 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm77.ko 2023-11-08T12:12:05.357 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm78.ko 2023-11-08T12:12:05.357 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm80.ko 2023-11-08T12:12:05.357 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm83.ko 2023-11-08T12:12:05.357 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm85.ko 2023-11-08T12:12:05.358 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm87.ko 2023-11-08T12:12:05.358 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm90.ko 2023-11-08T12:12:05.358 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm92.ko 2023-11-08T12:12:05.358 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm93.ko 2023-11-08T12:12:05.359 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95234.ko 2023-11-08T12:12:05.359 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95241.ko 2023-11-08T12:12:05.359 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95245.ko 2023-11-08T12:12:05.359 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc2945.ko 2023-11-08T12:12:05.359 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4151.ko 2023-11-08T12:12:05.359 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4215.ko 2023-11-08T12:12:05.360 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4222.ko 2023-11-08T12:12:05.360 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4245.ko 2023-11-08T12:12:05.360 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4260.ko 2023-11-08T12:12:05.360 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4261.ko 2023-11-08T12:12:05.360 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max16065.ko 2023-11-08T12:12:05.361 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max1619.ko 2023-11-08T12:12:05.361 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max1668.ko 2023-11-08T12:12:05.361 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max197.ko 2023-11-08T12:12:05.361 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6639.ko 2023-11-08T12:12:05.361 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6650.ko 2023-11-08T12:12:05.362 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6697.ko 2023-11-08T12:12:05.362 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-08T12:12:05.362 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/mcp3021.ko 2023-11-08T12:12:05.362 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-08T12:12:05.362 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6683.ko 2023-11-08T12:12:05.363 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6775-core.ko 2023-11-08T12:12:05.363 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6775.ko 2023-11-08T12:12:05.363 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct7802.ko 2023-11-08T12:12:05.363 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pc87360.ko 2023-11-08T12:12:05.363 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pc87427.ko 2023-11-08T12:12:05.364 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pcf8591.ko 2023-11-08T12:12:05.364 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ 2023-11-08T12:12:05.364 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-08T12:12:05.364 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-08T12:12:05.364 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-08T12:12:05.365 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-08T12:12:05.365 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-08T12:12:05.365 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-08T12:12:05.365 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-08T12:12:05.365 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-08T12:12:05.365 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-08T12:12:05.366 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-08T12:12:05.366 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-08T12:12:05.366 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-08T12:12:05.366 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/powr1220.ko 2023-11-08T12:12:05.366 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch5627.ko 2023-11-08T12:12:05.367 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch5636.ko 2023-11-08T12:12:05.367 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-08T12:12:05.367 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sht15.ko 2023-11-08T12:12:05.367 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sht21.ko 2023-11-08T12:12:05.367 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/shtc1.ko 2023-11-08T12:12:05.368 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sis5595.ko 2023-11-08T12:12:05.368 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47b397.ko 2023-11-08T12:12:05.368 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47m1.ko 2023-11-08T12:12:05.368 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47m192.ko 2023-11-08T12:12:05.368 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/thmc50.ko 2023-11-08T12:12:05.369 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp102.ko 2023-11-08T12:12:05.369 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp103.ko 2023-11-08T12:12:05.369 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp401.ko 2023-11-08T12:12:05.369 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp421.ko 2023-11-08T12:12:05.369 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/via-cputemp.ko 2023-11-08T12:12:05.370 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/via686a.ko 2023-11-08T12:12:05.370 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/vt1211.ko 2023-11-08T12:12:05.370 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/vt8231.ko 2023-11-08T12:12:05.370 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83627ehf.ko 2023-11-08T12:12:05.370 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83627hf.ko 2023-11-08T12:12:05.371 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83781d.ko 2023-11-08T12:12:05.371 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83791d.ko 2023-11-08T12:12:05.371 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83792d.ko 2023-11-08T12:12:05.371 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83793.ko 2023-11-08T12:12:05.371 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83795.ko 2023-11-08T12:12:05.372 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83l785ts.ko 2023-11-08T12:12:05.372 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83l786ng.ko 2023-11-08T12:12:05.372 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-08T12:12:05.372 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-08T12:12:05.372 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/ 2023-11-08T12:12:05.372 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/ 2023-11-08T12:12:05.373 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-08T12:12:05.373 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-08T12:12:05.373 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/ 2023-11-08T12:12:05.373 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-08T12:12:05.373 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-08T12:12:05.374 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-08T12:12:05.374 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-08T12:12:05.374 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-08T12:12:05.374 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-08T12:12:05.374 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-08T12:12:05.375 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-08T12:12:05.375 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-08T12:12:05.375 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-08T12:12:05.375 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-08T12:12:05.375 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-08T12:12:05.376 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-08T12:12:05.376 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-08T12:12:05.376 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-08T12:12:05.376 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-08T12:12:05.376 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-08T12:12:05.377 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-08T12:12:05.377 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-08T12:12:05.377 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-08T12:12:05.377 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-08T12:12:05.377 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-08T12:12:05.377 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-08T12:12:05.378 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-08T12:12:05.378 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-08T12:12:05.378 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-08T12:12:05.378 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-08T12:12:05.378 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-08T12:12:05.379 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-08T12:12:05.379 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-08T12:12:05.379 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-08T12:12:05.379 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-08T12:12:05.379 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-08T12:12:05.380 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-08T12:12:05.380 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-08T12:12:05.380 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-08T12:12:05.380 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-08T12:12:05.380 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-mux.ko 2023-11-08T12:12:05.381 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-smbus.ko 2023-11-08T12:12:05.381 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-stub.ko 2023-11-08T12:12:05.381 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/ 2023-11-08T12:12:05.381 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-08T12:12:05.381 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-08T12:12:05.382 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-08T12:12:05.382 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ 2023-11-08T12:12:05.382 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ 2023-11-08T12:12:05.382 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 273609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-08T12:12:05.382 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 879969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_core.ko 2023-11-08T12:12:05.383 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-08T12:12:05.383 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 324217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-08T12:12:05.383 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-08T12:12:05.383 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 282273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-08T12:12:05.383 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-08T12:12:05.384 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ 2023-11-08T12:12:05.384 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-08T12:12:05.384 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 493073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-08T12:12:05.384 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx4/ 2023-11-08T12:12:05.384 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 419737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-08T12:12:05.384 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx5/ 2023-11-08T12:12:05.385 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 739025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-08T12:12:05.385 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mthca/ 2023-11-08T12:12:05.385 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 296625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-08T12:12:05.385 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-08T12:12:05.385 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 153697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-08T12:12:05.386 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/usnic/ 2023-11-08T12:12:05.386 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 168969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-08T12:12:05.386 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ 2023-11-08T12:12:05.386 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-08T12:12:05.386 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-08T12:12:05.387 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/iser/ 2023-11-08T12:12:05.387 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-08T12:12:05.387 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/isert/ 2023-11-08T12:12:05.387 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 111425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-08T12:12:05.387 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srp/ 2023-11-08T12:12:05.388 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 128753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-08T12:12:05.388 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srpt/ 2023-11-08T12:12:05.388 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 129529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-08T12:12:05.388 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/ 2023-11-08T12:12:05.388 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/evbug.ko 2023-11-08T12:12:05.389 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/ff-memless.ko 2023-11-08T12:12:05.389 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/ 2023-11-08T12:12:05.389 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-08T12:12:05.389 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-08T12:12:05.389 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/gameport.ko 2023-11-08T12:12:05.390 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/joydev.ko 2023-11-08T12:12:05.390 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/ 2023-11-08T12:12:05.390 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-08T12:12:05.390 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-08T12:12:05.390 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-08T12:12:05.391 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-08T12:12:05.391 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-08T12:12:05.391 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-08T12:12:05.391 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-08T12:12:05.391 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lm8323.ko 2023-11-08T12:12:05.392 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lm8333.ko 2023-11-08T12:12:05.393 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-08T12:12:05.393 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-08T12:12:05.394 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-08T12:12:05.394 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-08T12:12:05.394 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-08T12:12:05.394 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-08T12:12:05.394 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/qt1070.ko 2023-11-08T12:12:05.395 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/qt2160.ko 2023-11-08T12:12:05.395 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-08T12:12:05.395 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/stowaway.ko 2023-11-08T12:12:05.395 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-08T12:12:05.396 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-08T12:12:05.396 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-08T12:12:05.396 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-08T12:12:05.396 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-08T12:12:05.396 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/matrix-keymap.ko 2023-11-08T12:12:05.397 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/ 2023-11-08T12:12:05.397 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/appletouch.ko 2023-11-08T12:12:05.397 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/bcm5974.ko 2023-11-08T12:12:05.397 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/cyapatp.ko 2023-11-08T12:12:05.397 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-08T12:12:05.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-08T12:12:05.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 335977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/psmouse.ko 2023-11-08T12:12:05.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/sermouse.ko 2023-11-08T12:12:05.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-08T12:12:05.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-08T12:12:05.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-08T12:12:05.399 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/rmi4/ 2023-11-08T12:12:05.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-08T12:12:05.399 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ 2023-11-08T12:12:05.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/altera_ps2.ko 2023-11-08T12:12:05.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/arc_ps2.ko 2023-11-08T12:12:05.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ct82c710.ko 2023-11-08T12:12:05.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-08T12:12:05.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/parkbd.ko 2023-11-08T12:12:05.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/pcips2.ko 2023-11-08T12:12:05.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ps2mult.ko 2023-11-08T12:12:05.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/serio_raw.ko 2023-11-08T12:12:05.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/serport.ko 2023-11-08T12:12:05.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/sparse-keymap.ko 2023-11-08T12:12:05.401 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/ 2023-11-08T12:12:05.401 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/amd/ 2023-11-08T12:12:05.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-08T12:12:05.402 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/ 2023-11-08T12:12:05.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-88pm860x.ko 2023-11-08T12:12:05.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-adp5520.ko 2023-11-08T12:12:05.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-bd2802.ko 2023-11-08T12:12:05.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-blinkm.ko 2023-11-08T12:12:05.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-da903x.ko 2023-11-08T12:12:05.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-da9052.ko 2023-11-08T12:12:05.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-gpio.ko 2023-11-08T12:12:05.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3530.ko 2023-11-08T12:12:05.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3533.ko 2023-11-08T12:12:05.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm355x.ko 2023-11-08T12:12:05.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3642.ko 2023-11-08T12:12:05.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lp3944.ko 2023-11-08T12:12:05.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lp8788.ko 2023-11-08T12:12:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-max8997.ko 2023-11-08T12:12:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-mc13783.ko 2023-11-08T12:12:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-08T12:12:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca9532.ko 2023-11-08T12:12:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca955x.ko 2023-11-08T12:12:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca963x.ko 2023-11-08T12:12:05.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-ss4200.ko 2023-11-08T12:12:05.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-tca6507.ko 2023-11-08T12:12:05.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-08T12:12:05.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-wm8350.ko 2023-11-08T12:12:05.406 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ 2023-11-08T12:12:05.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-08T12:12:05.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-08T12:12:05.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-08T12:12:05.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-08T12:12:05.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-08T12:12:05.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-08T12:12:05.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-08T12:12:05.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-08T12:12:05.408 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/ 2023-11-08T12:12:05.408 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/bcache/ 2023-11-08T12:12:05.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 654969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/bcache/bcache.ko 2023-11-08T12:12:05.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-bio-prison.ko 2023-11-08T12:12:05.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-bufio.ko 2023-11-08T12:12:05.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-cache-smq.ko 2023-11-08T12:12:05.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 156009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-cache.ko 2023-11-08T12:12:05.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-crypt.ko 2023-11-08T12:12:05.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-delay.ko 2023-11-08T12:12:05.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-era.ko 2023-11-08T12:12:05.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-flakey.ko 2023-11-08T12:12:05.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-log-userspace.ko 2023-11-08T12:12:05.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-log.ko 2023-11-08T12:12:05.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-mirror.ko 2023-11-08T12:12:05.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-multipath.ko 2023-11-08T12:12:05.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-queue-length.ko 2023-11-08T12:12:05.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-raid.ko 2023-11-08T12:12:05.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-region-hash.ko 2023-11-08T12:12:05.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-round-robin.ko 2023-11-08T12:12:05.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-service-time.ko 2023-11-08T12:12:05.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-snapshot.ko 2023-11-08T12:12:05.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-switch.ko 2023-11-08T12:12:05.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 181865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-thin-pool.ko 2023-11-08T12:12:05.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-verity.ko 2023-11-08T12:12:05.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-zero.ko 2023-11-08T12:12:05.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/faulty.ko 2023-11-08T12:12:05.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/linear.ko 2023-11-08T12:12:05.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/multipath.ko 2023-11-08T12:12:05.414 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/persistent-data/ 2023-11-08T12:12:05.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 199937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-08T12:12:05.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid0.ko 2023-11-08T12:12:05.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid1.ko 2023-11-08T12:12:05.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 158681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid10.ko 2023-11-08T12:12:05.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 395721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid456.ko 2023-11-08T12:12:05.415 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/ 2023-11-08T12:12:05.415 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/ 2023-11-08T12:12:05.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 178137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptbase.ko 2023-11-08T12:12:05.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptctl.ko 2023-11-08T12:12:05.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptfc.ko 2023-11-08T12:12:05.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptlan.ko 2023-11-08T12:12:05.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptsas.ko 2023-11-08T12:12:05.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 79041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptscsih.ko 2023-11-08T12:12:05.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptspi.ko 2023-11-08T12:12:05.416 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/ 2023-11-08T12:12:05.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm800.ko 2023-11-08T12:12:05.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm805.ko 2023-11-08T12:12:05.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm80x.ko 2023-11-08T12:12:05.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/arizona-i2c.ko 2023-11-08T12:12:05.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/arizona.ko 2023-11-08T12:12:05.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/bcm590xx.ko 2023-11-08T12:12:05.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-08T12:12:05.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/dln2.ko 2023-11-08T12:12:05.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/janz-cmodio.ko 2023-11-08T12:12:05.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/kempld-core.ko 2023-11-08T12:12:05.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lm3533-core.ko 2023-11-08T12:12:05.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-08T12:12:05.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lp3943.ko 2023-11-08T12:12:05.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lpc_ich.ko 2023-11-08T12:12:05.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lpc_sch.ko 2023-11-08T12:12:05.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/max8907.ko 2023-11-08T12:12:05.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-08T12:12:05.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-08T12:12:05.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/menf21bmc.ko 2023-11-08T12:12:05.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-08T12:12:05.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-08T12:12:05.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633.ko 2023-11-08T12:12:05.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-08T12:12:05.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/retu-mfd.ko 2023-11-08T12:12:05.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/si476x-core.ko 2023-11-08T12:12:05.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/sm501.ko 2023-11-08T12:12:05.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-08T12:12:05.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/tps65010.ko 2023-11-08T12:12:05.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/tps6507x.ko 2023-11-08T12:12:05.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/viperboard.ko 2023-11-08T12:12:05.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/vx855.ko 2023-11-08T12:12:05.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/wl1273-core.ko 2023-11-08T12:12:05.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/wm8994.ko 2023-11-08T12:12:05.423 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ 2023-11-08T12:12:05.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-08T12:12:05.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ad525x_dpot.ko 2023-11-08T12:12:05.424 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/altera-stapl/ 2023-11-08T12:12:05.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-08T12:12:05.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/apds9802als.ko 2023-11-08T12:12:05.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/apds990x.ko 2023-11-08T12:12:05.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/bh1770glc.ko 2023-11-08T12:12:05.424 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/ 2023-11-08T12:12:05.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-08T12:12:05.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/core.ko 2023-11-08T12:12:05.425 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/cb710/ 2023-11-08T12:12:05.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/cb710/cb710.ko 2023-11-08T12:12:05.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ds1682.ko 2023-11-08T12:12:05.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/dummy-irq.ko 2023-11-08T12:12:05.426 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/echo/ 2023-11-08T12:12:05.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/echo/echo.ko 2023-11-08T12:12:05.426 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/ 2023-11-08T12:12:05.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/at24.ko 2023-11-08T12:12:05.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-08T12:12:05.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-08T12:12:05.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/max6875.ko 2023-11-08T12:12:05.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/enclosure.ko 2023-11-08T12:12:05.427 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/genwqe/ 2023-11-08T12:12:05.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 152201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-08T12:12:05.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/hmc6352.ko 2023-11-08T12:12:05.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/hpilo.ko 2023-11-08T12:12:05.428 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ibmasm/ 2023-11-08T12:12:05.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-08T12:12:05.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ics932s401.ko 2023-11-08T12:12:05.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/isl29003.ko 2023-11-08T12:12:05.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/isl29020.ko 2023-11-08T12:12:05.429 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/ 2023-11-08T12:12:05.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-08T12:12:05.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-08T12:12:05.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/ 2023-11-08T12:12:05.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei-me.ko 2023-11-08T12:12:05.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei-txe.ko 2023-11-08T12:12:05.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 310113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei.ko 2023-11-08T12:12:05.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/phantom.ko 2023-11-08T12:12:05.431 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ti-st/ 2023-11-08T12:12:05.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-08T12:12:05.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tifm_7xx1.ko 2023-11-08T12:12:05.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tifm_core.ko 2023-11-08T12:12:05.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tsl2550.ko 2023-11-08T12:12:05.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_balloon.ko 2023-11-08T12:12:05.432 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_vmci/ 2023-11-08T12:12:05.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 183609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-08T12:12:05.432 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ 2023-11-08T12:12:05.432 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/bonding/ 2023-11-08T12:12:05.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 490129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/bonding/bonding.ko 2023-11-08T12:12:05.433 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/ 2023-11-08T12:12:05.433 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/b53/ 2023-11-08T12:12:05.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-08T12:12:05.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-08T12:12:05.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-08T12:12:05.434 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-08T12:12:05.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 453737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-08T12:12:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dummy.ko 2023-11-08T12:12:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/eql.ko 2023-11-08T12:12:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ 2023-11-08T12:12:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/ 2023-11-08T12:12:05.528 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-08T12:12:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-08T12:12:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 130553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-08T12:12:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-08T12:12:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/ 2023-11-08T12:12:05.529 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-08T12:12:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-08T12:12:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-08T12:12:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-08T12:12:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/adaptec/ 2023-11-08T12:12:05.530 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-08T12:12:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/agere/ 2023-11-08T12:12:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-08T12:12:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/alteon/ 2023-11-08T12:12:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-08T12:12:05.531 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/altera/ 2023-11-08T12:12:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-08T12:12:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/ 2023-11-08T12:12:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-08T12:12:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-08T12:12:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-08T12:12:05.532 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/ 2023-11-08T12:12:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-08T12:12:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-08T12:12:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-08T12:12:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 104673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-08T12:12:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-08T12:12:05.533 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-08T12:12:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-08T12:12:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-08T12:12:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-08T12:12:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/ 2023-11-08T12:12:05.534 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-08T12:12:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 176761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-08T12:12:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-08T12:12:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1421497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-08T12:12:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 128569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-08T12:12:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-08T12:12:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 132089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-08T12:12:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 312081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-08T12:12:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/ 2023-11-08T12:12:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-08T12:12:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 323513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-08T12:12:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/ 2023-11-08T12:12:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-08T12:12:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 193497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-08T12:12:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-08T12:12:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 347417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-08T12:12:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-08T12:12:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1044433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-08T12:12:05.537 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-08T12:12:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-08T12:12:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-08T12:12:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-08T12:12:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/ 2023-11-08T12:12:05.538 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-08T12:12:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 204345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-08T12:12:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/ 2023-11-08T12:12:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-08T12:12:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-08T12:12:05.539 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-08T12:12:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 141225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-08T12:12:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-08T12:12:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-08T12:12:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-08T12:12:05.540 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/ 2023-11-08T12:12:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-08T12:12:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-08T12:12:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dnet.ko 2023-11-08T12:12:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-08T12:12:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/ 2023-11-08T12:12:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-08T12:12:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 281137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-08T12:12:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ethoc.ko 2023-11-08T12:12:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fealnx.ko 2023-11-08T12:12:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fujitsu/ 2023-11-08T12:12:05.542 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-08T12:12:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ 2023-11-08T12:12:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-08T12:12:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-08T12:12:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 295577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-08T12:12:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-08T12:12:05.543 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 584497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-08T12:12:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-08T12:12:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 246209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-08T12:12:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-08T12:12:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 925697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-08T12:12:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-08T12:12:05.544 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 302849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-08T12:12:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igb/ 2023-11-08T12:12:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 514681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-08T12:12:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-08T12:12:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-08T12:12:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-08T12:12:05.545 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 734305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-08T12:12:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-08T12:12:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 151769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-08T12:12:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 86921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/jme.ko 2023-11-08T12:12:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/ 2023-11-08T12:12:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-08T12:12:05.546 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-08T12:12:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-08T12:12:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/ 2023-11-08T12:12:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-08T12:12:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 727601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-08T12:12:05.547 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 278937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-08T12:12:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-08T12:12:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-08T12:12:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1113993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-08T12:12:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ 2023-11-08T12:12:05.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-08T12:12:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-08T12:12:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-08T12:12:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 95665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-08T12:12:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/ 2023-11-08T12:12:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-08T12:12:05.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-08T12:12:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/ 2023-11-08T12:12:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-08T12:12:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-08T12:12:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/neterion/ 2023-11-08T12:12:05.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 150905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-08T12:12:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/nvidia/ 2023-11-08T12:12:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 136721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-08T12:12:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/ 2023-11-08T12:12:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-08T12:12:05.551 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-08T12:12:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/ 2023-11-08T12:12:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-08T12:12:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 227897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-08T12:12:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-08T12:12:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-08T12:12:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 672049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-08T12:12:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/rdc/ 2023-11-08T12:12:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-08T12:12:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/ 2023-11-08T12:12:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-08T12:12:05.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-08T12:12:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-08T12:12:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 189801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-08T12:12:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/ 2023-11-08T12:12:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-08T12:12:05.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 104241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-08T12:12:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sfc/ 2023-11-08T12:12:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1053921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-08T12:12:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/silan/ 2023-11-08T12:12:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-08T12:12:05.555 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/ 2023-11-08T12:12:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-08T12:12:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-08T12:12:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/ 2023-11-08T12:12:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-08T12:12:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-08T12:12:05.556 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-08T12:12:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-08T12:12:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/ 2023-11-08T12:12:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-08T12:12:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-08T12:12:05.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-08T12:12:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-08T12:12:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 486961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-08T12:12:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/ 2023-11-08T12:12:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-08T12:12:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-08T12:12:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-08T12:12:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-08T12:12:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/tehuti/ 2023-11-08T12:12:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-08T12:12:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ti/ 2023-11-08T12:12:05.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 86529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-08T12:12:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/ 2023-11-08T12:12:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-08T12:12:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-08T12:12:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/ 2023-11-08T12:12:05.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-08T12:12:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-08T12:12:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/xircom/ 2023-11-08T12:12:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-08T12:12:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/ 2023-11-08T12:12:05.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/defxx.ko 2023-11-08T12:12:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/skfp/ 2023-11-08T12:12:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 216985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-08T12:12:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/geneve.ko 2023-11-08T12:12:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/hyperv/ 2023-11-08T12:12:05.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 235521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-08T12:12:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ieee802154/ 2023-11-08T12:12:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-08T12:12:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ifb.ko 2023-11-08T12:12:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ipvlan/ 2023-11-08T12:12:05.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-08T12:12:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/macvlan.ko 2023-11-08T12:12:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/macvtap.ko 2023-11-08T12:12:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/ 2023-11-08T12:12:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-08T12:12:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-08T12:12:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-08T12:12:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-08T12:12:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio.ko 2023-11-08T12:12:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mii.ko 2023-11-08T12:12:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/netconsole.ko 2023-11-08T12:12:05.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/nlmon.ko 2023-11-08T12:12:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/ 2023-11-08T12:12:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-08T12:12:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-08T12:12:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/ 2023-11-08T12:12:05.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/amd.ko 2023-11-08T12:12:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-08T12:12:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-08T12:12:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm87xx.ko 2023-11-08T12:12:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/broadcom.ko 2023-11-08T12:12:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/cicada.ko 2023-11-08T12:12:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/davicom.ko 2023-11-08T12:12:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/et1011c.ko 2023-11-08T12:12:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/icplus.ko 2023-11-08T12:12:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/lxt.ko 2023-11-08T12:12:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/marvell.ko 2023-11-08T12:12:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/micrel.ko 2023-11-08T12:12:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/national.ko 2023-11-08T12:12:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/phylink.ko 2023-11-08T12:12:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/qsemi.ko 2023-11-08T12:12:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/realtek.ko 2023-11-08T12:12:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/smsc.ko 2023-11-08T12:12:05.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/ste10Xp.ko 2023-11-08T12:12:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/vitesse.ko 2023-11-08T12:12:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/plip/ 2023-11-08T12:12:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/plip/plip.ko 2023-11-08T12:12:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ 2023-11-08T12:12:05.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-08T12:12:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_async.ko 2023-11-08T12:12:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-08T12:12:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-08T12:12:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-08T12:12:05.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pppoe.ko 2023-11-08T12:12:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pppox.ko 2023-11-08T12:12:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pptp.ko 2023-11-08T12:12:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/sb1000.ko 2023-11-08T12:12:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/slip/ 2023-11-08T12:12:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/slip/slip.ko 2023-11-08T12:12:05.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/sungem_phy.ko 2023-11-08T12:12:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/tap.ko 2023-11-08T12:12:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/ 2023-11-08T12:12:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team.ko 2023-11-08T12:12:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-08T12:12:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-08T12:12:05.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-08T12:12:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_random.ko 2023-11-08T12:12:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-08T12:12:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/veth.ko 2023-11-08T12:12:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vmxnet3/ 2023-11-08T12:12:05.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-08T12:12:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vxlan/ 2023-11-08T12:12:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 297329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vxlan/vxlan.ko 2023-11-08T12:12:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/xen-netback/ 2023-11-08T12:12:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-08T12:12:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ntb/ 2023-11-08T12:12:05.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ntb/ntb.ko 2023-11-08T12:12:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/ 2023-11-08T12:12:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/ 2023-11-08T12:12:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 264937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/nvme-core.ko 2023-11-08T12:12:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/nvme.ko 2023-11-08T12:12:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/ 2023-11-08T12:12:05.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 133841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport.ko 2023-11-08T12:12:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_cs.ko 2023-11-08T12:12:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_pc.ko 2023-11-08T12:12:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_serial.ko 2023-11-08T12:12:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/ 2023-11-08T12:12:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/ 2023-11-08T12:12:05.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-08T12:12:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-08T12:12:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-08T12:12:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/pci-stub.ko 2023-11-08T12:12:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/xen-pcifront.ko 2023-11-08T12:12:05.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/ 2023-11-08T12:12:05.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/i82092.ko 2023-11-08T12:12:05.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 145809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia.ko 2023-11-08T12:12:05.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-08T12:12:05.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-08T12:12:05.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pd6729.ko 2023-11-08T12:12:05.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-08T12:12:05.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/ 2023-11-08T12:12:05.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/broadcom/ 2023-11-08T12:12:05.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-08T12:12:05.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/samsung/ 2023-11-08T12:12:05.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-08T12:12:05.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/ 2023-11-08T12:12:05.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/intel/ 2023-11-08T12:12:05.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-08T12:12:05.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/ 2023-11-08T12:12:05.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/ 2023-11-08T12:12:05.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-08T12:12:05.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-08T12:12:05.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-08T12:12:05.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-08T12:12:05.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-08T12:12:05.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-08T12:12:05.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-08T12:12:05.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/ 2023-11-08T12:12:05.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-08T12:12:05.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/acerhdf.ko 2023-11-08T12:12:05.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-08T12:12:05.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-08T12:12:05.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-08T12:12:05.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 127569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-08T12:12:05.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-08T12:12:05.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-08T12:12:05.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-08T12:12:05.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-08T12:12:05.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-08T12:12:05.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/hdaps.ko 2023-11-08T12:12:05.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-08T12:12:05.585 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/ 2023-11-08T12:12:05.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-08T12:12:05.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-08T12:12:05.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel_ips.ko 2023-11-08T12:12:05.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-08T12:12:05.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-08T12:12:05.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-08T12:12:05.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-08T12:12:05.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-08T12:12:05.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-08T12:12:05.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-08T12:12:05.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-08T12:12:05.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-08T12:12:05.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/wmi.ko 2023-11-08T12:12:05.588 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/ 2023-11-08T12:12:05.588 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ 2023-11-08T12:12:05.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-08T12:12:05.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-08T12:12:05.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-08T12:12:05.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-08T12:12:05.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-08T12:12:05.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-08T12:12:05.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/da9030_battery.ko 2023-11-08T12:12:05.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/da9052-battery.ko 2023-11-08T12:12:05.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-08T12:12:05.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-08T12:12:05.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-08T12:12:05.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-08T12:12:05.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/gpio-charger.ko 2023-11-08T12:12:05.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-08T12:12:05.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-08T12:12:05.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max14577_charger.ko 2023-11-08T12:12:05.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max17040_battery.ko 2023-11-08T12:12:05.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max17042_battery.ko 2023-11-08T12:12:05.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max8903_charger.ko 2023-11-08T12:12:05.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max8925_power.ko 2023-11-08T12:12:05.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-08T12:12:05.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/sbs-battery.ko 2023-11-08T12:12:05.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/test_power.ko 2023-11-08T12:12:05.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-08T12:12:05.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-08T12:12:05.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm831x_power.ko 2023-11-08T12:12:05.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm8350_power.ko 2023-11-08T12:12:05.594 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/ 2023-11-08T12:12:05.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-08T12:12:05.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-08T12:12:05.594 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/ 2023-11-08T12:12:05.595 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/ 2023-11-08T12:12:05.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-08T12:12:05.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-08T12:12:05.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps_parport.ko 2023-11-08T12:12:05.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/pps_core.ko 2023-11-08T12:12:05.596 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ 2023-11-08T12:12:05.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ptp.ko 2023-11-08T12:12:05.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ptp_kvm.ko 2023-11-08T12:12:05.596 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/ 2023-11-08T12:12:05.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-08T12:12:05.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-08T12:12:05.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-08T12:12:05.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9052.ko 2023-11-08T12:12:05.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9055.ko 2023-11-08T12:12:05.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9063.ko 2023-11-08T12:12:05.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-08T12:12:05.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-08T12:12:05.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-08T12:12:05.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-08T12:12:05.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-08T12:12:05.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-08T12:12:05.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-08T12:12:05.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-08T12:12:05.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-08T12:12:05.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-em3027.ko 2023-11-08T12:12:05.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-08T12:12:05.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-08T12:12:05.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-08T12:12:05.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-08T12:12:05.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-08T12:12:05.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-08T12:12:05.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-08T12:12:05.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-08T12:12:05.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max6900.ko 2023-11-08T12:12:05.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8907.ko 2023-11-08T12:12:05.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8925.ko 2023-11-08T12:12:05.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8997.ko 2023-11-08T12:12:05.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8998.ko 2023-11-08T12:12:05.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-08T12:12:05.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-08T12:12:05.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-palmas.ko 2023-11-08T12:12:05.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-08T12:12:05.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-08T12:12:05.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-08T12:12:05.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-08T12:12:05.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-08T12:12:05.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-08T12:12:05.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-08T12:12:05.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-08T12:12:05.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-08T12:12:05.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-08T12:12:05.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-08T12:12:05.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-08T12:12:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-08T12:12:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-08T12:12:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-08T12:12:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-08T12:12:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-08T12:12:05.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-08T12:12:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-x1205.ko 2023-11-08T12:12:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ 2023-11-08T12:12:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-9xxx.ko 2023-11-08T12:12:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-sas.ko 2023-11-08T12:12:05.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-xxxx.ko 2023-11-08T12:12:05.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 135185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/BusLogic.ko 2023-11-08T12:12:05.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/a100u2w.ko 2023-11-08T12:12:05.607 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aacraid/ 2023-11-08T12:12:05.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 272305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-08T12:12:05.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/advansys.ko 2023-11-08T12:12:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/ 2023-11-08T12:12:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 356265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-08T12:12:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 295801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-08T12:12:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic94xx/ 2023-11-08T12:12:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 189185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-08T12:12:05.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/am53c974.ko 2023-11-08T12:12:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/arcmsr/ 2023-11-08T12:12:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-08T12:12:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/atp870u.ko 2023-11-08T12:12:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/be2iscsi/ 2023-11-08T12:12:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 246985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-08T12:12:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bfa/ 2023-11-08T12:12:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1171945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bfa/bfa.ko 2023-11-08T12:12:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2fc/ 2023-11-08T12:12:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 237273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-08T12:12:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2i/ 2023-11-08T12:12:05.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-08T12:12:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ch.ko 2023-11-08T12:12:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/csiostor/ 2023-11-08T12:12:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 308921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-08T12:12:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/ 2023-11-08T12:12:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-08T12:12:05.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-08T12:12:05.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-08T12:12:05.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-08T12:12:05.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 146689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-08T12:12:05.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/dc395x.ko 2023-11-08T12:12:05.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/dmx3191d.ko 2023-11-08T12:12:05.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esas2r/ 2023-11-08T12:12:05.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 212425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-08T12:12:05.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esp_scsi.ko 2023-11-08T12:12:05.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/ 2023-11-08T12:12:05.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-08T12:12:05.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 158505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-08T12:12:05.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fdomain.ko 2023-11-08T12:12:05.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fnic/ 2023-11-08T12:12:05.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fnic/fnic.ko 2023-11-08T12:12:05.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 201817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hpsa.ko 2023-11-08T12:12:05.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hptiop.ko 2023-11-08T12:12:05.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hv_storvsc.ko 2023-11-08T12:12:05.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/imm.ko 2023-11-08T12:12:05.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/initio.ko 2023-11-08T12:12:05.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 266537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ipr.ko 2023-11-08T12:12:05.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ips.ko 2023-11-08T12:12:05.615 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/isci/ 2023-11-08T12:12:05.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 317153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/isci/isci.ko 2023-11-08T12:12:05.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-08T12:12:05.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-08T12:12:05.616 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libfc/ 2023-11-08T12:12:05.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 314865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libfc/libfc.ko 2023-11-08T12:12:05.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 145585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libiscsi.ko 2023-11-08T12:12:05.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-08T12:12:05.617 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libsas/ 2023-11-08T12:12:05.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 216665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libsas/libsas.ko 2023-11-08T12:12:05.617 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/lpfc/ 2023-11-08T12:12:05.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2197249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-08T12:12:05.617 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/ 2023-11-08T12:12:05.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-08T12:12:05.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-08T12:12:05.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 310617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-08T12:12:05.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid.ko 2023-11-08T12:12:05.618 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mpt3sas/ 2023-11-08T12:12:05.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 659777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-08T12:12:05.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvsas/ 2023-11-08T12:12:05.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-08T12:12:05.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvumi.ko 2023-11-08T12:12:05.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/ 2023-11-08T12:12:05.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-08T12:12:05.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-08T12:12:05.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-08T12:12:05.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-08T12:12:05.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pm8001/ 2023-11-08T12:12:05.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 364105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-08T12:12:05.621 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pmcraid.ko 2023-11-08T12:12:05.621 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ppa.ko 2023-11-08T12:12:05.621 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla1280.ko 2023-11-08T12:12:05.621 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/ 2023-11-08T12:12:05.621 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1876625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-08T12:12:05.622 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-08T12:12:05.622 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla4xxx/ 2023-11-08T12:12:05.622 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 559033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-08T12:12:05.622 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qlogicfas408.ko 2023-11-08T12:12:05.622 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/raid_class.ko 2023-11-08T12:12:05.623 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 238825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_debug.ko 2023-11-08T12:12:05.623 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 173937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-08T12:12:05.623 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 279313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-08T12:12:05.623 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-08T12:12:05.623 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-08T12:12:05.623 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-08T12:12:05.624 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ses.ko 2023-11-08T12:12:05.624 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/st.ko 2023-11-08T12:12:05.624 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/stex.ko 2023-11-08T12:12:05.624 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-08T12:12:05.624 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 162121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-08T12:12:05.625 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/virtio_scsi.ko 2023-11-08T12:12:05.625 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-08T12:12:05.625 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/wd719x.ko 2023-11-08T12:12:05.625 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/xen-scsifront.ko 2023-11-08T12:12:05.625 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ssb/ 2023-11-08T12:12:05.625 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 129441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ssb/ssb.ko 2023-11-08T12:12:05.626 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/ 2023-11-08T12:12:05.626 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/iscsi/ 2023-11-08T12:12:05.626 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 736601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-08T12:12:05.626 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/loopback/ 2023-11-08T12:12:05.626 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-08T12:12:05.627 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_file.ko 2023-11-08T12:12:05.627 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_iblock.ko 2023-11-08T12:12:05.627 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 930321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_mod.ko 2023-11-08T12:12:05.627 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_pscsi.ko 2023-11-08T12:12:05.627 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_user.ko 2023-11-08T12:12:05.628 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/tcm_fc/ 2023-11-08T12:12:05.628 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-08T12:12:05.628 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/ 2023-11-08T12:12:05.628 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/ 2023-11-08T12:12:05.628 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-08T12:12:05.629 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-08T12:12:05.629 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-08T12:12:05.629 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-08T12:12:05.629 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-08T12:12:05.629 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-08T12:12:05.630 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-08T12:12:05.630 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-08T12:12:05.630 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-08T12:12:05.630 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-08T12:12:05.630 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-08T12:12:05.631 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-08T12:12:05.631 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-08T12:12:05.631 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-08T12:12:05.631 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-08T12:12:05.631 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-08T12:12:05.632 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-08T12:12:05.632 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ 2023-11-08T12:12:05.632 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ipwireless/ 2023-11-08T12:12:05.632 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-08T12:12:05.632 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/moxa.ko 2023-11-08T12:12:05.632 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/mxser.ko 2023-11-08T12:12:05.633 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/n_gsm.ko 2023-11-08T12:12:05.633 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/n_hdlc.ko 2023-11-08T12:12:05.633 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/nozomi.ko 2023-11-08T12:12:05.633 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/ 2023-11-08T12:12:05.633 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/ 2023-11-08T12:12:05.634 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-08T12:12:05.634 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-08T12:12:05.634 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-08T12:12:05.634 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/altera_uart.ko 2023-11-08T12:12:05.634 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/arc_uart.ko 2023-11-08T12:12:05.635 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-08T12:12:05.635 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/jsm/ 2023-11-08T12:12:05.635 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-08T12:12:05.635 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/rp2.ko 2023-11-08T12:12:05.635 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-08T12:12:05.635 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/ 2023-11-08T12:12:05.636 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/core/ 2023-11-08T12:12:05.636 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 531265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-08T12:12:05.636 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ 2023-11-08T12:12:05.636 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-08T12:12:05.636 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-08T12:12:05.637 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/ 2023-11-08T12:12:05.637 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio.ko 2023-11-08T12:12:05.637 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_aec.ko 2023-11-08T12:12:05.637 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_cif.ko 2023-11-08T12:12:05.637 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-08T12:12:05.638 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_mf624.ko 2023-11-08T12:12:05.638 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_netx.ko 2023-11-08T12:12:05.638 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_pci_generic.ko 2023-11-08T12:12:05.638 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-08T12:12:05.638 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_sercos3.ko 2023-11-08T12:12:05.639 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/ 2023-11-08T12:12:05.639 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/c67x00/ 2023-11-08T12:12:05.639 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-08T12:12:05.639 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ 2023-11-08T12:12:05.639 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-08T12:12:05.640 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-08T12:12:05.640 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-08T12:12:05.640 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-08T12:12:05.640 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/ 2023-11-08T12:12:05.640 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/cdc-acm.ko 2023-11-08T12:12:05.641 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-08T12:12:05.641 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/usblp.ko 2023-11-08T12:12:05.641 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/usbtmc.ko 2023-11-08T12:12:05.641 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/common/ 2023-11-08T12:12:05.641 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/common/ulpi.ko 2023-11-08T12:12:05.642 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc2/ 2023-11-08T12:12:05.642 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-08T12:12:05.642 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/ 2023-11-08T12:12:05.642 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-08T12:12:05.642 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-08T12:12:05.643 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 444553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-08T12:12:05.643 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/ 2023-11-08T12:12:05.643 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/ 2023-11-08T12:12:05.643 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-08T12:12:05.643 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-08T12:12:05.644 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-08T12:12:05.644 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-08T12:12:05.644 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-08T12:12:05.644 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-08T12:12:05.644 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 92489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-08T12:12:05.644 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-08T12:12:05.645 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-08T12:12:05.645 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-08T12:12:05.645 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-08T12:12:05.645 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-08T12:12:05.645 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-08T12:12:05.646 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-08T12:12:05.646 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-08T12:12:05.646 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-08T12:12:05.646 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-08T12:12:05.646 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/ 2023-11-08T12:12:05.646 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-08T12:12:05.647 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-08T12:12:05.647 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-08T12:12:05.647 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-08T12:12:05.647 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-08T12:12:05.647 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-08T12:12:05.648 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-08T12:12:05.648 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-08T12:12:05.648 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-08T12:12:05.648 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-08T12:12:05.648 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-08T12:12:05.649 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-08T12:12:05.649 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-08T12:12:05.649 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-08T12:12:05.649 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 161225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-08T12:12:05.649 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/ 2023-11-08T12:12:05.650 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-08T12:12:05.650 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-08T12:12:05.650 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 157681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-08T12:12:05.650 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-08T12:12:05.650 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-08T12:12:05.651 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-08T12:12:05.651 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-08T12:12:05.651 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-08T12:12:05.651 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-08T12:12:05.651 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-08T12:12:05.652 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 65809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-08T12:12:05.652 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-08T12:12:05.652 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-08T12:12:05.652 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 156073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-08T12:12:05.652 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/ 2023-11-08T12:12:05.652 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-08T12:12:05.653 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-08T12:12:05.653 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-08T12:12:05.653 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-08T12:12:05.653 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-08T12:12:05.653 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/sl811_cs.ko 2023-11-08T12:12:05.654 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-08T12:12:05.654 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-08T12:12:05.654 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/ 2023-11-08T12:12:05.654 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/mdc800.ko 2023-11-08T12:12:05.654 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/microtek.ko 2023-11-08T12:12:05.655 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ 2023-11-08T12:12:05.655 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/adutux.ko 2023-11-08T12:12:05.655 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/appledisplay.ko 2023-11-08T12:12:05.655 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-08T12:12:05.655 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/cytherm.ko 2023-11-08T12:12:05.656 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ehset.ko 2023-11-08T12:12:05.656 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/emi26.ko 2023-11-08T12:12:05.656 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/emi62.ko 2023-11-08T12:12:05.656 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ezusb.ko 2023-11-08T12:12:05.656 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/idmouse.ko 2023-11-08T12:12:05.657 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/iowarrior.ko 2023-11-08T12:12:05.657 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-08T12:12:05.657 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ldusb.ko 2023-11-08T12:12:05.657 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/legousbtower.ko 2023-11-08T12:12:05.657 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/lvstest.ko 2023-11-08T12:12:05.658 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/sisusbvga/ 2023-11-08T12:12:05.658 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-08T12:12:05.658 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-08T12:12:05.658 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usb3503.ko 2023-11-08T12:12:05.658 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usblcd.ko 2023-11-08T12:12:05.658 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-08T12:12:05.659 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usbtest.ko 2023-11-08T12:12:05.659 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/uss720.ko 2023-11-08T12:12:05.659 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/yurex.ko 2023-11-08T12:12:05.659 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/mon/ 2023-11-08T12:12:05.659 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/mon/usbmon.ko 2023-11-08T12:12:05.660 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/musb/ 2023-11-08T12:12:05.660 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 301545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-08T12:12:05.660 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/ 2023-11-08T12:12:05.660 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-generic.ko 2023-11-08T12:12:05.660 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-08T12:12:05.661 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-08T12:12:05.661 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-08T12:12:05.661 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ 2023-11-08T12:12:05.661 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/aircable.ko 2023-11-08T12:12:05.661 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ark3116.ko 2023-11-08T12:12:05.661 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-08T12:12:05.662 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ch341.ko 2023-11-08T12:12:05.662 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cp210x.ko 2023-11-08T12:12:05.662 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cyberjack.ko 2023-11-08T12:12:05.662 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-08T12:12:05.662 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-08T12:12:05.663 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/empeg.ko 2023-11-08T12:12:05.663 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/f81232.ko 2023-11-08T12:12:05.663 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 175137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-08T12:12:05.663 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-08T12:12:05.663 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 137081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-08T12:12:05.664 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/io_ti.ko 2023-11-08T12:12:05.664 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ipaq.ko 2023-11-08T12:12:05.664 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ipw.ko 2023-11-08T12:12:05.664 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ir-usb.ko 2023-11-08T12:12:05.664 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-08T12:12:05.665 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/keyspan.ko 2023-11-08T12:12:05.665 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-08T12:12:05.665 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-08T12:12:05.665 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-08T12:12:05.665 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mct_u232.ko 2023-11-08T12:12:05.666 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/metro-usb.ko 2023-11-08T12:12:05.666 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mos7720.ko 2023-11-08T12:12:05.666 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mos7840.ko 2023-11-08T12:12:05.666 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mxuport.ko 2023-11-08T12:12:05.666 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/navman.ko 2023-11-08T12:12:05.666 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/omninet.ko 2023-11-08T12:12:05.667 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/opticon.ko 2023-11-08T12:12:05.667 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 190633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/option.ko 2023-11-08T12:12:05.667 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/oti6858.ko 2023-11-08T12:12:05.667 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/pl2303.ko 2023-11-08T12:12:05.667 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/qcaux.ko 2023-11-08T12:12:05.668 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/qcserial.ko 2023-11-08T12:12:05.668 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/quatech2.ko 2023-11-08T12:12:05.668 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/safe_serial.ko 2023-11-08T12:12:05.668 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/sierra.ko 2023-11-08T12:12:05.668 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-08T12:12:05.669 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ssu100.ko 2023-11-08T12:12:05.669 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/symbolserial.ko 2023-11-08T12:12:05.669 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-08T12:12:05.669 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-08T12:12:05.669 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb_debug.ko 2023-11-08T12:12:05.669 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-08T12:12:05.670 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usbserial.ko 2023-11-08T12:12:05.670 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/visor.ko 2023-11-08T12:12:05.670 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/whiteheat.ko 2023-11-08T12:12:05.670 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-08T12:12:05.670 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-08T12:12:05.671 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ 2023-11-08T12:12:05.671 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/uas.ko 2023-11-08T12:12:05.671 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-08T12:12:05.671 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-08T12:12:05.671 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-08T12:12:05.672 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-08T12:12:05.672 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-08T12:12:05.672 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-08T12:12:05.672 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-08T12:12:05.672 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-karma.ko 2023-11-08T12:12:05.672 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-08T12:12:05.673 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-08T12:12:05.673 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-08T12:12:05.673 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-08T12:12:05.673 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-08T12:12:05.673 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 179969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/usb-storage.ko 2023-11-08T12:12:05.674 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/ 2023-11-08T12:12:05.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-08T12:12:05.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-08T12:12:05.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-08T12:12:05.674 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/ 2023-11-08T12:12:05.675 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/ 2023-11-08T12:12:05.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 154297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-08T12:12:05.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-08T12:12:05.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/vfio.ko 2023-11-08T12:12:05.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-08T12:12:05.676 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/ 2023-11-08T12:12:05.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost.ko 2023-11-08T12:12:05.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-08T12:12:05.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_net.ko 2023-11-08T12:12:05.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_scsi.ko 2023-11-08T12:12:05.676 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/ 2023-11-08T12:12:05.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/ 2023-11-08T12:12:05.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-08T12:12:05.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-08T12:12:05.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-08T12:12:05.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-08T12:12:05.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-08T12:12:05.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/apple_bl.ko 2023-11-08T12:12:05.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-08T12:12:05.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/bd6107.ko 2023-11-08T12:12:05.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-08T12:12:05.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-08T12:12:05.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-08T12:12:05.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-08T12:12:05.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lcd.ko 2023-11-08T12:12:05.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-08T12:12:05.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-08T12:12:05.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-08T12:12:05.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-08T12:12:05.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-08T12:12:05.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-08T12:12:05.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-08T12:12:05.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-08T12:12:05.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/ 2023-11-08T12:12:05.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ 2023-11-08T12:12:05.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ds2482.ko 2023-11-08T12:12:05.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ds2490.ko 2023-11-08T12:12:05.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-08T12:12:05.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-08T12:12:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/ 2023-11-08T12:12:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-08T12:12:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-08T12:12:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-08T12:12:05.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-08T12:12:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-08T12:12:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-08T12:12:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-08T12:12:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-08T12:12:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-08T12:12:05.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-08T12:12:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-08T12:12:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/wire.ko 2023-11-08T12:12:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ 2023-11-08T12:12:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/acquirewdt.ko 2023-11-08T12:12:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/advantechwdt.ko 2023-11-08T12:12:05.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-08T12:12:05.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-08T12:12:05.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-08T12:12:05.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-08T12:12:05.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-08T12:12:05.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-08T12:12:05.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/dw_wdt.ko 2023-11-08T12:12:05.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-08T12:12:05.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-08T12:12:05.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/hpwdt.ko 2023-11-08T12:12:05.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/i6300esb.ko 2023-11-08T12:12:05.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-08T12:12:05.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-08T12:12:05.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ib700wdt.ko 2023-11-08T12:12:05.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ibmasr.ko 2023-11-08T12:12:05.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-08T12:12:05.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-08T12:12:05.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/it87_wdt.ko 2023-11-08T12:12:05.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-08T12:12:05.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/machzwd.ko 2023-11-08T12:12:05.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-08T12:12:05.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-08T12:12:05.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/nv_tco.ko 2023-11-08T12:12:05.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-08T12:12:05.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-08T12:12:05.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-08T12:12:05.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-08T12:12:05.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/retu_wdt.ko 2023-11-08T12:12:05.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-08T12:12:05.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-08T12:12:05.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-08T12:12:05.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-08T12:12:05.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-08T12:12:05.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-08T12:12:05.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/softdog.ko 2023-11-08T12:12:05.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-08T12:12:05.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-08T12:12:05.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/via_wdt.ko 2023-11-08T12:12:05.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-08T12:12:05.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-08T12:12:05.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-08T12:12:05.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-08T12:12:05.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wdt_pci.ko 2023-11-08T12:12:05.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-08T12:12:05.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-08T12:12:05.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/xen_wdt.ko 2023-11-08T12:12:05.693 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/ 2023-11-08T12:12:05.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-evtchn.ko 2023-11-08T12:12:05.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-gntalloc.ko 2023-11-08T12:12:05.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-gntdev.ko 2023-11-08T12:12:05.694 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-pciback/ 2023-11-08T12:12:05.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 176441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-08T12:12:05.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-privcmd.ko 2023-11-08T12:12:05.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-scsiback.ko 2023-11-08T12:12:05.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xenfs/ 2023-11-08T12:12:05.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-08T12:12:05.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ 2023-11-08T12:12:05.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/9p/ 2023-11-08T12:12:05.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/9p/9p.ko 2023-11-08T12:12:05.696 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/adfs/ 2023-11-08T12:12:05.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/adfs/adfs.ko 2023-11-08T12:12:05.696 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/affs/ 2023-11-08T12:12:05.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 163593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/affs/affs.ko 2023-11-08T12:12:05.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/afs/ 2023-11-08T12:12:05.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 932817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/afs/kafs.ko 2023-11-08T12:12:05.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/autofs/ 2023-11-08T12:12:05.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/autofs/autofs4.ko 2023-11-08T12:12:05.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/befs/ 2023-11-08T12:12:05.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/befs/befs.ko 2023-11-08T12:12:05.698 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/bfs/ 2023-11-08T12:12:05.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/bfs/bfs.ko 2023-11-08T12:12:05.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/binfmt_misc.ko 2023-11-08T12:12:05.698 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/btrfs/ 2023-11-08T12:12:05.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 3402585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/btrfs/btrfs.ko 2023-11-08T12:12:05.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cachefiles/ 2023-11-08T12:12:05.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 306073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cachefiles/cachefiles.ko 2023-11-08T12:12:05.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ceph/ 2023-11-08T12:12:05.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1323945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ceph/ceph.ko 2023-11-08T12:12:05.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/coda/ 2023-11-08T12:12:05.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/coda/coda.ko 2023-11-08T12:12:05.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/configfs/ 2023-11-08T12:12:05.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/configfs/configfs.ko 2023-11-08T12:12:05.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cramfs/ 2023-11-08T12:12:05.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cramfs/cramfs.ko 2023-11-08T12:12:05.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/dlm/ 2023-11-08T12:12:05.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 642577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/dlm/dlm.ko 2023-11-08T12:12:05.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/efs/ 2023-11-08T12:12:05.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/efs/efs.ko 2023-11-08T12:12:05.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/f2fs/ 2023-11-08T12:12:05.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1505025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/f2fs/f2fs.ko 2023-11-08T12:12:05.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fat/ 2023-11-08T12:12:05.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fat/msdos.ko 2023-11-08T12:12:05.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/freevxfs/ 2023-11-08T12:12:05.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/freevxfs/freevxfs.ko 2023-11-08T12:12:05.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fscache/ 2023-11-08T12:12:05.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 226481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fscache/fscache.ko 2023-11-08T12:12:05.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fuse/ 2023-11-08T12:12:05.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fuse/cuse.ko 2023-11-08T12:12:05.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/gfs2/ 2023-11-08T12:12:05.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1231529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/gfs2/gfs2.ko 2023-11-08T12:12:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfs/ 2023-11-08T12:12:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 141209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfs/hfs.ko 2023-11-08T12:12:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfsplus/ 2023-11-08T12:12:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 222817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfsplus/hfsplus.ko 2023-11-08T12:12:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hpfs/ 2023-11-08T12:12:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 192329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hpfs/hpfs.ko 2023-11-08T12:12:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/isofs/ 2023-11-08T12:12:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/isofs/isofs.ko 2023-11-08T12:12:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/jfs/ 2023-11-08T12:12:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 419497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/jfs/jfs.ko 2023-11-08T12:12:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/lockd/ 2023-11-08T12:12:05.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 280313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/lockd/lockd.ko 2023-11-08T12:12:05.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/minix/ 2023-11-08T12:12:05.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/minix/minix.ko 2023-11-08T12:12:05.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/netfs/ 2023-11-08T12:12:05.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/netfs/netfs.ko 2023-11-08T12:12:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/ 2023-11-08T12:12:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/blocklayout/ 2023-11-08T12:12:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-08T12:12:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/filelayout/ 2023-11-08T12:12:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-08T12:12:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/flexfilelayout/ 2023-11-08T12:12:05.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 117513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-08T12:12:05.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1055649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfs.ko 2023-11-08T12:12:05.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv2.ko 2023-11-08T12:12:05.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 120177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv3.ko 2023-11-08T12:12:05.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2041689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv4.ko 2023-11-08T12:12:05.709 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/ 2023-11-08T12:12:05.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/grace.ko 2023-11-08T12:12:05.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/nfs_acl.ko 2023-11-08T12:12:05.709 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfsd/ 2023-11-08T12:12:05.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1516809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfsd/nfsd.ko 2023-11-08T12:12:05.709 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nilfs2/ 2023-11-08T12:12:05.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 592833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nilfs2/nilfs2.ko 2023-11-08T12:12:05.710 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/ 2023-11-08T12:12:05.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-celtic.ko 2023-11-08T12:12:05.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-centeuro.ko 2023-11-08T12:12:05.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-croatian.ko 2023-11-08T12:12:05.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-cyrillic.ko 2023-11-08T12:12:05.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-gaelic.ko 2023-11-08T12:12:05.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-greek.ko 2023-11-08T12:12:05.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-iceland.ko 2023-11-08T12:12:05.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-inuit.ko 2023-11-08T12:12:05.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-roman.ko 2023-11-08T12:12:05.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-romanian.ko 2023-11-08T12:12:05.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-turkish.ko 2023-11-08T12:12:05.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_ascii.ko 2023-11-08T12:12:05.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1250.ko 2023-11-08T12:12:05.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1251.ko 2023-11-08T12:12:05.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1255.ko 2023-11-08T12:12:05.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp737.ko 2023-11-08T12:12:05.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp775.ko 2023-11-08T12:12:05.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp850.ko 2023-11-08T12:12:05.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp852.ko 2023-11-08T12:12:05.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp855.ko 2023-11-08T12:12:05.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp857.ko 2023-11-08T12:12:05.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp860.ko 2023-11-08T12:12:05.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp861.ko 2023-11-08T12:12:05.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp862.ko 2023-11-08T12:12:05.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp863.ko 2023-11-08T12:12:05.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp864.ko 2023-11-08T12:12:05.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp865.ko 2023-11-08T12:12:05.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp866.ko 2023-11-08T12:12:05.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp869.ko 2023-11-08T12:12:05.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp874.ko 2023-11-08T12:12:05.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp932.ko 2023-11-08T12:12:05.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 142673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp936.ko 2023-11-08T12:12:05.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 165745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp949.ko 2023-11-08T12:12:05.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 118121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp950.ko 2023-11-08T12:12:05.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_euc-jp.ko 2023-11-08T12:12:05.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-1.ko 2023-11-08T12:12:05.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-13.ko 2023-11-08T12:12:05.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-14.ko 2023-11-08T12:12:05.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-15.ko 2023-11-08T12:12:05.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-2.ko 2023-11-08T12:12:05.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-3.ko 2023-11-08T12:12:05.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-4.ko 2023-11-08T12:12:05.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-5.ko 2023-11-08T12:12:05.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-6.ko 2023-11-08T12:12:05.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-7.ko 2023-11-08T12:12:05.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-9.ko 2023-11-08T12:12:05.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-r.ko 2023-11-08T12:12:05.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-ru.ko 2023-11-08T12:12:05.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-u.ko 2023-11-08T12:12:05.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-08T12:12:05.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_utf8.ko 2023-11-08T12:12:05.719 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ntfs/ 2023-11-08T12:12:05.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 219417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ntfs/ntfs.ko 2023-11-08T12:12:05.720 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ 2023-11-08T12:12:05.720 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/cluster/ 2023-11-08T12:12:05.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 244409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-08T12:12:05.720 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlm/ 2023-11-08T12:12:05.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 440737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-08T12:12:05.721 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlmfs/ 2023-11-08T12:12:05.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-08T12:12:05.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2592433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2.ko 2023-11-08T12:12:05.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-08T12:12:05.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-08T12:12:05.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-08T12:12:05.722 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/omfs/ 2023-11-08T12:12:05.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/omfs/omfs.ko 2023-11-08T12:12:05.722 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/overlayfs/ 2023-11-08T12:12:05.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 352153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/overlayfs/overlay.ko 2023-11-08T12:12:05.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/pstore/ 2023-11-08T12:12:05.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/pstore/ramoops.ko 2023-11-08T12:12:05.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx4/ 2023-11-08T12:12:05.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx4/qnx4.ko 2023-11-08T12:12:05.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx6/ 2023-11-08T12:12:05.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx6/qnx6.ko 2023-11-08T12:12:05.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/ 2023-11-08T12:12:05.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_tree.ko 2023-11-08T12:12:05.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_v1.ko 2023-11-08T12:12:05.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_v2.ko 2023-11-08T12:12:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/reiserfs/ 2023-11-08T12:12:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 532673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/reiserfs/reiserfs.ko 2023-11-08T12:12:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/romfs/ 2023-11-08T12:12:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/romfs/romfs.ko 2023-11-08T12:12:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/ 2023-11-08T12:12:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/client/ 2023-11-08T12:12:05.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2668121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/client/cifs.ko 2023-11-08T12:12:05.726 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/ 2023-11-08T12:12:05.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/cifs_arc4.ko 2023-11-08T12:12:05.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/cifs_md4.ko 2023-11-08T12:12:05.726 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/squashfs/ 2023-11-08T12:12:05.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 134641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/squashfs/squashfs.ko 2023-11-08T12:12:05.727 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/sysv/ 2023-11-08T12:12:05.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/sysv/sysv.ko 2023-11-08T12:12:05.727 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/udf/ 2023-11-08T12:12:05.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 247737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/udf/udf.ko 2023-11-08T12:12:05.728 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ufs/ 2023-11-08T12:12:05.728 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 162497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ufs/ufs.ko 2023-11-08T12:12:05.728 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/xfs/ 2023-11-08T12:12:05.728 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4010729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/xfs/xfs.ko 2023-11-08T12:12:05.728 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/ 2023-11-08T12:12:05.728 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/locking/ 2023-11-08T12:12:05.729 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/locking/locktorture.ko 2023-11-08T12:12:05.729 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/time/ 2023-11-08T12:12:05.729 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/time/test_udelay.ko 2023-11-08T12:12:05.729 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/torture.ko 2023-11-08T12:12:05.729 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ 2023-11-08T12:12:05.730 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc-itu-t.ko 2023-11-08T12:12:05.730 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc7.ko 2023-11-08T12:12:05.730 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc8.ko 2023-11-08T12:12:05.730 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/ 2023-11-08T12:12:05.730 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/libarc4.ko 2023-11-08T12:12:05.731 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/libdes.ko 2023-11-08T12:12:05.731 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/interval_tree_test.ko 2023-11-08T12:12:05.731 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/libcrc32c.ko 2023-11-08T12:12:05.731 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lru_cache.ko 2023-11-08T12:12:05.731 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/ 2023-11-08T12:12:05.731 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/lz4_compress.ko 2023-11-08T12:12:05.732 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/lz4hc_compress.ko 2023-11-08T12:12:05.732 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/math/ 2023-11-08T12:12:05.732 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/math/cordic.ko 2023-11-08T12:12:05.732 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/memory-notifier-error-inject.ko 2023-11-08T12:12:05.732 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/notifier-error-inject.ko 2023-11-08T12:12:05.733 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/percpu_test.ko 2023-11-08T12:12:05.733 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/pm-notifier-error-inject.ko 2023-11-08T12:12:05.733 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/raid6/ 2023-11-08T12:12:05.733 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 143433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/raid6/raid6_pq.ko 2023-11-08T12:12:05.733 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/rbtree_test.ko 2023-11-08T12:12:05.734 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/reed_solomon/ 2023-11-08T12:12:05.734 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-08T12:12:05.734 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test-kstrtox.ko 2023-11-08T12:12:05.734 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test-string_helpers.ko 2023-11-08T12:12:05.734 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4760425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_bpf.ko 2023-11-08T12:12:05.735 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_firmware.ko 2023-11-08T12:12:05.735 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_module.ko 2023-11-08T12:12:05.735 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_user_copy.ko 2023-11-08T12:12:05.735 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_bm.ko 2023-11-08T12:12:05.735 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_fsm.ko 2023-11-08T12:12:05.735 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_kmp.ko 2023-11-08T12:12:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/xz/ 2023-11-08T12:12:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/xz/xz_dec_test.ko 2023-11-08T12:12:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/mm/ 2023-11-08T12:12:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/mm/hwpoison-inject.ko 2023-11-08T12:12:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ 2023-11-08T12:12:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/ 2023-11-08T12:12:05.737 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/6lowpan.ko 2023-11-08T12:12:05.737 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_dest.ko 2023-11-08T12:12:05.737 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_fragment.ko 2023-11-08T12:12:05.737 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_hop.ko 2023-11-08T12:12:05.737 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-08T12:12:05.738 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_mobility.ko 2023-11-08T12:12:05.738 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_routing.ko 2023-11-08T12:12:05.738 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_udp.ko 2023-11-08T12:12:05.738 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/ 2023-11-08T12:12:05.738 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/garp.ko 2023-11-08T12:12:05.739 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/mrp.ko 2023-11-08T12:12:05.739 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/p8022.ko 2023-11-08T12:12:05.739 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/psnap.ko 2023-11-08T12:12:05.739 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/stp.ko 2023-11-08T12:12:05.739 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/8021q/ 2023-11-08T12:12:05.739 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/8021q/8021q.ko 2023-11-08T12:12:05.740 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/ 2023-11-08T12:12:05.740 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 198337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet.ko 2023-11-08T12:12:05.740 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_fd.ko 2023-11-08T12:12:05.740 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_rdma.ko 2023-11-08T12:12:05.740 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_virtio.ko 2023-11-08T12:12:05.740 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/batman-adv/ 2023-11-08T12:12:05.741 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 649297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/batman-adv/batman-adv.ko 2023-11-08T12:12:05.741 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/ 2023-11-08T12:12:05.741 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/br_netfilter.ko 2023-11-08T12:12:05.741 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 777689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/bridge.ko 2023-11-08T12:12:05.741 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ 2023-11-08T12:12:05.741 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-08T12:12:05.742 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-08T12:12:05.742 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-08T12:12:05.742 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-08T12:12:05.742 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-08T12:12:05.742 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-08T12:12:05.743 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-08T12:12:05.743 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-08T12:12:05.743 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-08T12:12:05.743 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-08T12:12:05.743 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-08T12:12:05.743 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-08T12:12:05.744 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-08T12:12:05.744 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-08T12:12:05.744 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-08T12:12:05.744 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-08T12:12:05.744 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-08T12:12:05.744 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-08T12:12:05.745 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-08T12:12:05.745 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-08T12:12:05.745 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtables.ko 2023-11-08T12:12:05.745 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-08T12:12:05.745 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-08T12:12:05.746 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ceph/ 2023-11-08T12:12:05.746 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1046857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ceph/libceph.ko 2023-11-08T12:12:05.746 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/core/ 2023-11-08T12:12:05.746 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/core/pktgen.ko 2023-11-08T12:12:05.746 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/ 2023-11-08T12:12:05.747 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 194209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp.ko 2023-11-08T12:12:05.747 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_diag.ko 2023-11-08T12:12:05.747 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_ipv4.ko 2023-11-08T12:12:05.747 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_ipv6.ko 2023-11-08T12:12:05.747 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/ 2023-11-08T12:12:05.747 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 390473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/dsa_core.ko 2023-11-08T12:12:05.748 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_brcm.ko 2023-11-08T12:12:05.748 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_dsa.ko 2023-11-08T12:12:05.748 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_none.ko 2023-11-08T12:12:05.748 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_trailer.ko 2023-11-08T12:12:05.748 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/hsr/ 2023-11-08T12:12:05.748 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/hsr/hsr.ko 2023-11-08T12:12:05.749 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ 2023-11-08T12:12:05.749 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/6lowpan/ 2023-11-08T12:12:05.749 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-08T12:12:05.749 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 254625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ieee802154.ko 2023-11-08T12:12:05.749 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-08T12:12:05.750 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ 2023-11-08T12:12:05.750 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ah4.ko 2023-11-08T12:12:05.750 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/esp4.ko 2023-11-08T12:12:05.750 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/fou.ko 2023-11-08T12:12:05.750 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/gre.ko 2023-11-08T12:12:05.751 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/inet_diag.ko 2023-11-08T12:12:05.751 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_gre.ko 2023-11-08T12:12:05.751 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_tunnel.ko 2023-11-08T12:12:05.751 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_vti.ko 2023-11-08T12:12:05.751 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ipcomp.ko 2023-11-08T12:12:05.752 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ipip.ko 2023-11-08T12:12:05.752 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ 2023-11-08T12:12:05.752 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-08T12:12:05.752 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-08T12:12:05.752 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-08T12:12:05.753 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-08T12:12:05.753 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-08T12:12:05.753 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-08T12:12:05.753 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-08T12:12:05.753 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-08T12:12:05.753 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-08T12:12:05.754 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-08T12:12:05.754 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-08T12:12:05.754 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-08T12:12:05.754 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-08T12:12:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-08T12:12:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-08T12:12:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-08T12:12:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-08T12:12:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-08T12:12:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-08T12:12:05.756 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-08T12:12:05.756 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-08T12:12:05.756 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-08T12:12:05.756 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-08T12:12:05.756 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-08T12:12:05.757 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-08T12:12:05.757 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_bic.ko 2023-11-08T12:12:05.757 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_dctcp.ko 2023-11-08T12:12:05.757 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_diag.ko 2023-11-08T12:12:05.757 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_highspeed.ko 2023-11-08T12:12:05.758 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_htcp.ko 2023-11-08T12:12:05.758 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_hybla.ko 2023-11-08T12:12:05.758 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_illinois.ko 2023-11-08T12:12:05.758 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_lp.ko 2023-11-08T12:12:05.758 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_scalable.ko 2023-11-08T12:12:05.759 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_vegas.ko 2023-11-08T12:12:05.759 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_veno.ko 2023-11-08T12:12:05.759 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_westwood.ko 2023-11-08T12:12:05.759 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_yeah.ko 2023-11-08T12:12:05.759 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tunnel4.ko 2023-11-08T12:12:05.759 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/udp_diag.ko 2023-11-08T12:12:05.760 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/udp_tunnel.ko 2023-11-08T12:12:05.760 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-08T12:12:05.760 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ 2023-11-08T12:12:05.760 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ah6.ko 2023-11-08T12:12:05.760 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/esp6.ko 2023-11-08T12:12:05.761 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/fou6.ko 2023-11-08T12:12:05.761 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_gre.ko 2023-11-08T12:12:05.761 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_tunnel.ko 2023-11-08T12:12:05.761 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-08T12:12:05.761 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_vti.ko 2023-11-08T12:12:05.762 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ipcomp6.ko 2023-11-08T12:12:05.762 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/mip6.ko 2023-11-08T12:12:05.762 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ 2023-11-08T12:12:05.762 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-08T12:12:05.762 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-08T12:12:05.762 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-08T12:12:05.763 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-08T12:12:05.763 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-08T12:12:05.763 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-08T12:12:05.763 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-08T12:12:05.763 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-08T12:12:05.764 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-08T12:12:05.764 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-08T12:12:05.764 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-08T12:12:05.764 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-08T12:12:05.764 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-08T12:12:05.765 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-08T12:12:05.765 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-08T12:12:05.765 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-08T12:12:05.765 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-08T12:12:05.765 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-08T12:12:05.765 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-08T12:12:05.766 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-08T12:12:05.766 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-08T12:12:05.766 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-08T12:12:05.766 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-08T12:12:05.766 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-08T12:12:05.767 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-08T12:12:05.767 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/sit.ko 2023-11-08T12:12:05.767 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/tunnel6.ko 2023-11-08T12:12:05.767 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-08T12:12:05.767 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/key/ 2023-11-08T12:12:05.768 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/key/af_key.ko 2023-11-08T12:12:05.768 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/ 2023-11-08T12:12:05.768 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_core.ko 2023-11-08T12:12:05.768 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-08T12:12:05.768 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_eth.ko 2023-11-08T12:12:05.769 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ip.ko 2023-11-08T12:12:05.769 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ip6.ko 2023-11-08T12:12:05.769 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_netlink.ko 2023-11-08T12:12:05.769 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ppp.ko 2023-11-08T12:12:05.769 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/lapb/ 2023-11-08T12:12:05.769 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/lapb/lapb.ko 2023-11-08T12:12:05.770 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/ 2023-11-08T12:12:05.770 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/llc.ko 2023-11-08T12:12:05.770 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 267777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/llc2.ko 2023-11-08T12:12:05.770 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mac802154/ 2023-11-08T12:12:05.770 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 290417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mac802154/mac802154.ko 2023-11-08T12:12:05.771 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mpls/ 2023-11-08T12:12:05.771 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mpls/mpls_gso.ko 2023-11-08T12:12:05.771 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ 2023-11-08T12:12:05.771 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ 2023-11-08T12:12:05.771 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set.ko 2023-11-08T12:12:05.772 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-08T12:12:05.772 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-08T12:12:05.772 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-08T12:12:05.772 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-08T12:12:05.772 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-08T12:12:05.772 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-08T12:12:05.773 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-08T12:12:05.773 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-08T12:12:05.773 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-08T12:12:05.773 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-08T12:12:05.773 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-08T12:12:05.773 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-08T12:12:05.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 111585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-08T12:12:05.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 114465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-08T12:12:05.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-08T12:12:05.774 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ 2023-11-08T12:12:05.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 411729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-08T12:12:05.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-08T12:12:05.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-08T12:12:05.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-08T12:12:05.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-08T12:12:05.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-08T12:12:05.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-08T12:12:05.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-08T12:12:05.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-08T12:12:05.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-08T12:12:05.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-08T12:12:05.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-08T12:12:05.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-08T12:12:05.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-08T12:12:05.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conncount.ko 2023-11-08T12:12:05.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 408257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack.ko 2023-11-08T12:12:05.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-08T12:12:05.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-08T12:12:05.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-08T12:12:05.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 118145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-08T12:12:05.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-08T12:12:05.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-08T12:12:05.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-08T12:12:05.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-08T12:12:05.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-08T12:12:05.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-08T12:12:05.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-08T12:12:05.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-08T12:12:05.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-08T12:12:05.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_flow_table.ko 2023-11-08T12:12:05.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-08T12:12:05.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_log_syslog.ko 2023-11-08T12:12:05.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 95417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat.ko 2023-11-08T12:12:05.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-08T12:12:05.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-08T12:12:05.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_irc.ko 2023-11-08T12:12:05.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_sip.ko 2023-11-08T12:12:05.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-08T12:12:05.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-08T12:12:05.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 615313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_tables.ko 2023-11-08T12:12:05.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink.ko 2023-11-08T12:12:05.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-08T12:12:05.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-08T12:12:05.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_log.ko 2023-11-08T12:12:05.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-08T12:12:05.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-08T12:12:05.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_chain_nat.ko 2023-11-08T12:12:05.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_compat.ko 2023-11-08T12:12:05.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_ct.ko 2023-11-08T12:12:05.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-08T12:12:05.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_fib.ko 2023-11-08T12:12:05.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-08T12:12:05.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_hash.ko 2023-11-08T12:12:05.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_limit.ko 2023-11-08T12:12:05.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_log.ko 2023-11-08T12:12:05.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_masq.ko 2023-11-08T12:12:05.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_nat.ko 2023-11-08T12:12:05.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_numgen.ko 2023-11-08T12:12:05.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_osf.ko 2023-11-08T12:12:05.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_queue.ko 2023-11-08T12:12:05.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_redir.ko 2023-11-08T12:12:05.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_reject.ko 2023-11-08T12:12:05.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_reject_inet.ko 2023-11-08T12:12:05.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_socket.ko 2023-11-08T12:12:05.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_synproxy.ko 2023-11-08T12:12:05.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_tproxy.ko 2023-11-08T12:12:05.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/x_tables.ko 2023-11-08T12:12:05.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_AUDIT.ko 2023-11-08T12:12:05.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-08T12:12:05.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-08T12:12:05.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-08T12:12:05.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CT.ko 2023-11-08T12:12:05.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_DSCP.ko 2023-11-08T12:12:05.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_HL.ko 2023-11-08T12:12:05.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_HMARK.ko 2023-11-08T12:12:05.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-08T12:12:05.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_LED.ko 2023-11-08T12:12:05.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_LOG.ko 2023-11-08T12:12:05.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-08T12:12:05.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NETMAP.ko 2023-11-08T12:12:05.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NFLOG.ko 2023-11-08T12:12:05.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-08T12:12:05.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_RATEEST.ko 2023-11-08T12:12:05.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-08T12:12:05.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_SECMARK.ko 2023-11-08T12:12:05.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-08T12:12:05.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-08T12:12:05.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TEE.ko 2023-11-08T12:12:05.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TPROXY.ko 2023-11-08T12:12:05.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TRACE.ko 2023-11-08T12:12:05.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_addrtype.ko 2023-11-08T12:12:05.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_bpf.ko 2023-11-08T12:12:05.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cgroup.ko 2023-11-08T12:12:05.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cluster.ko 2023-11-08T12:12:05.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_comment.ko 2023-11-08T12:12:05.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connbytes.ko 2023-11-08T12:12:05.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connlabel.ko 2023-11-08T12:12:05.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connlimit.ko 2023-11-08T12:12:05.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connmark.ko 2023-11-08T12:12:05.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_conntrack.ko 2023-11-08T12:12:05.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cpu.ko 2023-11-08T12:12:05.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_dccp.ko 2023-11-08T12:12:05.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_devgroup.ko 2023-11-08T12:12:05.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_dscp.ko 2023-11-08T12:12:05.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ecn.ko 2023-11-08T12:12:05.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_esp.ko 2023-11-08T12:12:05.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_hashlimit.ko 2023-11-08T12:12:05.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_helper.ko 2023-11-08T12:12:05.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_hl.ko 2023-11-08T12:12:05.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ipcomp.ko 2023-11-08T12:12:05.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_iprange.ko 2023-11-08T12:12:05.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ipvs.ko 2023-11-08T12:12:05.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_l2tp.ko 2023-11-08T12:12:05.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_length.ko 2023-11-08T12:12:05.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_limit.ko 2023-11-08T12:12:05.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_mac.ko 2023-11-08T12:12:05.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_mark.ko 2023-11-08T12:12:05.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_multiport.ko 2023-11-08T12:12:05.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_nat.ko 2023-11-08T12:12:05.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_nfacct.ko 2023-11-08T12:12:05.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_osf.ko 2023-11-08T12:12:05.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_owner.ko 2023-11-08T12:12:05.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_physdev.ko 2023-11-08T12:12:05.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_pkttype.ko 2023-11-08T12:12:05.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_policy.ko 2023-11-08T12:12:05.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_quota.ko 2023-11-08T12:12:05.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_rateest.ko 2023-11-08T12:12:05.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_realm.ko 2023-11-08T12:12:05.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_recent.ko 2023-11-08T12:12:05.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_sctp.ko 2023-11-08T12:12:05.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_set.ko 2023-11-08T12:12:05.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_socket.ko 2023-11-08T12:12:05.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_state.ko 2023-11-08T12:12:05.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_statistic.ko 2023-11-08T12:12:05.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_string.ko 2023-11-08T12:12:05.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_tcpmss.ko 2023-11-08T12:12:05.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_tcpudp.ko 2023-11-08T12:12:05.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_time.ko 2023-11-08T12:12:05.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_u32.ko 2023-11-08T12:12:05.800 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netlink/ 2023-11-08T12:12:05.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netlink/netlink_diag.ko 2023-11-08T12:12:05.800 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/nsh/ 2023-11-08T12:12:05.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/nsh/nsh.ko 2023-11-08T12:12:05.801 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/ 2023-11-08T12:12:05.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 380033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/openvswitch.ko 2023-11-08T12:12:05.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-geneve.ko 2023-11-08T12:12:05.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-gre.ko 2023-11-08T12:12:05.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-vxlan.ko 2023-11-08T12:12:05.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/packet/ 2023-11-08T12:12:05.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/packet/af_packet_diag.ko 2023-11-08T12:12:05.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/ 2023-11-08T12:12:05.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 110201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/phonet.ko 2023-11-08T12:12:05.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/pn_pep.ko 2023-11-08T12:12:05.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/ 2023-11-08T12:12:05.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 251481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds.ko 2023-11-08T12:12:05.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 164937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds_rdma.ko 2023-11-08T12:12:05.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds_tcp.ko 2023-11-08T12:12:05.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rxrpc/ 2023-11-08T12:12:05.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 819657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rxrpc/rxrpc.ko 2023-11-08T12:12:05.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/ 2023-11-08T12:12:05.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_csum.ko 2023-11-08T12:12:05.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_gact.ko 2023-11-08T12:12:05.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_ipt.ko 2023-11-08T12:12:05.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_mirred.ko 2023-11-08T12:12:05.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_nat.ko 2023-11-08T12:12:05.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_pedit.ko 2023-11-08T12:12:05.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_police.ko 2023-11-08T12:12:05.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_simple.ko 2023-11-08T12:12:05.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_skbedit.ko 2023-11-08T12:12:05.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_vlan.ko 2023-11-08T12:12:05.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_basic.ko 2023-11-08T12:12:05.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_bpf.ko 2023-11-08T12:12:05.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_cgroup.ko 2023-11-08T12:12:05.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_flow.ko 2023-11-08T12:12:05.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_fw.ko 2023-11-08T12:12:05.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_route.ko 2023-11-08T12:12:05.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_u32.ko 2023-11-08T12:12:05.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_cmp.ko 2023-11-08T12:12:05.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_ipset.ko 2023-11-08T12:12:05.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_meta.ko 2023-11-08T12:12:05.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_nbyte.ko 2023-11-08T12:12:05.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_text.ko 2023-11-08T12:12:05.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_u32.ko 2023-11-08T12:12:05.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_choke.ko 2023-11-08T12:12:05.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_codel.ko 2023-11-08T12:12:05.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_drr.ko 2023-11-08T12:12:05.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_fq.ko 2023-11-08T12:12:05.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_fq_codel.ko 2023-11-08T12:12:05.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_gred.ko 2023-11-08T12:12:05.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_hfsc.ko 2023-11-08T12:12:05.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_hhf.ko 2023-11-08T12:12:05.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_htb.ko 2023-11-08T12:12:05.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_ingress.ko 2023-11-08T12:12:05.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_mqprio.ko 2023-11-08T12:12:05.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_mqprio_lib.ko 2023-11-08T12:12:05.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_multiq.ko 2023-11-08T12:12:05.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_netem.ko 2023-11-08T12:12:05.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_pie.ko 2023-11-08T12:12:05.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_plug.ko 2023-11-08T12:12:05.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_prio.ko 2023-11-08T12:12:05.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_qfq.ko 2023-11-08T12:12:05.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_red.ko 2023-11-08T12:12:05.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_sfb.ko 2023-11-08T12:12:05.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_sfq.ko 2023-11-08T12:12:05.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_tbf.ko 2023-11-08T12:12:05.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_teql.ko 2023-11-08T12:12:05.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/ 2023-11-08T12:12:05.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 929745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/sctp.ko 2023-11-08T12:12:05.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/sctp_diag.ko 2023-11-08T12:12:05.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/ 2023-11-08T12:12:05.814 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/ 2023-11-08T12:12:05.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 336529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-08T12:12:05.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-08T12:12:05.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1520161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/sunrpc.ko 2023-11-08T12:12:05.814 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/xprtrdma/ 2023-11-08T12:12:05.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 707721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-08T12:12:05.815 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/ 2023-11-08T12:12:05.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/diag.ko 2023-11-08T12:12:05.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 862641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/tipc.ko 2023-11-08T12:12:05.815 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/unix/ 2023-11-08T12:12:05.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/unix/unix_diag.ko 2023-11-08T12:12:05.816 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/ 2023-11-08T12:12:05.816 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-08T12:12:05.816 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-08T12:12:05.816 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 96193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock.ko 2023-11-08T12:12:05.816 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-08T12:12:05.817 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-08T12:12:05.817 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/x25/ 2023-11-08T12:12:05.817 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/x25/x25.ko 2023-11-08T12:12:05.817 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/ 2023-11-08T12:12:05.817 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_algo.ko 2023-11-08T12:12:05.818 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-08T12:12:05.818 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_user.ko 2023-11-08T12:12:05.818 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/ 2023-11-08T12:12:05.818 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/lib/ 2023-11-08T12:12:05.818 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/lib/irqbypass.ko 2023-11-08T12:12:05.819 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 639863 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.alias 2023-11-08T12:12:05.819 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 623919 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.alias.bin 2023-11-08T12:12:05.819 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7663 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin 2023-11-08T12:12:05.819 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23428 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.alias.bin 2023-11-08T12:12:05.819 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9821 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.bin 2023-11-08T12:12:05.820 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70004 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.modinfo 2023-11-08T12:12:05.820 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 146313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.dep 2023-11-08T12:12:05.820 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 232548 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.dep.bin 2023-11-08T12:12:05.820 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 210 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.devname 2023-11-08T12:12:05.820 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72606 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.order 2023-11-08T12:12:05.820 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 879 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.softdep 2023-11-08T12:12:05.821 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 254438 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.symbols 2023-11-08T12:12:05.821 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 309363 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.symbols.bin 2023-11-08T12:12:05.821 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/ 2023-11-08T12:12:05.821 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/share/ 2023-11-08T12:12:05.821 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/share/doc/ 2023-11-08T12:12:05.822 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/ 2023-11-08T12:12:05.822 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 173 2023-11-07 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/changelog.Debian.gz 2023-11-08T12:12:05.822 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 691 2023-11-07 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/copyright 2023-11-08T12:12:05.823 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:05.823 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:05.824 DEBUG:teuthology.orchestra.run.smithi133:> egrep '(submenu|menuentry.*6.6.0-rc5-g3b796cfe2969).*{' /boot/grub/grub.cfg 2023-11-08T12:12:05.833 INFO:teuthology.orchestra.run.smithi133.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-08T12:12:05.833 INFO:teuthology.orchestra.run.smithi133.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g3b796cfe2969-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-08T12:12:05.833 INFO:teuthology.orchestra.run.smithi133.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g3b796cfe2969-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-08T12:12:05.834 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-08T12:12:05.834 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:05.835 DEBUG:teuthology.orchestra.run.smithi133:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-08T12:12:05.876 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi133.front.sepia.ceph.com to complete... 2023-11-08T12:12:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-11-08T12:12:06.519 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-08T12:12:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-11-08T12:12:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:06.834 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:07.295 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-08T12:12:07.306 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-08T12:12:07.536 INFO:teuthology.orchestra.run.smithi112.stderr:done 2023-11-08T12:12:07.709 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-deb -c /tmp/linux-image.deb 2023-11-08T12:12:07.718 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./ 2023-11-08T12:12:07.719 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./boot/ 2023-11-08T12:12:07.719 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 4415097 2023-11-07 03:19 ./boot/System.map-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:07.735 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 169233 2023-11-07 03:19 ./boot/config-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:07.735 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11352928 2023-11-07 03:19 ./boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:07.757 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/ 2023-11-08T12:12:07.757 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/ 2023-11-08T12:12:07.757 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/postinst.d/ 2023-11-08T12:12:07.757 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/postrm.d/ 2023-11-08T12:12:07.758 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/preinst.d/ 2023-11-08T12:12:07.758 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./etc/kernel/prerm.d/ 2023-11-08T12:12:07.758 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/ 2023-11-08T12:12:07.758 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/ 2023-11-08T12:12:07.758 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/ 2023-11-08T12:12:07.759 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/ 2023-11-08T12:12:07.759 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/ 2023-11-08T12:12:07.759 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/ 2023-11-08T12:12:07.759 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/ 2023-11-08T12:12:07.759 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 490233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-08T12:12:07.762 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-08T12:12:07.762 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-08T12:12:07.762 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-08T12:12:07.763 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 93113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-08T12:12:07.763 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 106729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-08T12:12:07.763 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 152241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-08T12:12:07.763 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-08T12:12:07.764 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-08T12:12:07.764 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-08T12:12:07.764 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-08T12:12:07.764 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-08T12:12:07.764 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-08T12:12:07.765 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-08T12:12:07.765 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-08T12:12:07.765 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-08T12:12:07.765 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-08T12:12:07.765 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-08T12:12:07.765 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-08T12:12:07.766 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-08T12:12:07.766 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/ 2023-11-08T12:12:07.766 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/ 2023-11-08T12:12:07.766 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/mce/ 2023-11-08T12:12:07.767 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-08T12:12:07.767 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpuid.ko 2023-11-08T12:12:07.767 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/msr.ko 2023-11-08T12:12:07.767 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/ 2023-11-08T12:12:07.767 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 353761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-08T12:12:07.767 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 881713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-08T12:12:07.768 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2276817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm.ko 2023-11-08T12:12:07.844 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ 2023-11-08T12:12:07.844 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/af_alg.ko 2023-11-08T12:12:07.845 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/algif_hash.ko 2023-11-08T12:12:07.845 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/algif_skcipher.ko 2023-11-08T12:12:07.846 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ansi_cprng.ko 2023-11-08T12:12:07.846 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/anubis.ko 2023-11-08T12:12:07.846 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/arc4.ko 2023-11-08T12:12:07.847 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/asymmetric_keys/ 2023-11-08T12:12:07.847 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-08T12:12:07.847 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/ 2023-11-08T12:12:07.848 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_memcpy.ko 2023-11-08T12:12:07.848 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_pq.ko 2023-11-08T12:12:07.849 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-08T12:12:07.849 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_tx.ko 2023-11-08T12:12:07.849 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_xor.ko 2023-11-08T12:12:07.850 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/raid6test.ko 2023-11-08T12:12:07.850 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/authenc.ko 2023-11-08T12:12:07.850 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/authencesn.ko 2023-11-08T12:12:07.851 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blake2b_generic.ko 2023-11-08T12:12:07.851 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blowfish_common.ko 2023-11-08T12:12:07.851 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blowfish_generic.ko 2023-11-08T12:12:07.852 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/camellia_generic.ko 2023-11-08T12:12:07.853 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast5_generic.ko 2023-11-08T12:12:07.854 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast6_generic.ko 2023-11-08T12:12:07.854 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast_common.ko 2023-11-08T12:12:07.854 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ccm.ko 2023-11-08T12:12:07.855 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cmac.ko 2023-11-08T12:12:07.855 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crc32_generic.ko 2023-11-08T12:12:07.855 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cryptd.ko 2023-11-08T12:12:07.856 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_engine.ko 2023-11-08T12:12:07.856 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_simd.ko 2023-11-08T12:12:07.857 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_user.ko 2023-11-08T12:12:07.857 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cts.ko 2023-11-08T12:12:07.857 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/des_generic.ko 2023-11-08T12:12:07.858 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/dh_generic.ko 2023-11-08T12:12:07.858 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/echainiv.ko 2023-11-08T12:12:07.859 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/essiv.ko 2023-11-08T12:12:07.859 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/fcrypt.ko 2023-11-08T12:12:07.859 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/khazad.ko 2023-11-08T12:12:07.860 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lrw.ko 2023-11-08T12:12:07.860 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lz4.ko 2023-11-08T12:12:07.860 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lz4hc.ko 2023-11-08T12:12:07.861 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/md4.ko 2023-11-08T12:12:07.861 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/michael_mic.ko 2023-11-08T12:12:07.862 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/pcbc.ko 2023-11-08T12:12:07.862 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/pcrypt.ko 2023-11-08T12:12:07.862 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/rmd160.ko 2023-11-08T12:12:07.863 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/seed.ko 2023-11-08T12:12:07.863 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/serpent_generic.ko 2023-11-08T12:12:07.863 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 149193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/tcrypt.ko 2023-11-08T12:12:07.864 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/tea.ko 2023-11-08T12:12:07.864 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/twofish_common.ko 2023-11-08T12:12:07.864 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/twofish_generic.ko 2023-11-08T12:12:07.865 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/vmac.ko 2023-11-08T12:12:07.865 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/wp512.ko 2023-11-08T12:12:07.865 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xcbc.ko 2023-11-08T12:12:07.866 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xor.ko 2023-11-08T12:12:07.866 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xts.ko 2023-11-08T12:12:07.867 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xxhash_generic.ko 2023-11-08T12:12:07.867 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ 2023-11-08T12:12:07.867 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/ 2023-11-08T12:12:07.868 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_extlog.ko 2023-11-08T12:12:07.868 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-08T12:12:07.868 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_pad.ko 2023-11-08T12:12:07.869 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/apei/ 2023-11-08T12:12:07.869 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/apei/einj.ko 2023-11-08T12:12:07.869 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/ec_sys.ko 2023-11-08T12:12:07.870 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/platform_profile.ko 2023-11-08T12:12:07.870 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/sbs.ko 2023-11-08T12:12:07.870 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/sbshc.ko 2023-11-08T12:12:07.871 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/video.ko 2023-11-08T12:12:07.871 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ 2023-11-08T12:12:07.872 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/acard-ahci.ko 2023-11-08T12:12:07.872 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 88865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ahci.ko 2023-11-08T12:12:07.872 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ahci_platform.ko 2023-11-08T12:12:07.873 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 88289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/libahci.ko 2023-11-08T12:12:07.873 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/libahci_platform.ko 2023-11-08T12:12:07.874 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_acpi.ko 2023-11-08T12:12:07.874 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ali.ko 2023-11-08T12:12:07.874 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_amd.ko 2023-11-08T12:12:07.875 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_artop.ko 2023-11-08T12:12:07.875 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_atiixp.ko 2023-11-08T12:12:07.875 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_atp867x.ko 2023-11-08T12:12:07.876 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cmd640.ko 2023-11-08T12:12:07.876 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cmd64x.ko 2023-11-08T12:12:07.876 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cypress.ko 2023-11-08T12:12:07.876 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_efar.ko 2023-11-08T12:12:07.877 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt366.ko 2023-11-08T12:12:07.877 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt37x.ko 2023-11-08T12:12:07.877 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-08T12:12:07.878 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-08T12:12:07.878 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_it8213.ko 2023-11-08T12:12:07.878 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_it821x.ko 2023-11-08T12:12:07.879 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_jmicron.ko 2023-11-08T12:12:07.879 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_legacy.ko 2023-11-08T12:12:07.879 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_marvell.ko 2023-11-08T12:12:07.879 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_mpiix.ko 2023-11-08T12:12:07.880 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_netcell.ko 2023-11-08T12:12:07.880 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ninja32.ko 2023-11-08T12:12:07.880 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ns87410.ko 2023-11-08T12:12:07.881 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ns87415.ko 2023-11-08T12:12:07.881 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_oldpiix.ko 2023-11-08T12:12:07.881 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_opti.ko 2023-11-08T12:12:07.881 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_optidma.ko 2023-11-08T12:12:07.881 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pcmcia.ko 2023-11-08T12:12:07.882 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-08T12:12:07.882 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-08T12:12:07.882 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_piccolo.ko 2023-11-08T12:12:07.882 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_radisys.ko 2023-11-08T12:12:07.882 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_rdc.ko 2023-11-08T12:12:07.883 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_rz1000.ko 2023-11-08T12:12:07.883 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sch.ko 2023-11-08T12:12:07.883 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_serverworks.ko 2023-11-08T12:12:07.883 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sil680.ko 2023-11-08T12:12:07.883 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sl82c105.ko 2023-11-08T12:12:07.884 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_triflex.ko 2023-11-08T12:12:07.884 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_via.ko 2023-11-08T12:12:07.884 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pdc_adma.ko 2023-11-08T12:12:07.884 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_inic162x.ko 2023-11-08T12:12:07.884 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_mv.ko 2023-11-08T12:12:07.884 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_nv.ko 2023-11-08T12:12:07.885 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_promise.ko 2023-11-08T12:12:07.885 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_qstor.ko 2023-11-08T12:12:07.885 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sil.ko 2023-11-08T12:12:07.885 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sil24.ko 2023-11-08T12:12:07.885 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sis.ko 2023-11-08T12:12:07.886 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_svw.ko 2023-11-08T12:12:07.886 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sx4.ko 2023-11-08T12:12:07.886 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_uli.ko 2023-11-08T12:12:07.886 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_via.ko 2023-11-08T12:12:07.886 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_vsc.ko 2023-11-08T12:12:07.887 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/auxdisplay/ 2023-11-08T12:12:07.887 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/auxdisplay/ks0108.ko 2023-11-08T12:12:07.887 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/bcma/ 2023-11-08T12:12:07.887 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 124473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/bcma/bcma.ko 2023-11-08T12:12:07.887 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/ 2023-11-08T12:12:07.888 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/aoe/ 2023-11-08T12:12:07.888 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 113665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/aoe/aoe.ko 2023-11-08T12:12:07.888 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/drbd/ 2023-11-08T12:12:07.888 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 965585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/drbd/drbd.ko 2023-11-08T12:12:07.888 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 173225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/floppy.ko 2023-11-08T12:12:07.889 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/mtip32xx/ 2023-11-08T12:12:07.889 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 94297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-08T12:12:07.889 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/nbd.ko 2023-11-08T12:12:07.889 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/null_blk/ 2023-11-08T12:12:07.889 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 110449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/null_blk/null_blk.ko 2023-11-08T12:12:07.889 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 98193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/pktcdvd.ko 2023-11-08T12:12:07.890 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 263769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/rbd.ko 2023-11-08T12:12:07.890 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/xen-blkback/ 2023-11-08T12:12:07.890 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 98145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-08T12:12:07.890 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/zram/ 2023-11-08T12:12:07.890 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/zram/zram.ko 2023-11-08T12:12:07.891 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ 2023-11-08T12:12:07.891 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/applicom.ko 2023-11-08T12:12:07.891 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hangcheck-timer.ko 2023-11-08T12:12:07.891 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/ 2023-11-08T12:12:07.891 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-08T12:12:07.891 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-08T12:12:07.892 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-08T12:12:07.892 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/via-rng.ko 2023-11-08T12:12:07.892 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-08T12:12:07.892 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ 2023-11-08T12:12:07.892 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-08T12:12:07.892 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 148601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-08T12:12:07.893 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-08T12:12:07.893 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 139313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-08T12:12:07.893 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-08T12:12:07.893 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-08T12:12:07.893 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/lp.ko 2023-11-08T12:12:07.894 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/mwave/ 2023-11-08T12:12:07.894 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/mwave/mwave.ko 2023-11-08T12:12:07.894 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/nvram.ko 2023-11-08T12:12:07.894 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ppdev.ko 2023-11-08T12:12:07.894 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tlclk.ko 2023-11-08T12:12:07.895 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/ 2023-11-08T12:12:07.895 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-08T12:12:07.895 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-08T12:12:07.895 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-08T12:12:07.895 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-08T12:12:07.896 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-08T12:12:07.896 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-08T12:12:07.896 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-08T12:12:07.896 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/ 2023-11-08T12:12:07.896 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-08T12:12:07.896 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-08T12:12:07.897 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-08T12:12:07.897 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/ 2023-11-08T12:12:07.897 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-palmas.ko 2023-11-08T12:12:07.897 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-si5351.ko 2023-11-08T12:12:07.897 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-twl6040.ko 2023-11-08T12:12:07.898 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-wm831x.ko 2023-11-08T12:12:07.898 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/ 2023-11-08T12:12:07.898 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-08T12:12:07.898 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-08T12:12:07.898 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-08T12:12:07.899 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ 2023-11-08T12:12:07.899 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ 2023-11-08T12:12:07.899 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-08T12:12:07.899 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 243025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ccp.ko 2023-11-08T12:12:07.899 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/ 2023-11-08T12:12:07.899 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/ 2023-11-08T12:12:07.900 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-08T12:12:07.900 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 438761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-08T12:12:07.900 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-08T12:12:07.900 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-08T12:12:07.900 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/padlock-aes.ko 2023-11-08T12:12:07.900 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/padlock-sha.ko 2023-11-08T12:12:07.901 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/virtio/ 2023-11-08T12:12:07.901 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-08T12:12:07.901 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dca/ 2023-11-08T12:12:07.901 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dca/dca.ko 2023-11-08T12:12:07.901 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ 2023-11-08T12:12:07.902 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/dw/ 2023-11-08T12:12:07.902 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-08T12:12:07.902 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ioat/ 2023-11-08T12:12:07.902 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 122569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-08T12:12:07.902 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/ 2023-11-08T12:12:07.903 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 79953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/amd64_edac.ko 2023-11-08T12:12:07.903 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/e752x_edac.ko 2023-11-08T12:12:07.903 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/edac_mce_amd.ko 2023-11-08T12:12:07.903 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i3000_edac.ko 2023-11-08T12:12:07.903 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i3200_edac.ko 2023-11-08T12:12:07.904 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i5100_edac.ko 2023-11-08T12:12:07.904 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i5400_edac.ko 2023-11-08T12:12:07.904 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i7300_edac.ko 2023-11-08T12:12:07.904 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i7core_edac.ko 2023-11-08T12:12:07.904 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i82975x_edac.ko 2023-11-08T12:12:07.904 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/ie31200_edac.ko 2023-11-08T12:12:07.905 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/sb_edac.ko 2023-11-08T12:12:07.905 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/x38_edac.ko 2023-11-08T12:12:07.905 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/ 2023-11-08T12:12:07.905 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-gpio.ko 2023-11-08T12:12:07.905 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max14577.ko 2023-11-08T12:12:07.906 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max77693.ko 2023-11-08T12:12:07.906 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max8997.ko 2023-11-08T12:12:07.906 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-palmas.ko 2023-11-08T12:12:07.907 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-08T12:12:07.907 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-08T12:12:07.908 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/ 2023-11-08T12:12:07.908 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-08T12:12:07.908 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/efi/ 2023-11-08T12:12:07.909 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-08T12:12:07.909 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-08T12:12:07.909 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/ 2023-11-08T12:12:07.910 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-08T12:12:07.910 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-08T12:12:07.910 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-arizona.ko 2023-11-08T12:12:07.911 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-da9052.ko 2023-11-08T12:12:07.911 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-da9055.ko 2023-11-08T12:12:07.912 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-dln2.ko 2023-11-08T12:12:07.912 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-08T12:12:07.912 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-generic.ko 2023-11-08T12:12:07.913 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-ich.ko 2023-11-08T12:12:07.913 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-08T12:12:07.913 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-kempld.ko 2023-11-08T12:12:07.914 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-08T12:12:07.914 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max7300.ko 2023-11-08T12:12:07.915 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max730x.ko 2023-11-08T12:12:07.915 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max732x.ko 2023-11-08T12:12:07.915 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-08T12:12:07.916 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-08T12:12:07.916 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-08T12:12:07.916 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-08T12:12:07.917 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-sch.ko 2023-11-08T12:12:07.917 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-08T12:12:07.917 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-08T12:12:07.918 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-08T12:12:07.918 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-08T12:12:07.919 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-08T12:12:07.919 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-vx855.ko 2023-11-08T12:12:07.919 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-08T12:12:07.920 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-08T12:12:07.920 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-08T12:12:07.920 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/ 2023-11-08T12:12:07.921 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-a4tech.ko 2023-11-08T12:12:07.921 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-apple.ko 2023-11-08T12:12:07.922 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-appleir.ko 2023-11-08T12:12:07.922 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-aureal.ko 2023-11-08T12:12:07.922 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-axff.ko 2023-11-08T12:12:07.923 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-belkin.ko 2023-11-08T12:12:07.923 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cherry.ko 2023-11-08T12:12:07.924 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-chicony.ko 2023-11-08T12:12:07.924 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cp2112.ko 2023-11-08T12:12:07.924 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cypress.ko 2023-11-08T12:12:07.925 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-dr.ko 2023-11-08T12:12:07.925 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-elecom.ko 2023-11-08T12:12:07.925 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-elo.ko 2023-11-08T12:12:07.926 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-emsff.ko 2023-11-08T12:12:07.926 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ezkey.ko 2023-11-08T12:12:07.927 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gaff.ko 2023-11-08T12:12:07.927 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-generic.ko 2023-11-08T12:12:07.927 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gt683r.ko 2023-11-08T12:12:07.928 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gyration.ko 2023-11-08T12:12:07.928 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-08T12:12:07.929 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-08T12:12:07.929 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtekff.ko 2023-11-08T12:12:07.929 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-hyperv.ko 2023-11-08T12:12:07.930 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-icade.ko 2023-11-08T12:12:07.930 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-kensington.ko 2023-11-08T12:12:07.930 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-keytouch.ko 2023-11-08T12:12:07.931 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-kye.ko 2023-11-08T12:12:07.931 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lcpower.ko 2023-11-08T12:12:07.932 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-led.ko 2023-11-08T12:12:07.932 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lenovo.ko 2023-11-08T12:12:07.932 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lg-g15.ko 2023-11-08T12:12:07.933 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-08T12:12:07.933 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-08T12:12:07.933 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech.ko 2023-11-08T12:12:07.934 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-magicmouse.ko 2023-11-08T12:12:07.934 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-microsoft.ko 2023-11-08T12:12:07.934 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-monterey.ko 2023-11-08T12:12:07.935 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-multitouch.ko 2023-11-08T12:12:07.935 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ntrig.ko 2023-11-08T12:12:07.936 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ortek.ko 2023-11-08T12:12:07.936 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-penmount.ko 2023-11-08T12:12:07.936 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-petalynx.ko 2023-11-08T12:12:07.937 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-picolcd.ko 2023-11-08T12:12:07.937 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-pl.ko 2023-11-08T12:12:07.938 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-plantronics.ko 2023-11-08T12:12:07.938 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-primax.ko 2023-11-08T12:12:07.938 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-rmi.ko 2023-11-08T12:12:07.939 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-08T12:12:07.939 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-common.ko 2023-11-08T12:12:07.939 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-08T12:12:07.940 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-08T12:12:07.940 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-08T12:12:07.941 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-08T12:12:07.941 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-08T12:12:07.941 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-08T12:12:07.942 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-08T12:12:07.942 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-08T12:12:07.942 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-08T12:12:07.943 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat.ko 2023-11-08T12:12:07.943 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-saitek.ko 2023-11-08T12:12:07.943 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-samsung.ko 2023-11-08T12:12:07.944 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-08T12:12:07.944 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sjoy.ko 2023-11-08T12:12:07.944 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sony.ko 2023-11-08T12:12:07.944 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-speedlink.ko 2023-11-08T12:12:07.945 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-steelseries.ko 2023-11-08T12:12:07.945 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sunplus.ko 2023-11-08T12:12:07.945 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-08T12:12:07.946 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-tivo.ko 2023-11-08T12:12:07.946 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-tmff.ko 2023-11-08T12:12:07.946 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-topseed.ko 2023-11-08T12:12:07.947 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-twinhan.ko 2023-11-08T12:12:07.947 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-uclogic.ko 2023-11-08T12:12:07.947 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-waltop.ko 2023-11-08T12:12:07.947 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 143473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-wiimote.ko 2023-11-08T12:12:07.948 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-xinmo.ko 2023-11-08T12:12:07.948 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-zpff.ko 2023-11-08T12:12:07.948 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-zydacron.ko 2023-11-08T12:12:07.948 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 267825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid.ko 2023-11-08T12:12:07.949 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/uhid.ko 2023-11-08T12:12:07.949 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/ 2023-11-08T12:12:07.949 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 125721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-08T12:12:07.949 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-08T12:12:07.949 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-08T12:12:07.950 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 217873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/wacom.ko 2023-11-08T12:12:07.950 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/ 2023-11-08T12:12:07.950 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_balloon.ko 2023-11-08T12:12:07.950 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_utils.ko 2023-11-08T12:12:07.950 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 305465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_vmbus.ko 2023-11-08T12:12:07.950 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ 2023-11-08T12:12:07.951 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/abituguru.ko 2023-11-08T12:12:07.951 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/abituguru3.ko 2023-11-08T12:12:07.951 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-08T12:12:07.951 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ad7414.ko 2023-11-08T12:12:07.951 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ad7418.ko 2023-11-08T12:12:07.952 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adc128d818.ko 2023-11-08T12:12:07.952 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1025.ko 2023-11-08T12:12:07.952 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1026.ko 2023-11-08T12:12:07.952 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1029.ko 2023-11-08T12:12:07.952 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1031.ko 2023-11-08T12:12:07.952 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm9240.ko 2023-11-08T12:12:07.953 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ads7828.ko 2023-11-08T12:12:07.953 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7410.ko 2023-11-08T12:12:07.953 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7411.ko 2023-11-08T12:12:07.953 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7462.ko 2023-11-08T12:12:07.953 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7470.ko 2023-11-08T12:12:07.953 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7475.ko 2023-11-08T12:12:07.954 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7x10.ko 2023-11-08T12:12:07.954 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/amc6821.ko 2023-11-08T12:12:07.954 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/applesmc.ko 2023-11-08T12:12:07.954 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asb100.ko 2023-11-08T12:12:07.954 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asc7621.ko 2023-11-08T12:12:07.955 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-08T12:12:07.955 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/atxp1.ko 2023-11-08T12:12:07.955 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/coretemp.ko 2023-11-08T12:12:07.955 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-08T12:12:07.955 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-08T12:12:07.956 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-08T12:12:07.956 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 99601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/dme1737.ko 2023-11-08T12:12:07.956 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ds1621.ko 2023-11-08T12:12:07.956 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ds620.ko 2023-11-08T12:12:07.956 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc1403.ko 2023-11-08T12:12:07.957 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc2103.ko 2023-11-08T12:12:07.957 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc6w201.ko 2023-11-08T12:12:07.957 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f71805f.ko 2023-11-08T12:12:07.957 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 94457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f71882fg.ko 2023-11-08T12:12:07.957 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f75375s.ko 2023-11-08T12:12:07.957 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/fam15h_power.ko 2023-11-08T12:12:07.958 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/fschmd.ko 2023-11-08T12:12:07.958 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/g760a.ko 2023-11-08T12:12:07.958 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/g762.ko 2023-11-08T12:12:07.958 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/gl518sm.ko 2023-11-08T12:12:07.958 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/gl520sm.ko 2023-11-08T12:12:07.959 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/hih6130.ko 2023-11-08T12:12:07.959 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-08T12:12:07.959 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/i5500_temp.ko 2023-11-08T12:12:07.959 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/i5k_amb.ko 2023-11-08T12:12:07.959 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ibmaem.ko 2023-11-08T12:12:07.959 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ibmpex.ko 2023-11-08T12:12:07.960 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ina209.ko 2023-11-08T12:12:07.960 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ina2xx.ko 2023-11-08T12:12:07.960 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 130449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/it87.ko 2023-11-08T12:12:07.960 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/jc42.ko 2023-11-08T12:12:07.960 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/k10temp.ko 2023-11-08T12:12:07.961 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/k8temp.ko 2023-11-08T12:12:07.961 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lineage-pem.ko 2023-11-08T12:12:07.961 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm63.ko 2023-11-08T12:12:07.961 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm73.ko 2023-11-08T12:12:07.961 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm75.ko 2023-11-08T12:12:07.961 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm77.ko 2023-11-08T12:12:07.962 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm78.ko 2023-11-08T12:12:07.962 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm80.ko 2023-11-08T12:12:07.962 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm83.ko 2023-11-08T12:12:07.962 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm85.ko 2023-11-08T12:12:07.962 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm87.ko 2023-11-08T12:12:07.963 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm90.ko 2023-11-08T12:12:07.963 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm92.ko 2023-11-08T12:12:07.963 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm93.ko 2023-11-08T12:12:07.963 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95234.ko 2023-11-08T12:12:07.963 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95241.ko 2023-11-08T12:12:07.963 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95245.ko 2023-11-08T12:12:07.964 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc2945.ko 2023-11-08T12:12:07.964 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4151.ko 2023-11-08T12:12:07.964 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4215.ko 2023-11-08T12:12:07.964 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4222.ko 2023-11-08T12:12:07.964 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4245.ko 2023-11-08T12:12:07.965 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4260.ko 2023-11-08T12:12:07.965 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4261.ko 2023-11-08T12:12:07.965 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max16065.ko 2023-11-08T12:12:07.965 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max1619.ko 2023-11-08T12:12:07.965 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max1668.ko 2023-11-08T12:12:07.965 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max197.ko 2023-11-08T12:12:07.966 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6639.ko 2023-11-08T12:12:07.966 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6650.ko 2023-11-08T12:12:07.966 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6697.ko 2023-11-08T12:12:07.966 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-08T12:12:07.966 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/mcp3021.ko 2023-11-08T12:12:07.967 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-08T12:12:07.967 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6683.ko 2023-11-08T12:12:07.967 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 119817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6775-core.ko 2023-11-08T12:12:07.967 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6775.ko 2023-11-08T12:12:07.967 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct7802.ko 2023-11-08T12:12:07.967 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 82337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pc87360.ko 2023-11-08T12:12:07.968 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pc87427.ko 2023-11-08T12:12:07.968 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pcf8591.ko 2023-11-08T12:12:07.968 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ 2023-11-08T12:12:07.968 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-08T12:12:07.968 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-08T12:12:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-08T12:12:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-08T12:12:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-08T12:12:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-08T12:12:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-08T12:12:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 82577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-08T12:12:07.970 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-08T12:12:07.970 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-08T12:12:07.970 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-08T12:12:07.970 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-08T12:12:07.970 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/powr1220.ko 2023-11-08T12:12:07.971 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch5627.ko 2023-11-08T12:12:07.971 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch5636.ko 2023-11-08T12:12:07.971 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-08T12:12:07.971 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sht15.ko 2023-11-08T12:12:07.972 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sht21.ko 2023-11-08T12:12:07.972 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/shtc1.ko 2023-11-08T12:12:07.972 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sis5595.ko 2023-11-08T12:12:07.973 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47b397.ko 2023-11-08T12:12:07.973 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47m1.ko 2023-11-08T12:12:07.973 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47m192.ko 2023-11-08T12:12:07.974 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/thmc50.ko 2023-11-08T12:12:07.974 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp102.ko 2023-11-08T12:12:07.975 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp103.ko 2023-11-08T12:12:07.975 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp401.ko 2023-11-08T12:12:07.975 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp421.ko 2023-11-08T12:12:07.976 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/via-cputemp.ko 2023-11-08T12:12:07.976 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/via686a.ko 2023-11-08T12:12:07.976 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/vt1211.ko 2023-11-08T12:12:07.977 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/vt8231.ko 2023-11-08T12:12:07.977 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83627ehf.ko 2023-11-08T12:12:07.977 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83627hf.ko 2023-11-08T12:12:07.978 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83781d.ko 2023-11-08T12:12:07.978 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83791d.ko 2023-11-08T12:12:07.979 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83792d.ko 2023-11-08T12:12:07.979 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83793.ko 2023-11-08T12:12:07.979 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 119505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83795.ko 2023-11-08T12:12:07.980 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83l785ts.ko 2023-11-08T12:12:07.980 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83l786ng.ko 2023-11-08T12:12:07.980 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-08T12:12:07.981 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-08T12:12:07.981 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/ 2023-11-08T12:12:07.982 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/ 2023-11-08T12:12:07.982 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-08T12:12:07.982 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-08T12:12:07.983 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/ 2023-11-08T12:12:07.983 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-08T12:12:07.983 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-08T12:12:07.984 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-08T12:12:07.984 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-08T12:12:07.985 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-08T12:12:07.985 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-08T12:12:07.985 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-08T12:12:07.986 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 6929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-08T12:12:07.986 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-08T12:12:07.986 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-08T12:12:07.987 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-08T12:12:07.987 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-08T12:12:07.988 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-08T12:12:07.988 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-08T12:12:07.988 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-08T12:12:07.989 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-08T12:12:07.989 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-08T12:12:07.989 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-08T12:12:07.990 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-08T12:12:07.990 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-08T12:12:07.991 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-08T12:12:07.991 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-08T12:12:07.991 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-08T12:12:07.992 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-08T12:12:07.992 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-08T12:12:07.992 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-08T12:12:07.993 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-08T12:12:07.993 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-08T12:12:07.993 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-08T12:12:07.994 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-08T12:12:07.994 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-08T12:12:07.995 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-08T12:12:07.995 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-08T12:12:07.995 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-08T12:12:07.996 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-08T12:12:07.996 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-08T12:12:07.996 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-08T12:12:07.997 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-mux.ko 2023-11-08T12:12:07.997 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-smbus.ko 2023-11-08T12:12:07.997 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-stub.ko 2023-11-08T12:12:07.998 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/ 2023-11-08T12:12:07.998 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-08T12:12:07.999 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-08T12:12:07.999 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-08T12:12:07.999 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ 2023-11-08T12:12:08.000 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ 2023-11-08T12:12:08.000 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 273609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-08T12:12:08.001 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 879969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_core.ko 2023-11-08T12:12:08.001 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-08T12:12:08.001 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 324217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-08T12:12:08.002 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-08T12:12:08.002 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 282273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-08T12:12:08.002 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-08T12:12:08.003 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ 2023-11-08T12:12:08.003 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-08T12:12:08.004 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 493073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-08T12:12:08.004 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx4/ 2023-11-08T12:12:08.004 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 419737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-08T12:12:08.005 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx5/ 2023-11-08T12:12:08.005 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 739025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-08T12:12:08.006 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mthca/ 2023-11-08T12:12:08.006 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 296625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-08T12:12:08.006 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-08T12:12:08.007 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 153697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-08T12:12:08.007 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/usnic/ 2023-11-08T12:12:08.007 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 168969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-08T12:12:08.008 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ 2023-11-08T12:12:08.008 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-08T12:12:08.009 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 263081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-08T12:12:08.009 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/iser/ 2023-11-08T12:12:08.009 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 100241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-08T12:12:08.010 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/isert/ 2023-11-08T12:12:08.010 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 111425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-08T12:12:08.010 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srp/ 2023-11-08T12:12:08.011 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 128753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-08T12:12:08.011 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srpt/ 2023-11-08T12:12:08.011 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 129529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-08T12:12:08.012 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/ 2023-11-08T12:12:08.012 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/evbug.ko 2023-11-08T12:12:08.013 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/ff-memless.ko 2023-11-08T12:12:08.013 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/ 2023-11-08T12:12:08.013 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-08T12:12:08.014 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-08T12:12:08.014 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/gameport.ko 2023-11-08T12:12:08.014 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/joydev.ko 2023-11-08T12:12:08.015 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/ 2023-11-08T12:12:08.015 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-08T12:12:08.015 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-08T12:12:08.015 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-08T12:12:08.016 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-08T12:12:08.016 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-08T12:12:08.016 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-08T12:12:08.017 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-08T12:12:08.017 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lm8323.ko 2023-11-08T12:12:08.017 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lm8333.ko 2023-11-08T12:12:08.017 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-08T12:12:08.018 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-08T12:12:08.018 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-08T12:12:08.018 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-08T12:12:08.018 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-08T12:12:08.019 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-08T12:12:08.019 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/qt1070.ko 2023-11-08T12:12:08.019 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/qt2160.ko 2023-11-08T12:12:08.020 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-08T12:12:08.020 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/stowaway.ko 2023-11-08T12:12:08.020 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-08T12:12:08.020 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-08T12:12:08.020 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-08T12:12:08.021 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-08T12:12:08.021 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-08T12:12:08.021 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/matrix-keymap.ko 2023-11-08T12:12:08.021 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/ 2023-11-08T12:12:08.021 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/appletouch.ko 2023-11-08T12:12:08.022 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/bcm5974.ko 2023-11-08T12:12:08.022 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 123681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/cyapatp.ko 2023-11-08T12:12:08.022 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-08T12:12:08.022 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-08T12:12:08.022 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 335977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/psmouse.ko 2023-11-08T12:12:08.023 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/sermouse.ko 2023-11-08T12:12:08.023 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-08T12:12:08.023 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-08T12:12:08.023 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-08T12:12:08.023 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/rmi4/ 2023-11-08T12:12:08.023 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 109873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-08T12:12:08.024 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ 2023-11-08T12:12:08.024 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/altera_ps2.ko 2023-11-08T12:12:08.024 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/arc_ps2.ko 2023-11-08T12:12:08.024 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ct82c710.ko 2023-11-08T12:12:08.024 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-08T12:12:08.024 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/parkbd.ko 2023-11-08T12:12:08.025 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/pcips2.ko 2023-11-08T12:12:08.025 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ps2mult.ko 2023-11-08T12:12:08.025 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/serio_raw.ko 2023-11-08T12:12:08.025 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/serport.ko 2023-11-08T12:12:08.025 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/sparse-keymap.ko 2023-11-08T12:12:08.025 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/ 2023-11-08T12:12:08.026 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/amd/ 2023-11-08T12:12:08.026 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-08T12:12:08.026 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/ 2023-11-08T12:12:08.026 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-88pm860x.ko 2023-11-08T12:12:08.027 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-adp5520.ko 2023-11-08T12:12:08.027 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-bd2802.ko 2023-11-08T12:12:08.027 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-blinkm.ko 2023-11-08T12:12:08.027 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-da903x.ko 2023-11-08T12:12:08.027 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-da9052.ko 2023-11-08T12:12:08.028 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-gpio.ko 2023-11-08T12:12:08.028 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3530.ko 2023-11-08T12:12:08.028 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3533.ko 2023-11-08T12:12:08.028 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm355x.ko 2023-11-08T12:12:08.028 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3642.ko 2023-11-08T12:12:08.028 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lp3944.ko 2023-11-08T12:12:08.029 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lp8788.ko 2023-11-08T12:12:08.029 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-max8997.ko 2023-11-08T12:12:08.029 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-mc13783.ko 2023-11-08T12:12:08.029 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-08T12:12:08.029 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca9532.ko 2023-11-08T12:12:08.029 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca955x.ko 2023-11-08T12:12:08.030 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca963x.ko 2023-11-08T12:12:08.030 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-ss4200.ko 2023-11-08T12:12:08.030 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-tca6507.ko 2023-11-08T12:12:08.030 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-08T12:12:08.030 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-wm8350.ko 2023-11-08T12:12:08.031 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ 2023-11-08T12:12:08.031 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-08T12:12:08.031 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-08T12:12:08.031 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-08T12:12:08.031 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-08T12:12:08.032 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-08T12:12:08.032 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-08T12:12:08.032 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-08T12:12:08.032 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-08T12:12:08.033 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/ 2023-11-08T12:12:08.033 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/bcache/ 2023-11-08T12:12:08.033 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 654969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/bcache/bcache.ko 2023-11-08T12:12:08.034 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-bio-prison.ko 2023-11-08T12:12:08.034 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-bufio.ko 2023-11-08T12:12:08.034 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-cache-smq.ko 2023-11-08T12:12:08.035 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 156009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-cache.ko 2023-11-08T12:12:08.035 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 106897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-crypt.ko 2023-11-08T12:12:08.036 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-delay.ko 2023-11-08T12:12:08.036 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-era.ko 2023-11-08T12:12:08.036 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-flakey.ko 2023-11-08T12:12:08.037 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-log-userspace.ko 2023-11-08T12:12:08.037 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-log.ko 2023-11-08T12:12:08.037 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-mirror.ko 2023-11-08T12:12:08.038 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-multipath.ko 2023-11-08T12:12:08.038 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-queue-length.ko 2023-11-08T12:12:08.038 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-raid.ko 2023-11-08T12:12:08.039 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-region-hash.ko 2023-11-08T12:12:08.039 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-round-robin.ko 2023-11-08T12:12:08.039 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-service-time.ko 2023-11-08T12:12:08.040 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 109593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-snapshot.ko 2023-11-08T12:12:08.040 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-switch.ko 2023-11-08T12:12:08.040 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 181865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-thin-pool.ko 2023-11-08T12:12:08.041 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-verity.ko 2023-11-08T12:12:08.041 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-zero.ko 2023-11-08T12:12:08.041 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/faulty.ko 2023-11-08T12:12:08.042 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/linear.ko 2023-11-08T12:12:08.042 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/multipath.ko 2023-11-08T12:12:08.042 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/persistent-data/ 2023-11-08T12:12:08.042 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 199937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-08T12:12:08.043 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid0.ko 2023-11-08T12:12:08.043 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 113073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid1.ko 2023-11-08T12:12:08.043 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 158681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid10.ko 2023-11-08T12:12:08.043 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 395721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid456.ko 2023-11-08T12:12:08.043 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/ 2023-11-08T12:12:08.044 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/ 2023-11-08T12:12:08.044 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 178137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptbase.ko 2023-11-08T12:12:08.044 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptctl.ko 2023-11-08T12:12:08.044 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptfc.ko 2023-11-08T12:12:08.044 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptlan.ko 2023-11-08T12:12:08.044 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 123321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptsas.ko 2023-11-08T12:12:08.045 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 79041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptscsih.ko 2023-11-08T12:12:08.045 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptspi.ko 2023-11-08T12:12:08.045 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/ 2023-11-08T12:12:08.045 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm800.ko 2023-11-08T12:12:08.045 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm805.ko 2023-11-08T12:12:08.046 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm80x.ko 2023-11-08T12:12:08.046 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/arizona-i2c.ko 2023-11-08T12:12:08.046 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 123721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/arizona.ko 2023-11-08T12:12:08.046 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/bcm590xx.ko 2023-11-08T12:12:08.047 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-08T12:12:08.047 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/dln2.ko 2023-11-08T12:12:08.047 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/janz-cmodio.ko 2023-11-08T12:12:08.047 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/kempld-core.ko 2023-11-08T12:12:08.047 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lm3533-core.ko 2023-11-08T12:12:08.047 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-08T12:12:08.048 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lp3943.ko 2023-11-08T12:12:08.048 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lpc_ich.ko 2023-11-08T12:12:08.048 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lpc_sch.ko 2023-11-08T12:12:08.048 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/max8907.ko 2023-11-08T12:12:08.048 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-08T12:12:08.049 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-08T12:12:08.049 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/menf21bmc.ko 2023-11-08T12:12:08.049 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-08T12:12:08.049 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-08T12:12:08.049 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633.ko 2023-11-08T12:12:08.050 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-08T12:12:08.050 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/retu-mfd.ko 2023-11-08T12:12:08.050 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/si476x-core.ko 2023-11-08T12:12:08.050 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/sm501.ko 2023-11-08T12:12:08.050 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-08T12:12:08.051 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/tps65010.ko 2023-11-08T12:12:08.051 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/tps6507x.ko 2023-11-08T12:12:08.051 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/viperboard.ko 2023-11-08T12:12:08.051 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/vx855.ko 2023-11-08T12:12:08.051 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/wl1273-core.ko 2023-11-08T12:12:08.052 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/wm8994.ko 2023-11-08T12:12:08.052 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ 2023-11-08T12:12:08.052 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-08T12:12:08.052 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ad525x_dpot.ko 2023-11-08T12:12:08.052 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/altera-stapl/ 2023-11-08T12:12:08.053 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-08T12:12:08.053 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/apds9802als.ko 2023-11-08T12:12:08.053 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/apds990x.ko 2023-11-08T12:12:08.053 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/bh1770glc.ko 2023-11-08T12:12:08.053 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/ 2023-11-08T12:12:08.053 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-08T12:12:08.054 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/core.ko 2023-11-08T12:12:08.054 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/cb710/ 2023-11-08T12:12:08.054 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/cb710/cb710.ko 2023-11-08T12:12:08.054 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ds1682.ko 2023-11-08T12:12:08.054 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/dummy-irq.ko 2023-11-08T12:12:08.055 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/echo/ 2023-11-08T12:12:08.055 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/echo/echo.ko 2023-11-08T12:12:08.055 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/ 2023-11-08T12:12:08.055 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/at24.ko 2023-11-08T12:12:08.055 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-08T12:12:08.056 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-08T12:12:08.056 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/max6875.ko 2023-11-08T12:12:08.056 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/enclosure.ko 2023-11-08T12:12:08.056 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/genwqe/ 2023-11-08T12:12:08.056 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 152201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-08T12:12:08.057 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/hmc6352.ko 2023-11-08T12:12:08.057 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/hpilo.ko 2023-11-08T12:12:08.057 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ibmasm/ 2023-11-08T12:12:08.057 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-08T12:12:08.057 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ics932s401.ko 2023-11-08T12:12:08.058 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/isl29003.ko 2023-11-08T12:12:08.058 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/isl29020.ko 2023-11-08T12:12:08.058 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/ 2023-11-08T12:12:08.059 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-08T12:12:08.059 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-08T12:12:08.059 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/ 2023-11-08T12:12:08.059 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 125209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei-me.ko 2023-11-08T12:12:08.059 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei-txe.ko 2023-11-08T12:12:08.060 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 310113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei.ko 2023-11-08T12:12:08.060 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/phantom.ko 2023-11-08T12:12:08.060 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ti-st/ 2023-11-08T12:12:08.060 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-08T12:12:08.060 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tifm_7xx1.ko 2023-11-08T12:12:08.061 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tifm_core.ko 2023-11-08T12:12:08.061 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tsl2550.ko 2023-11-08T12:12:08.061 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_balloon.ko 2023-11-08T12:12:08.062 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_vmci/ 2023-11-08T12:12:08.062 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 183609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-08T12:12:08.062 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ 2023-11-08T12:12:08.063 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/bonding/ 2023-11-08T12:12:08.063 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 490129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/bonding/bonding.ko 2023-11-08T12:12:08.063 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/ 2023-11-08T12:12:08.064 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/b53/ 2023-11-08T12:12:08.064 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 106033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-08T12:12:08.064 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-08T12:12:08.064 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-08T12:12:08.065 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-08T12:12:08.065 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 453737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-08T12:12:08.065 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dummy.ko 2023-11-08T12:12:08.066 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/eql.ko 2023-11-08T12:12:08.066 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ 2023-11-08T12:12:08.066 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/ 2023-11-08T12:12:08.067 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-08T12:12:08.067 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-08T12:12:08.067 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 130553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-08T12:12:08.068 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-08T12:12:08.068 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/ 2023-11-08T12:12:08.068 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-08T12:12:08.068 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-08T12:12:08.069 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-08T12:12:08.069 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 99113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-08T12:12:08.069 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/adaptec/ 2023-11-08T12:12:08.070 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-08T12:12:08.070 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/agere/ 2023-11-08T12:12:08.070 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-08T12:12:08.070 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/alteon/ 2023-11-08T12:12:08.070 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-08T12:12:08.071 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/altera/ 2023-11-08T12:12:08.071 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-08T12:12:08.071 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/ 2023-11-08T12:12:08.071 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-08T12:12:08.071 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-08T12:12:08.072 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-08T12:12:08.072 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/ 2023-11-08T12:12:08.072 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-08T12:12:08.072 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-08T12:12:08.072 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-08T12:12:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 104673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-08T12:12:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-08T12:12:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-08T12:12:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-08T12:12:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-08T12:12:08.073 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-08T12:12:08.074 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/ 2023-11-08T12:12:08.074 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-08T12:12:08.074 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 176761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-08T12:12:08.074 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-08T12:12:08.074 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1421497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-08T12:12:08.075 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 128569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-08T12:12:08.075 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-08T12:12:08.075 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 132089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-08T12:12:08.075 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 312081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-08T12:12:08.075 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/ 2023-11-08T12:12:08.076 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-08T12:12:08.076 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 323513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-08T12:12:08.076 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/ 2023-11-08T12:12:08.076 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-08T12:12:08.076 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 193497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-08T12:12:08.077 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-08T12:12:08.077 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 347417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-08T12:12:08.077 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-08T12:12:08.077 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1044433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-08T12:12:08.077 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-08T12:12:08.078 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 166193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-08T12:12:08.078 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-08T12:12:08.078 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-08T12:12:08.078 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/ 2023-11-08T12:12:08.078 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-08T12:12:08.079 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 204345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-08T12:12:08.079 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/ 2023-11-08T12:12:08.079 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-08T12:12:08.079 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-08T12:12:08.079 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-08T12:12:08.080 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 141225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-08T12:12:08.080 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-08T12:12:08.080 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-08T12:12:08.080 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-08T12:12:08.080 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/ 2023-11-08T12:12:08.080 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-08T12:12:08.081 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-08T12:12:08.081 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dnet.ko 2023-11-08T12:12:08.081 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-08T12:12:08.081 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/ 2023-11-08T12:12:08.081 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-08T12:12:08.082 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 281137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-08T12:12:08.082 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ethoc.ko 2023-11-08T12:12:08.082 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fealnx.ko 2023-11-08T12:12:08.083 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fujitsu/ 2023-11-08T12:12:08.083 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-08T12:12:08.083 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ 2023-11-08T12:12:08.084 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-08T12:12:08.084 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-08T12:12:08.084 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 295577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-08T12:12:08.084 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-08T12:12:08.085 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 584497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-08T12:12:08.085 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-08T12:12:08.085 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 246209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-08T12:12:08.086 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-08T12:12:08.086 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 925697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-08T12:12:08.185 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-08T12:12:08.185 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 302849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-08T12:12:08.185 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igb/ 2023-11-08T12:12:08.185 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 514681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-08T12:12:08.186 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-08T12:12:08.186 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 93593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-08T12:12:08.186 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-08T12:12:08.186 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 734305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-08T12:12:08.186 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-08T12:12:08.187 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 151769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-08T12:12:08.187 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 86921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/jme.ko 2023-11-08T12:12:08.187 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/ 2023-11-08T12:12:08.187 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-08T12:12:08.187 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-08T12:12:08.188 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 122649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-08T12:12:08.188 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/ 2023-11-08T12:12:08.188 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-08T12:12:08.188 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 727601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-08T12:12:08.188 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 278937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-08T12:12:08.188 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-08T12:12:08.189 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-08T12:12:08.189 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1113993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-08T12:12:08.189 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ 2023-11-08T12:12:08.189 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-08T12:12:08.189 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-08T12:12:08.190 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-08T12:12:08.190 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 95665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-08T12:12:08.190 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/ 2023-11-08T12:12:08.190 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-08T12:12:08.190 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-08T12:12:08.191 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/ 2023-11-08T12:12:08.191 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-08T12:12:08.191 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-08T12:12:08.191 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/neterion/ 2023-11-08T12:12:08.191 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 150905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-08T12:12:08.192 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/nvidia/ 2023-11-08T12:12:08.192 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 136721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-08T12:12:08.192 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/ 2023-11-08T12:12:08.192 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-08T12:12:08.192 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-08T12:12:08.193 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/ 2023-11-08T12:12:08.193 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-08T12:12:08.193 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 227897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-08T12:12:08.193 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-08T12:12:08.193 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-08T12:12:08.194 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 672049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-08T12:12:08.194 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/rdc/ 2023-11-08T12:12:08.194 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-08T12:12:08.194 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/ 2023-11-08T12:12:08.194 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-08T12:12:08.195 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-08T12:12:08.195 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-08T12:12:08.195 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 189801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-08T12:12:08.195 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/ 2023-11-08T12:12:08.195 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-08T12:12:08.196 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 104241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-08T12:12:08.196 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sfc/ 2023-11-08T12:12:08.196 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1053921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-08T12:12:08.196 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/silan/ 2023-11-08T12:12:08.196 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-08T12:12:08.196 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/ 2023-11-08T12:12:08.197 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-08T12:12:08.197 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-08T12:12:08.197 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/ 2023-11-08T12:12:08.197 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-08T12:12:08.197 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-08T12:12:08.198 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-08T12:12:08.198 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-08T12:12:08.198 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/ 2023-11-08T12:12:08.198 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-08T12:12:08.198 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-08T12:12:08.199 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-08T12:12:08.199 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-08T12:12:08.199 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 486961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-08T12:12:08.199 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/ 2023-11-08T12:12:08.199 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-08T12:12:08.200 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 166161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-08T12:12:08.200 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-08T12:12:08.200 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-08T12:12:08.200 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/tehuti/ 2023-11-08T12:12:08.200 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-08T12:12:08.200 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ti/ 2023-11-08T12:12:08.201 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 86529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-08T12:12:08.201 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/ 2023-11-08T12:12:08.201 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-08T12:12:08.201 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-08T12:12:08.201 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/ 2023-11-08T12:12:08.202 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-08T12:12:08.202 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-08T12:12:08.202 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/xircom/ 2023-11-08T12:12:08.202 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-08T12:12:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/ 2023-11-08T12:12:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/defxx.ko 2023-11-08T12:12:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/skfp/ 2023-11-08T12:12:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 216985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-08T12:12:08.203 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/geneve.ko 2023-11-08T12:12:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/hyperv/ 2023-11-08T12:12:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 235521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-08T12:12:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ieee802154/ 2023-11-08T12:12:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-08T12:12:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ifb.ko 2023-11-08T12:12:08.204 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ipvlan/ 2023-11-08T12:12:08.205 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 83769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-08T12:12:08.205 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/macvlan.ko 2023-11-08T12:12:08.205 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/macvtap.ko 2023-11-08T12:12:08.205 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/ 2023-11-08T12:12:08.205 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-08T12:12:08.205 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-08T12:12:08.206 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-08T12:12:08.206 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-08T12:12:08.206 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio.ko 2023-11-08T12:12:08.206 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mii.ko 2023-11-08T12:12:08.206 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/netconsole.ko 2023-11-08T12:12:08.207 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/nlmon.ko 2023-11-08T12:12:08.207 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/ 2023-11-08T12:12:08.207 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-08T12:12:08.207 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-08T12:12:08.207 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/ 2023-11-08T12:12:08.208 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/amd.ko 2023-11-08T12:12:08.208 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-08T12:12:08.208 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-08T12:12:08.208 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm87xx.ko 2023-11-08T12:12:08.208 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/broadcom.ko 2023-11-08T12:12:08.209 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/cicada.ko 2023-11-08T12:12:08.209 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/davicom.ko 2023-11-08T12:12:08.209 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/et1011c.ko 2023-11-08T12:12:08.209 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/icplus.ko 2023-11-08T12:12:08.209 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/lxt.ko 2023-11-08T12:12:08.210 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 82049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/marvell.ko 2023-11-08T12:12:08.210 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 76177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/micrel.ko 2023-11-08T12:12:08.210 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/national.ko 2023-11-08T12:12:08.210 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/phylink.ko 2023-11-08T12:12:08.210 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/qsemi.ko 2023-11-08T12:12:08.211 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/realtek.ko 2023-11-08T12:12:08.211 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/smsc.ko 2023-11-08T12:12:08.211 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/ste10Xp.ko 2023-11-08T12:12:08.211 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/vitesse.ko 2023-11-08T12:12:08.211 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/plip/ 2023-11-08T12:12:08.212 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/plip/plip.ko 2023-11-08T12:12:08.212 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ 2023-11-08T12:12:08.212 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-08T12:12:08.212 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_async.ko 2023-11-08T12:12:08.212 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-08T12:12:08.212 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-08T12:12:08.213 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-08T12:12:08.213 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pppoe.ko 2023-11-08T12:12:08.213 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pppox.ko 2023-11-08T12:12:08.213 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pptp.ko 2023-11-08T12:12:08.213 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/sb1000.ko 2023-11-08T12:12:08.214 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/slip/ 2023-11-08T12:12:08.214 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/slip/slip.ko 2023-11-08T12:12:08.214 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/sungem_phy.ko 2023-11-08T12:12:08.214 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/tap.ko 2023-11-08T12:12:08.214 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/ 2023-11-08T12:12:08.215 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 106169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team.ko 2023-11-08T12:12:08.215 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-08T12:12:08.215 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-08T12:12:08.215 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-08T12:12:08.215 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_random.ko 2023-11-08T12:12:08.216 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-08T12:12:08.216 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/veth.ko 2023-11-08T12:12:08.216 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vmxnet3/ 2023-11-08T12:12:08.216 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 144297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-08T12:12:08.216 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vxlan/ 2023-11-08T12:12:08.216 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 297329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vxlan/vxlan.ko 2023-11-08T12:12:08.217 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/xen-netback/ 2023-11-08T12:12:08.217 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 144649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-08T12:12:08.217 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ntb/ 2023-11-08T12:12:08.217 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ntb/ntb.ko 2023-11-08T12:12:08.217 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/ 2023-11-08T12:12:08.218 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/ 2023-11-08T12:12:08.218 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 264937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/nvme-core.ko 2023-11-08T12:12:08.218 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/nvme.ko 2023-11-08T12:12:08.218 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/ 2023-11-08T12:12:08.218 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 133841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport.ko 2023-11-08T12:12:08.219 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_cs.ko 2023-11-08T12:12:08.219 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_pc.ko 2023-11-08T12:12:08.219 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_serial.ko 2023-11-08T12:12:08.219 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/ 2023-11-08T12:12:08.219 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/ 2023-11-08T12:12:08.220 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-08T12:12:08.220 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-08T12:12:08.220 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-08T12:12:08.220 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/pci-stub.ko 2023-11-08T12:12:08.220 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/xen-pcifront.ko 2023-11-08T12:12:08.221 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/ 2023-11-08T12:12:08.221 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/i82092.ko 2023-11-08T12:12:08.221 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 145809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia.ko 2023-11-08T12:12:08.221 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-08T12:12:08.221 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-08T12:12:08.221 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pd6729.ko 2023-11-08T12:12:08.222 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 112889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-08T12:12:08.222 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/ 2023-11-08T12:12:08.222 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/broadcom/ 2023-11-08T12:12:08.222 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-08T12:12:08.222 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/samsung/ 2023-11-08T12:12:08.223 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-08T12:12:08.223 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/ 2023-11-08T12:12:08.223 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/intel/ 2023-11-08T12:12:08.223 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-08T12:12:08.223 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/ 2023-11-08T12:12:08.224 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/ 2023-11-08T12:12:08.224 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-08T12:12:08.224 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-08T12:12:08.224 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-08T12:12:08.224 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-08T12:12:08.225 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-08T12:12:08.225 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-08T12:12:08.225 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-08T12:12:08.225 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/ 2023-11-08T12:12:08.225 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-08T12:12:08.226 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/acerhdf.ko 2023-11-08T12:12:08.226 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-08T12:12:08.226 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-08T12:12:08.226 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-08T12:12:08.226 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 127569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-08T12:12:08.227 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-08T12:12:08.227 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-08T12:12:08.227 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-08T12:12:08.227 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-08T12:12:08.227 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-08T12:12:08.227 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/hdaps.ko 2023-11-08T12:12:08.228 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-08T12:12:08.228 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/ 2023-11-08T12:12:08.228 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-08T12:12:08.228 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-08T12:12:08.228 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel_ips.ko 2023-11-08T12:12:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-08T12:12:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-08T12:12:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-08T12:12:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-08T12:12:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-08T12:12:08.229 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-08T12:12:08.230 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-08T12:12:08.230 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-08T12:12:08.230 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-08T12:12:08.230 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/wmi.ko 2023-11-08T12:12:08.230 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/ 2023-11-08T12:12:08.231 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ 2023-11-08T12:12:08.231 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-08T12:12:08.231 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-08T12:12:08.231 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-08T12:12:08.231 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-08T12:12:08.232 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-08T12:12:08.232 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-08T12:12:08.232 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/da9030_battery.ko 2023-11-08T12:12:08.232 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/da9052-battery.ko 2023-11-08T12:12:08.232 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-08T12:12:08.233 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-08T12:12:08.233 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-08T12:12:08.233 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-08T12:12:08.233 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/gpio-charger.ko 2023-11-08T12:12:08.233 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-08T12:12:08.233 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-08T12:12:08.234 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max14577_charger.ko 2023-11-08T12:12:08.234 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max17040_battery.ko 2023-11-08T12:12:08.234 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max17042_battery.ko 2023-11-08T12:12:08.234 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max8903_charger.ko 2023-11-08T12:12:08.234 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max8925_power.ko 2023-11-08T12:12:08.235 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-08T12:12:08.235 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/sbs-battery.ko 2023-11-08T12:12:08.235 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/test_power.ko 2023-11-08T12:12:08.235 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-08T12:12:08.236 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-08T12:12:08.236 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm831x_power.ko 2023-11-08T12:12:08.236 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm8350_power.ko 2023-11-08T12:12:08.236 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/ 2023-11-08T12:12:08.236 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-08T12:12:08.236 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-08T12:12:08.237 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/ 2023-11-08T12:12:08.237 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/ 2023-11-08T12:12:08.237 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-08T12:12:08.237 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-08T12:12:08.237 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps_parport.ko 2023-11-08T12:12:08.238 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/pps_core.ko 2023-11-08T12:12:08.238 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ 2023-11-08T12:12:08.238 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ptp.ko 2023-11-08T12:12:08.238 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ptp_kvm.ko 2023-11-08T12:12:08.238 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/ 2023-11-08T12:12:08.239 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-08T12:12:08.239 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-08T12:12:08.239 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-08T12:12:08.239 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9052.ko 2023-11-08T12:12:08.239 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9055.ko 2023-11-08T12:12:08.240 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9063.ko 2023-11-08T12:12:08.240 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-08T12:12:08.240 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-08T12:12:08.240 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-08T12:12:08.240 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-08T12:12:08.240 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-08T12:12:08.241 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-08T12:12:08.241 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-08T12:12:08.241 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-08T12:12:08.241 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-08T12:12:08.241 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-em3027.ko 2023-11-08T12:12:08.242 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-08T12:12:08.242 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-08T12:12:08.242 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-08T12:12:08.242 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-08T12:12:08.242 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-08T12:12:08.243 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-08T12:12:08.243 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-08T12:12:08.243 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-08T12:12:08.243 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max6900.ko 2023-11-08T12:12:08.243 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8907.ko 2023-11-08T12:12:08.243 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8925.ko 2023-11-08T12:12:08.244 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8997.ko 2023-11-08T12:12:08.244 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8998.ko 2023-11-08T12:12:08.244 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-08T12:12:08.244 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-08T12:12:08.244 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-palmas.ko 2023-11-08T12:12:08.245 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-08T12:12:08.245 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-08T12:12:08.245 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-08T12:12:08.245 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-08T12:12:08.245 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-08T12:12:08.246 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-08T12:12:08.246 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-08T12:12:08.246 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-08T12:12:08.246 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-08T12:12:08.246 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-08T12:12:08.247 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-08T12:12:08.247 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-08T12:12:08.247 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-08T12:12:08.247 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-08T12:12:08.247 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-08T12:12:08.247 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-08T12:12:08.248 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-08T12:12:08.248 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-08T12:12:08.248 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-x1205.ko 2023-11-08T12:12:08.248 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ 2023-11-08T12:12:08.248 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-9xxx.ko 2023-11-08T12:12:08.249 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-sas.ko 2023-11-08T12:12:08.249 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-xxxx.ko 2023-11-08T12:12:08.249 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 135185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/BusLogic.ko 2023-11-08T12:12:08.249 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/a100u2w.ko 2023-11-08T12:12:08.249 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aacraid/ 2023-11-08T12:12:08.250 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 272305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-08T12:12:08.250 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 100617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/advansys.ko 2023-11-08T12:12:08.250 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/ 2023-11-08T12:12:08.250 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 356265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-08T12:12:08.250 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 295801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-08T12:12:08.251 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic94xx/ 2023-11-08T12:12:08.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 189185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-08T12:12:08.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/am53c974.ko 2023-11-08T12:12:08.251 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/arcmsr/ 2023-11-08T12:12:08.251 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 106881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-08T12:12:08.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/atp870u.ko 2023-11-08T12:12:08.252 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/be2iscsi/ 2023-11-08T12:12:08.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 246985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-08T12:12:08.252 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bfa/ 2023-11-08T12:12:08.252 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1171945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bfa/bfa.ko 2023-11-08T12:12:08.252 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2fc/ 2023-11-08T12:12:08.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 237273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-08T12:12:08.253 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2i/ 2023-11-08T12:12:08.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-08T12:12:08.253 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ch.ko 2023-11-08T12:12:08.253 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/csiostor/ 2023-11-08T12:12:08.254 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 308921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-08T12:12:08.254 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/ 2023-11-08T12:12:08.254 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-08T12:12:08.254 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 76145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-08T12:12:08.254 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-08T12:12:08.255 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-08T12:12:08.255 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 146689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-08T12:12:08.255 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/dc395x.ko 2023-11-08T12:12:08.255 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/dmx3191d.ko 2023-11-08T12:12:08.255 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esas2r/ 2023-11-08T12:12:08.255 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 212425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-08T12:12:08.256 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esp_scsi.ko 2023-11-08T12:12:08.256 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/ 2023-11-08T12:12:08.256 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-08T12:12:08.256 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 158505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-08T12:12:08.256 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fdomain.ko 2023-11-08T12:12:08.257 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fnic/ 2023-11-08T12:12:08.257 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 263489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fnic/fnic.ko 2023-11-08T12:12:08.257 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 201817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hpsa.ko 2023-11-08T12:12:08.257 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hptiop.ko 2023-11-08T12:12:08.257 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hv_storvsc.ko 2023-11-08T12:12:08.258 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/imm.ko 2023-11-08T12:12:08.258 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/initio.ko 2023-11-08T12:12:08.258 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 266537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ipr.ko 2023-11-08T12:12:08.258 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ips.ko 2023-11-08T12:12:08.258 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/isci/ 2023-11-08T12:12:08.259 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 317153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/isci/isci.ko 2023-11-08T12:12:08.259 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-08T12:12:08.259 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-08T12:12:08.261 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libfc/ 2023-11-08T12:12:08.261 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 314865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libfc/libfc.ko 2023-11-08T12:12:08.262 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 145585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libiscsi.ko 2023-11-08T12:12:08.262 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-08T12:12:08.262 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libsas/ 2023-11-08T12:12:08.262 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 216665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libsas/libsas.ko 2023-11-08T12:12:08.262 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/lpfc/ 2023-11-08T12:12:08.263 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2197249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-08T12:12:08.263 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/ 2023-11-08T12:12:08.263 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-08T12:12:08.263 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-08T12:12:08.263 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 310617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-08T12:12:08.264 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 84721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid.ko 2023-11-08T12:12:08.264 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mpt3sas/ 2023-11-08T12:12:08.264 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 659777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-08T12:12:08.264 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvsas/ 2023-11-08T12:12:08.264 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 119561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-08T12:12:08.265 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvumi.ko 2023-11-08T12:12:08.265 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/ 2023-11-08T12:12:08.265 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-08T12:12:08.265 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-08T12:12:08.265 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-08T12:12:08.265 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-08T12:12:08.266 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pm8001/ 2023-11-08T12:12:08.266 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 364105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-08T12:12:08.266 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 123617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pmcraid.ko 2023-11-08T12:12:08.266 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ppa.ko 2023-11-08T12:12:08.266 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla1280.ko 2023-11-08T12:12:08.267 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/ 2023-11-08T12:12:08.267 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1876625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-08T12:12:08.267 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-08T12:12:08.267 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla4xxx/ 2023-11-08T12:12:08.267 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 559033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-08T12:12:08.268 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qlogicfas408.ko 2023-11-08T12:12:08.268 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/raid_class.ko 2023-11-08T12:12:08.268 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 238825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_debug.ko 2023-11-08T12:12:08.268 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 173937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-08T12:12:08.268 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 279313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-08T12:12:08.269 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 97729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-08T12:12:08.269 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-08T12:12:08.269 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-08T12:12:08.269 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ses.ko 2023-11-08T12:12:08.269 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 115889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/st.ko 2023-11-08T12:12:08.270 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/stex.ko 2023-11-08T12:12:08.270 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-08T12:12:08.270 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 162121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-08T12:12:08.270 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/virtio_scsi.ko 2023-11-08T12:12:08.270 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-08T12:12:08.271 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/wd719x.ko 2023-11-08T12:12:08.271 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/xen-scsifront.ko 2023-11-08T12:12:08.271 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ssb/ 2023-11-08T12:12:08.271 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 129441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ssb/ssb.ko 2023-11-08T12:12:08.271 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/ 2023-11-08T12:12:08.271 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/iscsi/ 2023-11-08T12:12:08.272 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 736601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-08T12:12:08.272 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/loopback/ 2023-11-08T12:12:08.272 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-08T12:12:08.272 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_file.ko 2023-11-08T12:12:08.272 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_iblock.ko 2023-11-08T12:12:08.272 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 930321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_mod.ko 2023-11-08T12:12:08.273 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_pscsi.ko 2023-11-08T12:12:08.273 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 122521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_user.ko 2023-11-08T12:12:08.273 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/tcm_fc/ 2023-11-08T12:12:08.273 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-08T12:12:08.274 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/ 2023-11-08T12:12:08.274 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/ 2023-11-08T12:12:08.274 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-08T12:12:08.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-08T12:12:08.274 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-08T12:12:08.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-08T12:12:08.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-08T12:12:08.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-08T12:12:08.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-08T12:12:08.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-08T12:12:08.275 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-08T12:12:08.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-08T12:12:08.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-08T12:12:08.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-08T12:12:08.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-08T12:12:08.276 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-08T12:12:08.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-08T12:12:08.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-08T12:12:08.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-08T12:12:08.277 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ 2023-11-08T12:12:08.277 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ipwireless/ 2023-11-08T12:12:08.277 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-08T12:12:08.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/moxa.ko 2023-11-08T12:12:08.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 50953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/mxser.ko 2023-11-08T12:12:08.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/n_gsm.ko 2023-11-08T12:12:08.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/n_hdlc.ko 2023-11-08T12:12:08.278 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/nozomi.ko 2023-11-08T12:12:08.279 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/ 2023-11-08T12:12:08.279 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/ 2023-11-08T12:12:08.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-08T12:12:08.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-08T12:12:08.279 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-08T12:12:08.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/altera_uart.ko 2023-11-08T12:12:08.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/arc_uart.ko 2023-11-08T12:12:08.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-08T12:12:08.280 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/jsm/ 2023-11-08T12:12:08.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-08T12:12:08.280 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/rp2.ko 2023-11-08T12:12:08.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-08T12:12:08.281 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/ 2023-11-08T12:12:08.281 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/core/ 2023-11-08T12:12:08.281 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 531265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-08T12:12:08.281 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ 2023-11-08T12:12:08.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-08T12:12:08.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-08T12:12:08.282 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/ 2023-11-08T12:12:08.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio.ko 2023-11-08T12:12:08.282 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_aec.ko 2023-11-08T12:12:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_cif.ko 2023-11-08T12:12:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-08T12:12:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_mf624.ko 2023-11-08T12:12:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_netx.ko 2023-11-08T12:12:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_pci_generic.ko 2023-11-08T12:12:08.283 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-08T12:12:08.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_sercos3.ko 2023-11-08T12:12:08.284 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/ 2023-11-08T12:12:08.284 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/c67x00/ 2023-11-08T12:12:08.284 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-08T12:12:08.284 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ 2023-11-08T12:12:08.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 144377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-08T12:12:08.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-08T12:12:08.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-08T12:12:08.285 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-08T12:12:08.285 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/ 2023-11-08T12:12:08.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/cdc-acm.ko 2023-11-08T12:12:08.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-08T12:12:08.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/usblp.ko 2023-11-08T12:12:08.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/usbtmc.ko 2023-11-08T12:12:08.286 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/common/ 2023-11-08T12:12:08.286 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/common/ulpi.ko 2023-11-08T12:12:08.287 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc2/ 2023-11-08T12:12:08.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-08T12:12:08.287 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/ 2023-11-08T12:12:08.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-08T12:12:08.287 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-08T12:12:08.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 444553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-08T12:12:08.288 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/ 2023-11-08T12:12:08.288 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/ 2023-11-08T12:12:08.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-08T12:12:08.288 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-08T12:12:08.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-08T12:12:08.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-08T12:12:08.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-08T12:12:08.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-08T12:12:08.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 92489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-08T12:12:08.289 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-08T12:12:08.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 122081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-08T12:12:08.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-08T12:12:08.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-08T12:12:08.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-08T12:12:08.290 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-08T12:12:08.291 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-08T12:12:08.291 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-08T12:12:08.291 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-08T12:12:08.291 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-08T12:12:08.291 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/ 2023-11-08T12:12:08.292 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-08T12:12:08.292 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-08T12:12:08.292 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-08T12:12:08.292 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-08T12:12:08.292 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-08T12:12:08.292 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-08T12:12:08.293 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-08T12:12:08.293 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-08T12:12:08.293 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-08T12:12:08.293 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-08T12:12:08.293 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-08T12:12:08.294 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-08T12:12:08.294 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 62185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-08T12:12:08.294 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-08T12:12:08.294 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 161225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-08T12:12:08.294 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/ 2023-11-08T12:12:08.295 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-08T12:12:08.295 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-08T12:12:08.295 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 157681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-08T12:12:08.295 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-08T12:12:08.295 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-08T12:12:08.296 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 69705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-08T12:12:08.296 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-08T12:12:08.296 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 76057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-08T12:12:08.296 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-08T12:12:08.296 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 73169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-08T12:12:08.296 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 65809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-08T12:12:08.297 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-08T12:12:08.297 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-08T12:12:08.297 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 156073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-08T12:12:08.297 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/ 2023-11-08T12:12:08.297 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-08T12:12:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-08T12:12:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 87353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-08T12:12:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-08T12:12:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-08T12:12:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/sl811_cs.ko 2023-11-08T12:12:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-08T12:12:08.299 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-08T12:12:08.299 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/ 2023-11-08T12:12:08.299 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/mdc800.ko 2023-11-08T12:12:08.299 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/microtek.ko 2023-11-08T12:12:08.299 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ 2023-11-08T12:12:08.300 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/adutux.ko 2023-11-08T12:12:08.300 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/appledisplay.ko 2023-11-08T12:12:08.300 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-08T12:12:08.300 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/cytherm.ko 2023-11-08T12:12:08.300 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ehset.ko 2023-11-08T12:12:08.300 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/emi26.ko 2023-11-08T12:12:08.301 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/emi62.ko 2023-11-08T12:12:08.301 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ezusb.ko 2023-11-08T12:12:08.301 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/idmouse.ko 2023-11-08T12:12:08.301 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/iowarrior.ko 2023-11-08T12:12:08.301 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-08T12:12:08.301 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ldusb.ko 2023-11-08T12:12:08.302 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/legousbtower.ko 2023-11-08T12:12:08.302 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/lvstest.ko 2023-11-08T12:12:08.302 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/sisusbvga/ 2023-11-08T12:12:08.302 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-08T12:12:08.303 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-08T12:12:08.303 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usb3503.ko 2023-11-08T12:12:08.303 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usblcd.ko 2023-11-08T12:12:08.303 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-08T12:12:08.303 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usbtest.ko 2023-11-08T12:12:08.303 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/uss720.ko 2023-11-08T12:12:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/yurex.ko 2023-11-08T12:12:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/mon/ 2023-11-08T12:12:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/mon/usbmon.ko 2023-11-08T12:12:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/musb/ 2023-11-08T12:12:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 301545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-08T12:12:08.304 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/ 2023-11-08T12:12:08.305 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-generic.ko 2023-11-08T12:12:08.305 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-08T12:12:08.305 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-08T12:12:08.305 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-08T12:12:08.305 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ 2023-11-08T12:12:08.306 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/aircable.ko 2023-11-08T12:12:08.306 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ark3116.ko 2023-11-08T12:12:08.306 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-08T12:12:08.306 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ch341.ko 2023-11-08T12:12:08.306 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cp210x.ko 2023-11-08T12:12:08.307 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cyberjack.ko 2023-11-08T12:12:08.307 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-08T12:12:08.307 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-08T12:12:08.307 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/empeg.ko 2023-11-08T12:12:08.307 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/f81232.ko 2023-11-08T12:12:08.307 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 175137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-08T12:12:08.308 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-08T12:12:08.308 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 137081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-08T12:12:08.308 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 124833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/io_ti.ko 2023-11-08T12:12:08.308 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ipaq.ko 2023-11-08T12:12:08.308 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ipw.ko 2023-11-08T12:12:08.309 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ir-usb.ko 2023-11-08T12:12:08.309 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-08T12:12:08.309 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 107521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/keyspan.ko 2023-11-08T12:12:08.309 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-08T12:12:08.309 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-08T12:12:08.309 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-08T12:12:08.310 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mct_u232.ko 2023-11-08T12:12:08.310 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/metro-usb.ko 2023-11-08T12:12:08.310 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mos7720.ko 2023-11-08T12:12:08.310 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 78217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mos7840.ko 2023-11-08T12:12:08.310 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mxuport.ko 2023-11-08T12:12:08.310 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/navman.ko 2023-11-08T12:12:08.311 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/omninet.ko 2023-11-08T12:12:08.311 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/opticon.ko 2023-11-08T12:12:08.311 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 190633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/option.ko 2023-11-08T12:12:08.311 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/oti6858.ko 2023-11-08T12:12:08.311 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/pl2303.ko 2023-11-08T12:12:08.312 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/qcaux.ko 2023-11-08T12:12:08.312 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/qcserial.ko 2023-11-08T12:12:08.312 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/quatech2.ko 2023-11-08T12:12:08.312 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/safe_serial.ko 2023-11-08T12:12:08.312 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 51625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/sierra.ko 2023-11-08T12:12:08.312 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-08T12:12:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ssu100.ko 2023-11-08T12:12:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/symbolserial.ko 2023-11-08T12:12:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-08T12:12:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-08T12:12:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb_debug.ko 2023-11-08T12:12:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-08T12:12:08.314 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 125609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usbserial.ko 2023-11-08T12:12:08.314 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/visor.ko 2023-11-08T12:12:08.314 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/whiteheat.ko 2023-11-08T12:12:08.314 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-08T12:12:08.314 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-08T12:12:08.315 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ 2023-11-08T12:12:08.315 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 52913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/uas.ko 2023-11-08T12:12:08.315 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-08T12:12:08.315 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-08T12:12:08.315 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-08T12:12:08.316 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-08T12:12:08.316 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-08T12:12:08.316 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-08T12:12:08.316 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-08T12:12:08.316 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-karma.ko 2023-11-08T12:12:08.317 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-08T12:12:08.317 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-08T12:12:08.317 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-08T12:12:08.317 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-08T12:12:08.317 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-08T12:12:08.317 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 179969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/usb-storage.ko 2023-11-08T12:12:08.318 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/ 2023-11-08T12:12:08.318 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-08T12:12:08.318 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-08T12:12:08.318 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 107001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-08T12:12:08.318 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/ 2023-11-08T12:12:08.319 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/ 2023-11-08T12:12:08.319 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 154297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-08T12:12:08.319 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-08T12:12:08.319 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/vfio.ko 2023-11-08T12:12:08.319 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 77609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-08T12:12:08.320 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/ 2023-11-08T12:12:08.320 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 113873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost.ko 2023-11-08T12:12:08.320 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-08T12:12:08.320 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 58089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_net.ko 2023-11-08T12:12:08.320 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_scsi.ko 2023-11-08T12:12:08.320 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/ 2023-11-08T12:12:08.321 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/ 2023-11-08T12:12:08.321 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-08T12:12:08.321 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-08T12:12:08.321 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-08T12:12:08.321 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-08T12:12:08.322 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-08T12:12:08.322 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/apple_bl.ko 2023-11-08T12:12:08.322 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-08T12:12:08.322 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/bd6107.ko 2023-11-08T12:12:08.322 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-08T12:12:08.323 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-08T12:12:08.323 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-08T12:12:08.323 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-08T12:12:08.323 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lcd.ko 2023-11-08T12:12:08.323 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-08T12:12:08.323 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-08T12:12:08.324 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-08T12:12:08.324 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-08T12:12:08.324 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-08T12:12:08.324 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-08T12:12:08.324 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-08T12:12:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-08T12:12:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/ 2023-11-08T12:12:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ 2023-11-08T12:12:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ds2482.ko 2023-11-08T12:12:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ds2490.ko 2023-11-08T12:12:08.326 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-08T12:12:08.326 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-08T12:12:08.326 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/ 2023-11-08T12:12:08.326 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-08T12:12:08.326 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-08T12:12:08.327 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-08T12:12:08.327 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-08T12:12:08.327 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-08T12:12:08.327 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-08T12:12:08.327 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-08T12:12:08.327 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-08T12:12:08.328 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-08T12:12:08.328 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-08T12:12:08.328 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 56425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-08T12:12:08.328 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/wire.ko 2023-11-08T12:12:08.328 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ 2023-11-08T12:12:08.329 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/acquirewdt.ko 2023-11-08T12:12:08.329 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/advantechwdt.ko 2023-11-08T12:12:08.329 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-08T12:12:08.329 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-08T12:12:08.329 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-08T12:12:08.330 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-08T12:12:08.330 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-08T12:12:08.330 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-08T12:12:08.330 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/dw_wdt.ko 2023-11-08T12:12:08.330 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-08T12:12:08.331 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-08T12:12:08.331 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/hpwdt.ko 2023-11-08T12:12:08.331 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/i6300esb.ko 2023-11-08T12:12:08.331 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-08T12:12:08.331 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-08T12:12:08.331 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ib700wdt.ko 2023-11-08T12:12:08.332 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ibmasr.ko 2023-11-08T12:12:08.332 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-08T12:12:08.332 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-08T12:12:08.332 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/it87_wdt.ko 2023-11-08T12:12:08.332 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-08T12:12:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/machzwd.ko 2023-11-08T12:12:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-08T12:12:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-08T12:12:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/nv_tco.ko 2023-11-08T12:12:08.333 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-08T12:12:08.334 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22265 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-08T12:12:08.334 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-08T12:12:08.334 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-08T12:12:08.334 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/retu_wdt.ko 2023-11-08T12:12:08.334 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-08T12:12:08.335 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-08T12:12:08.335 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-08T12:12:08.335 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-08T12:12:08.335 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-08T12:12:08.335 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-08T12:12:08.335 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/softdog.ko 2023-11-08T12:12:08.336 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-08T12:12:08.336 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-08T12:12:08.336 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/via_wdt.ko 2023-11-08T12:12:08.336 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-08T12:12:08.336 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-08T12:12:08.337 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-08T12:12:08.337 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-08T12:12:08.337 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wdt_pci.ko 2023-11-08T12:12:08.337 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-08T12:12:08.337 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-08T12:12:08.337 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/xen_wdt.ko 2023-11-08T12:12:08.338 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/ 2023-11-08T12:12:08.338 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-evtchn.ko 2023-11-08T12:12:08.338 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-gntalloc.ko 2023-11-08T12:12:08.338 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-gntdev.ko 2023-11-08T12:12:08.338 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-pciback/ 2023-11-08T12:12:08.339 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 176441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-08T12:12:08.339 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-privcmd.ko 2023-11-08T12:12:08.339 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 71249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-scsiback.ko 2023-11-08T12:12:08.339 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xenfs/ 2023-11-08T12:12:08.339 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-08T12:12:08.340 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ 2023-11-08T12:12:08.340 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/9p/ 2023-11-08T12:12:08.340 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 166425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/9p/9p.ko 2023-11-08T12:12:08.340 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/adfs/ 2023-11-08T12:12:08.340 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/adfs/adfs.ko 2023-11-08T12:12:08.341 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/affs/ 2023-11-08T12:12:08.341 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 163593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/affs/affs.ko 2023-11-08T12:12:08.341 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/afs/ 2023-11-08T12:12:08.341 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 932817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/afs/kafs.ko 2023-11-08T12:12:08.341 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/autofs/ 2023-11-08T12:12:08.341 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/autofs/autofs4.ko 2023-11-08T12:12:08.342 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/befs/ 2023-11-08T12:12:08.342 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 64545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/befs/befs.ko 2023-11-08T12:12:08.342 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/bfs/ 2023-11-08T12:12:08.342 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/bfs/bfs.ko 2023-11-08T12:12:08.342 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/binfmt_misc.ko 2023-11-08T12:12:08.343 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/btrfs/ 2023-11-08T12:12:08.343 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 3402585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/btrfs/btrfs.ko 2023-11-08T12:12:08.343 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cachefiles/ 2023-11-08T12:12:08.343 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 306073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cachefiles/cachefiles.ko 2023-11-08T12:12:08.343 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ceph/ 2023-11-08T12:12:08.344 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1323945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ceph/ceph.ko 2023-11-08T12:12:08.344 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/coda/ 2023-11-08T12:12:08.344 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 100801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/coda/coda.ko 2023-11-08T12:12:08.344 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/configfs/ 2023-11-08T12:12:08.344 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 108393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/configfs/configfs.ko 2023-11-08T12:12:08.344 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cramfs/ 2023-11-08T12:12:08.345 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 29625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cramfs/cramfs.ko 2023-11-08T12:12:08.345 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/dlm/ 2023-11-08T12:12:08.345 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 642577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/dlm/dlm.ko 2023-11-08T12:12:08.345 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/efs/ 2023-11-08T12:12:08.345 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/efs/efs.ko 2023-11-08T12:12:08.346 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/f2fs/ 2023-11-08T12:12:08.346 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1505025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/f2fs/f2fs.ko 2023-11-08T12:12:08.346 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fat/ 2023-11-08T12:12:08.346 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fat/msdos.ko 2023-11-08T12:12:08.346 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/freevxfs/ 2023-11-08T12:12:08.347 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/freevxfs/freevxfs.ko 2023-11-08T12:12:08.347 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fscache/ 2023-11-08T12:12:08.347 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 226481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fscache/fscache.ko 2023-11-08T12:12:08.347 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fuse/ 2023-11-08T12:12:08.347 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fuse/cuse.ko 2023-11-08T12:12:08.347 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/gfs2/ 2023-11-08T12:12:08.348 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1231529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/gfs2/gfs2.ko 2023-11-08T12:12:08.348 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfs/ 2023-11-08T12:12:08.348 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 141209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfs/hfs.ko 2023-11-08T12:12:08.348 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfsplus/ 2023-11-08T12:12:08.348 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 222817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfsplus/hfsplus.ko 2023-11-08T12:12:08.349 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hpfs/ 2023-11-08T12:12:08.349 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 192329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hpfs/hpfs.ko 2023-11-08T12:12:08.349 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/isofs/ 2023-11-08T12:12:08.349 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/isofs/isofs.ko 2023-11-08T12:12:08.349 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/jfs/ 2023-11-08T12:12:08.349 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 419497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/jfs/jfs.ko 2023-11-08T12:12:08.350 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/lockd/ 2023-11-08T12:12:08.350 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 280313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/lockd/lockd.ko 2023-11-08T12:12:08.350 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/minix/ 2023-11-08T12:12:08.350 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/minix/minix.ko 2023-11-08T12:12:08.350 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/netfs/ 2023-11-08T12:12:08.351 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 124649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/netfs/netfs.ko 2023-11-08T12:12:08.351 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/ 2023-11-08T12:12:08.351 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/blocklayout/ 2023-11-08T12:12:08.351 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-08T12:12:08.351 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/filelayout/ 2023-11-08T12:12:08.352 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 59449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-08T12:12:08.352 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/flexfilelayout/ 2023-11-08T12:12:08.352 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 117513 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-08T12:12:08.352 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1055649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfs.ko 2023-11-08T12:12:08.352 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv2.ko 2023-11-08T12:12:08.353 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 120177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv3.ko 2023-11-08T12:12:08.353 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2041689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv4.ko 2023-11-08T12:12:08.353 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/ 2023-11-08T12:12:08.353 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/grace.ko 2023-11-08T12:12:08.353 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/nfs_acl.ko 2023-11-08T12:12:08.354 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfsd/ 2023-11-08T12:12:08.354 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1516809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfsd/nfsd.ko 2023-11-08T12:12:08.354 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nilfs2/ 2023-11-08T12:12:08.354 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 592833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nilfs2/nilfs2.ko 2023-11-08T12:12:08.354 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/ 2023-11-08T12:12:08.355 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-celtic.ko 2023-11-08T12:12:08.355 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-centeuro.ko 2023-11-08T12:12:08.355 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-croatian.ko 2023-11-08T12:12:08.355 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-cyrillic.ko 2023-11-08T12:12:08.355 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-gaelic.ko 2023-11-08T12:12:08.355 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-greek.ko 2023-11-08T12:12:08.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-iceland.ko 2023-11-08T12:12:08.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-inuit.ko 2023-11-08T12:12:08.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-roman.ko 2023-11-08T12:12:08.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-romanian.ko 2023-11-08T12:12:08.356 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-turkish.ko 2023-11-08T12:12:08.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_ascii.ko 2023-11-08T12:12:08.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1250.ko 2023-11-08T12:12:08.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1251.ko 2023-11-08T12:12:08.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1255.ko 2023-11-08T12:12:08.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp737.ko 2023-11-08T12:12:08.357 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp775.ko 2023-11-08T12:12:08.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp850.ko 2023-11-08T12:12:08.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp852.ko 2023-11-08T12:12:08.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp855.ko 2023-11-08T12:12:08.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp857.ko 2023-11-08T12:12:08.358 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp860.ko 2023-11-08T12:12:08.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp861.ko 2023-11-08T12:12:08.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp862.ko 2023-11-08T12:12:08.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp863.ko 2023-11-08T12:12:08.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp864.ko 2023-11-08T12:12:08.359 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp865.ko 2023-11-08T12:12:08.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp866.ko 2023-11-08T12:12:08.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp869.ko 2023-11-08T12:12:08.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp874.ko 2023-11-08T12:12:08.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 94137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp932.ko 2023-11-08T12:12:08.360 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 142673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp936.ko 2023-11-08T12:12:08.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 165745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp949.ko 2023-11-08T12:12:08.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 118121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp950.ko 2023-11-08T12:12:08.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_euc-jp.ko 2023-11-08T12:12:08.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-1.ko 2023-11-08T12:12:08.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-13.ko 2023-11-08T12:12:08.361 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-14.ko 2023-11-08T12:12:08.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-15.ko 2023-11-08T12:12:08.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-2.ko 2023-11-08T12:12:08.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-3.ko 2023-11-08T12:12:08.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-4.ko 2023-11-08T12:12:08.362 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-5.ko 2023-11-08T12:12:08.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-6.ko 2023-11-08T12:12:08.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-7.ko 2023-11-08T12:12:08.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-9.ko 2023-11-08T12:12:08.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-r.ko 2023-11-08T12:12:08.363 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-ru.ko 2023-11-08T12:12:08.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-u.ko 2023-11-08T12:12:08.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-08T12:12:08.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_utf8.ko 2023-11-08T12:12:08.364 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ntfs/ 2023-11-08T12:12:08.364 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 219417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ntfs/ntfs.ko 2023-11-08T12:12:08.364 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ 2023-11-08T12:12:08.365 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/cluster/ 2023-11-08T12:12:08.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 244409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-08T12:12:08.365 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlm/ 2023-11-08T12:12:08.365 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 440737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-08T12:12:08.365 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlmfs/ 2023-11-08T12:12:08.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-08T12:12:08.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2592433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2.ko 2023-11-08T12:12:08.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-08T12:12:08.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-08T12:12:08.366 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-08T12:12:08.367 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/omfs/ 2023-11-08T12:12:08.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/omfs/omfs.ko 2023-11-08T12:12:08.367 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/overlayfs/ 2023-11-08T12:12:08.367 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 352153 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/overlayfs/overlay.ko 2023-11-08T12:12:08.367 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/pstore/ 2023-11-08T12:12:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/pstore/ramoops.ko 2023-11-08T12:12:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx4/ 2023-11-08T12:12:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx4/qnx4.ko 2023-11-08T12:12:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx6/ 2023-11-08T12:12:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 46689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx6/qnx6.ko 2023-11-08T12:12:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/ 2023-11-08T12:12:08.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_tree.ko 2023-11-08T12:12:08.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_v1.ko 2023-11-08T12:12:08.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_v2.ko 2023-11-08T12:12:08.369 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/reiserfs/ 2023-11-08T12:12:08.369 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 532673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/reiserfs/reiserfs.ko 2023-11-08T12:12:08.369 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/romfs/ 2023-11-08T12:12:08.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/romfs/romfs.ko 2023-11-08T12:12:08.370 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/ 2023-11-08T12:12:08.370 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/client/ 2023-11-08T12:12:08.370 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 2668121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/client/cifs.ko 2023-11-08T12:12:08.370 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/ 2023-11-08T12:12:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/cifs_arc4.ko 2023-11-08T12:12:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/cifs_md4.ko 2023-11-08T12:12:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/squashfs/ 2023-11-08T12:12:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 134641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/squashfs/squashfs.ko 2023-11-08T12:12:08.371 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/sysv/ 2023-11-08T12:12:08.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 90721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/sysv/sysv.ko 2023-11-08T12:12:08.372 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/udf/ 2023-11-08T12:12:08.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 247737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/udf/udf.ko 2023-11-08T12:12:08.372 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ufs/ 2023-11-08T12:12:08.372 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 162497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ufs/ufs.ko 2023-11-08T12:12:08.372 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/xfs/ 2023-11-08T12:12:08.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 4010729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/xfs/xfs.ko 2023-11-08T12:12:08.373 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/ 2023-11-08T12:12:08.373 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/locking/ 2023-11-08T12:12:08.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 75489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/locking/locktorture.ko 2023-11-08T12:12:08.373 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/time/ 2023-11-08T12:12:08.373 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/time/test_udelay.ko 2023-11-08T12:12:08.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/torture.ko 2023-11-08T12:12:08.374 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ 2023-11-08T12:12:08.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 6833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc-itu-t.ko 2023-11-08T12:12:08.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 6529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc7.ko 2023-11-08T12:12:08.374 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc8.ko 2023-11-08T12:12:08.375 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/ 2023-11-08T12:12:08.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/libarc4.ko 2023-11-08T12:12:08.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/libdes.ko 2023-11-08T12:12:08.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/interval_tree_test.ko 2023-11-08T12:12:08.375 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/libcrc32c.ko 2023-11-08T12:12:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lru_cache.ko 2023-11-08T12:12:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/ 2023-11-08T12:12:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/lz4_compress.ko 2023-11-08T12:12:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/lz4hc_compress.ko 2023-11-08T12:12:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/math/ 2023-11-08T12:12:08.376 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 6617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/math/cordic.ko 2023-11-08T12:12:08.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/memory-notifier-error-inject.ko 2023-11-08T12:12:08.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/notifier-error-inject.ko 2023-11-08T12:12:08.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/percpu_test.ko 2023-11-08T12:12:08.377 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/pm-notifier-error-inject.ko 2023-11-08T12:12:08.377 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/raid6/ 2023-11-08T12:12:08.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 143433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/raid6/raid6_pq.ko 2023-11-08T12:12:08.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/rbtree_test.ko 2023-11-08T12:12:08.378 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/reed_solomon/ 2023-11-08T12:12:08.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-08T12:12:08.378 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test-kstrtox.ko 2023-11-08T12:12:08.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test-string_helpers.ko 2023-11-08T12:12:08.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 4760425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_bpf.ko 2023-11-08T12:12:08.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_firmware.ko 2023-11-08T12:12:08.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 6369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_module.ko 2023-11-08T12:12:08.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_user_copy.ko 2023-11-08T12:12:08.379 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_bm.ko 2023-11-08T12:12:08.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_fsm.ko 2023-11-08T12:12:08.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_kmp.ko 2023-11-08T12:12:08.380 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/xz/ 2023-11-08T12:12:08.380 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/xz/xz_dec_test.ko 2023-11-08T12:12:08.380 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/mm/ 2023-11-08T12:12:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/mm/hwpoison-inject.ko 2023-11-08T12:12:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ 2023-11-08T12:12:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/ 2023-11-08T12:12:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/6lowpan.ko 2023-11-08T12:12:08.381 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_dest.ko 2023-11-08T12:12:08.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_fragment.ko 2023-11-08T12:12:08.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_hop.ko 2023-11-08T12:12:08.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 6985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-08T12:12:08.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_mobility.ko 2023-11-08T12:12:08.382 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_routing.ko 2023-11-08T12:12:08.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_udp.ko 2023-11-08T12:12:08.383 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/ 2023-11-08T12:12:08.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/garp.ko 2023-11-08T12:12:08.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/mrp.ko 2023-11-08T12:12:08.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/p8022.ko 2023-11-08T12:12:08.383 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/psnap.ko 2023-11-08T12:12:08.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/stp.ko 2023-11-08T12:12:08.384 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/8021q/ 2023-11-08T12:12:08.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 81737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/8021q/8021q.ko 2023-11-08T12:12:08.384 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/ 2023-11-08T12:12:08.384 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 198337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet.ko 2023-11-08T12:12:08.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_fd.ko 2023-11-08T12:12:08.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26345 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_rdma.ko 2023-11-08T12:12:08.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_virtio.ko 2023-11-08T12:12:08.385 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/batman-adv/ 2023-11-08T12:12:08.385 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 649297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/batman-adv/batman-adv.ko 2023-11-08T12:12:08.385 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/ 2023-11-08T12:12:08.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 63809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/br_netfilter.ko 2023-11-08T12:12:08.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 777689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/bridge.ko 2023-11-08T12:12:08.386 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ 2023-11-08T12:12:08.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-08T12:12:08.386 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-08T12:12:08.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-08T12:12:08.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-08T12:12:08.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-08T12:12:08.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-08T12:12:08.387 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-08T12:12:08.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-08T12:12:08.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13217 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-08T12:12:08.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-08T12:12:08.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-08T12:12:08.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8385 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-08T12:12:08.388 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-08T12:12:08.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-08T12:12:08.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-08T12:12:08.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-08T12:12:08.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-08T12:12:08.389 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-08T12:12:08.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-08T12:12:08.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-08T12:12:08.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 55929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtables.ko 2023-11-08T12:12:08.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-08T12:12:08.390 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-08T12:12:08.391 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ceph/ 2023-11-08T12:12:08.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1046857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ceph/libceph.ko 2023-11-08T12:12:08.391 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/core/ 2023-11-08T12:12:08.391 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 125697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/core/pktgen.ko 2023-11-08T12:12:08.391 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/ 2023-11-08T12:12:08.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 194209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp.ko 2023-11-08T12:12:08.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_diag.ko 2023-11-08T12:12:08.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 57881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_ipv4.ko 2023-11-08T12:12:08.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_ipv6.ko 2023-11-08T12:12:08.392 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/ 2023-11-08T12:12:08.392 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 390473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/dsa_core.ko 2023-11-08T12:12:08.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_brcm.ko 2023-11-08T12:12:08.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_dsa.ko 2023-11-08T12:12:08.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_none.ko 2023-11-08T12:12:08.393 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_trailer.ko 2023-11-08T12:12:08.393 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/hsr/ 2023-11-08T12:12:08.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 99729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/hsr/hsr.ko 2023-11-08T12:12:08.394 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ 2023-11-08T12:12:08.394 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/6lowpan/ 2023-11-08T12:12:08.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 45233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-08T12:12:08.394 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 254625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ieee802154.ko 2023-11-08T12:12:08.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-08T12:12:08.395 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ 2023-11-08T12:12:08.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ah4.ko 2023-11-08T12:12:08.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/esp4.ko 2023-11-08T12:12:08.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/fou.ko 2023-11-08T12:12:08.395 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/gre.ko 2023-11-08T12:12:08.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/inet_diag.ko 2023-11-08T12:12:08.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_gre.ko 2023-11-08T12:12:08.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_tunnel.ko 2023-11-08T12:12:08.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_vti.ko 2023-11-08T12:12:08.396 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ipcomp.ko 2023-11-08T12:12:08.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ipip.ko 2023-11-08T12:12:08.397 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ 2023-11-08T12:12:08.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-08T12:12:08.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-08T12:12:08.397 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-08T12:12:08.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-08T12:12:08.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-08T12:12:08.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-08T12:12:08.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-08T12:12:08.398 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-08T12:12:08.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-08T12:12:08.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11305 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-08T12:12:08.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-08T12:12:08.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-08T12:12:08.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-08T12:12:08.399 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-08T12:12:08.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-08T12:12:08.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-08T12:12:08.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-08T12:12:08.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18225 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-08T12:12:08.400 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-08T12:12:08.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-08T12:12:08.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-08T12:12:08.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-08T12:12:08.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-08T12:12:08.401 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-08T12:12:08.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-08T12:12:08.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_bic.ko 2023-11-08T12:12:08.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_dctcp.ko 2023-11-08T12:12:08.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_diag.ko 2023-11-08T12:12:08.402 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_highspeed.ko 2023-11-08T12:12:08.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_htcp.ko 2023-11-08T12:12:08.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_hybla.ko 2023-11-08T12:12:08.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_illinois.ko 2023-11-08T12:12:08.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_lp.ko 2023-11-08T12:12:08.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_scalable.ko 2023-11-08T12:12:08.403 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_vegas.ko 2023-11-08T12:12:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_veno.ko 2023-11-08T12:12:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_westwood.ko 2023-11-08T12:12:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_yeah.ko 2023-11-08T12:12:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tunnel4.ko 2023-11-08T12:12:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/udp_diag.ko 2023-11-08T12:12:08.404 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 41665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/udp_tunnel.ko 2023-11-08T12:12:08.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-08T12:12:08.405 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ 2023-11-08T12:12:08.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ah6.ko 2023-11-08T12:12:08.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/esp6.ko 2023-11-08T12:12:08.405 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/fou6.ko 2023-11-08T12:12:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 80897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_gre.ko 2023-11-08T12:12:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 93577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_tunnel.ko 2023-11-08T12:12:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-08T12:12:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_vti.ko 2023-11-08T12:12:08.406 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ipcomp6.ko 2023-11-08T12:12:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19017 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/mip6.ko 2023-11-08T12:12:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ 2023-11-08T12:12:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-08T12:12:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-08T12:12:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-08T12:12:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-08T12:12:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-08T12:12:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-08T12:12:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-08T12:12:08.408 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-08T12:12:08.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-08T12:12:08.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-08T12:12:08.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-08T12:12:08.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-08T12:12:08.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-08T12:12:08.409 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11121 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-08T12:12:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-08T12:12:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-08T12:12:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-08T12:12:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-08T12:12:08.410 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-08T12:12:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-08T12:12:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-08T12:12:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-08T12:12:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-08T12:12:08.411 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-08T12:12:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9009 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-08T12:12:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 74073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/sit.ko 2023-11-08T12:12:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/tunnel6.ko 2023-11-08T12:12:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-08T12:12:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/key/ 2023-11-08T12:12:08.412 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 82833 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/key/af_key.ko 2023-11-08T12:12:08.413 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/ 2023-11-08T12:12:08.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 125281 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_core.ko 2023-11-08T12:12:08.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-08T12:12:08.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 25953 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_eth.ko 2023-11-08T12:12:08.413 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ip.ko 2023-11-08T12:12:08.414 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36713 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ip6.ko 2023-11-08T12:12:08.414 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_netlink.ko 2023-11-08T12:12:08.414 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 53241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ppp.ko 2023-11-08T12:12:08.414 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/lapb/ 2023-11-08T12:12:08.414 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 47977 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/lapb/lapb.ko 2023-11-08T12:12:08.415 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/ 2023-11-08T12:12:08.415 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/llc.ko 2023-11-08T12:12:08.415 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 267777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/llc2.ko 2023-11-08T12:12:08.415 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mac802154/ 2023-11-08T12:12:08.415 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 290417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mac802154/mac802154.ko 2023-11-08T12:12:08.416 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mpls/ 2023-11-08T12:12:08.416 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mpls/mpls_gso.ko 2023-11-08T12:12:08.416 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ 2023-11-08T12:12:08.416 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ 2023-11-08T12:12:08.416 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 119585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set.ko 2023-11-08T12:12:08.417 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-08T12:12:08.417 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26913 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-08T12:12:08.417 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-08T12:12:08.417 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 100297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-08T12:12:08.417 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 101441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-08T12:12:08.417 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-08T12:12:08.418 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 103481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-08T12:12:08.418 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 112849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-08T12:12:08.418 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 60329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-08T12:12:08.418 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 109593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-08T12:12:08.418 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 113129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-08T12:12:08.419 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 112585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-08T12:12:08.419 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 111585 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-08T12:12:08.419 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 114465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-08T12:12:08.419 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-08T12:12:08.419 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ 2023-11-08T12:12:08.420 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 411729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-08T12:12:08.420 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-08T12:12:08.420 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-08T12:12:08.420 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-08T12:12:08.420 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-08T12:12:08.421 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-08T12:12:08.421 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-08T12:12:08.421 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7689 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-08T12:12:08.421 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10681 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-08T12:12:08.421 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-08T12:12:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-08T12:12:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-08T12:12:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-08T12:12:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10993 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-08T12:12:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conncount.ko 2023-11-08T12:12:08.423 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 408257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack.ko 2023-11-08T12:12:08.423 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-08T12:12:08.423 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-08T12:12:08.423 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33761 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-08T12:12:08.423 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 118145 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-08T12:12:08.423 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-08T12:12:08.424 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-08T12:12:08.424 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 107297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-08T12:12:08.424 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-08T12:12:08.424 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-08T12:12:08.424 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-08T12:12:08.425 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-08T12:12:08.425 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-08T12:12:08.425 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10113 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-08T12:12:08.425 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_flow_table.ko 2023-11-08T12:12:08.425 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9593 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-08T12:12:08.425 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 37129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_log_syslog.ko 2023-11-08T12:12:08.426 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 95417 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat.ko 2023-11-08T12:12:08.426 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-08T12:12:08.426 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-08T12:12:08.426 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11857 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_irc.ko 2023-11-08T12:12:08.426 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28929 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_sip.ko 2023-11-08T12:12:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-08T12:12:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 44065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-08T12:12:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 615313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_tables.ko 2023-11-08T12:12:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 42561 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink.ko 2023-11-08T12:12:08.427 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-08T12:12:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30569 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-08T12:12:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 39785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_log.ko 2023-11-08T12:12:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-08T12:12:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-08T12:12:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10457 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_chain_nat.ko 2023-11-08T12:12:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_compat.ko 2023-11-08T12:12:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 40721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_ct.ko 2023-11-08T12:12:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-08T12:12:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_fib.ko 2023-11-08T12:12:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-08T12:12:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14185 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_hash.ko 2023-11-08T12:12:08.430 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_limit.ko 2023-11-08T12:12:08.430 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_log.ko 2023-11-08T12:12:08.430 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_masq.ko 2023-11-08T12:12:08.430 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14329 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_nat.ko 2023-11-08T12:12:08.430 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13673 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_numgen.ko 2023-11-08T12:12:08.431 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11841 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_osf.ko 2023-11-08T12:12:08.431 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_queue.ko 2023-11-08T12:12:08.431 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_redir.ko 2023-11-08T12:12:08.431 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_reject.ko 2023-11-08T12:12:08.431 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_reject_inet.ko 2023-11-08T12:12:08.431 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_socket.ko 2023-11-08T12:12:08.432 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20369 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_synproxy.ko 2023-11-08T12:12:08.432 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_tproxy.ko 2023-11-08T12:12:08.432 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 89313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/x_tables.ko 2023-11-08T12:12:08.432 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_AUDIT.ko 2023-11-08T12:12:08.432 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-08T12:12:08.433 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-08T12:12:08.433 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-08T12:12:08.433 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 18169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CT.ko 2023-11-08T12:12:08.433 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_DSCP.ko 2023-11-08T12:12:08.433 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_HL.ko 2023-11-08T12:12:08.434 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_HMARK.ko 2023-11-08T12:12:08.434 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-08T12:12:08.434 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13889 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_LED.ko 2023-11-08T12:12:08.434 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_LOG.ko 2023-11-08T12:12:08.434 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-08T12:12:08.434 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NETMAP.ko 2023-11-08T12:12:08.435 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NFLOG.ko 2023-11-08T12:12:08.435 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-08T12:12:08.435 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_RATEEST.ko 2023-11-08T12:12:08.435 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-08T12:12:08.435 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 14337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_SECMARK.ko 2023-11-08T12:12:08.436 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-08T12:12:08.436 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-08T12:12:08.436 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17361 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TEE.ko 2023-11-08T12:12:08.436 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TPROXY.ko 2023-11-08T12:12:08.436 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TRACE.ko 2023-11-08T12:12:08.436 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_addrtype.ko 2023-11-08T12:12:08.437 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_bpf.ko 2023-11-08T12:12:08.437 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cgroup.ko 2023-11-08T12:12:08.437 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11209 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cluster.ko 2023-11-08T12:12:08.437 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_comment.ko 2023-11-08T12:12:08.437 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10465 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connbytes.ko 2023-11-08T12:12:08.438 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11081 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connlabel.ko 2023-11-08T12:12:08.438 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connlimit.ko 2023-11-08T12:12:08.438 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connmark.ko 2023-11-08T12:12:08.438 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_conntrack.ko 2023-11-08T12:12:08.438 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cpu.ko 2023-11-08T12:12:08.439 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_dccp.ko 2023-11-08T12:12:08.439 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_devgroup.ko 2023-11-08T12:12:08.439 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8801 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_dscp.ko 2023-11-08T12:12:08.439 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ecn.ko 2023-11-08T12:12:08.439 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_esp.ko 2023-11-08T12:12:08.440 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_hashlimit.ko 2023-11-08T12:12:08.440 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_helper.ko 2023-11-08T12:12:08.440 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7865 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_hl.ko 2023-11-08T12:12:08.440 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ipcomp.ko 2023-11-08T12:12:08.440 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_iprange.ko 2023-11-08T12:12:08.440 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11785 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ipvs.ko 2023-11-08T12:12:08.441 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_l2tp.ko 2023-11-08T12:12:08.441 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8001 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_length.ko 2023-11-08T12:12:08.441 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_limit.ko 2023-11-08T12:12:08.441 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7545 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_mac.ko 2023-11-08T12:12:08.441 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_mark.ko 2023-11-08T12:12:08.442 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11825 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_multiport.ko 2023-11-08T12:12:08.442 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13817 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_nat.ko 2023-11-08T12:12:08.442 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_nfacct.ko 2023-11-08T12:12:08.442 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_osf.ko 2023-11-08T12:12:08.442 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_owner.ko 2023-11-08T12:12:08.443 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_physdev.ko 2023-11-08T12:12:08.443 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_pkttype.ko 2023-11-08T12:12:08.443 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11985 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_policy.ko 2023-11-08T12:12:08.443 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_quota.ko 2023-11-08T12:12:08.443 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_rateest.ko 2023-11-08T12:12:08.443 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_realm.ko 2023-11-08T12:12:08.444 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_recent.ko 2023-11-08T12:12:08.444 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_sctp.ko 2023-11-08T12:12:08.444 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_set.ko 2023-11-08T12:12:08.444 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 16089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_socket.ko 2023-11-08T12:12:08.444 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9505 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_state.ko 2023-11-08T12:12:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_statistic.ko 2023-11-08T12:12:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8809 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_string.ko 2023-11-08T12:12:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 8553 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_tcpmss.ko 2023-11-08T12:12:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15777 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_tcpudp.ko 2023-11-08T12:12:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11129 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_time.ko 2023-11-08T12:12:08.445 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_u32.ko 2023-11-08T12:12:08.446 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netlink/ 2023-11-08T12:12:08.446 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13969 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netlink/netlink_diag.ko 2023-11-08T12:12:08.446 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/nsh/ 2023-11-08T12:12:08.446 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 12425 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/nsh/nsh.ko 2023-11-08T12:12:08.446 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/ 2023-11-08T12:12:08.447 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 380033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/openvswitch.ko 2023-11-08T12:12:08.447 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10321 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-geneve.ko 2023-11-08T12:12:08.447 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-gre.ko 2023-11-08T12:12:08.447 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 11793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-vxlan.ko 2023-11-08T12:12:08.447 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/packet/ 2023-11-08T12:12:08.448 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13057 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/packet/af_packet_diag.ko 2023-11-08T12:12:08.448 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/ 2023-11-08T12:12:08.448 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 110201 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/phonet.ko 2023-11-08T12:12:08.448 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54697 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/pn_pep.ko 2023-11-08T12:12:08.448 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/ 2023-11-08T12:12:08.448 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 251481 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds.ko 2023-11-08T12:12:08.449 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 164937 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds_rdma.ko 2023-11-08T12:12:08.449 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 67377 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds_tcp.ko 2023-11-08T12:12:08.449 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rxrpc/ 2023-11-08T12:12:08.449 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 819657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rxrpc/rxrpc.ko 2023-11-08T12:12:08.449 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/ 2023-11-08T12:12:08.450 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32241 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_csum.ko 2023-11-08T12:12:08.450 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23577 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_gact.ko 2023-11-08T12:12:08.450 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26873 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_ipt.ko 2023-11-08T12:12:08.450 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34097 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_mirred.ko 2023-11-08T12:12:08.450 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_nat.ko 2023-11-08T12:12:08.451 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 43449 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_pedit.ko 2023-11-08T12:12:08.451 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_police.ko 2023-11-08T12:12:08.451 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_simple.ko 2023-11-08T12:12:08.451 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35297 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_skbedit.ko 2023-11-08T12:12:08.451 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36665 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_vlan.ko 2023-11-08T12:12:08.452 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26169 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_basic.ko 2023-11-08T12:12:08.452 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33961 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_bpf.ko 2023-11-08T12:12:08.452 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19233 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_cgroup.ko 2023-11-08T12:12:08.452 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31401 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_flow.ko 2023-11-08T12:12:08.452 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31769 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_fw.ko 2023-11-08T12:12:08.452 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 38489 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_route.ko 2023-11-08T12:12:08.453 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 61409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_u32.ko 2023-11-08T12:12:08.453 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7441 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_cmp.ko 2023-11-08T12:12:08.453 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 13409 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_ipset.ko 2023-11-08T12:12:08.453 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33289 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_meta.ko 2023-11-08T12:12:08.453 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_nbyte.ko 2023-11-08T12:12:08.454 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_text.ko 2023-11-08T12:12:08.454 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7249 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_u32.ko 2023-11-08T12:12:08.454 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 21649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_choke.ko 2023-11-08T12:12:08.454 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20849 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_codel.ko 2023-11-08T12:12:08.454 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 34633 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_drr.ko 2023-11-08T12:12:08.455 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 33609 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_fq.ko 2023-11-08T12:12:08.455 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31617 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_fq_codel.ko 2023-11-08T12:12:08.455 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 35433 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_gred.ko 2023-11-08T12:12:08.455 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 49601 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_hfsc.ko 2023-11-08T12:12:08.455 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22089 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_hhf.ko 2023-11-08T12:12:08.456 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 66393 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_htb.ko 2023-11-08T12:12:08.456 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26073 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_ingress.ko 2023-11-08T12:12:08.456 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 30273 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_mqprio.ko 2023-11-08T12:12:08.456 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_mqprio_lib.ko 2023-11-08T12:12:08.456 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26065 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_multiq.ko 2023-11-08T12:12:08.457 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 36137 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_netem.ko 2023-11-08T12:12:08.457 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 27497 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_pie.ko 2023-11-08T12:12:08.457 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_plug.ko 2023-11-08T12:12:08.457 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_prio.ko 2023-11-08T12:12:08.457 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 48793 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_qfq.ko 2023-11-08T12:12:08.457 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 32905 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_red.ko 2023-11-08T12:12:08.458 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 26881 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_sfb.ko 2023-11-08T12:12:08.458 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 31353 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_sfq.ko 2023-11-08T12:12:08.458 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28897 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_tbf.ko 2023-11-08T12:12:08.458 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 28105 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_teql.ko 2023-11-08T12:12:08.458 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/ 2023-11-08T12:12:08.459 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 929745 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/sctp.ko 2023-11-08T12:12:08.459 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 19033 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/sctp_diag.ko 2023-11-08T12:12:08.459 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/ 2023-11-08T12:12:08.459 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/ 2023-11-08T12:12:08.459 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 336529 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-08T12:12:08.459 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 54737 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-08T12:12:08.460 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 1520161 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/sunrpc.ko 2023-11-08T12:12:08.460 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/xprtrdma/ 2023-11-08T12:12:08.460 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 707721 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-08T12:12:08.460 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/ 2023-11-08T12:12:08.460 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10025 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/diag.ko 2023-11-08T12:12:08.461 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 862641 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/tipc.ko 2023-11-08T12:12:08.461 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/unix/ 2023-11-08T12:12:08.461 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15729 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/unix/unix_diag.ko 2023-11-08T12:12:08.461 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/ 2023-11-08T12:12:08.461 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 85337 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-08T12:12:08.461 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 68049 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-08T12:12:08.462 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 96193 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock.ko 2023-11-08T12:12:08.462 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 10705 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-08T12:12:08.462 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 17521 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-08T12:12:08.462 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/x25/ 2023-11-08T12:12:08.462 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 125177 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/x25/x25.ko 2023-11-08T12:12:08.463 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/ 2023-11-08T12:12:08.463 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 22657 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_algo.ko 2023-11-08T12:12:08.463 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 20649 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-08T12:12:08.463 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 102257 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_user.ko 2023-11-08T12:12:08.463 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/ 2023-11-08T12:12:08.464 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/lib/ 2023-11-08T12:12:08.464 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 15537 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/lib/irqbypass.ko 2023-11-08T12:12:08.464 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 639863 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.alias 2023-11-08T12:12:08.464 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 623919 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.alias.bin 2023-11-08T12:12:08.464 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 7663 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin 2023-11-08T12:12:08.464 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 23428 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.alias.bin 2023-11-08T12:12:08.465 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 9821 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.bin 2023-11-08T12:12:08.465 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 70004 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.modinfo 2023-11-08T12:12:08.465 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 146313 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.dep 2023-11-08T12:12:08.465 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 232548 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.dep.bin 2023-11-08T12:12:08.465 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 210 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.devname 2023-11-08T12:12:08.466 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 72606 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.order 2023-11-08T12:12:08.466 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 879 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.softdep 2023-11-08T12:12:08.466 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 254438 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.symbols 2023-11-08T12:12:08.466 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 309363 2023-11-07 03:19 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.symbols.bin 2023-11-08T12:12:08.466 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/ 2023-11-08T12:12:08.467 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/share/ 2023-11-08T12:12:08.467 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/share/doc/ 2023-11-08T12:12:08.467 INFO:teuthology.orchestra.run.smithi112.stdout:drwxr-xr-x root/root 0 2023-11-07 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/ 2023-11-08T12:12:08.467 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 173 2023-11-07 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/changelog.Debian.gz 2023-11-08T12:12:08.467 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r-- root/root 691 2023-11-07 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/copyright 2023-11-08T12:12:08.468 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:08.468 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:08.469 DEBUG:teuthology.orchestra.run.smithi112:> egrep '(submenu|menuentry.*6.6.0-rc5-g3b796cfe2969).*{' /boot/grub/grub.cfg 2023-11-08T12:12:08.470 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-11-08T12:12:08.478 INFO:teuthology.orchestra.run.smithi112.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-08T12:12:08.479 INFO:teuthology.orchestra.run.smithi112.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g3b796cfe2969-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-08T12:12:08.479 INFO:teuthology.orchestra.run.smithi112.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g3b796cfe2969-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-08T12:12:08.480 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-08T12:12:08.480 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:08.480 DEBUG:teuthology.orchestra.run.smithi112:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-08T12:12:08.524 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi112.front.sepia.ceph.com to complete... 2023-11-08T12:12:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2023-11-08T12:12:09.197 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-08T12:12:09.212 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2023-11-08T12:12:09.483 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:09.495 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-08T12:12:09.868 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-08T12:12:09.878 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-08T12:12:11.546 INFO:teuthology.orchestra.run.smithi112.stderr:done 2023-11-08T12:12:39.518 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-08T12:12:39.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T12:12:39.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:12:42.682 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-08T12:12:42.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-08T12:12:42.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:12:57.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T12:13:01.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-08T12:13:06.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T12:13:06.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:13:09.914 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-11-08T12:13:10.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-08T12:13:10.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:13:13.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-08T12:13:21.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T12:13:21.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:13:25.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-08T12:13:25.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:13:43.674 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-08T12:13:53.653 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-11-08T12:13:54.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T12:13:54.373 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-rc5-g3b796cfe2969"... 2023-11-08T12:13:54.373 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-11-08T12:13:54.440 INFO:teuthology.orchestra.run.smithi133.stdout:6.6.0-rc5-g3b796cfe2969 2023-11-08T12:13:54.440 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g3b796cfe2969 vs 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:13:54.440 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-08T12:13:54.441 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-08T12:13:55.442 DEBUG:teuthology.parallel:result is None 2023-11-08T12:13:58.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-08T12:13:58.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:13:58.917 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-11-08T12:13:59.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-08T12:13:59.689 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g3b796cfe2969"... 2023-11-08T12:13:59.690 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2023-11-08T12:13:59.752 INFO:teuthology.orchestra.run.smithi112.stdout:6.6.0-rc5-g3b796cfe2969 2023-11-08T12:13:59.753 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g3b796cfe2969 vs 6.6.0-rc5-g3b796cfe2969 2023-11-08T12:13:59.753 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-08T12:13:59.753 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-08T12:14:00.754 DEBUG:teuthology.parallel:result is None 2023-11-08T12:14:00.755 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-08T12:14:00.764 INFO:teuthology.task.internal:Creating test directory... 2023-11-08T12:14:00.764 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-08T12:14:00.770 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-08T12:14:00.788 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-08T12:14:00.795 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-08T12:14:00.807 INFO:teuthology.task.internal:Creating archive directory... 2023-11-08T12:14:00.807 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-08T12:14:00.830 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-08T12:14:00.861 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-08T12:14:00.868 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-08T12:14:00.869 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-08T12:14:00.905 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-08T12:14:00.996 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T12:14:01.015 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T12:14:01.021 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T12:14:01.042 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T12:14:01.046 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-08T12:14:01.053 INFO:teuthology.task.internal:Configuring sudo... 2023-11-08T12:14:01.053 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-08T12:14:01.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-08T12:14:01.098 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-08T12:14:01.108 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-08T12:14:01.108 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-08T12:14:01.145 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-08T12:14:01.164 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-08T12:14:01.224 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-08T12:14:01.287 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:14:01.288 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-08T12:14:01.375 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-08T12:14:01.398 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-08T12:14:01.465 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:14:01.466 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-08T12:14:01.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2023-11-08T12:14:01.558 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-11-08T12:14:01.724 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-08T12:14:01.732 INFO:teuthology.task.internal:Starting timer... 2023-11-08T12:14:01.732 INFO:teuthology.run_tasks:Running task pcp... 2023-11-08T12:14:01.742 INFO:teuthology.run_tasks:Running task selinux... 2023-11-08T12:14:01.755 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2023-11-08T12:14:01.755 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2023-11-08T12:14:01.756 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-08T12:14:01.756 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-08T12:14:01.757 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-08T12:14:01.757 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-08T12:14:01.768 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-08T12:14:01.769 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-08T12:14:01.792 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-08T12:14:01.794 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-08T12:22:05.903 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2023-11-08T12:22:05.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-08T12:22:05.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:22:06.011 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-11-08T12:22:06.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-08T12:22:06.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T12:22:06.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T12:22:06.390 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-11-08T12:22:06.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-11-08T12:22:06.619 INFO:teuthology.run_tasks:Running task clock... 2023-11-08T12:22:06.630 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-08T12:22:06.631 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-08T12:22:06.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T12:22:06.639 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-08T12:22:06.639 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T12:22:06.706 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-08T12:22:06.707 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Command line: ntpd -gq 2023-11-08T12:22:06.707 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: proto: precision = 0.042 usec (-24) 2023-11-08T12:22:06.708 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-08T12:22:06.708 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-08T12:22:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-08T12:22:06.710 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: restrict ::: KOD does nothing without LIMITED. 2023-11-08T12:22:06.710 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Listen and drop on 0 v6wildcard [::]:123 2023-11-08T12:22:06.710 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-08T12:22:06.710 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Listen normally on 2 lo 127.0.0.1:123 2023-11-08T12:22:06.710 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2023-11-08T12:22:06.711 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Listen normally on 4 lo [::1]:123 2023-11-08T12:22:06.711 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2023-11-08T12:22:06.711 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:06 ntpd[22732]: Listening on routing socket on fd #22 for interface updates 2023-11-08T12:22:06.740 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-08T12:22:06.740 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Command line: ntpd -gq 2023-11-08T12:22:06.741 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: proto: precision = 0.080 usec (-23) 2023-11-08T12:22:06.742 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-08T12:22:06.743 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-08T12:22:06.743 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-08T12:22:06.744 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: restrict ::: KOD does nothing without LIMITED. 2023-11-08T12:22:06.744 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Listen and drop on 0 v6wildcard [::]:123 2023-11-08T12:22:06.744 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-08T12:22:06.744 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Listen normally on 2 lo 127.0.0.1:123 2023-11-08T12:22:06.745 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2023-11-08T12:22:06.745 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Listen normally on 4 lo [::1]:123 2023-11-08T12:22:06.746 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2023-11-08T12:22:06.746 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:06 ntpd[22737]: Listening on routing socket on fd #22 for interface updates 2023-11-08T12:22:07.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:07.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:07.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:07.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:07.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:07.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:07.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:07.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:07 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:07.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:07.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:07.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:07.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:07.744 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:07.744 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:07.745 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:07.745 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:07 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:09.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:09.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:09.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:09.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:09.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:09.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:09.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:09.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:09.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:09.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:09.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:09.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:09 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:09.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:09 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:09.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:09 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:09.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:09 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:09.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:09 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:09.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:09 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:09.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:09 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:10.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:10 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:10.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:10 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:10.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:10 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:10.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:10 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:10.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:10 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:10.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:10 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:10.740 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:10.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:10.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:10.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:10.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:10.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:10.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:10.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:10.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:10.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:10.744 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:10.744 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:10 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:11.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:11.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:11.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:11.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:11.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:11.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:11.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:11.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:11.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:11.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:11.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:11.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:11 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:11.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:11 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:11.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:11 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:11.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:11 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:11.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:11 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:11.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:11 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:11.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:11 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:12.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:12 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:12.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:12 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:12.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:12 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:12.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:12 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:12.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:12 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:12.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:12 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:12.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:12.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:12.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:12.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:12.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:12.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:12.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:12.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:12.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:12.744 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:12.744 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:12.744 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:12 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:13.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:13.707 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:13.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:13.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:13.708 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:13.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:13.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:13.709 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:13.709 INFO:teuthology.orchestra.run.smithi112.stdout: 8 Nov 12:22:13 ntpd[22732]: ntpd: time slew -0.000028 s 2023-11-08T12:22:13.710 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew -0.000028s 2023-11-08T12:22:13.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-08T12:22:13.710 INFO:teuthology.orchestra.run.smithi112.stderr: 8 Nov 12:22:13 ntpd[22732]: can't open /var/log/ntpstats/loopstats.20231108: Permission denied 2023-11-08T12:22:13.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:13.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:13.741 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T12:22:13.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T12:22:13.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T12:22:13.742 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T12:22:13.742 INFO:teuthology.orchestra.run.smithi133.stdout: 8 Nov 12:22:13 ntpd[22737]: ntpd: time slew +0.001530 s 2023-11-08T12:22:13.743 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew +0.001530s 2023-11-08T12:22:13.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-08T12:22:13.743 INFO:teuthology.orchestra.run.smithi133.stderr: 8 Nov 12:22:13 ntpd[22737]: can't open /var/log/ntpstats/loopstats.20231108: Permission denied 2023-11-08T12:22:13.842 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2023-11-08T12:22:13.843 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2023-11-08T12:22:13.845 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.845 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.846 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.846 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.900 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-11-08T12:22:13.900 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-11-08T12:22:13.900 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.900 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.901 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.901 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T12:22:13.902 INFO:teuthology.run_tasks:Running task install... 2023-11-08T12:22:13.911 DEBUG:teuthology.task.install:project ceph 2023-11-08T12:22:13.912 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b820560f30d310ab2570761b9a294523225d6998'}} 2023-11-08T12:22:13.912 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b820560f30d310ab2570761b9a294523225d6998'} 2023-11-08T12:22:13.912 INFO:teuthology.task.install:Using flavor: default 2023-11-08T12:22:13.918 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-08T12:22:13.919 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-08T12:22:13.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2023-11-08T12:22:13.920 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2023-11-08T12:22:14.150 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-08T12:22:14.156 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-08T12:22:14.298 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-08T12:22:14.298 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2023-11-08T12:22:14.299 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-08T12:22:14.299 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2023-11-08T12:22:14.301 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-08T12:22:14.301 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-08T12:22:14.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b820560f30d310ab2570761b9a294523225d6998 2023-11-08T12:22:14.304 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-08T12:22:14.304 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-08T12:22:14.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b820560f30d310ab2570761b9a294523225d6998 2023-11-08T12:22:14.554 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default/ 2023-11-08T12:22:14.554 INFO:teuthology.task.install.deb:Package version is 18.0.0-2698-gb820560f-1focal 2023-11-08T12:22:14.559 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default/ 2023-11-08T12:22:14.559 INFO:teuthology.task.install.deb:Package version is 18.0.0-2698-gb820560f-1focal 2023-11-08T12:22:14.882 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:22:14.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-08T12:22:14.917 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2023-11-08T12:22:14.933 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:22:14.933 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-08T12:22:14.970 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-11-08T12:22:15.196 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-08T12:22:15.196 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-08T12:22:15.207 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-08T12:22:15.304 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-08T12:22:15.498 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-08T12:22:15.498 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-08T12:22:15.517 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal InRelease 2023-11-08T12:22:15.552 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-08T12:22:15.599 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-08T12:22:15.634 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-08T12:22:15.661 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal InRelease 2023-11-08T12:22:15.683 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal Release.gpg 2023-11-08T12:22:15.744 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-08T12:22:15.766 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main i386 Packages [3,421 B] 2023-11-08T12:22:15.827 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal Release.gpg 2023-11-08T12:22:15.877 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-08T12:22:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-11-08T12:22:16.099 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main i386 Packages [3,421 B] 2023-11-08T12:22:16.608 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 28.4 kB in 1s (21.1 kB/s) 2023-11-08T12:22:16.899 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 28.4 kB in 1s (19.3 kB/s) 2023-11-08T12:22:17.828 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2023-11-08T12:22:17.868 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2698-gb820560f-1focal cephadm=18.0.0-2698-gb820560f-1focal ceph-mds=18.0.0-2698-gb820560f-1focal ceph-mgr=18.0.0-2698-gb820560f-1focal ceph-common=18.0.0-2698-gb820560f-1focal ceph-fuse=18.0.0-2698-gb820560f-1focal ceph-test=18.0.0-2698-gb820560f-1focal ceph-volume=18.0.0-2698-gb820560f-1focal radosgw=18.0.0-2698-gb820560f-1focal python3-rados=18.0.0-2698-gb820560f-1focal python3-rgw=18.0.0-2698-gb820560f-1focal python3-cephfs=18.0.0-2698-gb820560f-1focal python3-rbd=18.0.0-2698-gb820560f-1focal libcephfs2=18.0.0-2698-gb820560f-1focal libcephfs-dev=18.0.0-2698-gb820560f-1focal librados2=18.0.0-2698-gb820560f-1focal librbd1=18.0.0-2698-gb820560f-1focal rbd-fuse=18.0.0-2698-gb820560f-1focal python3-cephfs=18.0.0-2698-gb820560f-1focal cephfs-shell=18.0.0-2698-gb820560f-1focal cephfs-top=18.0.0-2698-gb820560f-1focal cephfs-mirror=18.0.0-2698-gb820560f-1focal 2023-11-08T12:22:17.990 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2023-11-08T12:22:18.116 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-11-08T12:22:18.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2698-gb820560f-1focal cephadm=18.0.0-2698-gb820560f-1focal ceph-mds=18.0.0-2698-gb820560f-1focal ceph-mgr=18.0.0-2698-gb820560f-1focal ceph-common=18.0.0-2698-gb820560f-1focal ceph-fuse=18.0.0-2698-gb820560f-1focal ceph-test=18.0.0-2698-gb820560f-1focal ceph-volume=18.0.0-2698-gb820560f-1focal radosgw=18.0.0-2698-gb820560f-1focal python3-rados=18.0.0-2698-gb820560f-1focal python3-rgw=18.0.0-2698-gb820560f-1focal python3-cephfs=18.0.0-2698-gb820560f-1focal python3-rbd=18.0.0-2698-gb820560f-1focal libcephfs2=18.0.0-2698-gb820560f-1focal libcephfs-dev=18.0.0-2698-gb820560f-1focal librados2=18.0.0-2698-gb820560f-1focal librbd1=18.0.0-2698-gb820560f-1focal rbd-fuse=18.0.0-2698-gb820560f-1focal python3-cephfs=18.0.0-2698-gb820560f-1focal cephfs-shell=18.0.0-2698-gb820560f-1focal cephfs-top=18.0.0-2698-gb820560f-1focal cephfs-mirror=18.0.0-2698-gb820560f-1focal 2023-11-08T12:22:18.167 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2023-11-08T12:22:18.168 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2023-11-08T12:22:18.288 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-11-08T12:22:18.338 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2023-11-08T12:22:18.339 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-08T12:22:18.339 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-08T12:22:18.339 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2023-11-08T12:22:18.340 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-08T12:22:18.340 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-08T12:22:18.340 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-08T12:22:18.340 INFO:teuthology.orchestra.run.smithi112.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-08T12:22:18.340 INFO:teuthology.orchestra.run.smithi112.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-08T12:22:18.341 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-08T12:22:18.342 INFO:teuthology.orchestra.run.smithi112.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-08T12:22:18.342 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-08T12:22:18.342 INFO:teuthology.orchestra.run.smithi112.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-08T12:22:18.342 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-08T12:22:18.342 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-08T12:22:18.343 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-08T12:22:18.343 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-08T12:22:18.343 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-08T12:22:18.343 INFO:teuthology.orchestra.run.smithi112.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-08T12:22:18.343 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-08T12:22:18.344 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-08T12:22:18.344 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-08T12:22:18.344 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-08T12:22:18.344 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-08T12:22:18.344 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-08T12:22:18.345 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-08T12:22:18.345 INFO:teuthology.orchestra.run.smithi112.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-08T12:22:18.345 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2023-11-08T12:22:18.345 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-08T12:22:18.345 INFO:teuthology.orchestra.run.smithi112.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-08T12:22:18.346 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-08T12:22:18.346 INFO:teuthology.orchestra.run.smithi112.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-08T12:22:18.346 INFO:teuthology.orchestra.run.smithi112.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-08T12:22:18.346 INFO:teuthology.orchestra.run.smithi112.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-08T12:22:18.346 INFO:teuthology.orchestra.run.smithi112.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-08T12:22:18.347 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-08T12:22:18.347 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-08T12:22:18.347 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2023-11-08T12:22:18.347 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2023-11-08T12:22:18.498 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-11-08T12:22:18.499 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-11-08T12:22:18.550 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2023-11-08T12:22:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-08T12:22:18.550 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-08T12:22:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-08T12:22:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-08T12:22:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-08T12:22:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-08T12:22:18.551 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-08T12:22:18.552 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-08T12:22:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-08T12:22:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-08T12:22:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-08T12:22:18.553 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-08T12:22:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-08T12:22:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-08T12:22:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-08T12:22:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-08T12:22:18.554 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-08T12:22:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-08T12:22:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-08T12:22:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-08T12:22:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-08T12:22:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-08T12:22:18.555 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-08T12:22:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-08T12:22:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-08T12:22:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-08T12:22:18.556 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2023-11-08T12:22:18.556 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 librbd1 2023-11-08T12:22:18.650 INFO:teuthology.orchestra.run.smithi112.stdout:2 upgraded, 116 newly installed, 0 to remove and 258 not upgraded. 2023-11-08T12:22:18.650 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 207 MB of archives. 2023-11-08T12:22:18.650 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-08T12:22:18.651 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-08T12:22:18.672 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-08T12:22:18.680 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-08T12:22:18.704 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-11-08T12:22:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-08T12:22:18.705 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-08T12:22:18.706 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-11-08T12:22:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-08T12:22:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-08T12:22:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-08T12:22:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-08T12:22:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-08T12:22:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-08T12:22:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-08T12:22:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-08T12:22:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-08T12:22:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-08T12:22:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-08T12:22:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-08T12:22:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-08T12:22:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-08T12:22:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-08T12:22:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-08T12:22:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-08T12:22:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-08T12:22:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-08T12:22:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-08T12:22:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-08T12:22:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-08T12:22:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-08T12:22:18.711 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-11-08T12:22:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-08T12:22:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-08T12:22:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-08T12:22:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-08T12:22:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-08T12:22:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-08T12:22:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-08T12:22:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-08T12:22:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-08T12:22:18.713 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2023-11-08T12:22:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: btrfs-tools 2023-11-08T12:22:18.715 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-08T12:22:18.749 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-08T12:22:18.754 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-08T12:22:18.769 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-08T12:22:18.828 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-08T12:22:18.830 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-08T12:22:18.837 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-08T12:22:18.840 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-08T12:22:18.840 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-08T12:22:18.841 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-08T12:22:18.842 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-08T12:22:18.846 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-08T12:22:18.846 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-08T12:22:18.848 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-08T12:22:18.868 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-08T12:22:18.869 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-08T12:22:18.870 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-08T12:22:18.873 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-08T12:22:18.874 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-08T12:22:18.875 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-08T12:22:18.876 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-08T12:22:18.877 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-08T12:22:18.889 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-08T12:22:18.891 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-08T12:22:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-08T12:22:18.921 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2698-gb820560f-1focal [3,433 kB] 2023-11-08T12:22:18.923 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-08T12:22:18.923 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-08T12:22:18.923 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-08T12:22:18.924 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-08T12:22:18.926 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-11-08T12:22:18.926 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-08T12:22:18.926 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-08T12:22:18.926 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-08T12:22:18.927 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-08T12:22:18.927 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-08T12:22:18.928 INFO:teuthology.orchestra.run.smithi133.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-08T12:22:18.928 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-08T12:22:18.931 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-08T12:22:18.931 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-08T12:22:18.931 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-08T12:22:18.932 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-08T12:22:18.933 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-08T12:22:18.933 INFO:teuthology.orchestra.run.smithi133.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-08T12:22:18.933 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-08T12:22:18.934 INFO:teuthology.orchestra.run.smithi133.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-08T12:22:18.934 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-08T12:22:18.934 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-08T12:22:18.935 INFO:teuthology.orchestra.run.smithi133.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-08T12:22:18.935 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-08T12:22:18.935 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-08T12:22:18.935 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-08T12:22:18.935 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-08T12:22:18.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-08T12:22:18.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-08T12:22:18.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-08T12:22:18.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-08T12:22:18.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-08T12:22:18.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-08T12:22:18.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-08T12:22:18.937 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-08T12:22:18.937 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-11-08T12:22:18.937 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 librbd1 2023-11-08T12:22:18.938 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-08T12:22:18.951 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-08T12:22:18.952 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-08T12:22:18.953 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-08T12:22:18.955 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-08T12:22:18.956 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-08T12:22:18.959 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-08T12:22:18.961 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-08T12:22:18.970 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-08T12:22:18.972 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-08T12:22:18.973 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-08T12:22:18.991 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-08T12:22:18.994 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-08T12:22:18.998 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-08T12:22:18.998 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-08T12:22:18.999 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-08T12:22:19.111 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-08T12:22:19.132 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-08T12:22:19.134 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-08T12:22:19.149 INFO:teuthology.orchestra.run.smithi133.stdout:2 upgraded, 116 newly installed, 0 to remove and 258 not upgraded. 2023-11-08T12:22:19.149 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 207 MB of archives. 2023-11-08T12:22:19.150 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 1,026 MB of additional disk space will be used. 2023-11-08T12:22:19.150 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-08T12:22:19.152 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-08T12:22:19.152 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-08T12:22:19.153 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-08T12:22:19.154 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-08T12:22:19.154 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-08T12:22:19.155 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-08T12:22:19.155 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-08T12:22:19.162 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-08T12:22:19.163 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-08T12:22:19.182 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-08T12:22:19.187 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-08T12:22:19.190 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-08T12:22:19.193 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-08T12:22:19.194 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-08T12:22:19.198 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-08T12:22:19.201 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-08T12:22:19.201 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-08T12:22:19.221 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-08T12:22:19.224 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-08T12:22:19.233 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-08T12:22:19.236 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-08T12:22:19.253 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-2698-gb820560f-1focal [3,433 kB] 2023-11-08T12:22:19.268 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-08T12:22:19.296 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-08T12:22:19.297 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-08T12:22:19.297 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-08T12:22:19.297 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-08T12:22:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-08T12:22:19.313 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-08T12:22:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-08T12:22:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-08T12:22:19.315 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-08T12:22:19.407 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-08T12:22:19.543 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-08T12:22:19.561 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-08T12:22:19.622 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-08T12:22:19.823 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-08T12:22:19.831 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-08T12:22:19.858 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-08T12:22:19.866 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-08T12:22:20.031 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-08T12:22:20.248 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2698-gb820560f-1focal [3,982 kB] 2023-11-08T12:22:20.401 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-08T12:22:20.423 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-08T12:22:20.602 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-08T12:22:20.611 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-08T12:22:20.649 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-08T12:22:20.654 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-08T12:22:20.657 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-08T12:22:20.659 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-08T12:22:20.669 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-08T12:22:20.669 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-08T12:22:20.835 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-08T12:22:21.175 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-08T12:22:21.199 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-08T12:22:21.270 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-08T12:22:21.299 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-2698-gb820560f-1focal [3,982 kB] 2023-11-08T12:22:21.332 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-08T12:22:21.342 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-08T12:22:21.461 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-08T12:22:21.462 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-08T12:22:21.465 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-08T12:22:21.469 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-08T12:22:21.481 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-08T12:22:21.482 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2698-gb820560f-1focal [722 kB] 2023-11-08T12:22:21.666 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2698-gb820560f-1focal [376 kB] 2023-11-08T12:22:21.667 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-08T12:22:21.784 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2698-gb820560f-1focal [22.4 kB] 2023-11-08T12:22:21.786 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2698-gb820560f-1focal [184 kB] 2023-11-08T12:22:21.842 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2698-gb820560f-1focal [47.7 kB] 2023-11-08T12:22:21.849 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2698-gb820560f-1focal [355 kB] 2023-11-08T12:22:21.917 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2698-gb820560f-1focal [6,531 kB] 2023-11-08T12:22:22.116 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-08T12:22:22.128 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-08T12:22:22.174 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-08T12:22:22.217 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-08T12:22:22.226 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-08T12:22:22.231 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-08T12:22:22.241 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-08T12:22:22.246 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-08T12:22:22.263 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-08T12:22:22.264 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-08T12:22:22.435 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-08T12:22:22.865 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-08T12:22:22.868 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-08T12:22:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-08T12:22:22.953 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-08T12:22:22.982 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-08T12:22:22.986 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-08T12:22:22.996 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-08T12:22:23.051 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-2698-gb820560f-1focal [722 kB] 2023-11-08T12:22:23.381 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-2698-gb820560f-1focal [376 kB] 2023-11-08T12:22:23.453 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-08T12:22:23.527 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-08T12:22:23.529 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-08T12:22:23.537 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-2698-gb820560f-1focal [22.4 kB] 2023-11-08T12:22:23.572 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-2698-gb820560f-1focal [184 kB] 2023-11-08T12:22:23.675 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-2698-gb820560f-1focal [47.7 kB] 2023-11-08T12:22:23.681 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-2698-gb820560f-1focal [355 kB] 2023-11-08T12:22:23.685 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2698-gb820560f-1focal [103 kB] 2023-11-08T12:22:23.693 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2698-gb820560f-1focal [467 kB] 2023-11-08T12:22:23.738 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-08T12:22:23.816 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-2698-gb820560f-1focal [6,531 kB] 2023-11-08T12:22:23.823 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-08T12:22:23.852 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2698-gb820560f-1focal [25.0 MB] 2023-11-08T12:22:23.947 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-08T12:22:24.010 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-08T12:22:24.036 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-08T12:22:24.074 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-08T12:22:24.087 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-08T12:22:24.139 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-08T12:22:24.148 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-08T12:22:24.161 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-08T12:22:24.241 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-08T12:22:24.431 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-08T12:22:24.806 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-08T12:22:24.834 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-08T12:22:24.986 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-08T12:22:25.045 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-08T12:22:25.050 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-08T12:22:25.216 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-08T12:22:25.225 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-08T12:22:25.234 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-08T12:22:25.390 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-08T12:22:25.391 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-08T12:22:25.556 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-08T12:22:25.893 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-08T12:22:26.262 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-08T12:22:26.266 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-08T12:22:26.277 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-08T12:22:26.279 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-08T12:22:26.282 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-08T12:22:26.943 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-2698-gb820560f-1focal [103 kB] 2023-11-08T12:22:26.966 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-2698-gb820560f-1focal [467 kB] 2023-11-08T12:22:27.149 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-2698-gb820560f-1focal [25.0 MB] 2023-11-08T12:22:31.276 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2698-gb820560f-1focal [10.9 MB] 2023-11-08T12:22:33.728 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2698-gb820560f-1focal [221 kB] 2023-11-08T12:22:33.784 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2698-gb820560f-1focal [133 kB] 2023-11-08T12:22:33.813 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2698-gb820560f-1focal [1,548 kB] 2023-11-08T12:22:34.236 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2698-gb820560f-1focal [9,376 kB] 2023-11-08T12:22:34.676 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-2698-gb820560f-1focal [10.9 MB] 2023-11-08T12:22:37.407 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2698-gb820560f-1focal [31.3 MB] 2023-11-08T12:22:41.578 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-2698-gb820560f-1focal [221 kB] 2023-11-08T12:22:41.652 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-2698-gb820560f-1focal [133 kB] 2023-11-08T12:22:41.720 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-2698-gb820560f-1focal [1,548 kB] 2023-11-08T12:22:42.516 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-2698-gb820560f-1focal [9,376 kB] 2023-11-08T12:22:45.967 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2698-gb820560f-1focal [3,816 B] 2023-11-08T12:22:45.967 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2698-gb820560f-1focal [830 kB] 2023-11-08T12:22:46.339 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2698-gb820560f-1focal [2,285 kB] 2023-11-08T12:22:47.409 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2698-gb820560f-1focal [96.8 kB] 2023-11-08T12:22:47.420 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2698-gb820560f-1focal [117 kB] 2023-11-08T12:22:47.487 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2698-gb820560f-1focal [1,795 kB] 2023-11-08T12:22:48.173 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2698-gb820560f-1focal [7,890 kB] 2023-11-08T12:22:48.429 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-2698-gb820560f-1focal [31.3 MB] 2023-11-08T12:22:51.376 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2698-gb820560f-1focal [3,936 B] 2023-11-08T12:22:51.376 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2698-gb820560f-1focal [49.9 MB] 2023-11-08T12:23:02.265 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-2698-gb820560f-1focal [3,816 B] 2023-11-08T12:23:02.266 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-2698-gb820560f-1focal [830 kB] 2023-11-08T12:23:02.500 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-2698-gb820560f-1focal [2,285 kB] 2023-11-08T12:23:03.203 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-2698-gb820560f-1focal [96.8 kB] 2023-11-08T12:23:03.249 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-2698-gb820560f-1focal [117 kB] 2023-11-08T12:23:03.285 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-2698-gb820560f-1focal [1,795 kB] 2023-11-08T12:23:03.879 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-2698-gb820560f-1focal [7,890 kB] 2023-11-08T12:23:06.127 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-2698-gb820560f-1focal [3,936 B] 2023-11-08T12:23:06.127 INFO:teuthology.orchestra.run.smithi133.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-2698-gb820560f-1focal [49.9 MB] 2023-11-08T12:23:06.854 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2698-gb820560f-1focal [225 kB] 2023-11-08T12:23:06.917 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2698-gb820560f-1focal [253 kB] 2023-11-08T12:23:06.987 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2698-gb820560f-1focal [23.3 kB] 2023-11-08T12:23:06.989 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2698-gb820560f-1focal [13.0 kB] 2023-11-08T12:23:06.990 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2698-gb820560f-1focal [27.4 kB] 2023-11-08T12:23:06.996 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2698-gb820560f-1focal [13.3 MB] 2023-11-08T12:23:12.096 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2698-gb820560f-1focal [97.3 kB] 2023-11-08T12:23:13.093 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 207 MB in 54s (3,866 kB/s) 2023-11-08T12:23:13.278 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-08T12:23:13.351 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-11-08T12:23:13.354 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-08T12:23:13.399 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-08T12:23:13.752 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-08T12:23:13.772 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-08T12:23:13.810 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-08T12:23:14.146 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cmd2. 2023-11-08T12:23:14.159 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-08T12:23:14.221 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-08T12:23:14.625 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-08T12:23:14.649 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-08T12:23:14.758 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-08T12:23:15.179 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-08T12:23:15.196 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-08T12:23:15.237 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-08T12:23:15.590 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-08T12:23:15.610 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-08T12:23:15.690 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-08T12:23:16.235 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-08T12:23:16.256 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-08T12:23:16.337 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:23:16.373 INFO:teuthology.orchestra.run.smithi133.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-2698-gb820560f-1focal [225 kB] 2023-11-08T12:23:16.375 INFO:teuthology.orchestra.run.smithi133.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-2698-gb820560f-1focal [253 kB] 2023-11-08T12:23:16.426 INFO:teuthology.orchestra.run.smithi133.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-2698-gb820560f-1focal [23.3 kB] 2023-11-08T12:23:16.426 INFO:teuthology.orchestra.run.smithi133.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-2698-gb820560f-1focal [13.0 kB] 2023-11-08T12:23:16.427 INFO:teuthology.orchestra.run.smithi133.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-2698-gb820560f-1focal [27.4 kB] 2023-11-08T12:23:16.443 INFO:teuthology.orchestra.run.smithi133.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-2698-gb820560f-1focal [13.3 MB] 2023-11-08T12:23:16.897 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-08T12:23:16.918 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-08T12:23:16.988 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:23:17.409 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-08T12:23:17.422 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-08T12:23:17.467 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:23:17.870 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-08T12:23:17.884 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-08T12:23:17.962 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-08T12:23:18.401 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-librbd1_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:18.524 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (18.0.0-2698-gb820560f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-08T12:23:18.538 INFO:teuthology.orchestra.run.smithi133.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-54557/b820560f30d310ab2570761b9a294523225d6998/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-2698-gb820560f-1focal [97.3 kB] 2023-11-08T12:23:19.317 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-librados2_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:19.445 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (18.0.0-2698-gb820560f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-08T12:23:19.521 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 207 MB in 60s (3,473 kB/s) 2023-11-08T12:23:19.719 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-08T12:23:19.790 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-11-08T12:23:19.793 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-08T12:23:19.832 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-08T12:23:20.168 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-08T12:23:20.189 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-08T12:23:20.243 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-08T12:23:20.383 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2023-11-08T12:23:20.404 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:20.441 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:20.571 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cmd2. 2023-11-08T12:23:20.591 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-08T12:23:20.629 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-08T12:23:20.810 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2023-11-08T12:23:20.830 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:20.868 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:21.007 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-08T12:23:21.029 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-08T12:23:21.116 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-08T12:23:21.305 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-08T12:23:21.324 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:21.363 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:21.511 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-08T12:23:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-08T12:23:21.569 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-08T12:23:21.666 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2023-11-08T12:23:21.679 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:21.716 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:21.956 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-08T12:23:21.977 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-08T12:23:22.022 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-08T12:23:22.094 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-08T12:23:22.107 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:22.143 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:22.525 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-08T12:23:22.530 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2023-11-08T12:23:22.544 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-08T12:23:22.551 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-08T12:23:22.588 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-08T12:23:22.604 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:23:22.908 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2023-11-08T12:23:22.926 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:22.999 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:23.112 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-08T12:23:23.125 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-08T12:23:23.162 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:23:23.394 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-08T12:23:23.414 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-08T12:23:23.452 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-08T12:23:23.565 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-08T12:23:23.589 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-08T12:23:23.632 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:23:23.855 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-08T12:23:23.873 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-08T12:23:23.938 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-08T12:23:24.052 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-08T12:23:24.065 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-08T12:23:24.094 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-08T12:23:24.319 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-08T12:23:24.337 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-08T12:23:24.376 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-08T12:23:24.486 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-librbd1_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:24.614 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (18.0.0-2698-gb820560f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-08T12:23:24.771 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2023-11-08T12:23:24.793 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-librgw2_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:24.837 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:25.338 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-librados2_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:25.494 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (18.0.0-2698-gb820560f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-08T12:23:25.757 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2023-11-08T12:23:25.774 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:25.814 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:26.247 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2023-11-08T12:23:26.267 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:26.275 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0. 2023-11-08T12:23:26.295 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-08T12:23:26.305 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:26.334 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-08T12:23:26.683 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2023-11-08T12:23:26.706 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2023-11-08T12:23:26.706 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-python3-rados_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:26.713 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:26.741 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:26.753 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:27.161 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-08T12:23:27.179 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:27.219 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:27.315 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2023-11-08T12:23:27.337 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:27.372 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:27.529 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2023-11-08T12:23:27.543 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:27.588 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:27.941 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-08T12:23:27.963 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:28.007 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:28.369 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2023-11-08T12:23:28.391 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-08T12:23:28.427 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-08T12:23:28.730 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2023-11-08T12:23:28.751 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:28.796 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:29.199 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-08T12:23:29.220 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-08T12:23:29.265 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-08T12:23:29.660 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-08T12:23:29.680 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-08T12:23:29.718 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-08T12:23:29.962 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2023-11-08T12:23:29.982 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:30.013 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-08T12:23:30.032 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-08T12:23:30.043 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:30.063 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-08T12:23:30.466 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2023-11-08T12:23:30.486 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-librgw2_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:30.524 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:31.460 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2023-11-08T12:23:31.481 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:31.526 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:31.541 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-08T12:23:31.562 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-08T12:23:31.607 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-08T12:23:31.904 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0. 2023-11-08T12:23:31.925 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-08T12:23:31.962 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-08T12:23:32.044 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2023-11-08T12:23:32.064 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-08T12:23:32.102 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-08T12:23:32.290 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2023-11-08T12:23:32.310 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:32.348 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:32.472 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2023-11-08T12:23:32.490 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-08T12:23:32.529 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-08T12:23:32.868 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2023-11-08T12:23:32.888 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-ceph-common_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:32.899 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-08T12:23:32.920 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-08T12:23:32.926 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:32.982 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-08T12:23:33.360 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2023-11-08T12:23:33.380 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-08T12:23:33.418 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-08T12:23:33.788 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-08T12:23:33.809 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-08T12:23:33.846 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-08T12:23:34.191 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-08T12:23:34.211 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-08T12:23:34.282 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-08T12:23:34.669 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2023-11-08T12:23:34.690 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-08T12:23:34.735 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-08T12:23:35.121 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-08T12:23:35.138 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-08T12:23:35.179 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-08T12:23:35.448 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2023-11-08T12:23:35.466 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-ceph-base_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:35.531 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:35.549 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bs4. 2023-11-08T12:23:35.569 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-08T12:23:35.632 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-08T12:23:36.044 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2023-11-08T12:23:36.064 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-08T12:23:36.100 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-08T12:23:36.496 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2023-11-08T12:23:36.519 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-08T12:23:36.604 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-08T12:23:36.936 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-08T12:23:36.949 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-08T12:23:36.974 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2023-11-08T12:23:36.985 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-08T12:23:36.994 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-08T12:23:37.032 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-08T12:23:37.364 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-natsort. 2023-11-08T12:23:37.384 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-08T12:23:37.410 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-08T12:23:37.427 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-08T12:23:37.439 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-08T12:23:37.468 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-08T12:23:37.792 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2023-11-08T12:23:37.812 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-08T12:23:37.813 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-08T12:23:37.833 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-08T12:23:37.867 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-08T12:23:38.220 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-08T12:23:38.236 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-08T12:23:38.249 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2023-11-08T12:23:38.270 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-08T12:23:38.277 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-08T12:23:38.307 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-08T12:23:38.606 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2023-11-08T12:23:38.627 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2023-11-08T12:23:38.628 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-08T12:23:38.646 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-08T12:23:38.663 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-08T12:23:38.684 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-08T12:23:39.042 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-08T12:23:39.061 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-08T12:23:39.100 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-08T12:23:39.114 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-08T12:23:39.131 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-08T12:23:39.205 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-08T12:23:39.395 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-08T12:23:39.415 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-08T12:23:39.444 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-08T12:23:39.567 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-08T12:23:39.588 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:39.625 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:40.139 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2023-11-08T12:23:40.158 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-08T12:23:40.197 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-08T12:23:40.211 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-08T12:23:40.231 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:40.271 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:40.617 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-08T12:23:40.632 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cryptography. 2023-11-08T12:23:40.635 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-08T12:23:40.650 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-08T12:23:40.675 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-08T12:23:40.690 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-08T12:23:41.059 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bs4. 2023-11-08T12:23:41.071 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-08T12:23:41.111 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-08T12:23:41.119 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2023-11-08T12:23:41.138 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-08T12:23:41.202 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-08T12:23:41.498 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2023-11-08T12:23:41.517 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-08T12:23:41.580 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2023-11-08T12:23:41.596 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-08T12:23:41.598 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:41.638 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:41.967 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2023-11-08T12:23:41.988 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-08T12:23:42.034 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-08T12:23:42.108 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2023-11-08T12:23:42.128 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:42.166 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:42.378 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2023-11-08T12:23:42.397 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-08T12:23:42.436 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-08T12:23:42.781 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-08T12:23:42.802 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-08T12:23:42.839 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-08T12:23:43.192 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-08T12:23:43.208 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-08T12:23:43.250 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-08T12:23:43.478 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2023-11-08T12:23:43.499 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:43.544 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:43.604 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2023-11-08T12:23:43.622 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-08T12:23:43.678 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-08T12:23:44.031 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2023-11-08T12:23:44.050 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-08T12:23:44.089 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-08T12:23:44.519 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-08T12:23:44.531 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-08T12:23:44.568 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-08T12:23:44.871 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-08T12:23:44.883 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:44.913 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:45.351 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-08T12:23:45.368 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:45.409 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:45.796 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cryptography. 2023-11-08T12:23:45.815 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-08T12:23:45.854 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-08T12:23:46.291 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2023-11-08T12:23:46.297 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2023-11-08T12:23:46.307 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-08T12:23:46.317 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-ceph_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:46.349 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-08T12:23:46.355 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:46.736 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2023-11-08T12:23:46.754 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:46.766 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2023-11-08T12:23:46.787 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:46.810 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:46.824 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:47.295 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2023-11-08T12:23:47.315 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:47.352 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:47.355 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2023-11-08T12:23:47.374 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:47.413 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:47.931 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2023-11-08T12:23:47.950 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-cephadm_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:47.988 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:48.377 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-08T12:23:48.396 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-08T12:23:48.441 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-08T12:23:48.700 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2023-11-08T12:23:48.712 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:48.749 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:48.878 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2023-11-08T12:23:48.898 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-08T12:23:48.935 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-08T12:23:49.322 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-08T12:23:49.342 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:49.404 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:49.775 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-08T12:23:49.795 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-08T12:23:49.841 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-08T12:23:50.219 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jwt. 2023-11-08T12:23:50.241 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-08T12:23:50.285 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-08T12:23:50.980 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-attr. 2023-11-08T12:23:50.999 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-08T12:23:51.037 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-08T12:23:51.407 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2023-11-08T12:23:51.426 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-08T12:23:51.465 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-08T12:23:51.495 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2023-11-08T12:23:51.509 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-ceph_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:51.552 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:51.835 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2023-11-08T12:23:51.853 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-08T12:23:51.893 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-08T12:23:51.905 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2023-11-08T12:23:51.917 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:51.988 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:52.290 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-08T12:23:52.308 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-08T12:23:52.346 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-08T12:23:52.425 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2023-11-08T12:23:52.439 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:52.508 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:52.699 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-packaging. 2023-11-08T12:23:52.719 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-08T12:23:52.756 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-08T12:23:53.069 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2023-11-08T12:23:53.076 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-cephadm_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:23:53.118 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2023-11-08T12:23:53.118 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:53.138 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-08T12:23:53.175 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-08T12:23:53.463 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-08T12:23:53.478 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-08T12:23:53.546 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-08T12:23:53.588 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-08T12:23:53.605 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-08T12:23:53.645 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-08T12:23:53.925 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2023-11-08T12:23:53.937 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-08T12:23:53.965 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjs-underscore. 2023-11-08T12:23:53.982 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-08T12:23:53.983 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-08T12:23:54.022 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-08T12:23:54.358 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-08T12:23:54.361 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-08T12:23:54.373 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:54.376 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-08T12:23:54.410 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:54.416 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-08T12:23:54.803 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2023-11-08T12:23:54.805 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-08T12:23:54.819 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-08T12:23:54.819 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-08T12:23:54.860 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-08T12:23:54.871 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-08T12:23:55.241 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jwt. 2023-11-08T12:23:55.255 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-08T12:23:55.299 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-08T12:23:55.314 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-08T12:23:55.328 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:55.371 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:23:55.687 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-attr. 2023-11-08T12:23:55.701 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-11-08T12:23:55.745 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-08T12:23:55.942 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-decorator. 2023-11-08T12:23:55.958 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-08T12:23:55.999 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-08T12:23:56.090 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2023-11-08T12:23:56.103 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-11-08T12:23:56.156 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-08T12:23:56.369 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-08T12:23:56.386 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-08T12:23:56.427 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-08T12:23:56.509 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2023-11-08T12:23:56.520 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-08T12:23:56.558 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-08T12:23:56.797 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-scipy. 2023-11-08T12:23:56.813 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-08T12:23:56.888 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-08T12:23:56.962 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-08T12:23:56.976 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-08T12:23:57.020 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-08T12:23:57.356 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-packaging. 2023-11-08T12:23:57.372 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-11-08T12:23:57.414 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-08T12:23:57.784 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2023-11-08T12:23:57.800 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-11-08T12:23:57.841 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-08T12:23:58.262 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-08T12:23:58.277 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-11-08T12:23:58.301 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-08T12:23:58.320 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-08T12:23:58.328 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-08T12:23:58.359 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-08T12:23:58.614 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-underscore. 2023-11-08T12:23:58.629 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-08T12:23:58.672 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-08T12:23:58.971 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2023-11-08T12:23:58.988 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-08T12:23:59.008 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-08T12:23:59.020 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-08T12:23:59.028 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-08T12:23:59.057 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-08T12:23:59.402 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2023-11-08T12:23:59.417 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-11-08T12:23:59.460 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-08T12:23:59.516 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2023-11-08T12:23:59.533 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-08T12:23:59.573 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-08T12:23:59.863 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-08T12:23:59.876 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:23:59.921 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:00.457 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-08T12:24:00.475 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:00.491 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-decorator. 2023-11-08T12:24:00.506 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-08T12:24:00.515 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:00.549 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-08T12:24:00.910 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-08T12:24:00.925 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-08T12:24:00.968 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-08T12:24:01.313 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-scipy. 2023-11-08T12:24:01.326 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-08T12:24:01.370 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-08T12:24:01.835 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2023-11-08T12:24:01.854 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-08T12:24:01.892 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-08T12:24:02.352 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-08T12:24:02.369 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-08T12:24:02.442 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-08T12:24:02.767 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-08T12:24:02.784 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-08T12:24:02.824 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-08T12:24:02.862 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-08T12:24:02.879 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-08T12:24:02.920 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-08T12:24:03.299 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2023-11-08T12:24:03.314 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-08T12:24:03.356 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-08T12:24:03.413 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2023-11-08T12:24:03.427 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-11-08T12:24:03.496 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-08T12:24:03.777 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2023-11-08T12:24:03.787 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-08T12:24:03.826 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-08T12:24:03.909 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2023-11-08T12:24:03.922 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-08T12:24:03.965 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-08T12:24:04.206 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-blinker. 2023-11-08T12:24:04.224 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-08T12:24:04.263 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-08T12:24:04.608 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-08T12:24:04.621 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-08T12:24:04.665 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-08T12:24:04.765 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-08T12:24:04.777 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:04.823 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:05.103 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-08T12:24:05.118 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-08T12:24:05.160 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-08T12:24:05.499 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2023-11-08T12:24:05.514 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-08T12:24:05.557 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-08T12:24:05.935 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-08T12:24:05.949 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-08T12:24:05.993 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-08T12:24:06.059 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cachetools. 2023-11-08T12:24:06.070 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-11-08T12:24:06.109 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-08T12:24:06.558 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-08T12:24:06.576 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-08T12:24:06.618 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-08T12:24:06.664 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-08T12:24:06.680 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:06.747 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:07.023 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-08T12:24:07.038 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-08T12:24:07.081 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-08T12:24:07.109 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-08T12:24:07.122 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-08T12:24:07.166 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-08T12:24:07.441 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2023-11-08T12:24:07.457 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-11-08T12:24:07.498 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-08T12:24:07.586 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-08T12:24:07.594 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:24:07.635 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:07.877 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-google-auth. 2023-11-08T12:24:07.892 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-11-08T12:24:07.934 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-08T12:24:07.947 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2023-11-08T12:24:07.963 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:24:08.005 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:08.325 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2023-11-08T12:24:08.342 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-08T12:24:08.355 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-blinker. 2023-11-08T12:24:08.372 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-08T12:24:08.407 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-08T12:24:08.413 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-08T12:24:08.749 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-08T12:24:08.769 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-08T12:24:08.786 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2023-11-08T12:24:08.799 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-08T12:24:08.807 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-08T12:24:08.843 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-08T12:24:09.186 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-08T12:24:09.202 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-08T12:24:09.244 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-08T12:24:09.275 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2023-11-08T12:24:09.290 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:09.357 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:09.614 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2023-11-08T12:24:09.632 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-08T12:24:09.672 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-08T12:24:10.050 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-08T12:24:10.070 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-08T12:24:10.108 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-08T12:24:10.939 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-08T12:24:10.956 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:10.996 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:11.383 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-08T12:24:11.400 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-11-08T12:24:11.440 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-08T12:24:11.843 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-08T12:24:11.862 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:24:11.901 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:12.229 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2023-11-08T12:24:12.250 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:24:12.287 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:12.582 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2023-11-08T12:24:12.602 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-11-08T12:24:12.640 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-08T12:24:13.011 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2023-11-08T12:24:13.030 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-08T12:24:13.067 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-08T12:24:13.514 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2023-11-08T12:24:13.533 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-ceph-test_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:13.561 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2023-11-08T12:24:13.572 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:13.579 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:14.024 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-08T12:24:14.043 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:14.081 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-mirror (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:14.468 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-colorama. 2023-11-08T12:24:14.485 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-08T12:24:14.564 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-08T12:24:14.837 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-shell. 2023-11-08T12:24:14.854 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:14.928 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-shell (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:15.206 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-top. 2023-11-08T12:24:15.223 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:15.288 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-top (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:15.600 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-08T12:24:15.616 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-08T12:24:15.657 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:16.236 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-08T12:24:16.254 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:16.293 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:16.739 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2023-11-08T12:24:16.757 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-08T12:24:16.832 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-08T12:24:17.251 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-08T12:24:17.268 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-08T12:24:17.309 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-08T12:24:17.754 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-08T12:24:17.772 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-08T12:24:17.810 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-volume. 2023-11-08T12:24:17.811 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:17.832 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-ceph-volume_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:17.876 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-volume (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:18.256 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-08T12:24:18.274 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-cephfs-mirror_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:18.314 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-mirror (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:18.684 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-colorama. 2023-11-08T12:24:18.700 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-08T12:24:18.741 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-08T12:24:19.036 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-shell. 2023-11-08T12:24:19.056 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-cephfs-shell_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:19.093 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-shell (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:19.405 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-top. 2023-11-08T12:24:19.423 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-cephfs-top_18.0.0-2698-gb820560f-1focal_all.deb ... 2023-11-08T12:24:19.462 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-top (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:19.774 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-08T12:24:19.840 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:19.888 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-08T12:24:19.902 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-08T12:24:19.946 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-08T12:24:20.367 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webencodings. 2023-11-08T12:24:20.385 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-08T12:24:20.402 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-08T12:24:20.421 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-libcephfs-dev_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:20.424 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-08T12:24:20.468 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:20.769 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-html5lib. 2023-11-08T12:24:20.788 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-08T12:24:20.860 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-08T12:24:20.930 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2023-11-08T12:24:20.949 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-08T12:24:21.025 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-08T12:24:21.426 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-08T12:24:21.445 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-08T12:24:21.484 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-08T12:24:21.555 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-08T12:24:21.575 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-08T12:24:21.612 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-08T12:24:21.920 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-08T12:24:21.940 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-08T12:24:21.978 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:22.133 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2023-11-08T12:24:22.150 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-08T12:24:22.190 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-08T12:24:22.586 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2023-11-08T12:24:22.602 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-08T12:24:22.643 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-08T12:24:23.056 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-08T12:24:23.075 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-08T12:24:23.113 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-08T12:24:23.486 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2023-11-08T12:24:23.506 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-08T12:24:23.551 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-08T12:24:23.896 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-08T12:24:23.915 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-08T12:24:23.950 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-08T12:24:23.953 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-08T12:24:23.969 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-08T12:24:24.007 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-08T12:24:24.411 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webencodings. 2023-11-08T12:24:24.429 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-08T12:24:24.477 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-08T12:24:24.771 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-html5lib. 2023-11-08T12:24:24.774 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2023-11-08T12:24:24.790 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-11-08T12:24:24.791 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-radosgw_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:24.829 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-08T12:24:24.833 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:25.233 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-08T12:24:25.249 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-08T12:24:25.290 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-08T12:24:25.819 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2023-11-08T12:24:25.838 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-11-08T12:24:25.876 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-08T12:24:26.247 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2023-11-08T12:24:26.266 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:26.297 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-psutil. 2023-11-08T12:24:26.304 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:26.317 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-08T12:24:26.354 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-08T12:24:26.742 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-08T12:24:26.749 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-08T12:24:26.769 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-08T12:24:26.807 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-08T12:24:27.118 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-08T12:24:27.169 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2023-11-08T12:24:27.189 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-08T12:24:27.227 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-08T12:24:27.246 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-08T12:24:27.397 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-08T12:24:27.549 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-08T12:24:27.569 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-08T12:24:27.632 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-08T12:24:27.673 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:28.369 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2023-11-08T12:24:28.386 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../116-radosgw_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:28.429 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:28.498 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2023-11-08T12:24:28.712 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:28.838 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-08T12:24:29.256 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-08T12:24:29.675 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:29.800 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-08T12:24:29.832 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2023-11-08T12:24:29.851 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-2698-gb820560f-1focal_amd64.deb ... 2023-11-08T12:24:29.891 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:29.926 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-08T12:24:30.282 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-08T12:24:30.361 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-08T12:24:30.646 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-08T12:24:30.805 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-08T12:24:30.846 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-08T12:24:30.931 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-08T12:24:31.160 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:31.206 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-08T12:24:31.591 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-08T12:24:31.944 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2023-11-08T12:24:32.009 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-08T12:24:32.133 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:32.293 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-08T12:24:32.368 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-08T12:24:32.718 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-08T12:24:32.736 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:33.094 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-08T12:24:33.103 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-08T12:24:33.212 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-08T12:24:33.229 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-08T12:24:33.371 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-08T12:24:33.605 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-08T12:24:33.764 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-08T12:24:34.006 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-08T12:24:34.283 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-08T12:24:34.366 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-08T12:24:34.491 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-08T12:24:34.668 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-08T12:24:34.959 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-08T12:24:35.019 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-08T12:24:35.327 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-08T12:24:35.404 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-08T12:24:35.686 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-08T12:24:35.738 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-08T12:24:36.089 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:36.096 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-08T12:24:36.439 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-08T12:24:36.457 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-08T12:24:36.591 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-08T12:24:36.848 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-08T12:24:36.959 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-08T12:24:37.266 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-08T12:24:37.310 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-08T12:24:37.617 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-08T12:24:37.669 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-08T12:24:37.742 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-08T12:24:37.795 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-08T12:24:37.868 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-08T12:24:38.238 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-08T12:24:38.295 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-08T12:24:38.597 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-08T12:24:38.779 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-08T12:24:38.968 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-08T12:24:39.172 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-08T12:24:39.383 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-08T12:24:39.657 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-08T12:24:39.776 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-08T12:24:40.100 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-08T12:24:40.193 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-08T12:24:40.259 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-08T12:24:40.652 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:24:40.795 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-08T12:24:41.263 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-08T12:24:41.278 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-08T12:24:41.389 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-08T12:24:41.404 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-08T12:24:41.514 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-08T12:24:41.530 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-08T12:24:41.881 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-08T12:24:41.935 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-08T12:24:42.344 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:24:42.391 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-08T12:24:42.470 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-08T12:24:42.638 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-08T12:24:42.767 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-08T12:24:43.031 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-08T12:24:43.252 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-08T12:24:43.382 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-08T12:24:43.728 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-08T12:24:43.741 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-08T12:24:43.855 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:43.893 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-08T12:24:44.244 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-08T12:24:44.272 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:24:44.444 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-08T12:24:44.612 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-08T12:24:44.891 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-08T12:24:44.996 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-08T12:24:45.067 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-08T12:24:45.193 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-08T12:24:45.429 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-08T12:24:45.561 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-08T12:24:45.790 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-08T12:24:45.958 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-08T12:24:45.990 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:24:46.121 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-08T12:24:46.247 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-08T12:24:46.352 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-08T12:24:46.649 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-08T12:24:46.772 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-08T12:24:46.931 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-08T12:24:46.992 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-08T12:24:47.057 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-08T12:24:47.384 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-08T12:24:47.492 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-08T12:24:47.510 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-08T12:24:47.852 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-08T12:24:47.886 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-08T12:24:48.245 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-08T12:24:48.647 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-08T12:24:49.062 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-08T12:24:49.383 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-08T12:24:49.508 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-08T12:24:49.657 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:49.825 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-08T12:24:49.901 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-08T12:24:50.310 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-08T12:24:50.336 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-08T12:24:50.453 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-08T12:24:50.580 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-08T12:24:50.762 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-08T12:24:50.985 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-08T12:24:51.123 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:24:51.248 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-08T12:24:51.326 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-08T12:24:51.658 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-08T12:24:52.160 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-08T12:24:52.637 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-08T12:24:53.071 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-08T12:24:53.123 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:53.250 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-08T12:24:53.734 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-08T12:24:54.101 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-08T12:24:54.312 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-08T12:24:54.461 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-08T12:24:54.471 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-08T12:24:54.587 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-08T12:24:54.597 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:54.756 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-08T12:24:55.005 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-08T12:24:55.124 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-08T12:24:55.250 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-08T12:24:55.425 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-08T12:24:55.693 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-08T12:24:55.902 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-08T12:24:56.053 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-08T12:24:56.336 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-08T12:24:56.437 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-08T12:24:56.873 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:57.151 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-08T12:24:57.322 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:57.453 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:57.587 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:57.634 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-08T12:24:57.738 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-08T12:24:57.759 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-08T12:24:57.886 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-08T12:24:58.045 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-08T12:24:58.107 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:58.232 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-08T12:24:58.413 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-08T12:24:58.564 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-08T12:24:58.659 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:58.802 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:58.928 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:24:58.940 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-08T12:24:59.213 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-08T12:24:59.213 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-08T12:24:59.292 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-08T12:24:59.684 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-08T12:25:00.121 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:00.136 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:00.280 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:00.365 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-08T12:25:00.406 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-top (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:00.490 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:00.532 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-08T12:25:00.650 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsqlite3-mod-ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:00.776 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:00.902 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-08T12:25:01.261 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:01.396 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-08T12:25:01.712 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:01.772 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:01.868 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:01.907 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:01.997 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:02.033 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:02.283 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:02.308 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-08T12:25:02.309 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-08T12:25:02.409 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-shell (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:02.560 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:03.126 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:03.175 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2023-11-08T12:25:03.302 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:03.428 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-top (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:03.554 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-08T12:25:03.631 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2023-11-08T12:25:03.853 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2023-11-08T12:25:03.887 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-08T12:25:04.092 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-08T12:25:04.658 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-08T12:25:04.745 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:04.875 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:05.001 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:05.127 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:05.286 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-shell (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:05.412 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:05.561 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-mirror (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:05.688 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:05.813 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:06.020 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2023-11-08T12:25:06.168 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-08T12:25:06.169 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-08T12:25:06.508 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2023-11-08T12:25:06.782 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2023-11-08T12:25:06.813 INFO:teuthology.orchestra.run.smithi133.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-08T12:25:06.996 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-08T12:25:07.432 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:07.501 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-08T12:25:07.969 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-08T12:25:08.447 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-mirror (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:08.573 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:08.699 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:08.909 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:09.015 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-08T12:25:09.015 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-08T12:25:09.185 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-08T12:25:09.186 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-08T12:25:10.102 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:10.284 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:10.408 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-08T12:25:10.408 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-08T12:25:10.807 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-08T12:25:11.212 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:11.919 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:12.043 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-08T12:25:12.043 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-08T12:25:12.234 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-08T12:25:12.234 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-08T12:25:12.906 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:13.023 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:13.096 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:13.208 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:13.375 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-08T12:25:13.375 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-08T12:25:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-08T12:25:13.468 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-08T12:25:14.272 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:14.301 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:14.485 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:14.619 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:14.804 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:14.931 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-08T12:25:15.081 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-08T12:25:15.081 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-08T12:25:15.118 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-08T12:25:15.625 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-08T12:25:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:16.066 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:16.242 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:16.495 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-08T12:25:16.495 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-08T12:25:17.394 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:17.544 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:17.670 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:17.855 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-volume (18.0.0-2698-gb820560f-1focal) ... 2023-11-08T12:25:17.982 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-08T12:25:18.142 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-08T12:25:18.610 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-08T12:25:20.861 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-08T12:25:21.660 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-08T12:25:21.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-08T12:25:21.792 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2023-11-08T12:25:21.997 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2023-11-08T12:25:21.998 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2023-11-08T12:25:22.202 INFO:teuthology.orchestra.run.smithi112.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-08T12:25:22.202 INFO:teuthology.orchestra.run.smithi112.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-08T12:25:22.202 INFO:teuthology.orchestra.run.smithi112.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-08T12:25:22.202 INFO:teuthology.orchestra.run.smithi112.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-08T12:25:22.203 INFO:teuthology.orchestra.run.smithi112.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-08T12:25:22.203 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2023-11-08T12:25:22.204 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-08T12:25:22.204 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-08T12:25:22.204 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2023-11-08T12:25:22.205 INFO:teuthology.orchestra.run.smithi112.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-08T12:25:22.205 INFO:teuthology.orchestra.run.smithi112.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-08T12:25:22.205 INFO:teuthology.orchestra.run.smithi112.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-08T12:25:22.205 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-08T12:25:22.205 INFO:teuthology.orchestra.run.smithi112.stdout: usb-modeswitch-data wpasupplicant 2023-11-08T12:25:22.206 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2023-11-08T12:25:22.206 INFO:teuthology.orchestra.run.smithi112.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-08T12:25:22.206 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-08T12:25:22.207 INFO:teuthology.orchestra.run.smithi112.stdout: libengine-pkcs11-openssl 2023-11-08T12:25:22.314 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2023-11-08T12:25:22.315 INFO:teuthology.orchestra.run.smithi112.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-08T12:25:22.315 INFO:teuthology.orchestra.run.smithi112.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-08T12:25:22.316 INFO:teuthology.orchestra.run.smithi112.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-08T12:25:22.317 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-08T12:25:22.317 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-08T12:25:22.317 INFO:teuthology.orchestra.run.smithi112.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-08T12:25:22.318 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2023-11-08T12:25:22.319 INFO:teuthology.orchestra.run.smithi112.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-08T12:25:22.516 INFO:teuthology.orchestra.run.smithi112.stdout:6 upgraded, 31 newly installed, 0 to remove and 252 not upgraded. 2023-11-08T12:25:22.516 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 25.3 MB of archives. 2023-11-08T12:25:22.517 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-08T12:25:22.517 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-08T12:25:23.156 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-08T12:25:23.158 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-08T12:25:23.171 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-08T12:25:23.174 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-08T12:25:23.273 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-08T12:25:23.275 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-08T12:25:23.282 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-08T12:25:23.287 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-08T12:25:23.288 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-08T12:25:23.455 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-08T12:25:23.727 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-08T12:25:23.728 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-08T12:25:23.871 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-08T12:25:23.875 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-08T12:25:23.982 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-08T12:25:23.988 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-08T12:25:24.065 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-08T12:25:24.084 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-08T12:25:24.150 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-08T12:25:24.151 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-08T12:25:24.235 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-08T12:25:24.399 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-08T12:25:24.510 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-08T12:25:24.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-08T12:25:24.642 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-11-08T12:25:24.851 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-11-08T12:25:24.852 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-11-08T12:25:25.028 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-08T12:25:25.052 INFO:teuthology.orchestra.run.smithi133.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-08T12:25:25.052 INFO:teuthology.orchestra.run.smithi133.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-08T12:25:25.052 INFO:teuthology.orchestra.run.smithi133.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-08T12:25:25.052 INFO:teuthology.orchestra.run.smithi133.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-08T12:25:25.053 INFO:teuthology.orchestra.run.smithi133.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-08T12:25:25.053 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-11-08T12:25:25.054 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-08T12:25:25.054 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-08T12:25:25.054 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-11-08T12:25:25.054 INFO:teuthology.orchestra.run.smithi133.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-08T12:25:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-08T12:25:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-08T12:25:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-08T12:25:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: usb-modeswitch-data wpasupplicant 2023-11-08T12:25:25.056 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-11-08T12:25:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-08T12:25:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-08T12:25:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: libengine-pkcs11-openssl 2023-11-08T12:25:25.129 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-08T12:25:25.166 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-11-08T12:25:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-08T12:25:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-08T12:25:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-08T12:25:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-08T12:25:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-08T12:25:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-08T12:25:25.169 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-11-08T12:25:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-08T12:25:25.218 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-08T12:25:25.227 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-08T12:25:25.228 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-08T12:25:25.229 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-08T12:25:25.229 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-08T12:25:25.252 INFO:teuthology.orchestra.run.smithi133.stdout:6 upgraded, 31 newly installed, 0 to remove and 252 not upgraded. 2023-11-08T12:25:25.253 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 25.3 MB of archives. 2023-11-08T12:25:25.253 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-08T12:25:25.253 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-08T12:25:25.262 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-08T12:25:25.267 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-08T12:25:25.495 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-08T12:25:25.497 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-08T12:25:25.498 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-08T12:25:25.508 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-08T12:25:25.508 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-08T12:25:25.570 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-08T12:25:25.572 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-08T12:25:25.577 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-08T12:25:25.580 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-08T12:25:25.581 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-08T12:25:25.592 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-08T12:25:25.595 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-08T12:25:25.600 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-08T12:25:25.601 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-08T12:25:25.638 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-08T12:25:25.639 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-08T12:25:25.642 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-08T12:25:25.650 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-08T12:25:25.653 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-08T12:25:25.660 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-08T12:25:25.660 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-08T12:25:25.699 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-08T12:25:25.700 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-08T12:25:25.716 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-08T12:25:25.754 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-08T12:25:25.806 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-08T12:25:25.844 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-08T12:25:25.848 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-08T12:25:25.848 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-08T12:25:25.849 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-08T12:25:25.858 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-08T12:25:25.883 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-08T12:25:25.886 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-08T12:25:25.890 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-08T12:25:25.890 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-08T12:25:26.006 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-08T12:25:26.290 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-08T12:25:26.291 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-08T12:25:26.291 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-08T12:25:26.292 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-08T12:25:26.292 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-08T12:25:26.684 INFO:teuthology.orchestra.run.smithi112.stdout:Preconfiguring packages ... 2023-11-08T12:25:26.873 INFO:teuthology.orchestra.run.smithi133.stdout:Preconfiguring packages ... 2023-11-08T12:25:26.933 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 25.3 MB in 4s (6,705 kB/s) 2023-11-08T12:25:27.274 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-11-08T12:25:27.277 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-08T12:25:27.304 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 25.3 MB in 1s (22.7 MB/s) 2023-11-08T12:25:27.462 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-08T12:25:27.629 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-11-08T12:25:27.632 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-08T12:25:27.812 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-08T12:25:29.326 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-08T12:25:29.447 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-08T12:25:31.373 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-11-08T12:25:31.376 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-08T12:25:31.454 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-11-08T12:25:31.458 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-08T12:25:31.505 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-08T12:25:31.582 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-08T12:25:32.006 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-08T12:25:32.058 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-08T12:25:32.170 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-08T12:25:32.364 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-08T12:25:32.538 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-08T12:25:32.740 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-08T12:25:33.062 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-11-08T12:25:33.066 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-08T12:25:33.238 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-08T12:25:33.255 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-11-08T12:25:33.258 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-08T12:25:33.413 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-08T12:25:33.765 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-08T12:25:33.919 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-08T12:25:33.948 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-08T12:25:34.076 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-08T12:25:34.470 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-08T12:25:34.632 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-08T12:25:34.638 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-08T12:25:34.781 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-08T12:25:35.178 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-08T12:25:35.198 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-08T12:25:35.253 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-08T12:25:35.344 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-08T12:25:35.366 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-08T12:25:35.410 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-08T12:25:35.647 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package dump. 2023-11-08T12:25:35.669 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-08T12:25:35.713 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking dump (0.4b46-6) ... 2023-11-08T12:25:35.763 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package dump. 2023-11-08T12:25:35.785 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-08T12:25:35.854 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking dump (0.4b46-6) ... 2023-11-08T12:25:36.085 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package indent. 2023-11-08T12:25:36.107 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:36.151 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-08T12:25:36.166 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package indent. 2023-11-08T12:25:36.190 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:36.233 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-08T12:25:36.554 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-08T12:25:36.578 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-08T12:25:36.611 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-08T12:25:36.620 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-08T12:25:36.633 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-08T12:25:36.677 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-08T12:25:37.024 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-08T12:25:37.045 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-08T12:25:37.064 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-08T12:25:37.083 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-08T12:25:37.090 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-08T12:25:37.122 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-08T12:25:37.427 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-08T12:25:37.448 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-08T12:25:37.493 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:25:37.652 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-08T12:25:37.674 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-08T12:25:37.718 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:25:37.905 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-08T12:25:37.926 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:37.979 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:25:38.113 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-08T12:25:38.135 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:38.180 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:25:38.399 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-08T12:25:38.422 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:38.465 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:25:38.483 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-08T12:25:38.504 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:38.549 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:25:38.844 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-08T12:25:38.863 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:38.902 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:25:38.903 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-08T12:25:38.924 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:38.985 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:25:39.330 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-08T12:25:39.351 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-08T12:25:39.371 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-08T12:25:39.394 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-08T12:25:39.396 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-08T12:25:39.463 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-08T12:25:39.799 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-08T12:25:39.819 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-08T12:25:39.833 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-08T12:25:39.854 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-08T12:25:39.857 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-08T12:25:39.899 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-08T12:25:40.319 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-08T12:25:40.320 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-08T12:25:40.340 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:40.341 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:40.385 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:40.386 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:40.789 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-08T12:25:40.805 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-08T12:25:40.808 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:40.826 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:40.847 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:25:40.871 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:25:41.266 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-08T12:25:41.267 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-08T12:25:41.288 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:41.289 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:41.332 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:25:41.333 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:25:41.652 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-08T12:25:41.652 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-08T12:25:41.671 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-08T12:25:41.675 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-08T12:25:41.710 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-08T12:25:41.718 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-08T12:25:42.280 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-08T12:25:42.299 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-08T12:25:42.306 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-08T12:25:42.327 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-08T12:25:42.338 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-08T12:25:42.372 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-08T12:25:42.809 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package modemmanager. 2023-11-08T12:25:42.831 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:42.926 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:25:43.108 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package modemmanager. 2023-11-08T12:25:43.128 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-08T12:25:43.195 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:25:43.640 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package wpasupplicant. 2023-11-08T12:25:43.662 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-08T12:25:43.706 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-08T12:25:43.839 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package wpasupplicant. 2023-11-08T12:25:43.858 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-08T12:25:43.897 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-08T12:25:44.329 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager. 2023-11-08T12:25:44.350 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-08T12:25:44.444 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-08T12:25:44.486 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager. 2023-11-08T12:25:44.507 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-08T12:25:44.596 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-08T12:25:45.269 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ppp. 2023-11-08T12:25:45.291 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-08T12:25:45.384 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ppp. 2023-11-08T12:25:45.404 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-08T12:25:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-08T12:25:45.910 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-08T12:25:46.191 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pptp-linux. 2023-11-08T12:25:46.212 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-08T12:25:46.274 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-08T12:25:46.347 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pptp-linux. 2023-11-08T12:25:46.369 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-08T12:25:46.422 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-08T12:25:46.671 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-08T12:25:46.695 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-08T12:25:46.775 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-08T12:25:46.834 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-08T12:25:46.854 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-08T12:25:46.926 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-08T12:25:47.141 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-08T12:25:47.162 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-08T12:25:47.240 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-08T12:25:47.287 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-08T12:25:47.309 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-08T12:25:47.353 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-08T12:25:47.628 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-08T12:25:47.651 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:47.691 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-08T12:25:47.694 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:47.714 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:47.758 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:48.408 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-common. 2023-11-08T12:25:48.420 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-common. 2023-11-08T12:25:48.430 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-08T12:25:48.443 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-08T12:25:48.505 INFO:teuthology.orchestra.run.smithi112.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-08T12:25:48.519 INFO:teuthology.orchestra.run.smithi133.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-08T12:25:48.536 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-08T12:25:48.549 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-08T12:25:49.102 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-12. 2023-11-08T12:25:49.106 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-12. 2023-11-08T12:25:49.125 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:49.127 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-08T12:25:49.176 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:49.180 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:50.746 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql. 2023-11-08T12:25:50.768 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-08T12:25:50.813 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-08T12:25:50.867 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql. 2023-11-08T12:25:50.892 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-08T12:25:50.959 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-08T12:25:51.124 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client. 2023-11-08T12:25:51.146 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-08T12:25:51.190 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-08T12:25:51.253 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client. 2023-11-08T12:25:51.275 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-08T12:25:51.328 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-08T12:25:51.484 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-08T12:25:51.507 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-08T12:25:51.550 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-08T12:25:51.647 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-08T12:25:51.669 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-08T12:25:51.713 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-08T12:25:51.836 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-08T12:25:51.859 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-08T12:25:51.902 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-08T12:25:51.999 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-08T12:25:52.023 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-08T12:25:52.065 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-08T12:25:52.331 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-08T12:25:52.353 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-08T12:25:52.418 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-08T12:25:52.518 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-08T12:25:52.533 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-08T12:25:52.632 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-08T12:25:52.779 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-08T12:25:53.007 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-08T12:25:53.011 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-08T12:25:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-08T12:25:53.346 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:53.497 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-08T12:25:53.623 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-08T12:25:53.750 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-08T12:25:53.967 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:54.093 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-08T12:25:54.218 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-08T12:25:54.218 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-08T12:25:54.253 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-08T12:25:54.379 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-08T12:25:54.845 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-08T12:25:54.845 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-08T12:25:55.152 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:55.757 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:25:57.225 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-08T12:25:57.340 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-08T12:25:57.466 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-08T12:25:57.592 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-08T12:25:57.899 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-08T12:25:58.013 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-08T12:25:58.163 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-08T12:25:58.289 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-08T12:25:59.062 INFO:teuthology.orchestra.run.smithi133.stdout:Adding user postgres to group ssl-cert 2023-11-08T12:25:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:25:59.461 INFO:teuthology.orchestra.run.smithi133.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-08T12:25:59.778 INFO:teuthology.orchestra.run.smithi112.stdout:Adding user postgres to group ssl-cert 2023-11-08T12:25:59.964 INFO:teuthology.orchestra.run.smithi133.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-08T12:25:59.964 INFO:teuthology.orchestra.run.smithi133.stdout:Removing obsolete dictionary files: 2023-11-08T12:26:00.190 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:00.190 INFO:teuthology.orchestra.run.smithi112.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-08T12:26:00.517 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-08T12:26:00.684 INFO:teuthology.orchestra.run.smithi112.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-08T12:26:00.684 INFO:teuthology.orchestra.run.smithi112.stdout:Removing obsolete dictionary files: 2023-11-08T12:26:01.223 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-08T12:26:02.035 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-08T12:26:02.161 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-08T12:26:02.296 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-08T12:26:02.422 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-08T12:26:02.625 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-08T12:26:02.800 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-08T12:26:02.926 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-08T12:26:03.086 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-08T12:26:03.736 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-08T12:26:04.136 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up dump (0.4b46-6) ... 2023-11-08T12:26:04.245 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-08T12:26:04.312 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:26:04.326 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-08T12:26:04.439 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-08T12:26:04.564 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-08T12:26:04.732 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-08T12:26:04.766 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up dump (0.4b46-6) ... 2023-11-08T12:26:04.875 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-08T12:26:04.925 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-08T12:26:04.943 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:26:05.051 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:26:05.111 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-08T12:26:05.237 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-08T12:26:05.396 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-08T12:26:05.589 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-08T12:26:05.590 INFO:teuthology.orchestra.run.smithi133.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-08T12:26:05.621 INFO:teuthology.orchestra.run.smithi133.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-08T12:26:05.706 INFO:teuthology.orchestra.run.smithi133.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-08T12:26:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:This user must also own the server process. 2023-11-08T12:26:05.707 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:The database cluster will be initialized with locale "en_US". 2023-11-08T12:26:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-08T12:26:05.707 INFO:teuthology.orchestra.run.smithi133.stdout:The default text search configuration will be set to "english". 2023-11-08T12:26:05.708 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:05.708 INFO:teuthology.orchestra.run.smithi133.stdout:Data page checksums are disabled. 2023-11-08T12:26:05.708 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:05.708 INFO:teuthology.orchestra.run.smithi133.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-08T12:26:05.710 INFO:teuthology.orchestra.run.smithi133.stdout:creating subdirectories ... ok 2023-11-08T12:26:05.711 INFO:teuthology.orchestra.run.smithi133.stdout:selecting dynamic shared memory implementation ... posix 2023-11-08T12:26:05.747 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default max_connections ... 100 2023-11-08T12:26:05.748 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-08T12:26:05.797 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default shared_buffers ... 128MB 2023-11-08T12:26:05.812 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default time zone ... Etc/UTC 2023-11-08T12:26:05.813 INFO:teuthology.orchestra.run.smithi133.stdout:creating configuration files ... ok 2023-11-08T12:26:05.997 INFO:teuthology.orchestra.run.smithi133.stdout:running bootstrap script ... ok 2023-11-08T12:26:06.248 INFO:teuthology.orchestra.run.smithi112.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-08T12:26:06.277 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-08T12:26:06.352 INFO:teuthology.orchestra.run.smithi112.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-08T12:26:06.352 INFO:teuthology.orchestra.run.smithi112.stdout:This user must also own the server process. 2023-11-08T12:26:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:The database cluster will be initialized with locale "en_US". 2023-11-08T12:26:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-08T12:26:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:The default text search configuration will be set to "english". 2023-11-08T12:26:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:06.353 INFO:teuthology.orchestra.run.smithi112.stdout:Data page checksums are disabled. 2023-11-08T12:26:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:06.354 INFO:teuthology.orchestra.run.smithi112.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-08T12:26:06.356 INFO:teuthology.orchestra.run.smithi112.stdout:creating subdirectories ... ok 2023-11-08T12:26:06.356 INFO:teuthology.orchestra.run.smithi112.stdout:selecting dynamic shared memory implementation ... posix 2023-11-08T12:26:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default max_connections ... 100 2023-11-08T12:26:06.438 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default shared_buffers ... 128MB 2023-11-08T12:26:06.462 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default time zone ... Etc/UTC 2023-11-08T12:26:06.463 INFO:teuthology.orchestra.run.smithi112.stdout:creating configuration files ... ok 2023-11-08T12:26:06.593 INFO:teuthology.orchestra.run.smithi133.stdout:performing post-bootstrap initialization ... ok 2023-11-08T12:26:06.645 INFO:teuthology.orchestra.run.smithi112.stdout:running bootstrap script ... ok 2023-11-08T12:26:07.150 INFO:teuthology.orchestra.run.smithi133.stdout:syncing data to disk ... ok 2023-11-08T12:26:07.150 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:07.151 INFO:teuthology.orchestra.run.smithi133.stdout:Success. You can now start the database server using: 2023-11-08T12:26:07.151 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:07.151 INFO:teuthology.orchestra.run.smithi133.stdout: pg_ctlcluster 12 main start 2023-11-08T12:26:07.151 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:07.280 INFO:teuthology.orchestra.run.smithi112.stdout:performing post-bootstrap initialization ... ok 2023-11-08T12:26:07.724 INFO:teuthology.orchestra.run.smithi133.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-08T12:26:07.724 INFO:teuthology.orchestra.run.smithi133.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-08T12:26:07.842 INFO:teuthology.orchestra.run.smithi112.stdout:syncing data to disk ... ok 2023-11-08T12:26:07.843 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:07.843 INFO:teuthology.orchestra.run.smithi112.stdout:Success. You can now start the database server using: 2023-11-08T12:26:07.843 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:07.843 INFO:teuthology.orchestra.run.smithi112.stdout: pg_ctlcluster 12 main start 2023-11-08T12:26:07.843 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:07.941 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-08T12:26:08.428 INFO:teuthology.orchestra.run.smithi112.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-08T12:26:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-08T12:26:08.656 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-08T12:26:11.585 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:26:11.709 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:26:11.835 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-08T12:26:12.028 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:26:12.154 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-08T12:26:12.280 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-08T12:26:12.306 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:26:12.432 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:26:12.558 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-08T12:26:12.752 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:26:12.878 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-08T12:26:13.037 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-08T12:26:13.580 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:13.580 INFO:teuthology.orchestra.run.smithi133.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-08T12:26:13.580 INFO:teuthology.orchestra.run.smithi133.stdout:which means they are currently configured by ifupdown: 2023-11-08T12:26:13.580 INFO:teuthology.orchestra.run.smithi133.stdout:- enp3s0f1 2023-11-08T12:26:13.581 INFO:teuthology.orchestra.run.smithi133.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-08T12:26:13.581 INFO:teuthology.orchestra.run.smithi133.stdout:remove their configuration from /etc/network/interfaces. 2023-11-08T12:26:13.581 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:13.805 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-08T12:26:14.228 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:14.228 INFO:teuthology.orchestra.run.smithi112.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-08T12:26:14.229 INFO:teuthology.orchestra.run.smithi112.stdout:which means they are currently configured by ifupdown: 2023-11-08T12:26:14.229 INFO:teuthology.orchestra.run.smithi112.stdout:- enp3s0f1 2023-11-08T12:26:14.229 INFO:teuthology.orchestra.run.smithi112.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-08T12:26:14.229 INFO:teuthology.orchestra.run.smithi112.stdout:remove their configuration from /etc/network/interfaces. 2023-11-08T12:26:14.230 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:14.334 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-08T12:26:14.454 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-08T12:26:15.025 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-08T12:26:15.393 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-08T12:26:15.965 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-08T12:26:16.341 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:26:16.451 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-08T12:26:16.611 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:26:16.736 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-08T12:26:16.888 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-08T12:26:16.940 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-08T12:26:17.014 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:26:17.083 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-08T12:26:17.140 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:26:17.242 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-08T12:26:17.266 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:26:17.377 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-08T12:26:17.536 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-08T12:26:17.622 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-08T12:26:17.623 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-08T12:26:17.662 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:26:17.788 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-08T12:26:17.947 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-08T12:26:18.265 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-08T12:26:18.265 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-08T12:26:18.635 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-08T12:26:18.744 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-08T12:26:18.878 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-08T12:26:19.064 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-08T12:26:19.283 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-08T12:26:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-08T12:26:19.548 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-08T12:26:19.552 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-08T12:26:19.720 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-08T12:26:20.222 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-08T12:26:33.051 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-08T12:26:33.151 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-08T12:26:33.842 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-08T12:26:33.967 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-08T12:26:34.358 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-08T12:26:34.364 DEBUG:teuthology.parallel:result is None 2023-11-08T12:26:35.293 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-08T12:26:35.299 DEBUG:teuthology.parallel:result is None 2023-11-08T12:26:35.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b820560f30d310ab2570761b9a294523225d6998 2023-11-08T12:26:35.445 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2023-11-08T12:26:35.484 INFO:teuthology.orchestra.run.smithi112.stdout:18.0.0-2698-gb820560f-1focal 2023-11-08T12:26:35.485 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2698-gb820560f-1focal 2023-11-08T12:26:35.485 INFO:teuthology.task.install:The correct ceph version 18.0.0-2698-gb820560f-1focal is installed. 2023-11-08T12:26:35.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=b820560f30d310ab2570761b9a294523225d6998 2023-11-08T12:26:35.705 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2023-11-08T12:26:35.747 INFO:teuthology.orchestra.run.smithi133.stdout:18.0.0-2698-gb820560f-1focal 2023-11-08T12:26:35.747 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2698-gb820560f-1focal 2023-11-08T12:26:35.748 INFO:teuthology.task.install:The correct ceph version 18.0.0-2698-gb820560f-1focal is installed. 2023-11-08T12:26:35.748 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-08T12:26:35.749 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:35.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-08T12:26:35.784 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:35.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-08T12:26:35.827 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-08T12:26:35.828 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:35.828 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2023-11-08T12:26:35.862 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-08T12:26:35.939 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:35.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-11-08T12:26:35.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-08T12:26:36.049 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-08T12:26:36.049 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:36.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-08T12:26:36.086 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-08T12:26:36.168 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:36.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-08T12:26:36.203 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-08T12:26:36.278 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-08T12:26:36.279 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:36.279 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2023-11-08T12:26:36.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-08T12:26:36.391 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:36.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-11-08T12:26:36.429 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-08T12:26:36.513 INFO:teuthology.run_tasks:Running task ceph... 2023-11-08T12:26:36.581 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-08T12:26:36.582 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2023-11-08T12:26:36.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2023-11-08T12:26:36.624 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-08T12:26:36.625 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-08T12:26:36.664 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-08T12:26:36.705 INFO:tasks.ceph:Creating extra log directories... 2023-11-08T12:26:36.705 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-08T12:26:36.740 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-08T12:26:36.796 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-08T12:26:36.797 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-08T12:26:36.797 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-08T12:26:36.798 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:36.798 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-08T12:26:36.836 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-08T12:26:36.961 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:36.962 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-08T12:26:36.982 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-08T12:26:37.120 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-08T12:26:37.120 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-08T12:26:37.120 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947', 'branch': 'wip-neesingh-testing-54557', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7451947', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-54557'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'b820560f30d310ab2570761b9a294523225d6998'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b820560f30d310ab2570761b9a294523225d6998'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'issue_54557', 'sha1': 'aa63d47e911f728a17b611e016a29a682d602ec3'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 456, 'sha1': 'b820560f30d310ab2570761b9a294523225d6998', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'issue_54557', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': 'aa63d47e911f728a17b611e016a29a682d602ec3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b820560f30d310ab2570761b9a294523225d6998'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-08_12:02:26', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714'} 2023-11-08T12:26:37.121 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-08T12:26:37.129 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-08T12:26:37.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2023-11-08T12:26:37.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2023-11-08T12:26:37.234 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:37.235 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2023-11-08T12:26:37.288 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-08T12:26:37.288 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2023-11-08T12:26:37.351 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-08T12:26:37.352 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:37.352 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 497 Links: 1 2023-11-08T12:26:37.352 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:37.353 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-11-08 12:20:11.447084398 +0000 2023-11-08T12:26:37.353 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-11-08 12:20:10.983095101 +0000 2023-11-08T12:26:37.353 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-11-08 12:20:10.983095101 +0000 2023-11-08T12:26:37.353 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-11-08T12:26:37.354 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-08T12:26:37.430 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-11-08T12:26:37.430 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-11-08T12:26:37.431 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000737259 s, 694 kB/s 2023-11-08T12:26:37.434 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-08T12:26:37.503 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2023-11-08T12:26:37.567 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-08T12:26:37.568 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:37.568 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 503 Links: 1 2023-11-08T12:26:37.568 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:37.568 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-11-08 12:20:11.727077938 +0000 2023-11-08T12:26:37.568 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-11-08 12:20:11.723078031 +0000 2023-11-08T12:26:37.569 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-11-08 12:20:11.723078031 +0000 2023-11-08T12:26:37.569 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-11-08T12:26:37.569 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-08T12:26:37.641 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-11-08T12:26:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-11-08T12:26:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000683821 s, 749 kB/s 2023-11-08T12:26:37.644 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-08T12:26:37.709 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2023-11-08T12:26:37.775 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-08T12:26:37.776 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:37.776 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-11-08T12:26:37.776 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:37.776 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-11-08 12:20:12.983048967 +0000 2023-11-08T12:26:37.776 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-11-08 12:20:12.487060407 +0000 2023-11-08T12:26:37.777 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-11-08 12:20:12.487060407 +0000 2023-11-08T12:26:37.777 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-11-08T12:26:37.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-08T12:26:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-11-08T12:26:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-11-08T12:26:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000531715 s, 963 kB/s 2023-11-08T12:26:37.856 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-08T12:26:37.922 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2023-11-08T12:26:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-08T12:26:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-11-08T12:26:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2023-11-08 12:20:13.847029036 +0000 2023-11-08T12:26:37.986 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2023-11-08 12:20:13.307041492 +0000 2023-11-08T12:26:37.987 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2023-11-08 12:20:13.307041492 +0000 2023-11-08T12:26:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2023-11-08T12:26:37.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-08T12:26:38.062 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2023-11-08T12:26:38.063 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2023-11-08T12:26:38.063 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000707117 s, 724 kB/s 2023-11-08T12:26:38.065 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-08T12:26:38.134 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:38.135 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:38.135 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-11-08T12:26:38.154 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-08T12:26:38.155 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-11-08T12:26:38.218 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-08T12:26:38.218 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:38.219 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-11-08T12:26:38.219 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:38.219 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-11-08 12:20:10.774834545 +0000 2023-11-08T12:26:38.219 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-11-08 12:20:10.302845430 +0000 2023-11-08T12:26:38.219 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-11-08 12:20:10.302845430 +0000 2023-11-08T12:26:38.220 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-11-08T12:26:38.220 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-08T12:26:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-11-08T12:26:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-11-08T12:26:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000642868 s, 796 kB/s 2023-11-08T12:26:38.297 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-08T12:26:38.364 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-11-08T12:26:38.426 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-08T12:26:38.426 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:38.426 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-11-08T12:26:38.427 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:38.427 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-11-08 12:20:11.542816834 +0000 2023-11-08T12:26:38.427 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-11-08 12:20:11.062827904 +0000 2023-11-08T12:26:38.427 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-11-08 12:20:11.062827904 +0000 2023-11-08T12:26:38.427 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-11-08T12:26:38.428 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-08T12:26:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-11-08T12:26:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-11-08T12:26:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000711224 s, 720 kB/s 2023-11-08T12:26:38.501 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-08T12:26:38.567 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-11-08T12:26:38.626 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-08T12:26:38.627 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:38.627 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 509 Links: 1 2023-11-08T12:26:38.627 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:38.628 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-11-08 12:20:12.314799031 +0000 2023-11-08T12:26:38.628 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-11-08 12:20:11.838810008 +0000 2023-11-08T12:26:38.628 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-11-08 12:20:11.838810008 +0000 2023-11-08T12:26:38.629 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-11-08T12:26:38.629 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-08T12:26:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-11-08T12:26:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-11-08T12:26:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000706781 s, 724 kB/s 2023-11-08T12:26:38.702 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-08T12:26:38.769 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-11-08T12:26:38.830 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-08T12:26:38.830 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T12:26:38.830 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 517 Links: 1 2023-11-08T12:26:38.831 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T12:26:38.831 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-11-08 12:20:13.074781505 +0000 2023-11-08T12:26:38.831 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-11-08 12:20:12.594792573 +0000 2023-11-08T12:26:38.831 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-11-08 12:20:12.594792573 +0000 2023-11-08T12:26:38.831 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-11-08T12:26:38.832 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-08T12:26:38.908 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-11-08T12:26:38.909 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-11-08T12:26:38.909 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000642317 s, 797 kB/s 2023-11-08T12:26:38.911 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-08T12:26:38.976 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:38.976 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-08T12:26:38.976 INFO:tasks.ceph:Generating config... 2023-11-08T12:26:38.978 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-08T12:26:38.978 INFO:tasks.ceph:[client] debug client = 20 2023-11-08T12:26:38.978 INFO:tasks.ceph:[client] debug ms = 1 2023-11-08T12:26:38.979 INFO:tasks.ceph:[client] pid file = 2023-11-08T12:26:38.979 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-08T12:26:38.979 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-08T12:26:38.980 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-08T12:26:38.980 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-08T12:26:38.980 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-08T12:26:38.980 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-08T12:26:38.981 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-08T12:26:38.981 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-08T12:26:38.981 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-08T12:26:38.981 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-08T12:26:38.982 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-08T12:26:38.982 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-08T12:26:38.983 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-08T12:26:38.983 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-08T12:26:38.983 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-08T12:26:38.983 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-08T12:26:38.984 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-08T12:26:38.984 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-08T12:26:38.984 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-08T12:26:38.984 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-08T12:26:38.985 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-08T12:26:38.985 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-08T12:26:38.985 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-08T12:26:38.985 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-08T12:26:38.986 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-08T12:26:38.986 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-08T12:26:38.986 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-08T12:26:38.987 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-08T12:26:38.987 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-08T12:26:38.987 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-08T12:26:38.987 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-08T12:26:38.988 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-08T12:26:38.988 INFO:tasks.ceph:Setting up mon.a... 2023-11-08T12:26:38.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-08T12:26:39.064 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2023-11-08T12:26:39.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-08T12:26:39.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T12:26:39.191 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.b', '172.21.15.133'), ('mon.c', '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]')] 2023-11-08T12:26:39.192 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-08T12:26:39.193 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:39.194 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-08T12:26:39.254 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --add b 172.21.15.133 --addv c '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:39.369 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:39.370 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid c14663df-4425-4498-9232-3ffa5f578bfa 2023-11-08T12:26:39.370 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = pacific 2023-11-08T12:26:39.370 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2023-11-08T12:26:39.370 INFO:teuthology.orchestra.run.smithi112.stdout:fsid c14663df-4425-4498-9232-3ffa5f578bfa 2023-11-08T12:26:39.371 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2023-11-08T12:26:39.369217+0000 2023-11-08T12:26:39.371 INFO:teuthology.orchestra.run.smithi112.stdout:created 2023-11-08T12:26:39.369217+0000 2023-11-08T12:26:39.371 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 16 (pacific) 2023-11-08T12:26:39.371 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2023-11-08T12:26:39.372 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2023-11-08T12:26:39.372 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2023-11-08T12:26:39.372 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2023-11-08T12:26:39.372 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-08T12:26:39.374 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-08T12:26:39.392 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c14663df-4425-4498-9232-3ffa5f578bfa... 2023-11-08T12:26:39.393 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T12:26:39.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T12:26:39.514 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2023-11-08T12:26:39.515 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2023-11-08T12:26:39.515 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T12:26:39.515 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2023-11-08T12:26:39.515 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.516 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2023-11-08T12:26:39.516 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.516 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2023-11-08T12:26:39.516 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.516 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2023-11-08T12:26:39.517 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2023-11-08T12:26:39.517 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.517 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2023-11-08T12:26:39.517 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2023-11-08T12:26:39.517 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.518 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T12:26:39.518 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2023-11-08T12:26:39.518 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.518 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T12:26:39.518 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T12:26:39.519 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.519 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2023-11-08T12:26:39.519 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.519 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2023-11-08T12:26:39.519 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2023-11-08T12:26:39.520 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2023-11-08T12:26:39.520 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2023-11-08T12:26:39.520 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2023-11-08T12:26:39.520 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2023-11-08T12:26:39.521 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2023-11-08T12:26:39.521 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T12:26:39.521 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T12:26:39.521 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2023-11-08T12:26:39.521 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.521 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T12:26:39.522 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.522 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2023-11-08T12:26:39.522 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.522 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2023-11-08T12:26:39.523 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.523 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2023-11-08T12:26:39.523 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2023-11-08T12:26:39.523 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2023-11-08T12:26:39.523 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2023-11-08T12:26:39.524 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2023-11-08T12:26:39.524 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = c14663df-4425-4498-9232-3ffa5f578bfa 2023-11-08T12:26:39.524 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.524 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2023-11-08T12:26:39.524 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2023-11-08T12:26:39.525 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.525 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2023-11-08T12:26:39.525 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2023-11-08T12:26:39.525 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.525 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2023-11-08T12:26:39.526 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2023-11-08T12:26:39.526 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.526 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2023-11-08T12:26:39.526 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2023-11-08T12:26:39.526 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2023-11-08T12:26:39.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.527 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2023-11-08T12:26:39.527 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2023-11-08T12:26:39.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.527 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2023-11-08T12:26:39.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.528 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2023-11-08T12:26:39.528 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.528 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2023-11-08T12:26:39.528 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.528 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2023-11-08T12:26:39.529 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2023-11-08T12:26:39.529 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.529 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2023-11-08T12:26:39.529 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2023-11-08T12:26:39.529 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2023-11-08T12:26:39.530 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2023-11-08T12:26:39.530 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2023-11-08T12:26:39.530 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2023-11-08T12:26:39.530 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-11-08T12:26:39.530 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2023-11-08T12:26:39.531 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2023-11-08T12:26:39.531 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T12:26:39.531 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2023-11-08T12:26:39.531 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2023-11-08T12:26:39.531 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2023-11-08T12:26:39.532 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2023-11-08T12:26:39.532 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2023-11-08T12:26:39.532 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.532 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2023-11-08T12:26:39.533 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-11-08T12:26:39.533 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2023-11-08T12:26:39.533 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-11-08T12:26:39.533 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-11-08T12:26:39.533 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-11-08T12:26:39.534 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-11-08T12:26:39.534 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2023-11-08T12:26:39.534 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.534 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2023-11-08T12:26:39.535 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-11-08T12:26:39.535 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2023-11-08T12:26:39.535 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2023-11-08T12:26:39.535 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2023-11-08T12:26:39.536 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2023-11-08T12:26:39.536 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2023-11-08T12:26:39.536 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2023-11-08T12:26:39.536 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2023-11-08T12:26:39.537 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2023-11-08T12:26:39.537 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2023-11-08T12:26:39.537 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.537 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T12:26:39.537 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T12:26:39.537 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T12:26:39.538 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.538 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T12:26:39.538 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T12:26:39.538 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T12:26:39.539 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.539 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2023-11-08T12:26:39.539 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2023-11-08T12:26:39.539 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.539 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2023-11-08T12:26:39.540 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2023-11-08T12:26:39.540 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:26:39.540 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2023-11-08T12:26:39.540 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2023-11-08T12:26:39.540 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2023-11-08T12:26:39.541 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2023-11-08T12:26:39.541 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T12:26:39.541 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T12:26:39.541 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2023-11-08T12:26:39.541 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2023-11-08T12:26:39.542 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-11-08T12:26:39.542 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2023-11-08T12:26:39.542 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2023-11-08T12:26:39.542 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2023-11-08T12:26:39.542 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2023-11-08T12:26:39.543 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2023-11-08T12:26:39.543 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2023-11-08T12:26:39.543 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-11-08T12:26:39.543 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-11-08T12:26:39.543 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-11-08T12:26:39.544 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-11-08T12:26:39.544 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2023-11-08T12:26:39.544 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2023-11-08T12:26:39.544 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2023-11-08T12:26:39.544 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2023-11-08T12:26:39.544 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2023-11-08T12:26:39.545 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2023-11-08T12:26:39.545 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2023-11-08T12:26:39.545 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2023-11-08T12:26:39.545 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2023-11-08T12:26:39.545 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2023-11-08T12:26:39.546 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2023-11-08T12:26:39.547 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2023-11-08T12:26:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2023-11-08T12:26:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T12:26:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2023-11-08T12:26:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2023-11-08T12:26:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2023-11-08T12:26:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2023-11-08T12:26:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2023-11-08T12:26:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2023-11-08T12:26:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2023-11-08T12:26:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T12:26:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2023-11-08T12:26:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T12:26:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T12:26:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2023-11-08T12:26:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2023-11-08T12:26:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2023-11-08T12:26:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2023-11-08T12:26:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2023-11-08T12:26:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2023-11-08T12:26:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2023-11-08T12:26:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2023-11-08T12:26:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T12:26:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T12:26:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2023-11-08T12:26:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-08T12:26:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2023-11-08T12:26:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2023-11-08T12:26:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2023-11-08T12:26:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2023-11-08T12:26:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2023-11-08T12:26:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.112,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2023-11-08T12:26:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on skipped message = False 2023-11-08T12:26:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = c14663df-4425-4498-9232-3ffa5f578bfa 2023-11-08T12:26:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.557 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2023-11-08T12:26:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2023-11-08T12:26:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2023-11-08T12:26:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2023-11-08T12:26:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2023-11-08T12:26:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2023-11-08T12:26:39.559 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.559 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2023-11-08T12:26:39.559 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2023-11-08T12:26:39.559 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2023-11-08T12:26:39.559 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.560 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2023-11-08T12:26:39.560 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2023-11-08T12:26:39.560 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.560 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2023-11-08T12:26:39.560 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.561 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2023-11-08T12:26:39.561 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.561 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2023-11-08T12:26:39.561 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.561 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2023-11-08T12:26:39.562 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2023-11-08T12:26:39.562 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.566 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2023-11-08T12:26:39.566 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2023-11-08T12:26:39.566 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2023-11-08T12:26:39.566 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2023-11-08T12:26:39.567 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 20 2023-11-08T12:26:39.567 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 20 2023-11-08T12:26:39.567 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-11-08T12:26:39.567 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2023-11-08T12:26:39.568 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 10 2023-11-08T12:26:39.568 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T12:26:39.568 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2023-11-08T12:26:39.568 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2023-11-08T12:26:39.568 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2023-11-08T12:26:39.569 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2023-11-08T12:26:39.569 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-11-08T12:26:39.569 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.569 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2023-11-08T12:26:39.569 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-11-08T12:26:39.570 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2023-11-08T12:26:39.570 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-11-08T12:26:39.570 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-11-08T12:26:39.570 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-11-08T12:26:39.570 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-11-08T12:26:39.571 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2023-11-08T12:26:39.571 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.571 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2023-11-08T12:26:39.571 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-11-08T12:26:39.571 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-11-08T12:26:39.572 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2023-11-08T12:26:39.572 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-11-08T12:26:39.572 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2023-11-08T12:26:39.572 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2023-11-08T12:26:39.572 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-11-08T12:26:39.573 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2023-11-08T12:26:39.573 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2023-11-08T12:26:39.573 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-11-08T12:26:39.573 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.573 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T12:26:39.574 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T12:26:39.574 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T12:26:39.574 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.574 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T12:26:39.574 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T12:26:39.575 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T12:26:39.575 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.575 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2023-11-08T12:26:39.575 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2023-11-08T12:26:39.575 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.576 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2023-11-08T12:26:39.576 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2023-11-08T12:26:39.576 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-11-08T12:26:39.576 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2023-11-08T12:26:39.576 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2023-11-08T12:26:39.577 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2023-11-08T12:26:39.577 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2023-11-08T12:26:39.577 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T12:26:39.577 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T12:26:39.577 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2023-11-08T12:26:39.578 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-11-08T12:26:39.578 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-11-08T12:26:39.578 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2023-11-08T12:26:39.578 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-11-08T12:26:39.578 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-11-08T12:26:39.579 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2023-11-08T12:26:39.579 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2023-11-08T12:26:39.579 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2023-11-08T12:26:39.579 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-11-08T12:26:39.579 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-11-08T12:26:39.580 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-11-08T12:26:39.580 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-11-08T12:26:39.580 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2023-11-08T12:26:39.580 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2023-11-08T12:26:39.580 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds balancer = 20 2023-11-08T12:26:39.581 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-11-08T12:26:39.581 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2023-11-08T12:26:39.581 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2023-11-08T12:26:39.581 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2023-11-08T12:26:39.581 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2023-11-08T12:26:39.582 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-11-08T12:26:39.582 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-11-08T12:26:39.582 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-11-08T12:26:39.583 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-08T12:26:39.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-08T12:26:39.677 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-08T12:26:39.678 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:39.678 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-08T12:26:39.696 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:39.696 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-08T12:26:39.758 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:26:39.759 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:39.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-08T12:26:39.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T12:26:39.869 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:26:39.870 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:39.930 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:26:39.931 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:39.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-08T12:26:39.932 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T12:26:39.995 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:26:39.995 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:40.057 INFO:tasks.ceph:Setting up mon nodes... 2023-11-08T12:26:40.057 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-08T12:26:40.057 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-08T12:26:40.159 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-08T12:26:40.167 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-08T12:26:40.267 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-08T12:26:40.287 INFO:tasks.ceph:Setting up mds nodes... 2023-11-08T12:26:40.287 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-08T12:26:40.393 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-08T12:26:40.400 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-08T12:26:40.432 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-08T12:26:40.574 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-08T12:26:40.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-08T12:26:40.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-08T12:26:40.715 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-08T12:26:40.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-08T12:26:40.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-08T12:26:40.909 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-08T12:26:40.916 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-08T12:26:40.952 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-08T12:26:40.952 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-08T12:26:41.030 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-08T12:26:41.059 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-08T12:26:41.135 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-08T12:26:41.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-08T12:26:41.243 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-08T12:26:41.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-08T12:26:41.345 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-08T12:26:41.375 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-08T12:26:41.376 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-08T12:26:41.376 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-08T12:26:41.411 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:41.412 INFO:tasks.ceph:role: osd.0 2023-11-08T12:26:41.412 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:26:41.412 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-08T12:26:42.013 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:26:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:26:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:26:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-11-08T12:26:42.014 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:26:42.014 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:26:42.015 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:26:42.015 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:26:42.015 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:26:42.015 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:26:42.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-11-08T12:26:42.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-08T12:26:42.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-08T12:26:42.176 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:26:42.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:26:42.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-08T12:26:42.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:42.263 INFO:tasks.ceph:role: osd.1 2023-11-08T12:26:42.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:26:42.263 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-08T12:26:42.782 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:26:42.782 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:26:42.782 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:26:42.782 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-11-08T12:26:42.783 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:26:42.783 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:26:42.783 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:26:42.783 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:26:42.783 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:26:42.784 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:26:42.786 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-11-08T12:26:42.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-08T12:26:42.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-08T12:26:42.883 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:26:42.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:26:42.884 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-08T12:26:42.961 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:42.962 INFO:tasks.ceph:role: osd.2 2023-11-08T12:26:42.962 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:26:42.962 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-08T12:26:43.515 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:26:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:26:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:26:43.515 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-11-08T12:26:43.516 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:26:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:26:43.516 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:26:43.516 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:26:43.516 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:26:43.517 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:26:43.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-11-08T12:26:43.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-08T12:26:43.639 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-08T12:26:43.661 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:26:43.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:26:43.662 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-08T12:26:43.748 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:43.749 INFO:tasks.ceph:role: osd.3 2023-11-08T12:26:43.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:26:43.749 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-08T12:26:44.321 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:26:44.322 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:26:44.322 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:26:44.322 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 2023-11-08T12:26:44.322 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:26:44.323 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:26:44.323 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:26:44.323 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:26:44.323 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:26:44.323 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:26:44.327 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2023-11-08T12:26:44.327 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-08T12:26:44.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-08T12:26:44.462 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:26:44.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:26:44.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:44.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:44.631+0000 7f12b1dc4700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-08T12:26:44.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:44.631+0000 7f12b1dc4700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-08T12:26:44.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:44.631+0000 7f12b1dc4700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T12:26:44.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:44.635+0000 7f12b1dc4700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T12:26:44.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:44.635+0000 7f12b1dc4700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T12:26:44.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:44.635+0000 7f12b1dc4700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-08T12:26:47.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-08T12:26:47.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:47.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:47.915+0000 7fd8adadf700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-08T12:26:47.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:47.915+0000 7fd8adadf700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-08T12:26:47.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:47.919+0000 7fd8adadf700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T12:26:47.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:47.919+0000 7fd8adadf700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T12:26:47.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:47.919+0000 7fd8adadf700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T12:26:47.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:47.919+0000 7fd8adadf700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-08T12:26:50.990 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-08T12:26:51.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:51.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:51.151+0000 7fc5251af700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-08T12:26:51.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:51.151+0000 7fc5251af700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-08T12:26:51.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:51.151+0000 7fc5251af700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T12:26:51.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:51.151+0000 7fc5251af700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T12:26:51.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:51.151+0000 7fc5251af700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T12:26:51.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:51.155+0000 7fc5251af700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-08T12:26:54.229 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-08T12:26:54.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:26:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:54.387+0000 7fbc26752700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-08T12:26:54.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:54.387+0000 7fbc26752700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-08T12:26:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:54.387+0000 7fbc26752700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-08T12:26:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:54.387+0000 7fbc26752700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-08T12:26:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:54.387+0000 7fbc26752700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-08T12:26:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:26:54.391+0000 7fbc26752700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-08T12:26:57.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-08T12:26:57.490 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-08T12:26:57.525 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:57.526 INFO:tasks.ceph:role: osd.4 2023-11-08T12:26:57.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:26:57.526 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-08T12:26:58.094 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:26:58.095 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:26:58.095 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:26:58.095 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-11-08T12:26:58.095 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:26:58.096 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:26:58.096 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:26:58.096 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:26:58.096 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:26:58.096 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:26:58.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-11-08T12:26:58.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-08T12:26:58.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-08T12:26:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:26:58.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:26:58.244 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-08T12:26:58.320 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:58.321 INFO:tasks.ceph:role: osd.5 2023-11-08T12:26:58.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:26:58.321 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-08T12:26:58.865 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:26:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:26:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:26:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-11-08T12:26:58.866 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:26:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:26:58.867 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:26:58.867 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:26:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:26:58.867 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:26:58.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-11-08T12:26:58.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-08T12:26:58.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-08T12:26:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:26:58.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:26:58.966 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-08T12:26:59.048 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:59.048 INFO:tasks.ceph:role: osd.6 2023-11-08T12:26:59.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:26:59.049 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-08T12:26:59.605 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:26:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:26:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:26:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-11-08T12:26:59.606 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:26:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:26:59.607 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:26:59.607 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:26:59.607 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:26:59.607 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:26:59.609 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-11-08T12:26:59.610 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-08T12:26:59.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-08T12:26:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:26:59.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:26:59.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-08T12:26:59.852 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-08T12:26:59.852 INFO:tasks.ceph:role: osd.7 2023-11-08T12:26:59.853 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:26:59.853 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-08T12:27:00.425 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T12:27:00.425 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T12:27:00.426 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T12:27:00.426 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-11-08T12:27:00.426 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T12:27:00.426 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-11-08T12:27:00.426 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T12:27:00.427 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T12:27:00.427 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T12:27:00.427 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T12:27:00.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-11-08T12:27:00.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-08T12:27:00.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-08T12:27:00.551 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T12:27:00.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:27:00.553 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:27:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:00.714+0000 7f11bae09700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-08T12:27:00.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:00.714+0000 7f11bae09700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-08T12:27:00.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:00.714+0000 7f11bae09700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-08T12:27:00.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:00.714+0000 7f11bae09700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-08T12:27:00.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:00.714+0000 7f11bae09700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-08T12:27:00.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:00.718+0000 7f11bae09700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-08T12:27:04.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-08T12:27:04.066 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:27:04.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:04.194+0000 7f5dfe13c700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-08T12:27:04.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:04.198+0000 7f5dfe13c700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-08T12:27:04.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:04.198+0000 7f5dfe13c700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-08T12:27:04.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:04.198+0000 7f5dfe13c700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-08T12:27:04.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:04.198+0000 7f5dfe13c700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-08T12:27:04.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:04.198+0000 7f5dfe13c700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-08T12:27:07.123 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:27:07.128 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:27:07.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-08T12:27:07.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:27:07.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:07.430+0000 7fd7b6b80700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-08T12:27:07.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:07.434+0000 7fd7b6b80700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-08T12:27:07.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:07.434+0000 7fd7b6b80700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-08T12:27:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:07.434+0000 7fd7b6b80700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-08T12:27:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:07.434+0000 7fd7b6b80700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-08T12:27:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:07.434+0000 7fd7b6b80700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-08T12:27:10.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-08T12:27:10.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:27:10.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:10.690+0000 7f4a6d8dd700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-08T12:27:10.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:10.690+0000 7f4a6d8dd700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-08T12:27:10.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:10.690+0000 7f4a6d8dd700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-08T12:27:10.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:10.690+0000 7f4a6d8dd700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-08T12:27:10.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:10.690+0000 7f4a6d8dd700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-08T12:27:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:10.694+0000 7f4a6d8dd700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-08T12:27:13.778 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-08T12:27:13.813 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-08T12:27:13.813 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:13.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-08T12:27:13.851 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:13.851 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-08T12:27:13.933 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:13.934 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-08T12:27:14.006 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:14.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-08T12:27:14.088 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:14.088 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-08T12:27:14.162 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:14.162 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-08T12:27:14.240 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:14.241 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-08T12:27:14.314 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-08T12:27:14.351 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-08T12:27:14.430 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-08T12:27:14.507 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-08T12:27:14.586 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.586 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-08T12:27:14.667 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.668 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-08T12:27:14.741 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-08T12:27:14.818 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:14.819 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-08T12:27:14.837 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:14.837 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-08T12:27:14.896 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.896 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-08T12:27:14.917 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:14.918 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-08T12:27:14.980 INFO:tasks.ceph:Adding keys to all mons... 2023-11-08T12:27:14.981 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-08T12:27:14.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-08T12:27:15.032 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2023-11-08T12:27:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCAfktlutF6CRAAjM6KkWuj4y/Fl97qiak9Xw== 2023-11-08T12:27:15.033 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2023-11-08T12:27:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCAfktlRHRoFxAAyw1Nx0lpcoK2O0Mffhxa+Q== 2023-11-08T12:27:15.033 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2023-11-08T12:27:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCAfktlxtc7IhAAMY7VdOn5spixCeT9mzaa7w== 2023-11-08T12:27:15.034 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2023-11-08T12:27:15.034 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCEfktlLsnsJRAAFve4QGR18ZZEoiNJHRc/bg== 2023-11-08T12:27:15.034 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2023-11-08T12:27:15.034 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCHfktlyiDmNhAAAmDd3WWs+eLtraPczzmkTA== 2023-11-08T12:27:15.034 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2023-11-08T12:27:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCLfktl3wtACRAAjC1v7SBT82SZhX7/gihG2g== 2023-11-08T12:27:15.035 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2023-11-08T12:27:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCOfktlD3FjFxAAIjzJfy66ntwKBw7jYTmQEQ== 2023-11-08T12:27:15.035 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2023-11-08T12:27:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCAfktlRLDaDxAAlkslT/w/88ZbnIMNtISKSg== 2023-11-08T12:27:15.036 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2023-11-08T12:27:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCAfktlJ/6NKhAA4JtSpMqfz11efoyViRsE9w== 2023-11-08T12:27:15.038 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2023-11-08T12:27:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCAfktlk30kNhAAeSX6T/4QZc9cWY79qyTDvg== 2023-11-08T12:27:15.038 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2023-11-08T12:27:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCUfktlPUqvKhAApaw64K+eVu+b7K5vRpIrzg== 2023-11-08T12:27:15.039 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2023-11-08T12:27:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCYfktlWkjeCxAAwJdasGWtOKqaCqIooSo5+Q== 2023-11-08T12:27:15.039 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2023-11-08T12:27:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCbfktlvK3vGRAADNtY8DuzQeaQ+lamxqnpxA== 2023-11-08T12:27:15.039 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2023-11-08T12:27:15.040 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCefktl6KNCKRAAp5984rD5GU3VsLxxZPH9Sg== 2023-11-08T12:27:15.040 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2023-11-08T12:27:15.040 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCBfktlKVzUARAA264fUIQ90p7D7mpBaFS5Iw== 2023-11-08T12:27:15.040 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2023-11-08T12:27:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCBfktlg7APCBAA4UD3EeuTRrU2hjW+ozVSnw== 2023-11-08T12:27:15.041 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2023-11-08T12:27:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCBfktlvItzDhAAOIl7M/iJ+xzhTEWNIef+/A== 2023-11-08T12:27:15.041 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2023-11-08T12:27:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQCBfktlskN+FBAA7JKk8gz0qAYvbt/9+mvqwg== 2023-11-08T12:27:15.055 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2023-11-08T12:27:15.056 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCAfktlutF6CRAAjM6KkWuj4y/Fl97qiak9Xw== 2023-11-08T12:27:15.056 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-11-08T12:27:15.056 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCAfktlRHRoFxAAyw1Nx0lpcoK2O0Mffhxa+Q== 2023-11-08T12:27:15.056 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-11-08T12:27:15.057 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCAfktlxtc7IhAAMY7VdOn5spixCeT9mzaa7w== 2023-11-08T12:27:15.057 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2023-11-08T12:27:15.057 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCEfktlLsnsJRAAFve4QGR18ZZEoiNJHRc/bg== 2023-11-08T12:27:15.057 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2023-11-08T12:27:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCHfktlyiDmNhAAAmDd3WWs+eLtraPczzmkTA== 2023-11-08T12:27:15.058 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2023-11-08T12:27:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCLfktl3wtACRAAjC1v7SBT82SZhX7/gihG2g== 2023-11-08T12:27:15.058 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2023-11-08T12:27:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCOfktlD3FjFxAAIjzJfy66ntwKBw7jYTmQEQ== 2023-11-08T12:27:15.059 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2023-11-08T12:27:15.059 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCAfktlRLDaDxAAlkslT/w/88ZbnIMNtISKSg== 2023-11-08T12:27:15.059 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-11-08T12:27:15.059 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCAfktlJ/6NKhAA4JtSpMqfz11efoyViRsE9w== 2023-11-08T12:27:15.059 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-11-08T12:27:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCAfktlk30kNhAAeSX6T/4QZc9cWY79qyTDvg== 2023-11-08T12:27:15.060 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2023-11-08T12:27:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCUfktlPUqvKhAApaw64K+eVu+b7K5vRpIrzg== 2023-11-08T12:27:15.060 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2023-11-08T12:27:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCYfktlWkjeCxAAwJdasGWtOKqaCqIooSo5+Q== 2023-11-08T12:27:15.061 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2023-11-08T12:27:15.061 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCbfktlvK3vGRAADNtY8DuzQeaQ+lamxqnpxA== 2023-11-08T12:27:15.061 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2023-11-08T12:27:15.061 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCefktl6KNCKRAAp5984rD5GU3VsLxxZPH9Sg== 2023-11-08T12:27:15.062 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-11-08T12:27:15.062 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCBfktlKVzUARAA264fUIQ90p7D7mpBaFS5Iw== 2023-11-08T12:27:15.062 INFO:teuthology.orchestra.run.smithi133.stdout:[client.2] 2023-11-08T12:27:15.062 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCBfktlg7APCBAA4UD3EeuTRrU2hjW+ozVSnw== 2023-11-08T12:27:15.063 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-11-08T12:27:15.063 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCBfktlvItzDhAAOIl7M/iJ+xzhTEWNIef+/A== 2023-11-08T12:27:15.063 INFO:teuthology.orchestra.run.smithi133.stdout:[client.3] 2023-11-08T12:27:15.063 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCBfktlskN+FBAA7JKk8gz0qAYvbt/9+mvqwg== 2023-11-08T12:27:15.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T12:27:15.096 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T12:27:15.195 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:15.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:15.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:15.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:15.388 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.394 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.570 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.575 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:15.746 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T12:27:15.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T12:27:15.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:15.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:15.943 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:15.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-08T12:27:16.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.044 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T12:27:16.392 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.491 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.580 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.587 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.674 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.679 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T12:27:16.764 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-08T12:27:16.765 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-08T12:27:16.804 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-08T12:27:16.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-08T12:27:16.983 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-08T12:27:17.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-08T12:27:17.171 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-08T12:27:17.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-08T12:27:17.288 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-08T12:27:17.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-08T12:27:17.480 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:27:17.488 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-08T12:27:17.542 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-08T12:27:17.543 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-08T12:27:17.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-08T12:27:17.551 INFO:tasks.ceph.mon.a:Started 2023-11-08T12:27:17.551 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-08T12:27:17.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-08T12:27:17.591 INFO:tasks.ceph.mon.b:Started 2023-11-08T12:27:17.591 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-08T12:27:17.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-08T12:27:17.596 INFO:tasks.ceph.mon.c:Started 2023-11-08T12:27:17.597 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-08T12:27:17.597 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-08T12:27:17.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-08T12:27:17.603 INFO:tasks.ceph.mgr.y:Started 2023-11-08T12:27:17.603 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-08T12:27:17.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-08T12:27:17.609 INFO:tasks.ceph.mgr.x:Started 2023-11-08T12:27:17.609 INFO:tasks.ceph:Setting crush tunables to default 2023-11-08T12:27:17.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2023-11-08T12:27:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0d0c66700 1 Processor -- start 2023-11-08T12:27:17.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0d0c66700 1 -- start start 2023-11-08T12:27:17.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0d0c66700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:17.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0d0c66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:17.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0d0c66700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc06c600 con 0x7fe0cc15c640 2023-11-08T12:27:17.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0d0c66700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc06cef0 con 0x7fe0cc071aa0 2023-11-08T12:27:17.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0d0c66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0d38f0 con 0x7fe0cc069e00 2023-11-08T12:27:17.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cbfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:17.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cbfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:36278/0 (socket says 172.21.15.112:36278) 2023-11-08T12:27:17.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0caffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:17.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 learned_addr learned my addr 172.21.15.112:0/2357262866 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:17.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cb7fe700 1 --1- 172.21.15.112:0/2357262866 >> v1:172.21.15.112:6789/0 conn(0x7fe0cc15c640 0x7fe0cc0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59138/0 (socket says 172.21.15.112:59138) 2023-11-08T12:27:17.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:17.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:17.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:17.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-08T12:27:17.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:17.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:17.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:17.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.774+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-08T12:27:17.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:17.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:17.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:17.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:17.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-08T12:27:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:17.978+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-08T12:27:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-08T12:27:18.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:18.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:18.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:18.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:18.382+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-08T12:27:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:19.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:19.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:19.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:19.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:19.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:19.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:19.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-08T12:27:19.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:19.186+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-08T12:27:20.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0cc06a280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:27:20.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0cc06a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:20.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 msgr2=0x7fe0cc06d310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:27:20.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0cc071aa0 0x7fe0cc06d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> v1:172.21.15.112:6789/0 conn(0x7fe0cc15c640 legacy=0x7fe0cc0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc0722f0 con 0x7fe0b8003760 2023-11-08T12:27:20.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc06cef0 con 0x7fe0b80073c0 2023-11-08T12:27:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:20.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:20.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.774+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-08T12:27:20.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.978+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:20.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.978+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:20.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.978+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:20.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.978+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:20.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:20.978+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-08T12:27:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:21.382+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:21.382+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:21.382+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:21.382+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:21.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:21.382+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-08T12:27:22.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:22.186+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:22.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:22.186+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-08T12:27:22.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:22.186+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:22.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:22.186+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:22.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:22.186+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-08T12:27:23.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 msgr2=0x7fe0b8009870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:27:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80073c0 0x7fe0b8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> v1:172.21.15.133:6789/0 conn(0x7fe0b8003760 legacy=0x7fe0b8005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 reap_dead start 2023-11-08T12:27:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b800af70 con 0x7fe0cc15c640 2023-11-08T12:27:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc06cef0 con 0x7fe0b8007860 2023-11-08T12:27:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0d38f0 con 0x7fe0cc069e00 2023-11-08T12:27:23.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.774+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:23.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:23.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T12:27:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-08T12:27:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.778+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-08T12:27:23.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:23.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:23.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T12:27:23.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:23.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-08T12:27:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:23.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:23.982+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-08T12:27:24.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:24.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:24.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T12:27:24.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:24.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:24.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-08T12:27:24.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:24.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:24.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:24.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:24.386+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-08T12:27:25.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:25.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-08T12:27:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T12:27:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-08T12:27:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:25.190+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-08T12:27:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 msgr2=0x7fe0b800a040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:27:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0cc069e00 0x7fe0b800a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 msgr2=0x7fe0b8003ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:27:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.133:3300/0 conn(0x7fe0b8007860 0x7fe0b8003ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 >> v1:172.21.15.112:6789/0 conn(0x7fe0cc15c640 legacy=0x7fe0b800a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b80050f0 con 0x7fe0b8004ae0 2023-11-08T12:27:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.774+0000 7fe0c97fa700 1 -- 172.21.15.112:0/2357262866 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc06cef0 con 0x7fe0b80040e0 2023-11-08T12:27:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.778+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.778+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 msgr2=0x7fe0b8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T12:27:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.778+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 msgr2=0x7fe0b8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.778+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.778+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-08T12:27:26.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.982+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:26.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.982+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 msgr2=0x7fe0b8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T12:27:26.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.982+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 msgr2=0x7fe0b8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:26.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.982+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:26.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:26.982+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-08T12:27:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.386+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.386+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 msgr2=0x7fe0b8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-08T12:27:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.386+0000 7fe0cb7fe700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 msgr2=0x7fe0b8004510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-08T12:27:27.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.386+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-08T12:27:27.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.386+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-08T12:27:27.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.970+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289442550 0 0) 0x7fe0b80050f0 con 0x7fe0b8004ae0 2023-11-08T12:27:27.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.970+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b40035d0 con 0x7fe0b8004ae0 2023-11-08T12:27:27.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 162083883 0 0) 0x7fe0b40035d0 con 0x7fe0b8004ae0 2023-11-08T12:27:27.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 msgr2=0x7fe0b8004510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:27:27.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 --2- 172.21.15.112:0/2357262866 >> v2:172.21.15.112:3300/0 conn(0x7fe0b80040e0 0x7fe0b8004510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b80149d0 con 0x7fe0b8004ae0 2023-11-08T12:27:27.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fe0c00177a0 con 0x7fe0b8004ae0 2023-11-08T12:27:27.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 >> v1:172.21.15.133:6789/0 conn(0x7fe0b8004ae0 legacy=0x7fe0b80122a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:27.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0cbfff700 1 -- 172.21.15.112:0/2357262866 reap_dead start 2023-11-08T12:27:27.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4003a20 0x7fe0b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:27.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4004870 0x7fe0b4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:27.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4005290 0x7fe0b400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:27.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc06cef0 con 0x7fe0b4003a20 2023-11-08T12:27:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b400c1d0 con 0x7fe0b4005290 2023-11-08T12:27:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b400c390 con 0x7fe0b4004870 2023-11-08T12:27:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4004870 0x7fe0b4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4005290 0x7fe0b400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4003a20 0x7fe0b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:27.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4005290 msgr2=0x7fe0b400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:27.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4005290 0x7fe0b400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4003a20 msgr2=0x7fe0b4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:27.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4003a20 0x7fe0b4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0caffd700 1 -- 172.21.15.112:0/2357262866 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40035d0 con 0x7fe0b4004870 2023-11-08T12:27:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0caffd700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4004870 0x7fe0b4004ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009100 tx=0x7fe0b40058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7542551156b64c15 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c001d070 con 0x7fe0b4004870 2023-11-08T12:27:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c000c040 con 0x7fe0b4004870 2023-11-08T12:27:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.974+0000 7fe0ca7fc700 1 -- 172.21.15.112:0/2357262866 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0003df0 con 0x7fe0b4004870 2023-11-08T12:27:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 -- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4004870 msgr2=0x7fe0b4004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4004870 0x7fe0b4004ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009100 tx=0x7fe0b40058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 -- 172.21.15.112:0/2357262866 shutdown_connections 2023-11-08T12:27:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4005290 0x7fe0b400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4004870 0x7fe0b4004ce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/2357262866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4003a20 0x7fe0b4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 -- 172.21.15.112:0/2357262866 >> 172.21.15.112:0/2357262866 conn(0x7fe0cc0b6520 msgr2=0x7fe0cc071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:27.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 -- 172.21.15.112:0/2357262866 shutdown_connections 2023-11-08T12:27:27.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.978+0000 7fe0d0c66700 1 -- 172.21.15.112:0/2357262866 wait complete. 2023-11-08T12:27:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 Processor -- start 2023-11-08T12:27:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 -- start start 2023-11-08T12:27:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4003a20 0x7fe0cc0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4004870 0x7fe0cc0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4005290 0x7fe0cc0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc159070 con 0x7fe0b4004870 2023-11-08T12:27:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0cad90 con 0x7fe0b4003a20 2023-11-08T12:27:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.982+0000 7fe0d0c66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc06a7e0 con 0x7fe0b4005290 2023-11-08T12:27:27.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4004870 0x7fe0cc0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:27.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4004870 0x7fe0cc0cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53286/0 (socket says 172.21.15.112:53286) 2023-11-08T12:27:27.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 -- 172.21.15.112:0/1779588580 learned_addr learned my addr 172.21.15.112:0/1779588580 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:27.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4003a20 0x7fe0cc0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:27.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0cbfff700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4005290 0x7fe0cc0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:27.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 -- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4005290 msgr2=0x7fe0cc0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:27.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4005290 0x7fe0cc0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 -- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4003a20 msgr2=0x7fe0cc0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:27.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4003a20 0x7fe0cc0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:27.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 -- 172.21.15.112:0/1779588580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc072010 con 0x7fe0b4004870 2023-11-08T12:27:27.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0cb7fe700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4003a20 0x7fe0cc0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:27.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0caffd700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4004870 0x7fe0cc0cd330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0000c00 tx=0x7fe0c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:27.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0b3fff700 1 -- 172.21.15.112:0/1779588580 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0018860 con 0x7fe0b4004870 2023-11-08T12:27:27.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0b3fff700 1 -- 172.21.15.112:0/1779588580 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00189e0 con 0x7fe0b4004870 2023-11-08T12:27:27.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0b3fff700 1 -- 172.21.15.112:0/1779588580 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0018d90 con 0x7fe0b4004870 2023-11-08T12:27:27.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc15ca10 con 0x7fe0b4004870 2023-11-08T12:27:27.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc06c830 con 0x7fe0b4004870 2023-11-08T12:27:27.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0b3fff700 1 -- 172.21.15.112:0/1779588580 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe0c003c070 con 0x7fe0b4004870 2023-11-08T12:27:27.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0b3fff700 1 -- 172.21.15.112:0/1779588580 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe0c00358e0 con 0x7fe0b4004870 2023-11-08T12:27:27.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.986+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc06fa80 con 0x7fe0b4004870 2023-11-08T12:27:27.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:27.990+0000 7fe0b3fff700 1 -- 172.21.15.112:0/1779588580 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe0c0054b00 con 0x7fe0b4004870 2023-11-08T12:27:28.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.062+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe0cc06fa80 con 0x7fe0b4004870 2023-11-08T12:27:28.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0b3fff700 1 -- 172.21.15.112:0/1779588580 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe0c0043020 con 0x7fe0b4004870 2023-11-08T12:27:28.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4004870 msgr2=0x7fe0cc0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:28.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4004870 0x7fe0cc0cd330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0000c00 tx=0x7fe0c0004770 comp rx=0 tx=0).stop 2023-11-08T12:27:28.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 shutdown_connections 2023-11-08T12:27:28.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4005290 0x7fe0cc0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0b4004870 0x7fe0cc0cd330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 --2- 172.21.15.112:0/1779588580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4003a20 0x7fe0cc0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 >> 172.21.15.112:0/1779588580 conn(0x7fe0cc0b6520 msgr2=0x7fe0cc0b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.070+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 shutdown_connections 2023-11-08T12:27:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:28.074+0000 7fe0d0c66700 1 -- 172.21.15.112:0/1779588580 wait complete. 2023-11-08T12:27:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2023-11-08T12:27:28.099 INFO:tasks.ceph:check_enable_crimson: False 2023-11-08T12:27:28.100 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-08T12:27:28.100 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:28.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-08T12:27:28.133 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:28.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-08T12:27:28.213 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:28.206+0000 7fd29683a2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-08T12:27:28.215 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:28.216 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-08T12:27:28.286 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:27:28.287 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-08T12:27:28.364 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:28.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-08T12:27:28.395 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:28.395 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-08T12:27:28.445 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:28.438+0000 7ff2ca26e2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-08T12:27:28.471 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:28.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-08T12:27:28.550 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:27:28.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-08T12:27:28.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 47b5f1ca-d17d-4619-be08-333a7272a603 0 2023-11-08T12:27:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.841+0000 7f2f75ad8700 1 Processor -- start 2023-11-08T12:27:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.841+0000 7f2f75ad8700 1 -- start start 2023-11-08T12:27:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f7015c640 0x7f2f700d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f70071aa0 0x7f2f7006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f70069e00 0x7f2f7006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7006cef0 con 0x7f2f70069e00 2023-11-08T12:27:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7006a7c0 con 0x7f2f70071aa0 2023-11-08T12:27:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7006c600 con 0x7f2f7015c640 2023-11-08T12:27:28.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f7015c640 0x7f2f700d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:28.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f6ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f70071aa0 0x7f2f7006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:28.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f7015c640 0x7f2f700d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:48110/0 (socket says 172.21.15.133:48110) 2023-11-08T12:27:28.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 -- 172.21.15.133:0/1282230039 learned_addr learned my addr 172.21.15.133:0/1282230039 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:28.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f752d7700 1 --2- 172.21.15.133:0/1282230039 >> v2:172.21.15.112:3300/0 conn(0x7f2f70069e00 0x7f2f7006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:28.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 -- 172.21.15.133:0/1282230039 >> v2:172.21.15.133:3300/0 conn(0x7f2f70071aa0 msgr2=0x7f2f7006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:28.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 --2- 172.21.15.133:0/1282230039 >> v2:172.21.15.133:3300/0 conn(0x7f2f70071aa0 0x7f2f7006d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 -- 172.21.15.133:0/1282230039 >> v2:172.21.15.112:3300/0 conn(0x7f2f70069e00 msgr2=0x7f2f7006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:28.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 --2- 172.21.15.133:0/1282230039 >> v2:172.21.15.112:3300/0 conn(0x7f2f70069e00 0x7f2f7006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 -- 172.21.15.133:0/1282230039 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700722f0 con 0x7f2f7015c640 2023-11-08T12:27:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f6ffff700 1 --2- 172.21.15.133:0/1282230039 >> v2:172.21.15.133:3300/0 conn(0x7f2f70071aa0 0x7f2f7006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f74ad6700 1 --2- 172.21.15.133:0/1282230039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f7015c640 0x7f2f700d31e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f7006fc90 tx=0x7f2f64009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55d56048fff48ebe server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f6f7fe700 1 -- 172.21.15.133:0/1282230039 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64011830 con 0x7f2f7015c640 2023-11-08T12:27:28.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f6f7fe700 1 -- 172.21.15.133:0/1282230039 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64011990 con 0x7f2f7015c640 2023-11-08T12:27:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f6f7fe700 1 -- 172.21.15.133:0/1282230039 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64011d20 con 0x7f2f7015c640 2023-11-08T12:27:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 -- 172.21.15.133:0/1282230039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f7015c640 msgr2=0x7f2f700d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.845+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/1282230039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f7015c640 0x7f2f700d31e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f7006fc90 tx=0x7f2f64009bf0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 -- 172.21.15.133:0/1282230039 shutdown_connections 2023-11-08T12:27:28.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/1282230039 >> v2:172.21.15.112:3300/0 conn(0x7f2f70069e00 0x7f2f7006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/1282230039 >> v2:172.21.15.133:3300/0 conn(0x7f2f70071aa0 0x7f2f7006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/1282230039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f7015c640 0x7f2f700d31e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 -- 172.21.15.133:0/1282230039 >> 172.21.15.133:0/1282230039 conn(0x7f2f700b6520 msgr2=0x7f2f70071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:28.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 -- 172.21.15.133:0/1282230039 shutdown_connections 2023-11-08T12:27:28.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 -- 172.21.15.133:0/1282230039 wait complete. 2023-11-08T12:27:28.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.849+0000 7f2f75ad8700 1 Processor -- start 2023-11-08T12:27:28.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 -- start start 2023-11-08T12:27:28.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f70069e00 0x7f2f700cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:28.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f70071aa0 0x7f2f701f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:28.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f7015c640 0x7f2f700ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:28.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700cc500 con 0x7f2f7015c640 2023-11-08T12:27:28.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700cbb30 con 0x7f2f70069e00 2023-11-08T12:27:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700b1580 con 0x7f2f70071aa0 2023-11-08T12:27:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f74ad6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f70069e00 0x7f2f700cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f74ad6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f70069e00 0x7f2f700cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47900/0 (socket says 172.21.15.133:47900) 2023-11-08T12:27:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f74ad6700 1 -- 172.21.15.133:0/3081824743 learned_addr learned my addr 172.21.15.133:0/3081824743 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6ffff700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f70071aa0 0x7f2f701f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:28.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f752d7700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f7015c640 0x7f2f700ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:28.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6ffff700 1 -- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f70069e00 msgr2=0x7f2f700cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:28.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6ffff700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f70069e00 0x7f2f700cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6ffff700 1 -- 172.21.15.133:0/3081824743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f7015c640 msgr2=0x7f2f700ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:28.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6ffff700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f7015c640 0x7f2f700ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6ffff700 1 -- 172.21.15.133:0/3081824743 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0094b0 con 0x7f2f70071aa0 2023-11-08T12:27:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f74ad6700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f70069e00 0x7f2f700cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6ffff700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f70071aa0 0x7f2f701f1390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00e9b0 tx=0x7f2f5c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6d7fa700 1 -- 172.21.15.133:0/3081824743 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00c640 con 0x7f2f70071aa0 2023-11-08T12:27:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6d7fa700 1 -- 172.21.15.133:0/3081824743 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c00c7a0 con 0x7f2f70071aa0 2023-11-08T12:27:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f64009570 con 0x7f2f70071aa0 2023-11-08T12:27:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f6d7fa700 1 -- 172.21.15.133:0/3081824743 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00cb50 con 0x7f2f70071aa0 2023-11-08T12:27:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.853+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f70072010 con 0x7f2f70071aa0 2023-11-08T12:27:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.857+0000 7f2f6d7fa700 1 -- 172.21.15.133:0/3081824743 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2f5c019030 con 0x7f2f70071aa0 2023-11-08T12:27:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.857+0000 7f2f6d7fa700 1 -- 172.21.15.133:0/3081824743 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f5c006580 con 0x7f2f70071aa0 2023-11-08T12:27:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.857+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7015ca10 con 0x7f2f70071aa0 2023-11-08T12:27:28.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.861+0000 7f2f6d7fa700 1 -- 172.21.15.133:0/3081824743 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2f5c021060 con 0x7f2f70071aa0 2023-11-08T12:27:28.934 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:28.930+0000 7fd29683a2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-08T12:27:28.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.941+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "47b5f1ca-d17d-4619-be08-333a7272a603", "id": 0} v 0) v1 -- 0x7f2f7006c7e0 con 0x7f2f70071aa0 2023-11-08T12:27:28.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f6d7fa700 1 -- 172.21.15.133:0/3081824743 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47b5f1ca-d17d-4619-be08-333a7272a603", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f5c0290b0 con 0x7f2f70071aa0 2023-11-08T12:27:28.953 INFO:teuthology.orchestra.run.smithi133.stdout:0 2023-11-08T12:27:28.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f70071aa0 msgr2=0x7f2f701f1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:28.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f70071aa0 0x7f2f701f1390 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00e9b0 tx=0x7f2f5c00ecc0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 shutdown_connections 2023-11-08T12:27:28.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f7015c640 0x7f2f700ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f70071aa0 0x7f2f701f1390 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 --2- 172.21.15.133:0/3081824743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f70069e00 0x7f2f700cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:28.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 >> 172.21.15.133:0/3081824743 conn(0x7f2f700b6520 msgr2=0x7f2f700b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:28.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 shutdown_connections 2023-11-08T12:27:28.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:28.949+0000 7f2f75ad8700 1 -- 172.21.15.133:0/3081824743 wait complete. 2023-11-08T12:27:28.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new ee741323-f98d-4f9f-9926-ca25115004a2 1 2023-11-08T12:27:29.011 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:29.006+0000 7fd29683a2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-08T12:27:29.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda72bdc700 1 Processor -- start 2023-11-08T12:27:29.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda72bdc700 1 -- start start 2023-11-08T12:27:29.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda72bdc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda6c070790 0x7fda6c164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda72bdc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c15a550 con 0x7fda6c0b1640 2023-11-08T12:27:29.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda72bdc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c06b0a0 con 0x7fda6c0b43a0 2023-11-08T12:27:29.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda72bdc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c0caac0 con 0x7fda6c070790 2023-11-08T12:27:29.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda71bda700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fda6c0b43a0 0x7fda6c15e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55742/0 (socket says 172.21.15.133:55742) 2023-11-08T12:27:29.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda71bda700 1 -- 172.21.15.133:0/1839770299 learned_addr learned my addr 172.21.15.133:0/1839770299 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-11-08T12:27:29.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.137+0000 7fda723db700 1 --2- 172.21.15.133:0/1839770299 >> v2:172.21.15.133:3300/0 conn(0x7fda6c070790 0x7fda6c164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda723db700 1 -- 172.21.15.133:0/1839770299 >> v1:172.21.15.133:6789/0 conn(0x7fda6c0b43a0 legacy=0x7fda6c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda723db700 1 -- 172.21.15.133:0/1839770299 >> v1:172.21.15.112:6789/0 conn(0x7fda6c0b1640 legacy=0x7fda6c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda723db700 1 -- 172.21.15.133:0/1839770299 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0cada0 con 0x7fda6c070790 2023-11-08T12:27:29.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda723db700 1 --2- 172.21.15.133:0/1839770299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c164fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d90 tx=0x7fda6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ce09d3cc96409e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:29.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda70bd8700 1 -- 172.21.15.133:0/1839770299 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400e070 con 0x7fda6c070790 2023-11-08T12:27:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda70bd8700 1 -- 172.21.15.133:0/1839770299 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6400bbd0 con 0x7fda6c070790 2023-11-08T12:27:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda70bd8700 1 -- 172.21.15.133:0/1839770299 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64012430 con 0x7fda6c070790 2023-11-08T12:27:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda72bdc700 1 -- 172.21.15.133:0/1839770299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 msgr2=0x7fda6c164fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda72bdc700 1 --2- 172.21.15.133:0/1839770299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c164fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d90 tx=0x7fda6400b330 comp rx=0 tx=0).stop 2023-11-08T12:27:29.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda72bdc700 1 -- 172.21.15.133:0/1839770299 shutdown_connections 2023-11-08T12:27:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda72bdc700 1 --2- 172.21.15.133:0/1839770299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c164fa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda72bdc700 1 -- 172.21.15.133:0/1839770299 >> 172.21.15.133:0/1839770299 conn(0x7fda6c0b0f80 msgr2=0x7fda6c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda72bdc700 1 -- 172.21.15.133:0/1839770299 shutdown_connections 2023-11-08T12:27:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.141+0000 7fda72bdc700 1 -- 172.21.15.133:0/1839770299 wait complete. 2023-11-08T12:27:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 Processor -- start 2023-11-08T12:27:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 -- start start 2023-11-08T12:27:29.151 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:29.146+0000 7fd29683a2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-08T12:27:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda6c0b1640 0x7fda6c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda6c0b43a0 0x7fda6c149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c15cf80 con 0x7fda6c0b1640 2023-11-08T12:27:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c15af40 con 0x7fda6c070790 2023-11-08T12:27:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda72bdc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c15c360 con 0x7fda6c0b43a0 2023-11-08T12:27:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda71bda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda71bda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47926/0 (socket says 172.21.15.133:47926) 2023-11-08T12:27:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda71bda700 1 -- 172.21.15.133:0/2114615116 learned_addr learned my addr 172.21.15.133:0/2114615116 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.145+0000 7fda723db700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda6c0b43a0 0x7fda6c149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda713d9700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda6c0b1640 0x7fda6c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda71bda700 1 -- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda6c0b43a0 msgr2=0x7fda6c149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda71bda700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda6c0b43a0 0x7fda6c149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda71bda700 1 -- 172.21.15.133:0/2114615116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda6c0b1640 msgr2=0x7fda6c0af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda71bda700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda6c0b1640 0x7fda6c0af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda71bda700 1 -- 172.21.15.133:0/2114615116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64009a70 con 0x7fda6c070790 2023-11-08T12:27:29.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda713d9700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda6c0b1640 0x7fda6c0af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:29.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda71bda700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c15a6f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c700 tx=0x7fda6800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:29.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda627fc700 1 -- 172.21.15.133:0/2114615116 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68005d90 con 0x7fda6c070790 2023-11-08T12:27:29.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda627fc700 1 -- 172.21.15.133:0/2114615116 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda680070d0 con 0x7fda6c070790 2023-11-08T12:27:29.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c06b5d0 con 0x7fda6c070790 2023-11-08T12:27:29.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda627fc700 1 -- 172.21.15.133:0/2114615116 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68007440 con 0x7fda6c070790 2023-11-08T12:27:29.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c06b2f0 con 0x7fda6c070790 2023-11-08T12:27:29.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda627fc700 1 -- 172.21.15.133:0/2114615116 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fda68019030 con 0x7fda6c070790 2023-11-08T12:27:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda627fc700 1 -- 172.21.15.133:0/2114615116 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fda6801cde0 con 0x7fda6c070790 2023-11-08T12:27:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.149+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c0ca7b0 con 0x7fda6c070790 2023-11-08T12:27:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.153+0000 7fda627fc700 1 -- 172.21.15.133:0/2114615116 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fda68021060 con 0x7fda6c070790 2023-11-08T12:27:29.218 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:29.213+0000 7ff2ca26e2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-08T12:27:29.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.229+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee741323-f98d-4f9f-9926-ca25115004a2", "id": 1} v 0) v1 -- 0x7fda6c15d0c0 con 0x7fda6c070790 2023-11-08T12:27:29.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda627fc700 1 -- 172.21.15.133:0/2114615116 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee741323-f98d-4f9f-9926-ca25115004a2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda6c15d0c0 con 0x7fda6c070790 2023-11-08T12:27:29.246 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-11-08T12:27:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 msgr2=0x7fda6c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c15a6f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c700 tx=0x7fda6800ca10 comp rx=0 tx=0).stop 2023-11-08T12:27:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 shutdown_connections 2023-11-08T12:27:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda6c0b43a0 0x7fda6c149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda6c0b1640 0x7fda6c0af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 --2- 172.21.15.133:0/2114615116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c070790 0x7fda6c15a6f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 >> 172.21.15.133:0/2114615116 conn(0x7fda6c0b0f80 msgr2=0x7fda6c060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 shutdown_connections 2023-11-08T12:27:29.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.241+0000 7fda72bdc700 1 -- 172.21.15.133:0/2114615116 wait complete. 2023-11-08T12:27:29.268 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 1c8b2a89-48f7-4390-81b1-c7940a234908 2 2023-11-08T12:27:29.302 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:29.297+0000 7ff2ca26e2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-08T12:27:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.433+0000 7fc865f45700 1 Processor -- start 2023-11-08T12:27:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.433+0000 7fc865f45700 1 -- start start 2023-11-08T12:27:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.433+0000 7fc865f45700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8600cfc40 0x7fc8600b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.433+0000 7fc865f45700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc860072270 con 0x7fc86006a300 2023-11-08T12:27:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.433+0000 7fc865f45700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8600d0120 con 0x7fc86015c6d0 2023-11-08T12:27:29.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.433+0000 7fc865f45700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600d0400 con 0x7fc8600cfc40 2023-11-08T12:27:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.433+0000 7fc864f43700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc86015c6d0 0x7fc860069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55756/0 (socket says 172.21.15.133:55756) 2023-11-08T12:27:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc864f43700 1 -- 172.21.15.133:0/643146984 learned_addr learned my addr 172.21.15.133:0/643146984 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-11-08T12:27:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc865744700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8600cfc40 0x7fc8600b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105129128 0 0) 0x7fc8600d0120 con 0x7fc86015c6d0 2023-11-08T12:27:29.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8500035d0 con 0x7fc86015c6d0 2023-11-08T12:27:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1975679672 0 0) 0x7fc8500035d0 con 0x7fc86015c6d0 2023-11-08T12:27:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8600cfc40 msgr2=0x7fc8600b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8600cfc40 0x7fc8600b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 >> v1:172.21.15.112:6789/0 conn(0x7fc86006a300 legacy=0x7fc86006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860071c20 con 0x7fc86015c6d0 2023-11-08T12:27:29.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fc854001670 con 0x7fc86015c6d0 2023-11-08T12:27:29.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 >> v1:172.21.15.133:6789/0 conn(0x7fc86015c6d0 legacy=0x7fc860069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc850003a20 0x7fc850003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc850004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8500050c0 0x7fc85000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600d0400 con 0x7fc850003a20 2023-11-08T12:27:29.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85000bfd0 con 0x7fc8500050c0 2023-11-08T12:27:29.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85000c190 con 0x7fc850004450 2023-11-08T12:27:29.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc865744700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8600cfc40 0x7fc8600b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85ffff700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc850004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc865744700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8500050c0 0x7fc85000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc864f43700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc850003a20 0x7fc850003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85ffff700 1 -- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8500050c0 msgr2=0x7fc85000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:29.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85ffff700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8500050c0 0x7fc85000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85ffff700 1 -- 172.21.15.133:0/643146984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc850003a20 msgr2=0x7fc850003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:29.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85ffff700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc850003a20 0x7fc850003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85ffff700 1 -- 172.21.15.133:0/643146984 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500035d0 con 0x7fc850004450 2023-11-08T12:27:29.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc865744700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8500050c0 0x7fc85000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:29.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85ffff700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc850004910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007fd0 tx=0x7fc8500058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de8513fdebb63629 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:29.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0052d0 con 0x7fc850004450 2023-11-08T12:27:29.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c005430 con 0x7fc850004450 2023-11-08T12:27:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.437+0000 7fc85f7fe700 1 -- 172.21.15.133:0/643146984 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0055a0 con 0x7fc850004450 2023-11-08T12:27:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.441+0000 7fc865f45700 1 -- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 msgr2=0x7fc850004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.441+0000 7fc865f45700 1 --2- 172.21.15.133:0/643146984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc850004910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007fd0 tx=0x7fc8500058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.441+0000 7fc865744700 1 -- 172.21.15.133:0/643146984 reap_dead start 2023-11-08T12:27:29.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.441+0000 7fc865f45700 1 -- 172.21.15.133:0/643146984 shutdown_connections 2023-11-08T12:27:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.441+0000 7fc865f45700 1 -- 172.21.15.133:0/643146984 >> 172.21.15.133:0/643146984 conn(0x7fc8600b6520 msgr2=0x7fc860071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.441+0000 7fc865f45700 1 -- 172.21.15.133:0/643146984 shutdown_connections 2023-11-08T12:27:29.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.441+0000 7fc865f45700 1 -- 172.21.15.133:0/643146984 wait complete. 2023-11-08T12:27:29.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 Processor -- start 2023-11-08T12:27:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 -- start start 2023-11-08T12:27:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc86015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc86015ba10 0x7fc8601e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8601e34d0 0x7fc8600d1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8601e45f0 con 0x7fc8601e34d0 2023-11-08T12:27:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8601e3970 con 0x7fc86015ba10 2023-11-08T12:27:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc865f45700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8601e3c50 con 0x7fc850004450 2023-11-08T12:27:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc85ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc86015ba10 0x7fc8601e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.445+0000 7fc864f43700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc86015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc85ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc86015ba10 0x7fc8601e2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47936/0 (socket says 172.21.15.133:47936) 2023-11-08T12:27:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc864f43700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc86015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:48148/0 (socket says 172.21.15.133:48148) 2023-11-08T12:27:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc85ffff700 1 -- 172.21.15.133:0/1139136892 learned_addr learned my addr 172.21.15.133:0/1139136892 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc865744700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8601e34d0 0x7fc8600d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc864f43700 1 -- 172.21.15.133:0/1139136892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc86015ba10 msgr2=0x7fc8601e2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc864f43700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc86015ba10 0x7fc8601e2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc864f43700 1 -- 172.21.15.133:0/1139136892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8601e34d0 msgr2=0x7fc8600d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc864f43700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8601e34d0 0x7fc8600d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc864f43700 1 -- 172.21.15.133:0/1139136892 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86015caa0 con 0x7fc850004450 2023-11-08T12:27:29.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc864f43700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc86015b0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8540072c0 tx=0x7fc8540075d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc85d7fa700 1 -- 172.21.15.133:0/1139136892 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854011580 con 0x7fc850004450 2023-11-08T12:27:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc85d7fa700 1 -- 172.21.15.133:0/1139136892 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854011720 con 0x7fc850004450 2023-11-08T12:27:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860071f00 con 0x7fc850004450 2023-11-08T12:27:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc85d7fa700 1 -- 172.21.15.133:0/1139136892 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854011ad0 con 0x7fc850004450 2023-11-08T12:27:29.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8600b1f80 con 0x7fc850004450 2023-11-08T12:27:29.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc85d7fa700 1 -- 172.21.15.133:0/1139136892 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc85401d460 con 0x7fc850004450 2023-11-08T12:27:29.460 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:29.454+0000 7fd29683a2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-08T12:27:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc85d7fa700 1 -- 172.21.15.133:0/1139136892 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc85401db10 con 0x7fc850004450 2023-11-08T12:27:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.449+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8601e4730 con 0x7fc850004450 2023-11-08T12:27:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.453+0000 7fc85d7fa700 1 -- 172.21.15.133:0/1139136892 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc85401d6f0 con 0x7fc850004450 2023-11-08T12:27:29.465 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:29.461+0000 7ff2ca26e2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-08T12:27:29.543 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:29.538+0000 7fd29683a2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-08T12:27:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.541+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1c8b2a89-48f7-4390-81b1-c7940a234908", "id": 2} v 0) v1 -- 0x7fc860073cb0 con 0x7fc850004450 2023-11-08T12:27:29.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc85d7fa700 1 -- 172.21.15.133:0/1139136892 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c8b2a89-48f7-4390-81b1-c7940a234908", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc85401d910 con 0x7fc850004450 2023-11-08T12:27:29.555 INFO:teuthology.orchestra.run.smithi133.stdout:2 2023-11-08T12:27:29.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 msgr2=0x7fc86015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc86015b0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8540072c0 tx=0x7fc8540075d0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 shutdown_connections 2023-11-08T12:27:29.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8601e34d0 0x7fc8600d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc86015ba10 0x7fc8601e2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 --2- 172.21.15.133:0/1139136892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc850004450 0x7fc86015b0a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 >> 172.21.15.133:0/1139136892 conn(0x7fc8600b6520 msgr2=0x7fc8600d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:29.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 shutdown_connections 2023-11-08T12:27:29.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.549+0000 7fc865f45700 1 -- 172.21.15.133:0/1139136892 wait complete. 2023-11-08T12:27:29.579 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 74b2e634-466f-43dc-a722-fea68bd0285a 3 2023-11-08T12:27:29.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.777+0000 7fafaf59e700 1 Processor -- start 2023-11-08T12:27:29.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.777+0000 7fafaf59e700 1 -- start start 2023-11-08T12:27:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafaf59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fafb006ad00 0x7fafb006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafaf59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fafb00cfe10 0x7fafb0160060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafaf59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00cf6c0 con 0x7fafb00cf8c0 2023-11-08T12:27:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafaf59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb015c9e0 con 0x7fafb00cfe10 2023-11-08T12:27:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafaf59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00b37b0 con 0x7fafb006ad00 2023-11-08T12:27:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fafb006ad00 0x7fafb006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fafb006ad00 0x7fafb006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47944/0 (socket says 172.21.15.133:47944) 2023-11-08T12:27:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 -- 172.21.15.133:0/1678971410 learned_addr learned my addr 172.21.15.133:0/1678971410 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafadd9b700 1 --2- 172.21.15.133:0/1678971410 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cfe10 0x7fafb0160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 -- 172.21.15.133:0/1678971410 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cfe10 msgr2=0x7fafb0160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 --2- 172.21.15.133:0/1678971410 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cfe10 0x7fafb0160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 -- 172.21.15.133:0/1678971410 >> v1:172.21.15.112:6789/0 conn(0x7fafb00cf8c0 legacy=0x7fafb01605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 -- 172.21.15.133:0/1678971410 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb006b610 con 0x7fafb006ad00 2023-11-08T12:27:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafadd9b700 1 --2- 172.21.15.133:0/1678971410 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cfe10 0x7fafb0160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafae59c700 1 --2- 172.21.15.133:0/1678971410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb006ad00 0x7fafb006b0d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fafb0071c10 tx=0x7fafa0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3217b87ca311f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:29.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafad59a700 1 -- 172.21.15.133:0/1678971410 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0005e50 con 0x7fafb006ad00 2023-11-08T12:27:29.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafad59a700 1 -- 172.21.15.133:0/1678971410 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0006030 con 0x7fafb006ad00 2023-11-08T12:27:29.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.781+0000 7fafad59a700 1 -- 172.21.15.133:0/1678971410 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00063c0 con 0x7fafb006ad00 2023-11-08T12:27:29.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 -- 172.21.15.133:0/1678971410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb006ad00 msgr2=0x7fafb006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 --2- 172.21.15.133:0/1678971410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb006ad00 0x7fafb006b0d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fafb0071c10 tx=0x7fafa0009bf0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 -- 172.21.15.133:0/1678971410 shutdown_connections 2023-11-08T12:27:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 --2- 172.21.15.133:0/1678971410 >> v2:172.21.15.112:3300/0 conn(0x7fafb00cfe10 0x7fafb0160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 --2- 172.21.15.133:0/1678971410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb006ad00 0x7fafb006b0d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 -- 172.21.15.133:0/1678971410 >> 172.21.15.133:0/1678971410 conn(0x7fafb0099af0 msgr2=0x7fafb00d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 -- 172.21.15.133:0/1678971410 shutdown_connections 2023-11-08T12:27:29.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 -- 172.21.15.133:0/1678971410 wait complete. 2023-11-08T12:27:29.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 Processor -- start 2023-11-08T12:27:29.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.785+0000 7fafaf59e700 1 -- start start 2023-11-08T12:27:29.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafb006ad00 0x7fafb00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb00cf8c0 0x7fafb014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb00cfe10 0x7fafb014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:29.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb015f7b0 con 0x7fafb00cfe10 2023-11-08T12:27:29.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb015eb30 con 0x7fafb00cf8c0 2023-11-08T12:27:29.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb015ee10 con 0x7fafb006ad00 2023-11-08T12:27:29.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb00cf8c0 0x7fafb014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb00cf8c0 0x7fafb014cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47950/0 (socket says 172.21.15.133:47950) 2023-11-08T12:27:29.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 -- 172.21.15.133:0/4027003002 learned_addr learned my addr 172.21.15.133:0/4027003002 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:29.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafae59c700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafb006ad00 0x7fafb00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaed9d700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb00cfe10 0x7fafb014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 -- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafb006ad00 msgr2=0x7fafb00b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafb006ad00 0x7fafb00b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 -- 172.21.15.133:0/4027003002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb00cfe10 msgr2=0x7fafb014d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb00cfe10 0x7fafb014d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 -- 172.21.15.133:0/4027003002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40094b0 con 0x7fafb00cf8c0 2023-11-08T12:27:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafadd9b700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb00cf8c0 0x7fafb014cda0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafa400ebe0 tx=0x7fafa400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7faf9effd700 1 -- 172.21.15.133:0/4027003002 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4009770 con 0x7fafb00cf8c0 2023-11-08T12:27:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7faf9effd700 1 -- 172.21.15.133:0/4027003002 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400c850 con 0x7fafb00cf8c0 2023-11-08T12:27:29.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7faf9effd700 1 -- 172.21.15.133:0/4027003002 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400cbe0 con 0x7fafb00cf8c0 2023-11-08T12:27:29.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa0009520 con 0x7fafb00cf8c0 2023-11-08T12:27:29.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb00cf100 con 0x7fafb00cf8c0 2023-11-08T12:27:29.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7faf9effd700 1 -- 172.21.15.133:0/4027003002 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fafa4019030 con 0x7fafb00cf8c0 2023-11-08T12:27:29.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7faf9effd700 1 -- 172.21.15.133:0/4027003002 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fafa4013d60 con 0x7fafb00cf8c0 2023-11-08T12:27:29.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.789+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb00cee20 con 0x7fafb00cf8c0 2023-11-08T12:27:29.805 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:29.794+0000 7fd29683a2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-08T12:27:29.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.793+0000 7faf9effd700 1 -- 172.21.15.133:0/4027003002 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fafa4021060 con 0x7fafb00cf8c0 2023-11-08T12:27:29.806 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:29.793+0000 7ff2ca26e2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-08T12:27:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.869+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "74b2e634-466f-43dc-a722-fea68bd0285a", "id": 3} v 0) v1 -- 0x7fafb00cf3e0 con 0x7fafb00cf8c0 2023-11-08T12:27:29.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.877+0000 7faf9effd700 1 -- 172.21.15.133:0/4027003002 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74b2e634-466f-43dc-a722-fea68bd0285a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fafa4017070 con 0x7fafb00cf8c0 2023-11-08T12:27:29.884 INFO:teuthology.orchestra.run.smithi133.stdout:3 2023-11-08T12:27:29.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb00cf8c0 msgr2=0x7fafb014cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:29.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb00cf8c0 0x7fafb014cda0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafa400ebe0 tx=0x7fafa400eef0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 shutdown_connections 2023-11-08T12:27:29.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafb00cfe10 0x7fafb014d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb00cf8c0 0x7fafb014cda0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 --2- 172.21.15.133:0/4027003002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafb006ad00 0x7fafb00b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 >> 172.21.15.133:0/4027003002 conn(0x7fafb0099af0 msgr2=0x7fafb00b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 shutdown_connections 2023-11-08T12:27:29.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:29.881+0000 7fafaf59e700 1 -- 172.21.15.133:0/4027003002 wait complete. 2023-11-08T12:27:29.888 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:29.881+0000 7ff2ca26e2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-08T12:27:29.891 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:29.886+0000 7fd29683a2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-08T12:27:29.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 7e052dbc-e322-44e4-b028-2dd0ebe88f84 4 2023-11-08T12:27:29.991 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:29.986+0000 7fd29683a2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-08T12:27:30.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.069+0000 7fb56ffff700 1 Processor -- start 2023-11-08T12:27:30.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.069+0000 7fb56ffff700 1 -- start start 2023-11-08T12:27:30.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb570070790 0x7fb570164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56ffff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57015a550 con 0x7fb5700b1640 2023-11-08T12:27:30.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57006b0a0 con 0x7fb5700b43a0 2023-11-08T12:27:30.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56ffff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700caac0 con 0x7fb570070790 2023-11-08T12:27:30.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5700b43a0 0x7fb57015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55760/0 (socket says 172.21.15.133:55760) 2023-11-08T12:27:30.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56effd700 1 -- 172.21.15.133:0/552403500 learned_addr learned my addr 172.21.15.133:0/552403500 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-11-08T12:27:30.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56f7fe700 1 --2- 172.21.15.133:0/552403500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb570070790 0x7fb570164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56dffb700 1 -- 172.21.15.133:0/552403500 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721335325 0 0) 0x7fb57006b0a0 con 0x7fb5700b43a0 2023-11-08T12:27:30.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56dffb700 1 -- 172.21.15.133:0/552403500 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5580035d0 con 0x7fb5700b43a0 2023-11-08T12:27:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56dffb700 1 -- 172.21.15.133:0/552403500 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19563611 0 0) 0x7fb564001110 con 0x7fb5700b1640 2023-11-08T12:27:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56f7fe700 1 -- 172.21.15.133:0/552403500 >> v1:172.21.15.133:6789/0 conn(0x7fb5700b43a0 legacy=0x7fb57015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56f7fe700 1 -- 172.21.15.133:0/552403500 >> v1:172.21.15.112:6789/0 conn(0x7fb5700b1640 legacy=0x7fb570070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.073+0000 7fb56f7fe700 1 -- 172.21.15.133:0/552403500 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700cada0 con 0x7fb570070790 2023-11-08T12:27:30.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56f7fe700 1 --2- 172.21.15.133:0/552403500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb570070790 0x7fb570164fa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb568009dc0 tx=0x7fb56800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46896efa37855137 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:30.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56dffb700 1 -- 172.21.15.133:0/552403500 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800e070 con 0x7fb570070790 2023-11-08T12:27:30.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56dffb700 1 -- 172.21.15.133:0/552403500 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800bb20 con 0x7fb570070790 2023-11-08T12:27:30.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56dffb700 1 -- 172.21.15.133:0/552403500 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800bed0 con 0x7fb570070790 2023-11-08T12:27:30.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56ffff700 1 -- 172.21.15.133:0/552403500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb570070790 msgr2=0x7fb570164fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56ffff700 1 --2- 172.21.15.133:0/552403500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb570070790 0x7fb570164fa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb568009dc0 tx=0x7fb56800b330 comp rx=0 tx=0).stop 2023-11-08T12:27:30.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56ffff700 1 -- 172.21.15.133:0/552403500 shutdown_connections 2023-11-08T12:27:30.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56ffff700 1 --2- 172.21.15.133:0/552403500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb570070790 0x7fb570164fa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56ffff700 1 -- 172.21.15.133:0/552403500 >> 172.21.15.133:0/552403500 conn(0x7fb5700b0f80 msgr2=0x7fb5700ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:30.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56ffff700 1 -- 172.21.15.133:0/552403500 shutdown_connections 2023-11-08T12:27:30.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.077+0000 7fb56ffff700 1 -- 172.21.15.133:0/552403500 wait complete. 2023-11-08T12:27:30.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 Processor -- start 2023-11-08T12:27:30.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 -- start start 2023-11-08T12:27:30.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb570070790 0x7fb5701ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5700b1640 0x7fb57015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5700b43a0 0x7fb5700c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57015cd70 con 0x7fb570070790 2023-11-08T12:27:30.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701ef650 con 0x7fb5700b1640 2023-11-08T12:27:30.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.081+0000 7fb56ffff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57015b2a0 con 0x7fb5700b43a0 2023-11-08T12:27:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5700b43a0 0x7fb5700c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5700b1640 0x7fb57015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5700b43a0 0x7fb5700c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:48176/0 (socket says 172.21.15.133:48176) 2023-11-08T12:27:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 -- 172.21.15.133:0/2191914081 learned_addr learned my addr 172.21.15.133:0/2191914081 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:30.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56effd700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb570070790 0x7fb5701ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 -- 172.21.15.133:0/2191914081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5700b1640 msgr2=0x7fb57015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5700b1640 0x7fb57015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 -- 172.21.15.133:0/2191914081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb570070790 msgr2=0x7fb5701ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb570070790 0x7fb5701ef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 -- 172.21.15.133:0/2191914081 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568009a70 con 0x7fb5700b43a0 2023-11-08T12:27:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56f7fe700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5700b43a0 0x7fb5700c3940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb568009f30 tx=0x7fb568004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb557fff700 1 -- 172.21.15.133:0/2191914081 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56801b810 con 0x7fb5700b43a0 2023-11-08T12:27:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb557fff700 1 -- 172.21.15.133:0/2191914081 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568020070 con 0x7fb5700b43a0 2023-11-08T12:27:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57006b5d0 con 0x7fb5700b43a0 2023-11-08T12:27:30.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb557fff700 1 -- 172.21.15.133:0/2191914081 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56801bbf0 con 0x7fb5700b43a0 2023-11-08T12:27:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57006b2f0 con 0x7fb5700b43a0 2023-11-08T12:27:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb557fff700 1 -- 172.21.15.133:0/2191914081 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb568027770 con 0x7fb5700b43a0 2023-11-08T12:27:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb557fff700 1 -- 172.21.15.133:0/2191914081 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb568022070 con 0x7fb5700b43a0 2023-11-08T12:27:30.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.085+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5700ca7b0 con 0x7fb5700b43a0 2023-11-08T12:27:30.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.089+0000 7fb557fff700 1 -- 172.21.15.133:0/2191914081 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb568027a00 con 0x7fb5700b43a0 2023-11-08T12:27:30.144 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:30.137+0000 7ff2ca26e2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-08T12:27:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.177+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7e052dbc-e322-44e4-b028-2dd0ebe88f84", "id": 4} v 0) v1 -- 0x7fb570073cb0 con 0x7fb5700b43a0 2023-11-08T12:27:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb557fff700 1 -- 172.21.15.133:0/2191914081 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e052dbc-e322-44e4-b028-2dd0ebe88f84", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb568027ba0 con 0x7fb5700b43a0 2023-11-08T12:27:30.191 INFO:teuthology.orchestra.run.smithi133.stdout:4 2023-11-08T12:27:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5700b43a0 msgr2=0x7fb5700c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb56ffff700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5700b43a0 0x7fb5700c3940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb568009f30 tx=0x7fb568004af0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 shutdown_connections 2023-11-08T12:27:30.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb56ffff700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5700b43a0 0x7fb5700c3940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb56ffff700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5700b1640 0x7fb57015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb56ffff700 1 --2- 172.21.15.133:0/2191914081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb570070790 0x7fb5701ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.185+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 >> 172.21.15.133:0/2191914081 conn(0x7fb5700b0f80 msgr2=0x7fb5700b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.189+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 shutdown_connections 2023-11-08T12:27:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.189+0000 7fb56ffff700 1 -- 172.21.15.133:0/2191914081 wait complete. 2023-11-08T12:27:30.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new d2a144b3-6132-4240-8160-483ff40c62e5 5 2023-11-08T12:27:30.236 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:30.229+0000 7ff2ca26e2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-08T12:27:30.341 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:30.337+0000 7ff2ca26e2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-08T12:27:30.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8bce0b700 1 Processor -- start 2023-11-08T12:27:30.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8bce0b700 1 -- start start 2023-11-08T12:27:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8bce0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8bce0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8b80d0340 0x7fe8b80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8bce0b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b80cec80 con 0x7fe8b80afc50 2023-11-08T12:27:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8bce0b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80b0c40 con 0x7fe8b80d0340 2023-11-08T12:27:30.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8bce0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80b0f20 con 0x7fe8b80ce370 2023-11-08T12:27:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:53888/0 (socket says 172.21.15.133:53888) 2023-11-08T12:27:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b77fe700 1 -- 172.21.15.133:0/3882981600 learned_addr learned my addr 172.21.15.133:0/3882981600 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b6ffd700 1 --2- 172.21.15.133:0/3882981600 >> v2:172.21.15.133:3300/0 conn(0x7fe8b80d0340 0x7fe8b80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b77fe700 1 -- 172.21.15.133:0/3882981600 >> v2:172.21.15.133:3300/0 conn(0x7fe8b80d0340 msgr2=0x7fe8b80ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b77fe700 1 --2- 172.21.15.133:0/3882981600 >> v2:172.21.15.133:3300/0 conn(0x7fe8b80d0340 0x7fe8b80ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b77fe700 1 -- 172.21.15.133:0/3882981600 >> v1:172.21.15.112:6789/0 conn(0x7fe8b80afc50 legacy=0x7fe8b80ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.377+0000 7fe8b77fe700 1 -- 172.21.15.133:0/3882981600 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80b1200 con 0x7fe8b80ce370 2023-11-08T12:27:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8b77fe700 1 --2- 172.21.15.133:0/3882981600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80b1ce0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009910 tx=0x7fe8a8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5279983610415a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:30.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8b67fc700 1 -- 172.21.15.133:0/3882981600 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8005e50 con 0x7fe8b80ce370 2023-11-08T12:27:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8b67fc700 1 -- 172.21.15.133:0/3882981600 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a8006030 con 0x7fe8b80ce370 2023-11-08T12:27:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8b67fc700 1 -- 172.21.15.133:0/3882981600 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80063e0 con 0x7fe8b80ce370 2023-11-08T12:27:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 -- 172.21.15.133:0/3882981600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 msgr2=0x7fe8b80b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 --2- 172.21.15.133:0/3882981600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80b1ce0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009910 tx=0x7fe8a8009c20 comp rx=0 tx=0).stop 2023-11-08T12:27:30.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 -- 172.21.15.133:0/3882981600 shutdown_connections 2023-11-08T12:27:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 --2- 172.21.15.133:0/3882981600 >> v2:172.21.15.133:3300/0 conn(0x7fe8b80d0340 0x7fe8b80ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 --2- 172.21.15.133:0/3882981600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80b1ce0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 -- 172.21.15.133:0/3882981600 >> 172.21.15.133:0/3882981600 conn(0x7fe8b8099af0 msgr2=0x7fe8b80d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 -- 172.21.15.133:0/3882981600 shutdown_connections 2023-11-08T12:27:30.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 -- 172.21.15.133:0/3882981600 wait complete. 2023-11-08T12:27:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.381+0000 7fe8bce0b700 1 Processor -- start 2023-11-08T12:27:30.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 -- start start 2023-11-08T12:27:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b80afc50 0x7fe8b80aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b81474d0 0x7fe8b815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80c7100 con 0x7fe8b80afc50 2023-11-08T12:27:30.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80c6580 con 0x7fe8b81474d0 2023-11-08T12:27:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80c6860 con 0x7fe8b80ce370 2023-11-08T12:27:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b81474d0 0x7fe8b815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b81474d0 0x7fe8b815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40250/0 (socket says 172.21.15.133:40250) 2023-11-08T12:27:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 -- 172.21.15.133:0/923437093 learned_addr learned my addr 172.21.15.133:0/923437093 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b6ffd700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b77fe700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b80afc50 0x7fe8b80aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 -- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 msgr2=0x7fe8b80c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 -- 172.21.15.133:0/923437093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b80afc50 msgr2=0x7fe8b80aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b80afc50 0x7fe8b80aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 -- 172.21.15.133:0/923437093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8009520 con 0x7fe8b81474d0 2023-11-08T12:27:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8b7fff700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b81474d0 0x7fe8b815ca40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000cbc0 tx=0x7fe8b000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8affff700 1 -- 172.21.15.133:0/923437093 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0003c20 con 0x7fe8b81474d0 2023-11-08T12:27:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8affff700 1 -- 172.21.15.133:0/923437093 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0003d80 con 0x7fe8b81474d0 2023-11-08T12:27:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b80b17c0 con 0x7fe8b81474d0 2023-11-08T12:27:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8affff700 1 -- 172.21.15.133:0/923437093 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000ab40 con 0x7fe8b81474d0 2023-11-08T12:27:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b80b14e0 con 0x7fe8b81474d0 2023-11-08T12:27:30.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8affff700 1 -- 172.21.15.133:0/923437093 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe8b0010050 con 0x7fe8b81474d0 2023-11-08T12:27:30.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.385+0000 7fe8affff700 1 -- 172.21.15.133:0/923437093 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe8b0012420 con 0x7fe8b81474d0 2023-11-08T12:27:30.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.389+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b815a4a0 con 0x7fe8b81474d0 2023-11-08T12:27:30.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.389+0000 7fe8affff700 1 -- 172.21.15.133:0/923437093 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe8b00050d0 con 0x7fe8b81474d0 2023-11-08T12:27:30.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.469+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2a144b3-6132-4240-8160-483ff40c62e5", "id": 5} v 0) v1 -- 0x7fe8b8073cb0 con 0x7fe8b81474d0 2023-11-08T12:27:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8affff700 1 -- 172.21.15.133:0/923437093 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2a144b3-6132-4240-8160-483ff40c62e5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe8b0005270 con 0x7fe8b81474d0 2023-11-08T12:27:30.486 INFO:teuthology.orchestra.run.smithi133.stdout:5 2023-11-08T12:27:30.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b81474d0 msgr2=0x7fe8b815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b81474d0 0x7fe8b815ca40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000cbc0 tx=0x7fe8b000ced0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 shutdown_connections 2023-11-08T12:27:30.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8b81474d0 0x7fe8b815ca40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8b80ce370 0x7fe8b80c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 --2- 172.21.15.133:0/923437093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b80afc50 0x7fe8b80aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 >> 172.21.15.133:0/923437093 conn(0x7fe8b8099af0 msgr2=0x7fe8b80d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:30.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 shutdown_connections 2023-11-08T12:27:30.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.481+0000 7fe8bce0b700 1 -- 172.21.15.133:0/923437093 wait complete. 2023-11-08T12:27:30.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new ed1c99ab-1da7-49c1-9263-31bf27cc2909 6 2023-11-08T12:27:30.523 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:30.518+0000 7fd29683a2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-08T12:27:30.708 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:30.702+0000 7fd29683a2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-08T12:27:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.753+0000 7fc4c95f9700 1 Processor -- start 2023-11-08T12:27:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.753+0000 7fc4c95f9700 1 -- start start 2023-11-08T12:27:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.753+0000 7fc4c95f9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4c40b43a0 0x7fc4c415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.753+0000 7fc4c95f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4c40b1640 0x7fc4c4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40c9040 0x7fc4c40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c415a550 con 0x7fc4c40b43a0 2023-11-08T12:27:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c406b0a0 con 0x7fc4c40b1640 2023-11-08T12:27:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40caac0 con 0x7fc4c40c9040 2023-11-08T12:27:30.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40c9040 0x7fc4c40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40c9040 0x7fc4c40705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:53906/0 (socket says 172.21.15.133:53906) 2023-11-08T12:27:30.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 -- 172.21.15.133:0/1123014157 learned_addr learned my addr 172.21.15.133:0/1123014157 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:30.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4bbfff700 1 --2- 172.21.15.133:0/1123014157 >> v2:172.21.15.133:3300/0 conn(0x7fc4c40b1640 0x7fc4c4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c2ffd700 1 --2- 172.21.15.133:0/1123014157 >> v2:172.21.15.112:3300/0 conn(0x7fc4c40b43a0 0x7fc4c415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 -- 172.21.15.133:0/1123014157 >> v2:172.21.15.133:3300/0 conn(0x7fc4c40b1640 msgr2=0x7fc4c4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 --2- 172.21.15.133:0/1123014157 >> v2:172.21.15.133:3300/0 conn(0x7fc4c40b1640 0x7fc4c4070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 -- 172.21.15.133:0/1123014157 >> v2:172.21.15.112:3300/0 conn(0x7fc4c40b43a0 msgr2=0x7fc4c415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 --2- 172.21.15.133:0/1123014157 >> v2:172.21.15.112:3300/0 conn(0x7fc4c40b43a0 0x7fc4c415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 -- 172.21.15.133:0/1123014157 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40cada0 con 0x7fc4c40c9040 2023-11-08T12:27:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c37fe700 1 --2- 172.21.15.133:0/1123014157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40c9040 0x7fc4c40705c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4072d40 tx=0x7fc4bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c02dc234f7a8d9e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c27fc700 1 -- 172.21.15.133:0/1123014157 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00e070 con 0x7fc4c40c9040 2023-11-08T12:27:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c27fc700 1 -- 172.21.15.133:0/1123014157 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00b910 con 0x7fc4c40c9040 2023-11-08T12:27:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c27fc700 1 -- 172.21.15.133:0/1123014157 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00bcc0 con 0x7fc4c40c9040 2023-11-08T12:27:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 -- 172.21.15.133:0/1123014157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40c9040 msgr2=0x7fc4c40705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/1123014157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40c9040 0x7fc4c40705c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4072d40 tx=0x7fc4bc00b330 comp rx=0 tx=0).stop 2023-11-08T12:27:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 -- 172.21.15.133:0/1123014157 shutdown_connections 2023-11-08T12:27:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/1123014157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40c9040 0x7fc4c40705c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/1123014157 >> v2:172.21.15.133:3300/0 conn(0x7fc4c40b1640 0x7fc4c4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/1123014157 >> v2:172.21.15.112:3300/0 conn(0x7fc4c40b43a0 0x7fc4c415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 -- 172.21.15.133:0/1123014157 >> 172.21.15.133:0/1123014157 conn(0x7fc4c40b0f80 msgr2=0x7fc4c40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:30.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.757+0000 7fc4c95f9700 1 -- 172.21.15.133:0/1123014157 shutdown_connections 2023-11-08T12:27:30.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.761+0000 7fc4c95f9700 1 -- 172.21.15.133:0/1123014157 wait complete. 2023-11-08T12:27:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.761+0000 7fc4c95f9700 1 Processor -- start 2023-11-08T12:27:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.761+0000 7fc4c95f9700 1 -- start start 2023-11-08T12:27:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40b1640 0x7fc4c40c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4c40b43a0 0x7fc4c40b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40c9040 0x7fc4c40cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41f5b30 con 0x7fc4c40c9040 2023-11-08T12:27:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41f4f20 con 0x7fc4c40b43a0 2023-11-08T12:27:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41f5200 con 0x7fc4c40b1640 2023-11-08T12:27:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40b1640 0x7fc4c40c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40b1640 0x7fc4c40c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:53920/0 (socket says 172.21.15.133:53920) 2023-11-08T12:27:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 -- 172.21.15.133:0/802118242 learned_addr learned my addr 172.21.15.133:0/802118242 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4bbfff700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4c40b43a0 0x7fc4c40b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c37fe700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40c9040 0x7fc4c40cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 -- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4c40b43a0 msgr2=0x7fc4c40b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4c40b43a0 0x7fc4c40b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 -- 172.21.15.133:0/802118242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40c9040 msgr2=0x7fc4c40cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40c9040 0x7fc4c40cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 -- 172.21.15.133:0/802118242 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc009b30 con 0x7fc4c40b1640 2023-11-08T12:27:30.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c2ffd700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40b1640 0x7fc4c40c3a00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e9d0 tx=0x7fc4b400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:30.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4bb7fe700 1 -- 172.21.15.133:0/802118242 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4009720 con 0x7fc4c40b1640 2023-11-08T12:27:30.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4bb7fe700 1 -- 172.21.15.133:0/802118242 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400c850 con 0x7fc4c40b1640 2023-11-08T12:27:30.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c406b5d0 con 0x7fc4c40b1640 2023-11-08T12:27:30.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4bb7fe700 1 -- 172.21.15.133:0/802118242 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400cbc0 con 0x7fc4c40b1640 2023-11-08T12:27:30.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c406b2f0 con 0x7fc4c40b1640 2023-11-08T12:27:30.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4bb7fe700 1 -- 172.21.15.133:0/802118242 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc4b4019030 con 0x7fc4c40b1640 2023-11-08T12:27:30.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.765+0000 7fc4bb7fe700 1 -- 172.21.15.133:0/802118242 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc4b4006840 con 0x7fc4c40b1640 2023-11-08T12:27:30.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.769+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c415eb10 con 0x7fc4c40b1640 2023-11-08T12:27:30.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.769+0000 7fc4bb7fe700 1 -- 172.21.15.133:0/802118242 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc4b4021060 con 0x7fc4c40b1640 2023-11-08T12:27:30.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.849+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ed1c99ab-1da7-49c1-9263-31bf27cc2909", "id": 6} v 0) v1 -- 0x7fc4c4073cb0 con 0x7fc4c40b1640 2023-11-08T12:27:30.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4bb7fe700 1 -- 172.21.15.133:0/802118242 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed1c99ab-1da7-49c1-9263-31bf27cc2909", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc4b4029020 con 0x7fc4c40b1640 2023-11-08T12:27:30.866 INFO:teuthology.orchestra.run.smithi133.stdout:6 2023-11-08T12:27:30.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40b1640 msgr2=0x7fc4c40c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:30.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40b1640 0x7fc4c40c3a00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e9d0 tx=0x7fc4b400ece0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 shutdown_connections 2023-11-08T12:27:30.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40c9040 0x7fc4c40cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4c40b43a0 0x7fc4c40b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 --2- 172.21.15.133:0/802118242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4c40b1640 0x7fc4c40c3a00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:30.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 >> 172.21.15.133:0/802118242 conn(0x7fc4c40b0f80 msgr2=0x7fc4c40ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:30.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 shutdown_connections 2023-11-08T12:27:30.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:30.861+0000 7fc4c95f9700 1 -- 172.21.15.133:0/802118242 wait complete. 2023-11-08T12:27:30.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 038526bd-caad-4bb8-b409-9afc4704c9ac 7 2023-11-08T12:27:30.903 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:30.897+0000 7ff2ca26e2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-08T12:27:31.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe20c861700 1 Processor -- start 2023-11-08T12:27:31.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe20c861700 1 -- start start 2023-11-08T12:27:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe20c861700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe20815c6d0 0x7fe2080b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe20c861700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe208072270 con 0x7fe20806a300 2023-11-08T12:27:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe20c861700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2080d0120 con 0x7fe2080cfc40 2023-11-08T12:27:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe20c861700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2080d0400 con 0x7fe20815c6d0 2023-11-08T12:27:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe206d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe20815c6d0 0x7fe2080b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe1fe59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe2080cfc40 0x7fe208069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40922/0 (socket says 172.21.15.133:40922) 2023-11-08T12:27:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.049+0000 7fe1fe59c700 1 -- 172.21.15.133:0/387646146 learned_addr learned my addr 172.21.15.133:0/387646146 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-11-08T12:27:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe206d9d700 1 -- 172.21.15.133:0/387646146 >> v1:172.21.15.133:6789/0 conn(0x7fe2080cfc40 legacy=0x7fe208069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe206d9d700 1 -- 172.21.15.133:0/387646146 >> v1:172.21.15.112:6789/0 conn(0x7fe20806a300 legacy=0x7fe20806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe206d9d700 1 -- 172.21.15.133:0/387646146 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208071c20 con 0x7fe20815c6d0 2023-11-08T12:27:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe206d9d700 1 --2- 172.21.15.133:0/387646146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20815c6d0 0x7fe2080b17a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009850 tx=0x7fe1f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b4c5a1ad62f30a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20659c700 1 -- 172.21.15.133:0/387646146 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8011830 con 0x7fe20815c6d0 2023-11-08T12:27:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20659c700 1 -- 172.21.15.133:0/387646146 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8011990 con 0x7fe20815c6d0 2023-11-08T12:27:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20659c700 1 -- 172.21.15.133:0/387646146 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8011d20 con 0x7fe20815c6d0 2023-11-08T12:27:31.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20c861700 1 -- 172.21.15.133:0/387646146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20815c6d0 msgr2=0x7fe2080b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20c861700 1 --2- 172.21.15.133:0/387646146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20815c6d0 0x7fe2080b17a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009850 tx=0x7fe1f8009b60 comp rx=0 tx=0).stop 2023-11-08T12:27:31.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20c861700 1 -- 172.21.15.133:0/387646146 shutdown_connections 2023-11-08T12:27:31.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20c861700 1 --2- 172.21.15.133:0/387646146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20815c6d0 0x7fe2080b17a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20c861700 1 -- 172.21.15.133:0/387646146 >> 172.21.15.133:0/387646146 conn(0x7fe2080b6520 msgr2=0x7fe208071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:31.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20c861700 1 -- 172.21.15.133:0/387646146 shutdown_connections 2023-11-08T12:27:31.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.053+0000 7fe20c861700 1 -- 172.21.15.133:0/387646146 wait complete. 2023-11-08T12:27:31.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 Processor -- start 2023-11-08T12:27:31.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 -- start start 2023-11-08T12:27:31.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20806a300 0x7fe2080d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2080cfc40 0x7fe2080d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe20815c6d0 0x7fe2080d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080c9b90 con 0x7fe20815c6d0 2023-11-08T12:27:31.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080d25b0 con 0x7fe20806a300 2023-11-08T12:27:31.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20c861700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080d19a0 con 0x7fe2080cfc40 2023-11-08T12:27:31.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20806a300 0x7fe2080d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20806a300 0x7fe2080d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40288/0 (socket says 172.21.15.133:40288) 2023-11-08T12:27:31.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 -- 172.21.15.133:0/575453218 learned_addr learned my addr 172.21.15.133:0/575453218 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-11-08T12:27:31.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe1fe59c700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2080cfc40 0x7fe2080d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20759e700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe20815c6d0 0x7fe2080d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 -- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2080cfc40 msgr2=0x7fe2080d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2080cfc40 0x7fe2080d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 -- 172.21.15.133:0/575453218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe20815c6d0 msgr2=0x7fe2080d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe20815c6d0 0x7fe2080d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 -- 172.21.15.133:0/575453218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f80094b0 con 0x7fe20806a300 2023-11-08T12:27:31.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe20759e700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe20815c6d0 0x7fe2080d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:31.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.057+0000 7fe206d9d700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20806a300 0x7fe2080d2a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8014040 tx=0x7fe1f8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:31.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe1fffff700 1 -- 172.21.15.133:0/575453218 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80036c0 con 0x7fe20806a300 2023-11-08T12:27:31.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe1fffff700 1 -- 172.21.15.133:0/575453218 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f801e070 con 0x7fe20806a300 2023-11-08T12:27:31.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20815caa0 con 0x7fe20806a300 2023-11-08T12:27:31.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe1fffff700 1 -- 172.21.15.133:0/575453218 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8003a80 con 0x7fe20806a300 2023-11-08T12:27:31.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe208071f00 con 0x7fe20806a300 2023-11-08T12:27:31.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe1fffff700 1 -- 172.21.15.133:0/575453218 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe1f800f050 con 0x7fe20806a300 2023-11-08T12:27:31.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe1fffff700 1 -- 172.21.15.133:0/575453218 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe1f8020070 con 0x7fe20806a300 2023-11-08T12:27:31.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.061+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe208073cb0 con 0x7fe20806a300 2023-11-08T12:27:31.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.065+0000 7fe1fffff700 1 -- 172.21.15.133:0/575453218 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe1f8015020 con 0x7fe20806a300 2023-11-08T12:27:31.103 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:31.097+0000 7ff2ca26e2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-08T12:27:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.145+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "038526bd-caad-4bb8-b409-9afc4704c9ac", "id": 7} v 0) v1 -- 0x7fe2080cea30 con 0x7fe20806a300 2023-11-08T12:27:31.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.157+0000 7fe1fffff700 1 -- 172.21.15.133:0/575453218 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "038526bd-caad-4bb8-b409-9afc4704c9ac", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe1f8003c30 con 0x7fe20806a300 2023-11-08T12:27:31.164 INFO:teuthology.orchestra.run.smithi133.stdout:7 2023-11-08T12:27:31.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20806a300 msgr2=0x7fe2080d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20806a300 0x7fe2080d2a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8014040 tx=0x7fe1f8004770 comp rx=0 tx=0).stop 2023-11-08T12:27:31.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 shutdown_connections 2023-11-08T12:27:31.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe20815c6d0 0x7fe2080d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2080cfc40 0x7fe2080d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 --2- 172.21.15.133:0/575453218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20806a300 0x7fe2080d2a40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 >> 172.21.15.133:0/575453218 conn(0x7fe2080b6520 msgr2=0x7fe20806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:31.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 shutdown_connections 2023-11-08T12:27:31.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-11-08T12:27:31.161+0000 7fe20c861700 1 -- 172.21.15.133:0/575453218 wait complete. 2023-11-08T12:27:31.183 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-08T12:27:31.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-08T12:27:31.191 INFO:tasks.ceph.osd.0:Started 2023-11-08T12:27:31.191 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-08T12:27:31.191 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-08T12:27:31.196 INFO:tasks.ceph.osd.1:Started 2023-11-08T12:27:31.197 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-08T12:27:31.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-08T12:27:31.202 INFO:tasks.ceph.osd.2:Started 2023-11-08T12:27:31.202 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-08T12:27:31.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-08T12:27:31.210 INFO:tasks.ceph.osd.3:Started 2023-11-08T12:27:31.210 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-08T12:27:31.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-08T12:27:31.236 INFO:tasks.ceph.osd.4:Started 2023-11-08T12:27:31.236 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-08T12:27:31.237 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-08T12:27:31.243 INFO:tasks.ceph.osd.5:Started 2023-11-08T12:27:31.243 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-08T12:27:31.243 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-08T12:27:31.249 INFO:tasks.ceph.osd.6:Started 2023-11-08T12:27:31.249 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-08T12:27:31.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-08T12:27:31.255 INFO:tasks.ceph.osd.7:Started 2023-11-08T12:27:31.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca671d700 1 Processor -- start 2023-11-08T12:27:31.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca671d700 1 -- start start 2023-11-08T12:27:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca671d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 0x7f1ca00704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca671d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00ad6c0 con 0x7f1ca0164250 2023-11-08T12:27:31.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca671d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00adc60 con 0x7f1ca0160710 2023-11-08T12:27:31.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca671d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca006b1c0 con 0x7f1ca0070080 2023-11-08T12:27:31.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca5f1c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1ca0164250 0x7f1ca01646d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36238/0 (socket says 172.21.15.112:36238) 2023-11-08T12:27:31.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.418+0000 7f1ca5f1c700 1 -- 172.21.15.112:0/2651270721 learned_addr learned my addr 172.21.15.112:0/2651270721 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:31.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca4f1a700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 0x7f1ca00704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616187447 0 0) 0x7f1ca00ad6c0 con 0x7f1ca0164250 2023-11-08T12:27:31.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c8c0035d0 con 0x7f1ca0164250 2023-11-08T12:27:31.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597658310 0 0) 0x7f1ca00adc60 con 0x7f1ca0160710 2023-11-08T12:27:31.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca00ad6c0 con 0x7f1ca0160710 2023-11-08T12:27:31.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1791392960 0 0) 0x7f1c8c0035d0 con 0x7f1ca0164250 2023-11-08T12:27:31.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 msgr2=0x7f1ca00704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:31.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 0x7f1ca00704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 >> v1:172.21.15.133:6789/0 conn(0x7f1ca0160710 legacy=0x7f1ca00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00709f0 con 0x7f1ca0164250 2023-11-08T12:27:31.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f1c98001670 con 0x7f1ca0164250 2023-11-08T12:27:31.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 >> v1:172.21.15.112:6789/0 conn(0x7f1ca0164250 legacy=0x7f1ca01646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c8c003be0 0x7f1c8c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c004870 0x7f1c8c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 0x7f1c8c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca006b1c0 con 0x7f1c8c003be0 2023-11-08T12:27:31.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c00bae0 con 0x7f1c8c004870 2023-11-08T12:27:31.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c00bca0 con 0x7f1ca0070080 2023-11-08T12:27:31.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca571b700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c8c003be0 0x7f1c8c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca5f1c700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 0x7f1c8c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca4f1a700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c004870 0x7f1c8c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca571b700 1 -- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 msgr2=0x7f1c8c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:31.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca571b700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca0070080 0x7f1c8c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca571b700 1 -- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c004870 msgr2=0x7f1c8c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:31.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca571b700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c004870 0x7f1c8c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca571b700 1 -- 172.21.15.112:0/2651270721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0035d0 con 0x7f1c8c003be0 2023-11-08T12:27:31.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1ca571b700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c8c003be0 0x7f1c8c003fd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c002230 tx=0x7f1c8c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec472bd23802e533 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:31.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c001f30 con 0x7f1c8c003be0 2023-11-08T12:27:31.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00ce60 con 0x7f1c8c003be0 2023-11-08T12:27:31.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.422+0000 7f1c97fff700 1 -- 172.21.15.112:0/2651270721 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c003c60 con 0x7f1c8c003be0 2023-11-08T12:27:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca671d700 1 -- 172.21.15.112:0/2651270721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c8c003be0 msgr2=0x7f1c8c003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca671d700 1 --2- 172.21.15.112:0/2651270721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c8c003be0 0x7f1c8c003fd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c002230 tx=0x7f1c8c0058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca5f1c700 1 -- 172.21.15.112:0/2651270721 reap_dead start 2023-11-08T12:27:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca671d700 1 -- 172.21.15.112:0/2651270721 shutdown_connections 2023-11-08T12:27:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca671d700 1 -- 172.21.15.112:0/2651270721 >> 172.21.15.112:0/2651270721 conn(0x7f1ca00b0f80 msgr2=0x7f1ca00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca671d700 1 -- 172.21.15.112:0/2651270721 shutdown_connections 2023-11-08T12:27:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca671d700 1 -- 172.21.15.112:0/2651270721 wait complete. 2023-11-08T12:27:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.426+0000 7f1ca671d700 1 Processor -- start 2023-11-08T12:27:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 -- start start 2023-11-08T12:27:31.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c003be0 0x7f1ca00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca01610d0 0x7f1ca0161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ca0162ec0 0x7f1ca0163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:31.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca015fad0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00c2370 con 0x7f1c8c003be0 2023-11-08T12:27:31.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0163c40 con 0x7f1ca01610d0 2023-11-08T12:27:31.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ca0162ec0 0x7f1ca0163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ca0162ec0 0x7f1ca0163330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53328/0 (socket says 172.21.15.112:53328) 2023-11-08T12:27:31.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 -- 172.21.15.112:0/1996235103 learned_addr learned my addr 172.21.15.112:0/1996235103 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:31.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca4f1a700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca01610d0 0x7f1ca0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca571b700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c003be0 0x7f1ca00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:31.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 -- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca01610d0 msgr2=0x7f1ca0161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca01610d0 0x7f1ca0161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 -- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c003be0 msgr2=0x7f1ca00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c003be0 0x7f1ca00b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 -- 172.21.15.112:0/1996235103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca006b3d0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca4f1a700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca01610d0 0x7f1ca0161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca571b700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c003be0 0x7f1ca00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca5f1c700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ca0162ec0 0x7f1ca0163330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00cb1a0 tx=0x7f1c9800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:31.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1c95ffb700 1 -- 172.21.15.112:0/1996235103 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98010450 con 0x7f1ca0162ec0 2023-11-08T12:27:31.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1c95ffb700 1 -- 172.21.15.112:0/1996235103 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c980105d0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca00cca30 con 0x7f1ca0162ec0 2023-11-08T12:27:31.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1c95ffb700 1 -- 172.21.15.112:0/1996235103 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98010980 con 0x7f1ca0162ec0 2023-11-08T12:27:31.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1c95ffb700 1 -- 172.21.15.112:0/1996235103 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f1c98014430 con 0x7f1ca0162ec0 2023-11-08T12:27:31.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.430+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca006b6b0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.434+0000 7f1c95ffb700 1 -- 172.21.15.112:0/1996235103 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1c980133e0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.434+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca0161a80 con 0x7f1ca0162ec0 2023-11-08T12:27:31.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.438+0000 7f1c95ffb700 1 -- 172.21.15.112:0/1996235103 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1c980148a0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.469 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:31.462+0000 7fd29683a2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-08T12:27:31.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.498+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ca0073cb0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1c95ffb700 1 -- 172.21.15.112:0/1996235103 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1c98014af0 con 0x7f1ca0162ec0 2023-11-08T12:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":10,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:31.152866+0000","last_up_change":"0.000000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:31.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ca0162ec0 msgr2=0x7f1ca0163330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:31.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ca0162ec0 0x7f1ca0163330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00cb1a0 tx=0x7f1c9800ea90 comp rx=0 tx=0).stop 2023-11-08T12:27:31.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 shutdown_connections 2023-11-08T12:27:31.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ca0162ec0 0x7f1ca0163330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ca01610d0 0x7f1ca0161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 --2- 172.21.15.112:0/1996235103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8c003be0 0x7f1ca00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:31.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 >> 172.21.15.112:0/1996235103 conn(0x7f1ca00b0f80 msgr2=0x7f1ca006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:31.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 shutdown_connections 2023-11-08T12:27:31.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:31.502+0000 7f1ca671d700 1 -- 172.21.15.112:0/1996235103 wait complete. 2023-11-08T12:27:31.526 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-08T12:27:31.526 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-08T12:27:31.706 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:31.698+0000 7fd29683a2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-08T12:27:31.875 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-11-08T12:27:31.870+0000 7f8cfa3ff700 -1 Falling back to public interface 2023-11-08T12:27:31.876 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-11-08T12:27:31.870+0000 7fde938d7700 -1 Falling back to public interface 2023-11-08T12:27:31.876 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-11-08T12:27:31.870+0000 7f8cf93ca700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-08T12:27:31.876 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-11-08T12:27:31.870+0000 7fde928a2700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2023-11-08T12:27:31.884 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-11-08T12:27:31.878+0000 7f43c6758700 -1 Falling back to public interface 2023-11-08T12:27:31.897 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:31.893+0000 7ff2ca26e2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-08T12:27:31.912 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-11-08T12:27:31.906+0000 7f13f2e76700 -1 Falling back to public interface 2023-11-08T12:27:31.920 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-11-08T12:27:31.913+0000 7f9828d72700 -1 Falling back to public interface 2023-11-08T12:27:31.920 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-11-08T12:27:31.913+0000 7fc32b25e700 -1 Falling back to public interface 2023-11-08T12:27:31.935 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-11-08T12:27:31.929+0000 7f8d80095700 -1 Falling back to public interface 2023-11-08T12:27:31.941 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:31.934+0000 7fd29683a2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-08T12:27:31.974 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-11-08T12:27:31.969+0000 7f5fd421a700 -1 Falling back to public interface 2023-11-08T12:27:32.024 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:32.018+0000 7fd29683a2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-08T12:27:32.142 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:32.137+0000 7ff2ca26e2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-08T12:27:32.332 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:32.368 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:32.361+0000 7ff2ca26e2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-08T12:27:32.455 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:32.449+0000 7ff2ca26e2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-08T12:27:32.490 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.486+0000 7f59e8a09700 1 Processor -- start 2023-11-08T12:27:32.491 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.486+0000 7f59e8a09700 1 -- start start 2023-11-08T12:27:32.494 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e8a09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4157e80 0x7f59e4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:32.495 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e8a09700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59e406ce90 0x7f59e40cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:32.495 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e8a09700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e406acc0 con 0x7f59e40710e0 2023-11-08T12:27:32.496 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e8a09700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e406b940 con 0x7f59e406ce90 2023-11-08T12:27:32.496 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e8a09700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e406afa0 con 0x7f59e4157e80 2023-11-08T12:27:32.499 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59e406ce90 0x7f59e40cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:32.499 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59dbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f59e40710e0 0x7f59e406c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:50354/0 (socket says 172.21.15.112:50354) 2023-11-08T12:27:32.499 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e2d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4157e80 0x7f59e4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:32.500 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59dbfff700 1 -- 172.21.15.112:0/2242744698 learned_addr learned my addr 172.21.15.112:0/2242744698 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:32.500 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e259c700 1 -- 172.21.15.112:0/2242744698 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286120045 0 0) 0x7f59e406acc0 con 0x7f59e40710e0 2023-11-08T12:27:32.500 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e259c700 1 -- 172.21.15.112:0/2242744698 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d00035d0 con 0x7f59e40710e0 2023-11-08T12:27:32.500 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e2d9d700 1 -- 172.21.15.112:0/2242744698 >> v2:172.21.15.112:3300/0 conn(0x7f59e406ce90 msgr2=0x7f59e40cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:32.501 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e2d9d700 1 --2- 172.21.15.112:0/2242744698 >> v2:172.21.15.112:3300/0 conn(0x7f59e406ce90 0x7f59e40cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.501 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e2d9d700 1 -- 172.21.15.112:0/2242744698 >> v1:172.21.15.133:6789/0 conn(0x7f59e40710e0 legacy=0x7f59e406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:32.501 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e2d9d700 1 -- 172.21.15.112:0/2242744698 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e406b280 con 0x7f59e4157e80 2023-11-08T12:27:32.501 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e2d9d700 1 --2- 172.21.15.112:0/2242744698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4157e80 0x7f59e4070ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009850 tx=0x7f59d4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4746ebd5e5613a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:32.502 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e259c700 1 -- 172.21.15.112:0/2242744698 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011830 con 0x7f59e4157e80 2023-11-08T12:27:32.502 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e259c700 1 -- 172.21.15.112:0/2242744698 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4011990 con 0x7f59e4157e80 2023-11-08T12:27:32.502 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.490+0000 7f59e259c700 1 -- 172.21.15.112:0/2242744698 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011d40 con 0x7f59e4157e80 2023-11-08T12:27:32.503 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 -- 172.21.15.112:0/2242744698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4157e80 msgr2=0x7f59e4070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:32.503 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 --2- 172.21.15.112:0/2242744698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4157e80 0x7f59e4070ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009850 tx=0x7f59d4009b60 comp rx=0 tx=0).stop 2023-11-08T12:27:32.503 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 -- 172.21.15.112:0/2242744698 shutdown_connections 2023-11-08T12:27:32.503 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 --2- 172.21.15.112:0/2242744698 >> v2:172.21.15.112:3300/0 conn(0x7f59e406ce90 0x7f59e40cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.503 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 --2- 172.21.15.112:0/2242744698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4157e80 0x7f59e4070ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.504 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 -- 172.21.15.112:0/2242744698 >> 172.21.15.112:0/2242744698 conn(0x7f59e40b0b70 msgr2=0x7f59e40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:32.504 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 -- 172.21.15.112:0/2242744698 shutdown_connections 2023-11-08T12:27:32.504 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.494+0000 7f59e8a09700 1 -- 172.21.15.112:0/2242744698 wait complete. 2023-11-08T12:27:32.506 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 Processor -- start 2023-11-08T12:27:32.507 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 -- start start 2023-11-08T12:27:32.507 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e406ce90 0x7f59e40a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:32.507 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e40710e0 0x7f59e415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:32.507 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4157e80 0x7f59e40a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:32.508 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e4159960 con 0x7f59e406ce90 2023-11-08T12:27:32.508 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e415c300 con 0x7f59e4157e80 2023-11-08T12:27:32.508 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e8a09700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40a7980 con 0x7f59e40710e0 2023-11-08T12:27:32.508 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e406ce90 0x7f59e40a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:32.508 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e406ce90 0x7f59e40a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53356/0 (socket says 172.21.15.112:53356) 2023-11-08T12:27:32.509 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 -- 172.21.15.112:0/1191892053 learned_addr learned my addr 172.21.15.112:0/1191892053 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:32.509 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59dbfff700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e40710e0 0x7f59e415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:32.509 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e359e700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4157e80 0x7f59e40a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:32.509 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 -- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e40710e0 msgr2=0x7f59e415cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:32.509 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e40710e0 0x7f59e415cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.510 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 -- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4157e80 msgr2=0x7f59e40a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:32.510 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4157e80 0x7f59e40a8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.510 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 -- 172.21.15.112:0/1191892053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d40094b0 con 0x7f59e406ce90 2023-11-08T12:27:32.510 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.498+0000 7f59e2d9d700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e406ce90 0x7f59e40a7440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59e406b0e0 tx=0x7f59d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:32.510 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59db7fe700 1 -- 172.21.15.112:0/1191892053 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4004520 con 0x7f59e406ce90 2023-11-08T12:27:32.511 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59db7fe700 1 -- 172.21.15.112:0/1191892053 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d401f070 con 0x7f59e406ce90 2023-11-08T12:27:32.511 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e415b630 con 0x7f59e406ce90 2023-11-08T12:27:32.511 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59db7fe700 1 -- 172.21.15.112:0/1191892053 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40038e0 con 0x7f59e406ce90 2023-11-08T12:27:32.511 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e406b560 con 0x7f59e406ce90 2023-11-08T12:27:32.512 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59db7fe700 1 -- 172.21.15.112:0/1191892053 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f59d400f050 con 0x7f59e406ce90 2023-11-08T12:27:32.512 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59db7fe700 1 -- 172.21.15.112:0/1191892053 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f59d4021070 con 0x7f59e406ce90 2023-11-08T12:27:32.512 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.502+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e406bd60 con 0x7f59e406ce90 2023-11-08T12:27:32.513 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.506+0000 7f59db7fe700 1 -- 172.21.15.112:0/1191892053 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f59d402b020 con 0x7f59e406ce90 2023-11-08T12:27:32.577 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.570+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59e4067250 con 0x7f59e406ce90 2023-11-08T12:27:32.578 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.570+0000 7f59db7fe700 1 -- 172.21.15.112:0/1191892053 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f59d4015020 con 0x7f59e406ce90 2023-11-08T12:27:32.578 INFO:teuthology.misc.health.smithi112.stdout: 2023-11-08T12:27:32.579 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":10,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:31.152866+0000","last_up_change":"0.000000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:32.580 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e406ce90 msgr2=0x7f59e40a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:32.581 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e406ce90 0x7f59e40a7440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59e406b0e0 tx=0x7f59d4004770 comp rx=0 tx=0).stop 2023-11-08T12:27:32.581 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 shutdown_connections 2023-11-08T12:27:32.581 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4157e80 0x7f59e40a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.582 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e40710e0 0x7f59e415cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.582 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 --2- 172.21.15.112:0/1191892053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59e406ce90 0x7f59e40a7440 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:32.583 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 >> 172.21.15.112:0/1191892053 conn(0x7f59e40b0b70 msgr2=0x7f59e40ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:32.583 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 shutdown_connections 2023-11-08T12:27:32.583 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:32.574+0000 7f59e8a09700 1 -- 172.21.15.112:0/1191892053 wait complete. 2023-11-08T12:27:32.595 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-08T12:27:32.768 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:32.762+0000 7fd29683a2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-08T12:27:32.863 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:32.858+0000 7fd29683a2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-08T12:27:33.061 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:33.054+0000 7fd29683a2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-08T12:27:33.156 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:33.150+0000 7fd29683a2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-08T12:27:33.206 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:33.201+0000 7ff2ca26e2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-08T12:27:33.304 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:33.297+0000 7ff2ca26e2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-08T12:27:33.433 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:33.426+0000 7fd29683a2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-08T12:27:33.502 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:33.497+0000 7ff2ca26e2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-08T12:27:33.593 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:33.589+0000 7ff2ca26e2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-08T12:27:33.659 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:33.654+0000 7fd29683a2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-08T12:27:33.764 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:33.758+0000 7fd29683a2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-08T12:27:33.873 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:33.869+0000 7ff2ca26e2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-08T12:27:34.088 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:34.081+0000 7ff2ca26e2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-08T12:27:34.193 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:34.189+0000 7ff2ca26e2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-08T12:27:34.684 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:34.678+0000 7fd29683a2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-08T12:27:35.147 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-11-08T12:27:35.141+0000 7ff2ca26e2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-08T12:27:35.585 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-11-08T12:27:35.578+0000 7f43c6758700 -1 osd.2 0 log_to_monitors true 2023-11-08T12:27:35.720 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:35.714+0000 7fd27d0a4700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-08T12:27:35.721 INFO:tasks.ceph.mgr.y.smithi112.stderr:2023-11-08T12:27:35.714+0000 7fd27d0a4700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-08T12:27:35.853 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-11-08T12:27:35.846+0000 7fde938d7700 -1 osd.1 0 log_to_monitors true 2023-11-08T12:27:35.855 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-11-08T12:27:35.850+0000 7f8cfa3ff700 -1 osd.0 0 log_to_monitors true 2023-11-08T12:27:35.884 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-11-08T12:27:35.878+0000 7f13f2e76700 -1 osd.3 0 log_to_monitors true 2023-11-08T12:27:35.913 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-11-08T12:27:35.909+0000 7fc32b25e700 -1 osd.4 0 log_to_monitors true 2023-11-08T12:27:35.962 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-11-08T12:27:35.957+0000 7f5fd421a700 -1 osd.7 0 log_to_monitors true 2023-11-08T12:27:36.203 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-11-08T12:27:36.197+0000 7f8d80095700 -1 osd.6 0 log_to_monitors true 2023-11-08T12:27:36.220 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-11-08T12:27:36.213+0000 7f9828d72700 -1 osd.5 0 log_to_monitors true 2023-11-08T12:27:37.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:27:37.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:27:38.145 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-11-08T12:27:38.138+0000 7f43c2597700 -1 osd.2 0 waiting for initial osdmap 2023-11-08T12:27:38.175 INFO:tasks.ceph.osd.2.smithi112.stderr:2023-11-08T12:27:38.170+0000 7f43b9ff0700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:39.401 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:39.588 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.582+0000 7ff4db59e700 1 Processor -- start 2023-11-08T12:27:39.589 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.582+0000 7ff4db59e700 1 -- start start 2023-11-08T12:27:39.592 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4db59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4dc159db0 0x7ff4dc0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.592 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4db59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc15a180 con 0x7ff4dc0c7950 2023-11-08T12:27:39.593 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4db59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc15fd70 con 0x7ff4dc0cb7d0 2023-11-08T12:27:39.593 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4db59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc06af10 con 0x7ff4dc159db0 2023-11-08T12:27:39.593 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4dad9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff4dc0c7950 0x7ff4dc0c7d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47506/0 (socket says 172.21.15.112:47506) 2023-11-08T12:27:39.593 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4dad9d700 1 -- 172.21.15.112:0/4128046973 learned_addr learned my addr 172.21.15.112:0/4128046973 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:39.594 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603565417 0 0) 0x7ff4dc15a180 con 0x7ff4dc0c7950 2023-11-08T12:27:39.594 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c40035d0 con 0x7ff4dc0c7950 2023-11-08T12:27:39.596 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625183549 0 0) 0x7ff4c40035d0 con 0x7ff4dc0c7950 2023-11-08T12:27:39.596 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 >> v2:172.21.15.133:3300/0 conn(0x7ff4dc159db0 msgr2=0x7ff4dc0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:39.596 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 --2- 172.21.15.112:0/4128046973 >> v2:172.21.15.133:3300/0 conn(0x7ff4dc159db0 0x7ff4dc0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.597 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 >> v1:172.21.15.133:6789/0 conn(0x7ff4dc0cb7d0 legacy=0x7ff4dc160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:39.597 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc06b1f0 con 0x7ff4dc0c7950 2023-11-08T12:27:39.597 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7ff4d40019f0 con 0x7ff4dc0c7950 2023-11-08T12:27:39.597 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 >> v1:172.21.15.112:6789/0 conn(0x7ff4dc0c7950 legacy=0x7ff4dc0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:39.597 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4003a20 0x7ff4c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.598 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4c4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.598 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4c4005340 0x7ff4c400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.598 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc06af10 con 0x7ff4c4004870 2023-11-08T12:27:39.598 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c400c200 con 0x7ff4c4003a20 2023-11-08T12:27:39.599 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c400c3c0 con 0x7ff4c4005340 2023-11-08T12:27:39.599 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4dad9d700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4c4005340 0x7ff4c400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:39.599 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.586+0000 7ff4da59c700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4003a20 0x7ff4c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:39.599 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d9d9b700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4c4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:39.600 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d9d9b700 1 -- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4c4005340 msgr2=0x7ff4c400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:39.600 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d9d9b700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4c4005340 0x7ff4c400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.600 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d9d9b700 1 -- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4003a20 msgr2=0x7ff4c4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:39.600 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d9d9b700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4c4003a20 0x7ff4c4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.600 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d9d9b700 1 -- 172.21.15.112:0/4128046973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40035d0 con 0x7ff4c4004870 2023-11-08T12:27:39.601 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4dad9d700 1 -- 172.21.15.112:0/4128046973 reap_dead start 2023-11-08T12:27:39.601 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d9d9b700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4c4004ce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0001700 tx=0x7ff4c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda76616bba4bb80 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:39.601 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00011a0 con 0x7ff4c4004870 2023-11-08T12:27:39.601 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d00052d0 con 0x7ff4c4004870 2023-11-08T12:27:39.602 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4d959a700 1 -- 172.21.15.112:0/4128046973 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00036a0 con 0x7ff4c4004870 2023-11-08T12:27:39.602 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4db59e700 1 -- 172.21.15.112:0/4128046973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 msgr2=0x7ff4c4004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:39.602 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4db59e700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4c4004ce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0001700 tx=0x7ff4c40058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.605 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4db59e700 1 -- 172.21.15.112:0/4128046973 shutdown_connections 2023-11-08T12:27:39.606 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4db59e700 1 --2- 172.21.15.112:0/4128046973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4c4004ce0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.606 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4db59e700 1 -- 172.21.15.112:0/4128046973 >> 172.21.15.112:0/4128046973 conn(0x7ff4dc0cf290 msgr2=0x7ff4dc0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:39.606 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4db59e700 1 -- 172.21.15.112:0/4128046973 shutdown_connections 2023-11-08T12:27:39.606 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.590+0000 7ff4db59e700 1 -- 172.21.15.112:0/4128046973 wait complete. 2023-11-08T12:27:39.607 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 Processor -- start 2023-11-08T12:27:39.607 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 -- start start 2023-11-08T12:27:39.607 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4dc0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.607 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4dc0ae5c0 0x7ff4dc153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.607 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4dc152a30 0x7ff4dc1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.608 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc0b2f70 con 0x7ff4c4004870 2023-11-08T12:27:39.608 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc0b2680 con 0x7ff4dc0ae5c0 2023-11-08T12:27:39.608 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.594+0000 7ff4db59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc0b2920 con 0x7ff4dc152a30 2023-11-08T12:27:39.608 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4dc152a30 0x7ff4dc1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:39.609 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4dc152a30 0x7ff4dc1583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:47202/0 (socket says 172.21.15.112:47202) 2023-11-08T12:27:39.609 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 -- 172.21.15.112:0/3823936902 learned_addr learned my addr 172.21.15.112:0/3823936902 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:39.609 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 -- 172.21.15.112:0/3823936902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4dc0ae5c0 msgr2=0x7ff4dc153e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-08T12:27:39.609 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4dc0ae5c0 0x7ff4dc153e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.610 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 -- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 msgr2=0x7ff4dc0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:39.610 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4dc0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.610 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 -- 172.21.15.112:0/3823936902 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc160030 con 0x7ff4dc152a30 2023-11-08T12:27:39.610 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4dad9d700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4dc152a30 0x7ff4dc1583f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0c9cd0 tx=0x7ff4d4007060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:39.610 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4caffd700 1 -- 172.21.15.112:0/3823936902 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4007890 con 0x7ff4dc152a30 2023-11-08T12:27:39.611 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4caffd700 1 -- 172.21.15.112:0/3823936902 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d40079f0 con 0x7ff4dc152a30 2023-11-08T12:27:39.611 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4caffd700 1 -- 172.21.15.112:0/3823936902 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4013630 con 0x7ff4dc152a30 2023-11-08T12:27:39.611 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc06b4d0 con 0x7ff4dc152a30 2023-11-08T12:27:39.611 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.598+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc06d410 con 0x7ff4dc152a30 2023-11-08T12:27:39.612 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.602+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4dc067480 con 0x7ff4dc152a30 2023-11-08T12:27:39.612 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.602+0000 7ff4caffd700 1 -- 172.21.15.112:0/3823936902 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 4) v1 ==== 83919+0+0 (secure 0 0 0) 0x7ff4d4039ac0 con 0x7ff4dc152a30 2023-11-08T12:27:39.613 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.602+0000 7ff4caffd700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff4bc064e90 0x7ff4bc067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:39.613 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.602+0000 7ff4caffd700 1 -- 172.21.15.112:0/3823936902 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7ff4d4081b70 con 0x7ff4dc152a30 2023-11-08T12:27:39.613 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.602+0000 7ff4da59c700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff4bc064e90 0x7ff4bc067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:39.614 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.606+0000 7ff4da59c700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff4bc064e90 0x7ff4bc067340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc006fd0 tx=0x7ff4cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:39.621 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.614+0000 7ff4caffd700 1 -- 172.21.15.112:0/3823936902 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff4d4050ad0 con 0x7ff4dc152a30 2023-11-08T12:27:39.727 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-11-08T12:27:39.718+0000 7f8cf623e700 -1 osd.0 0 waiting for initial osdmap 2023-11-08T12:27:39.733 INFO:tasks.ceph.osd.0.smithi112.stderr:2023-11-08T12:27:39.726+0000 7f8cedbf0700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:39.742 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-11-08T12:27:39.738+0000 7fde8f716700 -1 osd.1 0 waiting for initial osdmap 2023-11-08T12:27:39.756 INFO:tasks.ceph.osd.1.smithi112.stderr:2023-11-08T12:27:39.750+0000 7fde86ff0700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:39.767 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-11-08T12:27:39.762+0000 7f13eecb5700 -1 osd.3 0 waiting for initial osdmap 2023-11-08T12:27:39.777 INFO:tasks.ceph.osd.3.smithi112.stderr:2023-11-08T12:27:39.770+0000 7f13e65f0700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:39.842 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.838+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4dc067250 con 0x7ff4dc152a30 2023-11-08T12:27:39.844 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.838+0000 7ff4caffd700 1 -- 172.21.15.112:0/3823936902 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7506 (secure 0 0 0) 0x7ff4d40540f0 con 0x7ff4dc152a30 2023-11-08T12:27:39.845 INFO:teuthology.misc.health.smithi112.stdout: 2023-11-08T12:27:39.845 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":14,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:39.202046+0000","last_up_change":"2023-11-08T12:27:39.202046+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:39.849 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff4bc064e90 msgr2=0x7ff4bc067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:39.849 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff4bc064e90 0x7ff4bc067340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc006fd0 tx=0x7ff4cc008040 comp rx=0 tx=0).stop 2023-11-08T12:27:39.849 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4dc152a30 msgr2=0x7ff4dc1583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:39.850 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4dc152a30 0x7ff4dc1583f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0c9cd0 tx=0x7ff4d4007060 comp rx=0 tx=0).stop 2023-11-08T12:27:39.850 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 shutdown_connections 2023-11-08T12:27:39.850 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff4bc064e90 0x7ff4bc067340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.850 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4dc152a30 0x7ff4dc1583f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.851 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4dc0ae5c0 0x7ff4dc153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.851 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 --2- 172.21.15.112:0/3823936902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4c4004870 0x7ff4dc0aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:39.851 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 >> 172.21.15.112:0/3823936902 conn(0x7ff4dc0cf290 msgr2=0x7ff4dc0703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:39.851 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 shutdown_connections 2023-11-08T12:27:39.851 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:39.842+0000 7ff4db59e700 1 -- 172.21.15.112:0/3823936902 wait complete. 2023-11-08T12:27:39.868 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-08T12:27:40.174 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-11-08T12:27:40.169+0000 7f9825538700 -1 osd.5 0 waiting for initial osdmap 2023-11-08T12:27:40.185 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-11-08T12:27:40.181+0000 7f5fd0059700 -1 osd.7 0 waiting for initial osdmap 2023-11-08T12:27:40.186 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-11-08T12:27:40.181+0000 7f981c5f0700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:40.197 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-11-08T12:27:40.193+0000 7f5fc79f0700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:40.269 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-11-08T12:27:40.265+0000 7fc32709d700 -1 osd.4 0 waiting for initial osdmap 2023-11-08T12:27:40.277 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-11-08T12:27:40.273+0000 7f8d7bed4700 -1 osd.6 0 waiting for initial osdmap 2023-11-08T12:27:40.279 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-11-08T12:27:40.273+0000 7fc31e9f0700 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:40.289 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-11-08T12:27:40.285+0000 7f8d737f0700 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T12:27:46.675 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:46.825 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.818+0000 7f25091a1700 1 Processor -- start 2023-11-08T12:27:46.826 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.818+0000 7f25091a1700 1 -- start start 2023-11-08T12:27:46.827 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25091a1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f25040b4c60 0x7f25040cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:46.828 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25091a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040cd660 0x7f25040d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:46.828 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25091a1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2504069c80 con 0x7f250415c5e0 2023-11-08T12:27:46.828 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25091a1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250406acb0 con 0x7f25040b4c60 2023-11-08T12:27:46.828 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25091a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25040d2910 con 0x7f25040cd660 2023-11-08T12:27:46.828 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f25040b4c60 0x7f25040cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:46.829 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f25040b4c60 0x7f25040cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60736/0 (socket says 172.21.15.112:60736) 2023-11-08T12:27:46.829 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 -- 172.21.15.112:0/1488566446 learned_addr learned my addr 172.21.15.112:0/1488566446 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:46.830 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25089a0700 1 --2- 172.21.15.112:0/1488566446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040cd660 0x7f25040d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:46.831 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 -- 172.21.15.112:0/1488566446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040cd660 msgr2=0x7f25040d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:46.831 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 --2- 172.21.15.112:0/1488566446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040cd660 0x7f25040d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:46.831 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 -- 172.21.15.112:0/1488566446 >> v1:172.21.15.112:6789/0 conn(0x7f250415c5e0 legacy=0x7f25040b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:46.831 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 -- 172.21.15.112:0/1488566446 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250415c9b0 con 0x7f25040b4c60 2023-11-08T12:27:46.832 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25089a0700 1 --2- 172.21.15.112:0/1488566446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040cd660 0x7f25040d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:46.832 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f24fb7fe700 1 --2- 172.21.15.112:0/1488566446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040b4c60 0x7f25040cd120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009910 tx=0x7f24ec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c875f3f451625c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:46.832 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25037fe700 1 -- 172.21.15.112:0/1488566446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00ba60 con 0x7f25040b4c60 2023-11-08T12:27:46.832 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25037fe700 1 -- 172.21.15.112:0/1488566446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec00bbc0 con 0x7f25040b4c60 2023-11-08T12:27:46.832 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25037fe700 1 -- 172.21.15.112:0/1488566446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec009e60 con 0x7f25040b4c60 2023-11-08T12:27:46.833 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25091a1700 1 -- 172.21.15.112:0/1488566446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040b4c60 msgr2=0x7f25040cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:46.833 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.822+0000 7f25091a1700 1 --2- 172.21.15.112:0/1488566446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040b4c60 0x7f25040cd120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009910 tx=0x7f24ec009c20 comp rx=0 tx=0).stop 2023-11-08T12:27:46.833 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- 172.21.15.112:0/1488566446 shutdown_connections 2023-11-08T12:27:46.833 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 --2- 172.21.15.112:0/1488566446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040cd660 0x7f25040d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:46.834 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 --2- 172.21.15.112:0/1488566446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040b4c60 0x7f25040cd120 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:46.834 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- 172.21.15.112:0/1488566446 >> 172.21.15.112:0/1488566446 conn(0x7f25040cf550 msgr2=0x7f25040cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:46.835 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- 172.21.15.112:0/1488566446 shutdown_connections 2023-11-08T12:27:46.835 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- 172.21.15.112:0/1488566446 wait complete. 2023-11-08T12:27:46.837 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 Processor -- start 2023-11-08T12:27:46.838 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- start start 2023-11-08T12:27:46.838 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040b4c60 0x7f250414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:46.838 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040cd660 0x7f25040cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:46.838 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f250415c5e0 0x7f25040cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:46.839 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25041f1830 con 0x7f25040cd660 2023-11-08T12:27:46.839 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25040cc990 con 0x7f250415c5e0 2023-11-08T12:27:46.839 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f25091a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250414fe00 con 0x7f25040b4c60 2023-11-08T12:27:46.839 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f24fb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040cd660 0x7f25040cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:46.839 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f24fb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040cd660 0x7f25040cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60746/0 (socket says 172.21.15.112:60746) 2023-11-08T12:27:46.840 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f24fb7fe700 1 -- 172.21.15.112:0/2747557934 learned_addr learned my addr 172.21.15.112:0/2747557934 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:46.840 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f2503fff700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040b4c60 0x7f250414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:46.840 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f24fb7fe700 1 -- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040b4c60 msgr2=0x7f250414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:46.840 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.826+0000 7f24fb7fe700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040b4c60 0x7f250414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:46.840 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f24fb7fe700 1 -- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f250415c5e0 msgr2=0x7f25040cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:46.841 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f24fb7fe700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f250415c5e0 0x7f25040cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:46.841 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f24fb7fe700 1 -- 172.21.15.112:0/2747557934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec009570 con 0x7f25040cd660 2023-11-08T12:27:46.841 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f2503fff700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040b4c60 0x7f250414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:46.841 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f24fb7fe700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040cd660 0x7f25040cbf10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f24ec000c00 tx=0x7f24ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:46.841 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f25017fa700 1 -- 172.21.15.112:0/2747557934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec004310 con 0x7f25040cd660 2023-11-08T12:27:46.842 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f25017fa700 1 -- 172.21.15.112:0/2747557934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec01f070 con 0x7f25040cd660 2023-11-08T12:27:46.842 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250406a1d0 con 0x7f25040cd660 2023-11-08T12:27:46.842 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f25017fa700 1 -- 172.21.15.112:0/2747557934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0036c0 con 0x7f25040cd660 2023-11-08T12:27:46.842 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2504069ef0 con 0x7f25040cd660 2023-11-08T12:27:46.843 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250406a4b0 con 0x7f25040cd660 2023-11-08T12:27:46.843 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.830+0000 7f25017fa700 1 -- 172.21.15.112:0/2747557934 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f24ec02a020 con 0x7f25040cd660 2023-11-08T12:27:46.844 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.834+0000 7f25017fa700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f24e4064f10 0x7f24e40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:46.844 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.834+0000 7f25017fa700 1 -- 172.21.15.112:0/2747557934 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f24ec082fd0 con 0x7f25040cd660 2023-11-08T12:27:46.844 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.834+0000 7f2503fff700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f24e4064f10 0x7f24e40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:46.844 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.834+0000 7f2503fff700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f24e4064f10 0x7f24e40673c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25040cd2c0 tx=0x7f24f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:46.845 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:46.838+0000 7f25017fa700 1 -- 172.21.15.112:0/2747557934 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f24ec0515a0 con 0x7f25040cd660 2023-11-08T12:27:47.019 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.014+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25040b71c0 con 0x7f25040cd660 2023-11-08T12:27:47.021 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.014+0000 7f25017fa700 1 -- 172.21.15.112:0/2747557934 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f24ec015020 con 0x7f25040cd660 2023-11-08T12:27:47.021 INFO:teuthology.misc.health.smithi112.stdout: 2023-11-08T12:27:47.022 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":18,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:43.708898+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:47.023 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f24e4064f10 msgr2=0x7f24e40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.023 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f24e4064f10 0x7f24e40673c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25040cd2c0 tx=0x7f24f4009040 comp rx=0 tx=0).stop 2023-11-08T12:27:47.024 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040cd660 msgr2=0x7f25040cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.024 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040cd660 0x7f25040cbf10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f24ec000c00 tx=0x7f24ec004770 comp rx=0 tx=0).stop 2023-11-08T12:27:47.026 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 shutdown_connections 2023-11-08T12:27:47.027 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f24e4064f10 0x7f24e40673c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.030 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f250415c5e0 0x7f25040cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.030 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25040cd660 0x7f25040cbf10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.030 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 --2- 172.21.15.112:0/2747557934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f25040b4c60 0x7f250414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.031 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 >> 172.21.15.112:0/2747557934 conn(0x7f25040cf550 msgr2=0x7f25040cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:47.031 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 shutdown_connections 2023-11-08T12:27:47.031 INFO:teuthology.misc.health.smithi112.stderr:2023-11-08T12:27:47.018+0000 7f25091a1700 1 -- 172.21.15.112:0/2747557934 wait complete. 2023-11-08T12:27:47.043 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-08T12:27:47.044 INFO:tasks.ceph:Creating RBD pool 2023-11-08T12:27:47.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-08T12:27:47.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.194+0000 7fc72759e700 1 Processor -- start 2023-11-08T12:27:47.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.194+0000 7fc72759e700 1 -- start start 2023-11-08T12:27:47.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.194+0000 7fc72759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc72815c150 0x7fc7280b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.194+0000 7fc72759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72806ff10 0x7fc728070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.194+0000 7fc72759e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc72815fc30 0x7fc7281600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.194+0000 7fc72759e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280b4240 con 0x7fc72815fc30 2023-11-08T12:27:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72815c520 con 0x7fc72815c150 2023-11-08T12:27:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280708a0 con 0x7fc72806ff10 2023-11-08T12:27:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc72815fc30 0x7fc7281600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc72815fc30 0x7fc7281600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60752/0 (socket says 172.21.15.112:60752) 2023-11-08T12:27:47.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 -- 172.21.15.112:0/1054002576 learned_addr learned my addr 172.21.15.112:0/1054002576 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:47.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc725d9b700 1 --2- 172.21.15.112:0/1054002576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72806ff10 0x7fc728070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72659c700 1 --2- 172.21.15.112:0/1054002576 >> v2:172.21.15.133:3300/0 conn(0x7fc72815c150 0x7fc7280b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 -- 172.21.15.112:0/1054002576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72806ff10 msgr2=0x7fc728070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 --2- 172.21.15.112:0/1054002576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72806ff10 0x7fc728070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 -- 172.21.15.112:0/1054002576 >> v2:172.21.15.133:3300/0 conn(0x7fc72815c150 msgr2=0x7fc7280b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:47.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 --2- 172.21.15.112:0/1054002576 >> v2:172.21.15.133:3300/0 conn(0x7fc72815c150 0x7fc7280b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 -- 172.21.15.112:0/1054002576 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72806cc50 con 0x7fc72815fc30 2023-11-08T12:27:47.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc726d9d700 1 --2- 172.21.15.112:0/1054002576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7281600b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc728071900 tx=0x7fc72000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2782bd13528c0c51 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:47.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72559a700 1 -- 172.21.15.112:0/1054002576 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000e070 con 0x7fc72815fc30 2023-11-08T12:27:47.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72559a700 1 -- 172.21.15.112:0/1054002576 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000b8d0 con 0x7fc72815fc30 2023-11-08T12:27:47.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72559a700 1 -- 172.21.15.112:0/1054002576 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000bc80 con 0x7fc72815fc30 2023-11-08T12:27:47.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 -- 172.21.15.112:0/1054002576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 msgr2=0x7fc7281600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 --2- 172.21.15.112:0/1054002576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7281600b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc728071900 tx=0x7fc72000b330 comp rx=0 tx=0).stop 2023-11-08T12:27:47.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 -- 172.21.15.112:0/1054002576 shutdown_connections 2023-11-08T12:27:47.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 --2- 172.21.15.112:0/1054002576 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72806ff10 0x7fc728070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 --2- 172.21.15.112:0/1054002576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7281600b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 --2- 172.21.15.112:0/1054002576 >> v2:172.21.15.133:3300/0 conn(0x7fc72815c150 0x7fc7280b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 -- 172.21.15.112:0/1054002576 >> 172.21.15.112:0/1054002576 conn(0x7fc7280d3680 msgr2=0x7fc7280cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 -- 172.21.15.112:0/1054002576 shutdown_connections 2023-11-08T12:27:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.198+0000 7fc72759e700 1 -- 172.21.15.112:0/1054002576 wait complete. 2023-11-08T12:27:47.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 Processor -- start 2023-11-08T12:27:47.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 -- start start 2023-11-08T12:27:47.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72806ff10 0x7fc728146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72815c150 0x7fc7280b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7280b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280b87d0 con 0x7fc72815fc30 2023-11-08T12:27:47.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281f25f0 con 0x7fc72806ff10 2023-11-08T12:27:47.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280c9d20 con 0x7fc72815c150 2023-11-08T12:27:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7280b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7280b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60760/0 (socket says 172.21.15.112:60760) 2023-11-08T12:27:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc72659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72806ff10 0x7fc728146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 -- 172.21.15.112:0/2379546532 learned_addr learned my addr 172.21.15.112:0/2379546532 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc725d9b700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72815c150 0x7fc7280b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 -- 172.21.15.112:0/2379546532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72815c150 msgr2=0x7fc7280b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72815c150 0x7fc7280b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 -- 172.21.15.112:0/2379546532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72806ff10 msgr2=0x7fc728146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72806ff10 0x7fc728146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 -- 172.21.15.112:0/2379546532 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720009b30 con 0x7fc72815fc30 2023-11-08T12:27:47.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.202+0000 7fc726d9d700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7280b6f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc728073200 tx=0x7fc720004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.206+0000 7fc71effd700 1 -- 172.21.15.112:0/2379546532 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200099b0 con 0x7fc72815fc30 2023-11-08T12:27:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.206+0000 7fc71effd700 1 -- 172.21.15.112:0/2379546532 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7200092e0 con 0x7fc72815fc30 2023-11-08T12:27:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.206+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7280d2730 con 0x7fc72815fc30 2023-11-08T12:27:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.206+0000 7fc71effd700 1 -- 172.21.15.112:0/2379546532 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720004470 con 0x7fc72815fc30 2023-11-08T12:27:47.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.206+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7280d2450 con 0x7fc72815fc30 2023-11-08T12:27:47.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.206+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7280d05e0 con 0x7fc72815fc30 2023-11-08T12:27:47.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.206+0000 7fc71effd700 1 -- 172.21.15.112:0/2379546532 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc72002b070 con 0x7fc72815fc30 2023-11-08T12:27:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.210+0000 7fc71effd700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc708064ee0 0x7fc708067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.210+0000 7fc71effd700 1 -- 172.21.15.112:0/2379546532 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc720082830 con 0x7fc72815fc30 2023-11-08T12:27:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.210+0000 7fc72659c700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc708064ee0 0x7fc708067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.210+0000 7fc72659c700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc708064ee0 0x7fc708067390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc718009a00 tx=0x7fc718008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:47.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.214+0000 7fc71effd700 1 -- 172.21.15.112:0/2379546532 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc720050e80 con 0x7fc72815fc30 2023-11-08T12:27:47.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.394+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc728073d20 con 0x7fc72815fc30 2023-11-08T12:27:47.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.518+0000 7fc71effd700 1 -- 172.21.15.112:0/2379546532 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc7200290a0 con 0x7fc72815fc30 2023-11-08T12:27:47.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.522+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc708064ee0 msgr2=0x7fc708067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.522+0000 7fc72759e700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc708064ee0 0x7fc708067390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc718009a00 tx=0x7fc718008040 comp rx=0 tx=0).stop 2023-11-08T12:27:47.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.522+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 msgr2=0x7fc7280b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.522+0000 7fc72759e700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7280b6f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc728073200 tx=0x7fc720004af0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 shutdown_connections 2023-11-08T12:27:47.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc708064ee0 0x7fc708067390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72815fc30 0x7fc7280b6f40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc72815c150 0x7fc7280b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 --2- 172.21.15.112:0/2379546532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72806ff10 0x7fc728146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 >> 172.21.15.112:0/2379546532 conn(0x7fc7280d3680 msgr2=0x7fc7280c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:47.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 shutdown_connections 2023-11-08T12:27:47.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.526+0000 7fc72759e700 1 -- 172.21.15.112:0/2379546532 wait complete. 2023-11-08T12:27:47.533 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'rbd' created 2023-11-08T12:27:47.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-08T12:27:47.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.710+0000 7fa99d7ef700 1 Processor -- start 2023-11-08T12:27:47.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.710+0000 7fa99d7ef700 1 -- start start 2023-11-08T12:27:47.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa99806a250 0x7fa99806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99815cab0 con 0x7fa99815c6e0 2023-11-08T12:27:47.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980702d0 con 0x7fa998069e00 2023-11-08T12:27:47.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9980d2800 con 0x7fa99806a250 2023-11-08T12:27:47.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa997fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa99815c6e0 0x7fa998071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35766/0 (socket says 172.21.15.112:35766) 2023-11-08T12:27:47.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa997fff700 1 -- 172.21.15.112:0/2353897106 learned_addr learned my addr 172.21.15.112:0/2353897106 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:47.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99cfee700 1 --2- 172.21.15.112:0/2353897106 >> v2:172.21.15.112:3300/0 conn(0x7fa99806a250 0x7fa99806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa9977fe700 1 -- 172.21.15.112:0/2353897106 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205234692 0 0) 0x7fa99815cab0 con 0x7fa99815c6e0 2023-11-08T12:27:47.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa9977fe700 1 -- 172.21.15.112:0/2353897106 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9840035d0 con 0x7fa99815c6e0 2023-11-08T12:27:47.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99cfee700 1 -- 172.21.15.112:0/2353897106 >> v1:172.21.15.133:6789/0 conn(0x7fa998069e00 legacy=0x7fa99806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99cfee700 1 -- 172.21.15.112:0/2353897106 >> v1:172.21.15.112:6789/0 conn(0x7fa99815c6e0 legacy=0x7fa998071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa9977fe700 1 -- 172.21.15.112:0/2353897106 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650261280 0 0) 0x7fa9980702d0 con 0x7fa998069e00 2023-11-08T12:27:47.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99cfee700 1 -- 172.21.15.112:0/2353897106 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980d2a10 con 0x7fa99806a250 2023-11-08T12:27:47.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99cfee700 1 --2- 172.21.15.112:0/2353897106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa99806a250 0x7fa99806cd40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d90 tx=0x7fa99000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4e63b875b192ba server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:47.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa9977fe700 1 -- 172.21.15.112:0/2353897106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000e070 con 0x7fa99806a250 2023-11-08T12:27:47.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa9977fe700 1 -- 172.21.15.112:0/2353897106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990003a40 con 0x7fa99806a250 2023-11-08T12:27:47.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa9977fe700 1 -- 172.21.15.112:0/2353897106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990003dd0 con 0x7fa99806a250 2023-11-08T12:27:47.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- 172.21.15.112:0/2353897106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa99806a250 msgr2=0x7fa99806cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/2353897106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa99806a250 0x7fa99806cd40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d90 tx=0x7fa99000b330 comp rx=0 tx=0).stop 2023-11-08T12:27:47.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- 172.21.15.112:0/2353897106 shutdown_connections 2023-11-08T12:27:47.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/2353897106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa99806a250 0x7fa99806cd40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- 172.21.15.112:0/2353897106 >> 172.21.15.112:0/2353897106 conn(0x7fa9980b65b0 msgr2=0x7fa998071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:47.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- 172.21.15.112:0/2353897106 shutdown_connections 2023-11-08T12:27:47.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.714+0000 7fa99d7ef700 1 -- 172.21.15.112:0/2353897106 wait complete. 2023-11-08T12:27:47.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.718+0000 7fa99d7ef700 1 Processor -- start 2023-11-08T12:27:47.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.718+0000 7fa99d7ef700 1 -- start start 2023-11-08T12:27:47.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.718+0000 7fa99d7ef700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa998069e00 0x7fa9980c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.718+0000 7fa99d7ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa99806a250 0x7fa9980ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.718+0000 7fa99d7ef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa99815c6e0 0x7fa9980b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa99d7ef700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980c8910 con 0x7fa998069e00 2023-11-08T12:27:47.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa99d7ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980cc5a0 con 0x7fa99806a250 2023-11-08T12:27:47.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa99d7ef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980c9b70 con 0x7fa99815c6e0 2023-11-08T12:27:47.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa998069e00 0x7fa9980c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa998069e00 0x7fa9980c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60790/0 (socket says 172.21.15.112:60790) 2023-11-08T12:27:47.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 -- 172.21.15.112:0/1989150363 learned_addr learned my addr 172.21.15.112:0/1989150363 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:47.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa98f7fe700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa99806a250 0x7fa9980ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa99cfee700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa99815c6e0 0x7fa9980b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 -- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa99815c6e0 msgr2=0x7fa9980b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa99815c6e0 0x7fa9980b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 -- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa99806a250 msgr2=0x7fa9980ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:47.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa99806a250 0x7fa9980ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:47.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 -- 172.21.15.112:0/1989150363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990009a70 con 0x7fa998069e00 2023-11-08T12:27:47.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa997fff700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa998069e00 0x7fa9980c83d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c780 tx=0x7fa98800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:47.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa9957fa700 1 -- 172.21.15.112:0/1989150363 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988005d90 con 0x7fa998069e00 2023-11-08T12:27:47.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa9957fa700 1 -- 172.21.15.112:0/1989150363 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988007070 con 0x7fa998069e00 2023-11-08T12:27:47.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9980d2fd0 con 0x7fa998069e00 2023-11-08T12:27:47.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa9957fa700 1 -- 172.21.15.112:0/1989150363 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880073e0 con 0x7fa998069e00 2023-11-08T12:27:47.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9980d2cf0 con 0x7fa998069e00 2023-11-08T12:27:47.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.722+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9980d32b0 con 0x7fa998069e00 2023-11-08T12:27:47.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.726+0000 7fa9957fa700 1 -- 172.21.15.112:0/1989150363 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa988019030 con 0x7fa998069e00 2023-11-08T12:27:47.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.726+0000 7fa9957fa700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:47.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.726+0000 7fa9957fa700 1 -- 172.21.15.112:0/1989150363 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fa988080ff0 con 0x7fa998069e00 2023-11-08T12:27:47.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.726+0000 7fa98f7fe700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:47.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.730+0000 7fa98f7fe700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa980007fd0 tx=0x7fa980009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:47.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.734+0000 7fa9957fa700 1 -- 172.21.15.112:0/1989150363 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa98804a400 con 0x7fa998069e00 2023-11-08T12:27:47.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:47.906+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa998073cb0 con 0x7fa998069e00 2023-11-08T12:27:48.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.522+0000 7fa9957fa700 1 -- 172.21.15.112:0/1989150363 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa988017070 con 0x7fa998069e00 2023-11-08T12:27:48.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 msgr2=0x7fa978067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa980007fd0 tx=0x7fa980009040 comp rx=0 tx=0).stop 2023-11-08T12:27:48.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa998069e00 msgr2=0x7fa9980c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa998069e00 0x7fa9980c83d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c780 tx=0x7fa98800cb40 comp rx=0 tx=0).stop 2023-11-08T12:27:48.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 shutdown_connections 2023-11-08T12:27:48.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa99815c6e0 0x7fa9980b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa99806a250 0x7fa9980ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 --2- 172.21.15.112:0/1989150363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa998069e00 0x7fa9980c83d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 >> 172.21.15.112:0/1989150363 conn(0x7fa9980b65b0 msgr2=0x7fa99806d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 shutdown_connections 2023-11-08T12:27:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.530+0000 7fa99d7ef700 1 -- 172.21.15.112:0/1989150363 wait complete. 2023-11-08T12:27:48.539 INFO:teuthology.orchestra.run.smithi112.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-08T12:27:48.557 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-08T12:27:48.558 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T12:27:48.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T12:27:48.566 INFO:tasks.ceph.mds.a:Started 2023-11-08T12:27:48.567 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T12:27:48.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T12:27:48.572 INFO:tasks.ceph.mds.c:Started 2023-11-08T12:27:48.572 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T12:27:48.572 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T12:27:48.580 INFO:tasks.ceph.mds.b:Started 2023-11-08T12:27:48.580 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T12:27:48.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T12:27:48.585 INFO:tasks.ceph.mds.d:Started 2023-11-08T12:27:48.585 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-08T12:27:48.586 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:48.683 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-11-08T12:27:48.684 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-11-08T12:27:48.714 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-11-08T12:27:48.716 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-11-08T12:27:48.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.742+0000 7f16aa19a700 1 Processor -- start 2023-11-08T12:27:48.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.742+0000 7f16aa19a700 1 -- start start 2023-11-08T12:27:48.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.742+0000 7f16aa19a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16a40b43a0 0x7f16a415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.742+0000 7f16aa19a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a415a550 con 0x7f16a4070790 2023-11-08T12:27:48.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.742+0000 7f16aa19a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a406b0a0 con 0x7f16a40b1640 2023-11-08T12:27:48.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.742+0000 7f16aa19a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40caac0 con 0x7f16a40b43a0 2023-11-08T12:27:48.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a9999700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16a4070790 0x7f16a406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35776/0 (socket says 172.21.15.112:35776) 2023-11-08T12:27:48.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a9999700 1 -- 172.21.15.112:0/2959137933 learned_addr learned my addr 172.21.15.112:0/2959137933 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:48.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a9198700 1 --2- 172.21.15.112:0/2959137933 >> v2:172.21.15.133:3300/0 conn(0x7f16a40b43a0 0x7f16a415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129133227 0 0) 0x7f169c001110 con 0x7f16a4070790 2023-11-08T12:27:48.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16900035d0 con 0x7f16a4070790 2023-11-08T12:27:48.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 351901853 0 0) 0x7f16900035d0 con 0x7f16a4070790 2023-11-08T12:27:48.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 >> v2:172.21.15.133:3300/0 conn(0x7f16a40b43a0 msgr2=0x7f16a415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:48.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 --2- 172.21.15.112:0/2959137933 >> v2:172.21.15.133:3300/0 conn(0x7f16a40b43a0 0x7f16a415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 >> v1:172.21.15.133:6789/0 conn(0x7f16a40b1640 legacy=0x7f16a4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40cada0 con 0x7f16a4070790 2023-11-08T12:27:48.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f169c001800 con 0x7f16a4070790 2023-11-08T12:27:48.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a9198700 1 --2- 172.21.15.112:0/2959137933 >> v2:172.21.15.133:3300/0 conn(0x7f16a40b43a0 0x7f16a415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:48.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 >> v1:172.21.15.112:6789/0 conn(0x7f16a4070790 legacy=0x7f16a406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1690003a20 0x7f1690003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16900048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1690005170 0x7f169000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40caac0 con 0x7f1690004410 2023-11-08T12:27:48.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169000c0a0 con 0x7f1690005170 2023-11-08T12:27:48.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169000c260 con 0x7f1690003a20 2023-11-08T12:27:48.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a8997700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16900048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a9198700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1690003a20 0x7f1690003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a9999700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1690005170 0x7f169000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a8997700 1 -- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1690003a20 msgr2=0x7f1690003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:48.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a8997700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1690003a20 0x7f1690003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a8997700 1 -- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1690005170 msgr2=0x7f169000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:48.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a8997700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1690005170 0x7f169000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a8997700 1 -- 172.21.15.112:0/2959137933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16900035d0 con 0x7f1690004410 2023-11-08T12:27:48.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a9999700 1 -- 172.21.15.112:0/2959137933 reap_dead start 2023-11-08T12:27:48.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f16a8997700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16900048d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16940018f0 tx=0x7f16900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6741dae28ed750 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:48.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694001390 con 0x7f1690004410 2023-11-08T12:27:48.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940052f0 con 0x7f1690004410 2023-11-08T12:27:48.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.746+0000 7f169bfff700 1 -- 172.21.15.112:0/2959137933 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940036a0 con 0x7f1690004410 2023-11-08T12:27:48.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 -- 172.21.15.112:0/2959137933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 msgr2=0x7f16900048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16900048d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16940018f0 tx=0x7f16900058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 -- 172.21.15.112:0/2959137933 shutdown_connections 2023-11-08T12:27:48.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 --2- 172.21.15.112:0/2959137933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16900048d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 -- 172.21.15.112:0/2959137933 >> 172.21.15.112:0/2959137933 conn(0x7f16a40b0f80 msgr2=0x7f16a40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 -- 172.21.15.112:0/2959137933 shutdown_connections 2023-11-08T12:27:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 -- 172.21.15.112:0/2959137933 wait complete. 2023-11-08T12:27:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 Processor -- start 2023-11-08T12:27:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.750+0000 7f16aa19a700 1 -- start start 2023-11-08T12:27:48.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16a40c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16a41f0950 0x7f16a40c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16a41f0dc0 0x7f16a40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a41f07e0 con 0x7f1690004410 2023-11-08T12:27:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40c8810 con 0x7f16a41f0950 2023-11-08T12:27:48.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40c3410 con 0x7f16a41f0dc0 2023-11-08T12:27:48.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16a40c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16a40c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60830/0 (socket says 172.21.15.112:60830) 2023-11-08T12:27:48.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 -- 172.21.15.112:0/1515125173 learned_addr learned my addr 172.21.15.112:0/1515125173 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:48.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a8997700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16a41f0950 0x7f16a40c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9999700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16a41f0dc0 0x7f16a40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 -- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16a41f0dc0 msgr2=0x7f16a40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16a41f0dc0 0x7f16a40c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 -- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16a41f0950 msgr2=0x7f16a40c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16a41f0950 0x7f16a40c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 -- 172.21.15.112:0/1515125173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a406b5d0 con 0x7f1690004410 2023-11-08T12:27:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9999700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16a41f0dc0 0x7f16a40c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16a9198700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16a40c62b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16a000f430 tx=0x7f16a000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f1699ffb700 1 -- 172.21.15.112:0/1515125173 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000e040 con 0x7f1690004410 2023-11-08T12:27:48.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f1699ffb700 1 -- 172.21.15.112:0/1515125173 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a000f040 con 0x7f1690004410 2023-11-08T12:27:48.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a406b2f0 con 0x7f1690004410 2023-11-08T12:27:48.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f1699ffb700 1 -- 172.21.15.112:0/1515125173 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0003c60 con 0x7f1690004410 2023-11-08T12:27:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.754+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a40ca7b0 con 0x7f1690004410 2023-11-08T12:27:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.758+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a4073cb0 con 0x7f1690004410 2023-11-08T12:27:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.758+0000 7f1699ffb700 1 -- 172.21.15.112:0/1515125173 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f16a0024070 con 0x7f1690004410 2023-11-08T12:27:48.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.758+0000 7f1699ffb700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1688064ee0 0x7f1688067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.758+0000 7f1699ffb700 1 -- 172.21.15.112:0/1515125173 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f16a0082560 con 0x7f1690004410 2023-11-08T12:27:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.758+0000 7f16a8997700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1688064ee0 0x7f1688067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:48.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.762+0000 7f16a8997700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1688064ee0 0x7f1688067390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16a415ab50 tx=0x7f1694005000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:48.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.766+0000 7f1699ffb700 1 -- 172.21.15.112:0/1515125173 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f16a0050a50 con 0x7f1690004410 2023-11-08T12:27:48.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.938+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16a4071090 con 0x7f1690004410 2023-11-08T12:27:48.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.942+0000 7f1699ffb700 1 -- 172.21.15.112:0/1515125173 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14229 (secure 0 0 0) 0x7f16a0054070 con 0x7f1690004410 2023-11-08T12:27:48.947 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:48.947 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":20,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:48.518702+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:48.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1688064ee0 msgr2=0x7f1688067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1688064ee0 0x7f1688067390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16a415ab50 tx=0x7f1694005000 comp rx=0 tx=0).stop 2023-11-08T12:27:48.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 msgr2=0x7f16a40c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:48.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16a40c62b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16a000f430 tx=0x7f16a000f7f0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 shutdown_connections 2023-11-08T12:27:48.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1688064ee0 0x7f1688067390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f16a41f0dc0 0x7f16a40c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16a41f0950 0x7f16a40c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 --2- 172.21.15.112:0/1515125173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1690004410 0x7f16a40c62b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:48.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 >> 172.21.15.112:0/1515125173 conn(0x7f16a40b0f80 msgr2=0x7f16a40b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:48.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 shutdown_connections 2023-11-08T12:27:48.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:48.946+0000 7f16aa19a700 1 -- 172.21.15.112:0/1515125173 wait complete. 2023-11-08T12:27:48.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:27:48.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:27:49.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.158+0000 7f43a30c3700 1 Processor -- start 2023-11-08T12:27:49.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.158+0000 7f43a30c3700 1 -- start start 2023-11-08T12:27:49.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f43a30c3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f439c0aed60 0x7f439c165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f43a30c3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c06afb0 con 0x7f439c06c2b0 2023-11-08T12:27:49.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f43a30c3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c06b290 con 0x7f439c06c680 2023-11-08T12:27:49.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f43a30c3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c0c8f40 con 0x7f439c0aed60 2023-11-08T12:27:49.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f43a0e5f700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f439c06c2b0 0x7f439c1639d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35778/0 (socket says 172.21.15.112:35778) 2023-11-08T12:27:49.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f43a0e5f700 1 -- 172.21.15.112:0/403363540 learned_addr learned my addr 172.21.15.112:0/403363540 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:49.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439bfff700 1 --2- 172.21.15.112:0/403363540 >> v2:172.21.15.112:3300/0 conn(0x7f439c0aed60 0x7f439c165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582486325 0 0) 0x7f439c06afb0 con 0x7f439c06c2b0 2023-11-08T12:27:49.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c0035d0 con 0x7f439c06c2b0 2023-11-08T12:27:49.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878894673 0 0) 0x7f439c06b290 con 0x7f439c06c680 2023-11-08T12:27:49.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f439c06afb0 con 0x7f439c06c680 2023-11-08T12:27:49.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016795931 0 0) 0x7f438c0035d0 con 0x7f439c06c2b0 2023-11-08T12:27:49.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 >> v2:172.21.15.112:3300/0 conn(0x7f439c0aed60 msgr2=0x7f439c165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:49.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 --2- 172.21.15.112:0/403363540 >> v2:172.21.15.112:3300/0 conn(0x7f439c0aed60 0x7f439c165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 >> v1:172.21.15.133:6789/0 conn(0x7f439c06c680 legacy=0x7f439c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c0c9220 con 0x7f439c06c2b0 2023-11-08T12:27:49.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.162+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f4390001670 con 0x7f439c06c2b0 2023-11-08T12:27:49.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 >> v1:172.21.15.112:6789/0 conn(0x7f439c06c2b0 legacy=0x7f439c1639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438c003c00 0x7f438c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f438c004870 0x7f438c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c005270 0x7f438c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c8f40 con 0x7f438c004870 2023-11-08T12:27:49.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c00c180 con 0x7f438c005270 2023-11-08T12:27:49.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c00c340 con 0x7f438c003c00 2023-11-08T12:27:49.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439bfff700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f438c004870 0x7f438c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a0e5f700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438c003c00 0x7f438c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a1660700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c005270 0x7f438c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439bfff700 1 -- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438c003c00 msgr2=0x7f438c003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:49.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439bfff700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f438c003c00 0x7f438c003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439bfff700 1 -- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c005270 msgr2=0x7f438c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:49.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439bfff700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c005270 0x7f438c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439bfff700 1 -- 172.21.15.112:0/403363540 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0035d0 con 0x7f438c004870 2023-11-08T12:27:49.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a1660700 1 -- 172.21.15.112:0/403363540 reap_dead start 2023-11-08T12:27:49.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439bfff700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f438c004870 0x7f438c004ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f439c0af1b0 tx=0x7f438c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1670dc5e3d64677d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438800e6c0 con 0x7f438c004870 2023-11-08T12:27:49.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438800e820 con 0x7f438c004870 2023-11-08T12:27:49.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f439b7fe700 1 -- 172.21.15.112:0/403363540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438800eb90 con 0x7f438c004870 2023-11-08T12:27:49.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a30c3700 1 -- 172.21.15.112:0/403363540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f438c004870 msgr2=0x7f438c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a30c3700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f438c004870 0x7f438c004ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f439c0af1b0 tx=0x7f438c0058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a30c3700 1 -- 172.21.15.112:0/403363540 shutdown_connections 2023-11-08T12:27:49.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a30c3700 1 --2- 172.21.15.112:0/403363540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f438c004870 0x7f438c004ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a30c3700 1 -- 172.21.15.112:0/403363540 >> 172.21.15.112:0/403363540 conn(0x7f439c0cf580 msgr2=0x7f439c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:49.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a30c3700 1 -- 172.21.15.112:0/403363540 shutdown_connections 2023-11-08T12:27:49.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.166+0000 7f43a30c3700 1 -- 172.21.15.112:0/403363540 wait complete. 2023-11-08T12:27:49.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.170+0000 7f43a30c3700 1 Processor -- start 2023-11-08T12:27:49.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.170+0000 7f43a30c3700 1 -- start start 2023-11-08T12:27:49.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c004870 0x7f439c0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f439c157e90 0x7f439c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f439c1582e0 0x7f439c0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c1ea370 con 0x7f439c157e90 2023-11-08T12:27:49.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c8900 con 0x7f438c004870 2023-11-08T12:27:49.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0b47c0 con 0x7f439c1582e0 2023-11-08T12:27:49.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f439c157e90 0x7f439c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f439c157e90 0x7f439c0b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60854/0 (socket says 172.21.15.112:60854) 2023-11-08T12:27:49.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 -- 172.21.15.112:0/578423304 learned_addr learned my addr 172.21.15.112:0/578423304 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:49.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a0e5f700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c004870 0x7f439c0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a1660700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f439c1582e0 0x7f439c0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 -- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f439c1582e0 msgr2=0x7f439c0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f439c1582e0 0x7f439c0b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 -- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c004870 msgr2=0x7f439c0c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c004870 0x7f439c0c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 -- 172.21.15.112:0/578423304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c165080 con 0x7f439c157e90 2023-11-08T12:27:49.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f439bfff700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f439c157e90 0x7f439c0b2820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f438c00c150 tx=0x7f43880047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43997fa700 1 -- 172.21.15.112:0/578423304 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438800e6c0 con 0x7f439c157e90 2023-11-08T12:27:49.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43997fa700 1 -- 172.21.15.112:0/578423304 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43880038e0 con 0x7f439c157e90 2023-11-08T12:27:49.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c0ad800 con 0x7f439c157e90 2023-11-08T12:27:49.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43997fa700 1 -- 172.21.15.112:0/578423304 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388003c90 con 0x7f439c157e90 2023-11-08T12:27:49.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.174+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c165210 con 0x7f439c157e90 2023-11-08T12:27:49.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.178+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c0726c0 con 0x7f439c157e90 2023-11-08T12:27:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.178+0000 7f43997fa700 1 -- 172.21.15.112:0/578423304 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f438802c020 con 0x7f439c157e90 2023-11-08T12:27:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.178+0000 7f43997fa700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4380064ee0 0x7f4380067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.178+0000 7f43997fa700 1 -- 172.21.15.112:0/578423304 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4388083370 con 0x7f439c157e90 2023-11-08T12:27:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.178+0000 7f43a0e5f700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4380064ee0 0x7f4380067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.182+0000 7f43a0e5f700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4380064ee0 0x7f4380067390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4390005ac0 tx=0x7f4390007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.186+0000 7f43997fa700 1 -- 172.21.15.112:0/578423304 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4388051710 con 0x7f439c157e90 2023-11-08T12:27:49.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.354+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f439c0c1870 con 0x7f439c157e90 2023-11-08T12:27:49.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.354+0000 7f43997fa700 1 -- 172.21.15.112:0/578423304 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4388054d30 con 0x7f439c157e90 2023-11-08T12:27:49.361 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:27:49.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4380064ee0 msgr2=0x7f4380067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4380064ee0 0x7f4380067390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4390005ac0 tx=0x7f4390007040 comp rx=0 tx=0).stop 2023-11-08T12:27:49.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f439c157e90 msgr2=0x7f439c0b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f439c157e90 0x7f439c0b2820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f438c00c150 tx=0x7f43880047e0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 shutdown_connections 2023-11-08T12:27:49.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4380064ee0 0x7f4380067390 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f439c1582e0 0x7f439c0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f439c157e90 0x7f439c0b2820 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 --2- 172.21.15.112:0/578423304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f438c004870 0x7f439c0c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 >> 172.21.15.112:0/578423304 conn(0x7f439c0cf580 msgr2=0x7f439c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:49.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 shutdown_connections 2023-11-08T12:27:49.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.358+0000 7f43a30c3700 1 -- 172.21.15.112:0/578423304 wait complete. 2023-11-08T12:27:49.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:27:49.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.561+0000 7f79d142f700 1 Processor -- start 2023-11-08T12:27:49.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.561+0000 7f79d142f700 1 -- start start 2023-11-08T12:27:49.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79d142f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79cc15c150 0x7f79cc0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79d142f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc06ff10 0x7f79cc070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79d142f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79cc15fc30 0x7f79cc1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79d142f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc0b4240 con 0x7f79cc15c150 2023-11-08T12:27:49.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79d142f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc15c520 con 0x7f79cc15fc30 2023-11-08T12:27:49.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79d142f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0708a0 con 0x7f79cc06ff10 2023-11-08T12:27:49.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79cc15c150 0x7f79cc0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79c37fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc06ff10 0x7f79cc070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79d0c2e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79cc15fc30 0x7f79cc1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79cc15c150 0x7f79cc0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60866/0 (socket says 172.21.15.112:60866) 2023-11-08T12:27:49.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 -- 172.21.15.112:0/2182639015 learned_addr learned my addr 172.21.15.112:0/2182639015 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:49.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 -- 172.21.15.112:0/2182639015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc06ff10 msgr2=0x7f79cc070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:49.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 --2- 172.21.15.112:0/2182639015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc06ff10 0x7f79cc070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 -- 172.21.15.112:0/2182639015 >> v2:172.21.15.133:3300/0 conn(0x7f79cc15fc30 msgr2=0x7f79cc1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:49.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 --2- 172.21.15.112:0/2182639015 >> v2:172.21.15.133:3300/0 conn(0x7f79cc15fc30 0x7f79cc1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 -- 172.21.15.112:0/2182639015 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc06cc50 con 0x7f79cc15c150 2023-11-08T12:27:49.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cbfff700 1 --2- 172.21.15.112:0/2182639015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15c150 0x7f79cc0b3d00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79cc071460 tx=0x7f79bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e3713562afdfad server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cb7fe700 1 -- 172.21.15.112:0/2182639015 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00e070 con 0x7f79cc15c150 2023-11-08T12:27:49.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cb7fe700 1 -- 172.21.15.112:0/2182639015 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00b8d0 con 0x7f79cc15c150 2023-11-08T12:27:49.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.565+0000 7f79cb7fe700 1 -- 172.21.15.112:0/2182639015 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00bc80 con 0x7f79cc15c150 2023-11-08T12:27:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 -- 172.21.15.112:0/2182639015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15c150 msgr2=0x7f79cc0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 --2- 172.21.15.112:0/2182639015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15c150 0x7f79cc0b3d00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79cc071460 tx=0x7f79bc00b330 comp rx=0 tx=0).stop 2023-11-08T12:27:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 -- 172.21.15.112:0/2182639015 shutdown_connections 2023-11-08T12:27:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 --2- 172.21.15.112:0/2182639015 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc06ff10 0x7f79cc070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 --2- 172.21.15.112:0/2182639015 >> v2:172.21.15.133:3300/0 conn(0x7f79cc15fc30 0x7f79cc1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 --2- 172.21.15.112:0/2182639015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15c150 0x7f79cc0b3d00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 -- 172.21.15.112:0/2182639015 >> 172.21.15.112:0/2182639015 conn(0x7f79cc0d3680 msgr2=0x7f79cc0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:49.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 -- 172.21.15.112:0/2182639015 shutdown_connections 2023-11-08T12:27:49.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 -- 172.21.15.112:0/2182639015 wait complete. 2023-11-08T12:27:49.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 Processor -- start 2023-11-08T12:27:49.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.569+0000 7f79d142f700 1 -- start start 2023-11-08T12:27:49.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79cc06ff10 0x7f79cc14fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc15c150 0x7f79cc15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15fc30 0x7f79cc160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc15f4c0 con 0x7f79cc15fc30 2023-11-08T12:27:49.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc15cf10 con 0x7f79cc06ff10 2023-11-08T12:27:49.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc15f1e0 con 0x7f79cc15c150 2023-11-08T12:27:49.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15fc30 0x7f79cc160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15fc30 0x7f79cc160090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60876/0 (socket says 172.21.15.112:60876) 2023-11-08T12:27:49.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 -- 172.21.15.112:0/4213139169 learned_addr learned my addr 172.21.15.112:0/4213139169 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:49.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79cbfff700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79cc06ff10 0x7f79cc14fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79c37fe700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc15c150 0x7f79cc15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 -- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc15c150 msgr2=0x7f79cc15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc15c150 0x7f79cc15e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 -- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79cc06ff10 msgr2=0x7f79cc14fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79cc06ff10 0x7f79cc14fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 -- 172.21.15.112:0/4213139169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc009b30 con 0x7f79cc15fc30 2023-11-08T12:27:49.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79cbfff700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79cc06ff10 0x7f79cc14fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:49.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d0c2e700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15fc30 0x7f79cc160090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79c400e7f0 tx=0x7f79c400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79c97fa700 1 -- 172.21.15.112:0/4213139169 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40095c0 con 0x7f79cc15fc30 2023-11-08T12:27:49.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79c97fa700 1 -- 172.21.15.112:0/4213139169 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4013680 con 0x7f79cc15fc30 2023-11-08T12:27:49.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79c97fa700 1 -- 172.21.15.112:0/4213139169 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4013a10 con 0x7f79cc15fc30 2023-11-08T12:27:49.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc0d2730 con 0x7f79cc15fc30 2023-11-08T12:27:49.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.573+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc0d2450 con 0x7f79cc15fc30 2023-11-08T12:27:49.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.577+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc0d05e0 con 0x7f79cc15fc30 2023-11-08T12:27:49.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.577+0000 7f79c97fa700 1 -- 172.21.15.112:0/4213139169 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f79c4019030 con 0x7f79cc15fc30 2023-11-08T12:27:49.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.577+0000 7f79c97fa700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f79ac064f10 0x7f79ac0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.577+0000 7f79c97fa700 1 -- 172.21.15.112:0/4213139169 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f79c4081a20 con 0x7f79cc15fc30 2023-11-08T12:27:49.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.577+0000 7f79cbfff700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f79ac064f10 0x7f79ac0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.581+0000 7f79cbfff700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f79ac064f10 0x7f79ac0673c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00b370 tx=0x7f79bc009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.585+0000 7f79c97fa700 1 -- 172.21.15.112:0/4213139169 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f79c404fe20 con 0x7f79cc15fc30 2023-11-08T12:27:49.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.757+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79cc15c6b0 con 0x7f79cc15fc30 2023-11-08T12:27:49.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.757+0000 7f79c97fa700 1 -- 172.21.15.112:0/4213139169 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79cc15c6b0 con 0x7f79cc15fc30 2023-11-08T12:27:49.764 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:27:49.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f79ac064f10 msgr2=0x7f79ac0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f79ac064f10 0x7f79ac0673c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00b370 tx=0x7f79bc009000 comp rx=0 tx=0).stop 2023-11-08T12:27:49.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15fc30 msgr2=0x7f79cc160090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15fc30 0x7f79cc160090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79c400e7f0 tx=0x7f79c400ebb0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 shutdown_connections 2023-11-08T12:27:49.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f79ac064f10 0x7f79ac0673c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79cc15fc30 0x7f79cc160090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79cc15c150 0x7f79cc15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 --2- 172.21.15.112:0/4213139169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79cc06ff10 0x7f79cc14fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 >> 172.21.15.112:0/4213139169 conn(0x7f79cc0d3680 msgr2=0x7f79cc0b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:49.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 shutdown_connections 2023-11-08T12:27:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.761+0000 7f79d142f700 1 -- 172.21.15.112:0/4213139169 wait complete. 2023-11-08T12:27:49.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:27:49.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.961+0000 7efe0ae20700 1 Processor -- start 2023-11-08T12:27:49.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.961+0000 7efe0ae20700 1 -- start start 2023-11-08T12:27:49.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.961+0000 7efe0ae20700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efe040b1b30 0x7efe040cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.961+0000 7efe0ae20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.961+0000 7efe0ae20700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040cb9c0 con 0x7efe040cd950 2023-11-08T12:27:49.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.961+0000 7efe0ae20700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040ced30 con 0x7efe040b1b30 2023-11-08T12:27:49.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.961+0000 7efe0ae20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040cadf0 con 0x7efe040ce370 2023-11-08T12:27:49.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe09e1e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efe040b1b30 0x7efe040cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0961d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efe040cd950 0x7efe040b35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35794/0 (socket says 172.21.15.112:35794) 2023-11-08T12:27:49.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0961d700 1 -- 172.21.15.112:0/4116242369 learned_addr learned my addr 172.21.15.112:0/4116242369 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:49.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0a61f700 1 --2- 172.21.15.112:0/4116242369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe08e1c700 1 -- 172.21.15.112:0/4116242369 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232852840 0 0) 0x7efe040cb9c0 con 0x7efe040cd950 2023-11-08T12:27:49.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe08e1c700 1 -- 172.21.15.112:0/4116242369 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf00035d0 con 0x7efe040cd950 2023-11-08T12:27:49.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe09e1e700 1 -- 172.21.15.112:0/4116242369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 msgr2=0x7efe040ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:49.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe09e1e700 1 --2- 172.21.15.112:0/4116242369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe09e1e700 1 -- 172.21.15.112:0/4116242369 >> v1:172.21.15.112:6789/0 conn(0x7efe040cd950 legacy=0x7efe040b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe09e1e700 1 -- 172.21.15.112:0/4116242369 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040cb090 con 0x7efe040b1b30 2023-11-08T12:27:49.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0a61f700 1 --2- 172.21.15.112:0/4116242369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:49.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe09e1e700 1 --2- 172.21.15.112:0/4116242369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe040cca20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe00009840 tx=0x7efe00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea1f34a7a513d2c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe08e1c700 1 -- 172.21.15.112:0/4116242369 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00005e50 con 0x7efe040b1b30 2023-11-08T12:27:49.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe08e1c700 1 -- 172.21.15.112:0/4116242369 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00006030 con 0x7efe040b1b30 2023-11-08T12:27:49.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe08e1c700 1 -- 172.21.15.112:0/4116242369 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000063c0 con 0x7efe040b1b30 2023-11-08T12:27:49.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 -- 172.21.15.112:0/4116242369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 msgr2=0x7efe040cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 --2- 172.21.15.112:0/4116242369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe040cca20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe00009840 tx=0x7efe00009b50 comp rx=0 tx=0).stop 2023-11-08T12:27:49.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 -- 172.21.15.112:0/4116242369 shutdown_connections 2023-11-08T12:27:49.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 --2- 172.21.15.112:0/4116242369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 --2- 172.21.15.112:0/4116242369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe040cca20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 -- 172.21.15.112:0/4116242369 >> 172.21.15.112:0/4116242369 conn(0x7efe04099af0 msgr2=0x7efe040d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:49.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 -- 172.21.15.112:0/4116242369 shutdown_connections 2023-11-08T12:27:49.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.965+0000 7efe0ae20700 1 -- 172.21.15.112:0/4116242369 wait complete. 2023-11-08T12:27:49.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 Processor -- start 2023-11-08T12:27:49.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 -- start start 2023-11-08T12:27:49.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe041f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe040cd950 0x7efe040ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040c6600 con 0x7efe040b1b30 2023-11-08T12:27:49.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe041f5b00 con 0x7efe040cd950 2023-11-08T12:27:49.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0ae20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe041f5de0 con 0x7efe040ce370 2023-11-08T12:27:49.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe041f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe041f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60896/0 (socket says 172.21.15.112:60896) 2023-11-08T12:27:49.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 -- 172.21.15.112:0/1268332302 learned_addr learned my addr 172.21.15.112:0/1268332302 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:49.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0961d700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe040cd950 0x7efe040ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe0a61f700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 -- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 msgr2=0x7efe040cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 -- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe040cd950 msgr2=0x7efe040ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:49.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe040cd950 0x7efe040ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:49.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.969+0000 7efe09e1e700 1 -- 172.21.15.112:0/1268332302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009450 con 0x7efe040b1b30 2023-11-08T12:27:49.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.973+0000 7efe09e1e700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe041f2520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe00013040 tx=0x7efe00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.973+0000 7efdfa7fc700 1 -- 172.21.15.112:0/1268332302 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00003ad0 con 0x7efe040b1b30 2023-11-08T12:27:49.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.973+0000 7efdfa7fc700 1 -- 172.21.15.112:0/1268332302 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00003c50 con 0x7efe040b1b30 2023-11-08T12:27:49.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.973+0000 7efdfa7fc700 1 -- 172.21.15.112:0/1268332302 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000061a0 con 0x7efe040b1b30 2023-11-08T12:27:49.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.973+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe040cb650 con 0x7efe040b1b30 2023-11-08T12:27:49.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.973+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040cb370 con 0x7efe040b1b30 2023-11-08T12:27:49.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.973+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe040b3d00 con 0x7efe040b1b30 2023-11-08T12:27:49.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.977+0000 7efdfa7fc700 1 -- 172.21.15.112:0/1268332302 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efe0000f050 con 0x7efe040b1b30 2023-11-08T12:27:49.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.977+0000 7efdfa7fc700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efde8064f10 0x7efde80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:49.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.977+0000 7efdfa7fc700 1 -- 172.21.15.112:0/1268332302 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efe00083690 con 0x7efe040b1b30 2023-11-08T12:27:49.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.977+0000 7efe0961d700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efde8064f10 0x7efde80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:49.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.977+0000 7efe0961d700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efde8064f10 0x7efde80673c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe040b3740 tx=0x7efdf4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:49.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:49.981+0000 7efdfa7fc700 1 -- 172.21.15.112:0/1268332302 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efe00051a90 con 0x7efe040b1b30 2023-11-08T12:27:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.197+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe04073cb0 con 0x7efe040b1b30 2023-11-08T12:27:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.197+0000 7efdfa7fc700 1 -- 172.21.15.112:0/1268332302 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7efe000550b0 con 0x7efe040b1b30 2023-11-08T12:27:50.204 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:50.204 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-08T12:27:50.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efde8064f10 msgr2=0x7efde80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efde8064f10 0x7efde80673c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe040b3740 tx=0x7efdf4009040 comp rx=0 tx=0).stop 2023-11-08T12:27:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 msgr2=0x7efe041f2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe041f2520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe00013040 tx=0x7efe00004770 comp rx=0 tx=0).stop 2023-11-08T12:27:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 shutdown_connections 2023-11-08T12:27:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efde8064f10 0x7efde80673c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe040ce370 0x7efe040cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe040cd950 0x7efe040ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 --2- 172.21.15.112:0/1268332302 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe040b1b30 0x7efe041f2520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 >> 172.21.15.112:0/1268332302 conn(0x7efe04099af0 msgr2=0x7efe04159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 shutdown_connections 2023-11-08T12:27:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.201+0000 7efe0ae20700 1 -- 172.21.15.112:0/1268332302 wait complete. 2023-11-08T12:27:50.209 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 3 2023-11-08T12:27:50.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:50.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 Processor -- start 2023-11-08T12:27:50.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 -- start start 2023-11-08T12:27:50.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f070015c6d0 0x7f07000b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f0700069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f070006a130 0x7f07000b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07000d0400 con 0x7f070006a130 2023-11-08T12:27:50.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070006a5b0 con 0x7f070015c6d0 2023-11-08T12:27:50.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.393+0000 7f0705999700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0700072270 con 0x7f07000cfc40 2023-11-08T12:27:50.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f070015c6d0 0x7f07000b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06ff7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f070006a130 0x7f07000b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06fe7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f0700069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f070015c6d0 0x7f07000b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:57348/0 (socket says 172.21.15.112:57348) 2023-11-08T12:27:50.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 -- 172.21.15.112:0/763477202 learned_addr learned my addr 172.21.15.112:0/763477202 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:50.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 -- 172.21.15.112:0/763477202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 msgr2=0x7f0700069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:50.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 --2- 172.21.15.112:0/763477202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f0700069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 -- 172.21.15.112:0/763477202 >> v2:172.21.15.112:3300/0 conn(0x7f070006a130 msgr2=0x7f07000b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:50.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 --2- 172.21.15.112:0/763477202 >> v2:172.21.15.112:3300/0 conn(0x7f070006a130 0x7f07000b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 -- 172.21.15.112:0/763477202 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000d0120 con 0x7f070015c6d0 2023-11-08T12:27:50.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06ff7fe700 1 --2- 172.21.15.112:0/763477202 >> v2:172.21.15.112:3300/0 conn(0x7f070006a130 0x7f07000b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:50.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06feffd700 1 --2- 172.21.15.112:0/763477202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070015c6d0 0x7f07000b17a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0700066bf0 tx=0x7f06f0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48299f4a288e474 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:50.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06fdffb700 1 -- 172.21.15.112:0/763477202 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0011830 con 0x7f070015c6d0 2023-11-08T12:27:50.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06fdffb700 1 -- 172.21.15.112:0/763477202 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f0011990 con 0x7f070015c6d0 2023-11-08T12:27:50.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f06fdffb700 1 -- 172.21.15.112:0/763477202 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0011d20 con 0x7f070015c6d0 2023-11-08T12:27:50.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f0705999700 1 -- 172.21.15.112:0/763477202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070015c6d0 msgr2=0x7f07000b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f0705999700 1 --2- 172.21.15.112:0/763477202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070015c6d0 0x7f07000b17a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0700066bf0 tx=0x7f06f0009bf0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f0705999700 1 -- 172.21.15.112:0/763477202 shutdown_connections 2023-11-08T12:27:50.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f0705999700 1 --2- 172.21.15.112:0/763477202 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f0700069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f0705999700 1 --2- 172.21.15.112:0/763477202 >> v2:172.21.15.112:3300/0 conn(0x7f070006a130 0x7f07000b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f0705999700 1 --2- 172.21.15.112:0/763477202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070015c6d0 0x7f07000b17a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.397+0000 7f0705999700 1 -- 172.21.15.112:0/763477202 >> 172.21.15.112:0/763477202 conn(0x7f07000b6520 msgr2=0x7f0700071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:50.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.401+0000 7f0705999700 1 -- 172.21.15.112:0/763477202 shutdown_connections 2023-11-08T12:27:50.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.401+0000 7f0705999700 1 -- 172.21.15.112:0/763477202 wait complete. 2023-11-08T12:27:50.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.401+0000 7f0705999700 1 Processor -- start 2023-11-08T12:27:50.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.401+0000 7f0705999700 1 -- start start 2023-11-08T12:27:50.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070006a130 0x7f07001e6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f070006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f070015c6d0 0x7f070006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07001e4cf0 con 0x7f070015c6d0 2023-11-08T12:27:50.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07001e4f00 con 0x7f070006a130 2023-11-08T12:27:50.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07001e51e0 con 0x7f07000cfc40 2023-11-08T12:27:50.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f070015c6d0 0x7f070006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f070015c6d0 0x7f070006cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60904/0 (socket says 172.21.15.112:60904) 2023-11-08T12:27:50.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 -- 172.21.15.112:0/3494595760 learned_addr learned my addr 172.21.15.112:0/3494595760 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:50.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06fe7fc700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f070006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06feffd700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070006a130 0x7f07001e6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 -- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 msgr2=0x7f070006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f070006c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 -- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070006a130 msgr2=0x7f07001e6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070006a130 0x7f07001e6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 -- 172.21.15.112:0/3494595760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f8009a70 con 0x7f070015c6d0 2023-11-08T12:27:50.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06ff7fe700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f070015c6d0 0x7f070006cae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06f800eed0 tx=0x7f06f800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:50.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06e7fff700 1 -- 172.21.15.112:0/3494595760 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8010040 con 0x7f070015c6d0 2023-11-08T12:27:50.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06e7fff700 1 -- 172.21.15.112:0/3494595760 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f800ba80 con 0x7f070015c6d0 2023-11-08T12:27:50.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f0009570 con 0x7f070015c6d0 2023-11-08T12:27:50.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f06e7fff700 1 -- 172.21.15.112:0/3494595760 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f800be10 con 0x7f070015c6d0 2023-11-08T12:27:50.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.405+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0700071f00 con 0x7f070015c6d0 2023-11-08T12:27:50.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.409+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0700071c20 con 0x7f070015c6d0 2023-11-08T12:27:50.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.409+0000 7f06e7fff700 1 -- 172.21.15.112:0/3494595760 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f06f801d410 con 0x7f070015c6d0 2023-11-08T12:27:50.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.409+0000 7f06e7fff700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f06ec064ee0 0x7f06ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.409+0000 7f06e7fff700 1 -- 172.21.15.112:0/3494595760 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f06f8081f00 con 0x7f070015c6d0 2023-11-08T12:27:50.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.413+0000 7f06feffd700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f06ec064ee0 0x7f06ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.413+0000 7f06feffd700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f06ec064ee0 0x7f06ec067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:50.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.417+0000 7f06e7fff700 1 -- 172.21.15.112:0/3494595760 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f06f80502a0 con 0x7f070015c6d0 2023-11-08T12:27:50.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.597+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f070015caa0 con 0x7f070015c6d0 2023-11-08T12:27:50.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.597+0000 7f06e7fff700 1 -- 172.21.15.112:0/3494595760 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14216 (secure 0 0 0) 0x7f06f80538c0 con 0x7f070015c6d0 2023-11-08T12:27:50.606 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:50.606 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":21,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:49.532881+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:50.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f06ec064ee0 msgr2=0x7f06ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f06ec064ee0 0x7f06ec067390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06f0000c00 tx=0x7f06f0008030 comp rx=0 tx=0).stop 2023-11-08T12:27:50.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f070015c6d0 msgr2=0x7f070006cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f070015c6d0 0x7f070006cae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06f800eed0 tx=0x7f06f800b390 comp rx=0 tx=0).stop 2023-11-08T12:27:50.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 shutdown_connections 2023-11-08T12:27:50.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f06ec064ee0 0x7f06ec067390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f070015c6d0 0x7f070006cae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07000cfc40 0x7f070006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 --2- 172.21.15.112:0/3494595760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f070006a130 0x7f07001e6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 >> 172.21.15.112:0/3494595760 conn(0x7f07000b6520 msgr2=0x7f07000d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:50.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 shutdown_connections 2023-11-08T12:27:50.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.605+0000 7f0705999700 1 -- 172.21.15.112:0/3494595760 wait complete. 2023-11-08T12:27:50.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:27:50.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:27:50.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.797+0000 7fd2bb59e700 1 Processor -- start 2023-11-08T12:27:50.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bb59e700 1 -- start start 2023-11-08T12:27:50.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15c150 0x7fd2bc0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bb59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2bc06ff10 0x7fd2bc070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bb59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd2bc15fc30 0x7fd2bc1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bb59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0b4240 con 0x7fd2bc15fc30 2023-11-08T12:27:50.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bb59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc15c520 con 0x7fd2bc06ff10 2023-11-08T12:27:50.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0708a0 con 0x7fd2bc15c150 2023-11-08T12:27:50.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd2bc15fc30 0x7fd2bc1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd2bc15fc30 0x7fd2bc1600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60906/0 (socket says 172.21.15.112:60906) 2023-11-08T12:27:50.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.801+0000 7fd2bad9d700 1 -- 172.21.15.112:0/299919928 learned_addr learned my addr 172.21.15.112:0/299919928 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:50.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2ba59c700 1 --2- 172.21.15.112:0/299919928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15c150 0x7fd2bc0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2b9d9b700 1 --2- 172.21.15.112:0/299919928 >> v2:172.21.15.133:3300/0 conn(0x7fd2bc06ff10 0x7fd2bc070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bad9d700 1 -- 172.21.15.112:0/299919928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15c150 msgr2=0x7fd2bc0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:50.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bad9d700 1 --2- 172.21.15.112:0/299919928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15c150 0x7fd2bc0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bad9d700 1 -- 172.21.15.112:0/299919928 >> v2:172.21.15.133:3300/0 conn(0x7fd2bc06ff10 msgr2=0x7fd2bc070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:50.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bad9d700 1 --2- 172.21.15.112:0/299919928 >> v2:172.21.15.133:3300/0 conn(0x7fd2bc06ff10 0x7fd2bc070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bad9d700 1 -- 172.21.15.112:0/299919928 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc06cc50 con 0x7fd2bc15fc30 2023-11-08T12:27:50.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bad9d700 1 --2- 172.21.15.112:0/299919928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15fc30 0x7fd2bc1600b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc06bd50 tx=0x7fd2b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e696fdf46b9d44d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:50.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2b959a700 1 -- 172.21.15.112:0/299919928 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400e070 con 0x7fd2bc15fc30 2023-11-08T12:27:50.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2b959a700 1 -- 172.21.15.112:0/299919928 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b400b8d0 con 0x7fd2bc15fc30 2023-11-08T12:27:50.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2b959a700 1 -- 172.21.15.112:0/299919928 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400bc80 con 0x7fd2bc15fc30 2023-11-08T12:27:50.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 -- 172.21.15.112:0/299919928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15fc30 msgr2=0x7fd2bc1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/299919928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15fc30 0x7fd2bc1600b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc06bd50 tx=0x7fd2b400b330 comp rx=0 tx=0).stop 2023-11-08T12:27:50.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 -- 172.21.15.112:0/299919928 shutdown_connections 2023-11-08T12:27:50.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/299919928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15fc30 0x7fd2bc1600b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/299919928 >> v2:172.21.15.133:3300/0 conn(0x7fd2bc06ff10 0x7fd2bc070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/299919928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15c150 0x7fd2bc0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 -- 172.21.15.112:0/299919928 >> 172.21.15.112:0/299919928 conn(0x7fd2bc0d3680 msgr2=0x7fd2bc0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:50.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 -- 172.21.15.112:0/299919928 shutdown_connections 2023-11-08T12:27:50.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.805+0000 7fd2bb59e700 1 -- 172.21.15.112:0/299919928 wait complete. 2023-11-08T12:27:50.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 Processor -- start 2023-11-08T12:27:50.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 -- start start 2023-11-08T12:27:50.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2bc06ff10 0x7fd2bc1f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15c150 0x7fd2bc13fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15fc30 0x7fd2bc142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0b6a40 con 0x7fd2bc15c150 2023-11-08T12:27:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc140050 con 0x7fd2bc06ff10 2023-11-08T12:27:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1432d0 con 0x7fd2bc15fc30 2023-11-08T12:27:50.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15c150 0x7fd2bc13fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15c150 0x7fd2bc13fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60914/0 (socket says 172.21.15.112:60914) 2023-11-08T12:27:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 -- 172.21.15.112:0/1764330716 learned_addr learned my addr 172.21.15.112:0/1764330716 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bad9d700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15fc30 0x7fd2bc142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2ba59c700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2bc06ff10 0x7fd2bc1f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 -- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15fc30 msgr2=0x7fd2bc142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15fc30 0x7fd2bc142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 -- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2bc06ff10 msgr2=0x7fd2bc1f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:50.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2bc06ff10 0x7fd2bc1f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:50.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 -- 172.21.15.112:0/1764330716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4009b30 con 0x7fd2bc15c150 2023-11-08T12:27:50.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bad9d700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15fc30 0x7fd2bc142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:50.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2ba59c700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2bc06ff10 0x7fd2bc1f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:50.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2b9d9b700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15c150 0x7fd2bc13fb10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000e930 tx=0x7fd2b000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:50.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2aaffd700 1 -- 172.21.15.112:0/1764330716 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0009690 con 0x7fd2bc15c150 2023-11-08T12:27:50.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc0d2730 con 0x7fd2bc15c150 2023-11-08T12:27:50.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2aaffd700 1 -- 172.21.15.112:0/1764330716 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b0005a40 con 0x7fd2bc15c150 2023-11-08T12:27:50.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2aaffd700 1 -- 172.21.15.112:0/1764330716 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0005dd0 con 0x7fd2bc15c150 2023-11-08T12:27:50.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.809+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0d2450 con 0x7fd2bc15c150 2023-11-08T12:27:50.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.813+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc0d05e0 con 0x7fd2bc15c150 2023-11-08T12:27:50.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.813+0000 7fd2aaffd700 1 -- 172.21.15.112:0/1764330716 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd2b0022070 con 0x7fd2bc15c150 2023-11-08T12:27:50.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.813+0000 7fd2aaffd700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd29c064ee0 0x7fd29c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:50.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.813+0000 7fd2aaffd700 1 -- 172.21.15.112:0/1764330716 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd2b0081de0 con 0x7fd2bc15c150 2023-11-08T12:27:50.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.817+0000 7fd2ba59c700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd29c064ee0 0x7fd29c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:50.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.817+0000 7fd2ba59c700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd29c064ee0 0x7fd29c067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc1553f0 tx=0x7fd2ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.821+0000 7fd2aaffd700 1 -- 172.21.15.112:0/1764330716 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd2b0050160 con 0x7fd2bc15c150 2023-11-08T12:27:50.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.993+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2bc0b6b80 con 0x7fd2bc15c150 2023-11-08T12:27:50.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.993+0000 7fd2aaffd700 1 -- 172.21.15.112:0/1764330716 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2bc0b6b80 con 0x7fd2bc15c150 2023-11-08T12:27:50.999 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:27:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.993+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd29c064ee0 msgr2=0x7fd29c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.993+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd29c064ee0 0x7fd29c067390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc1553f0 tx=0x7fd2ac008040 comp rx=0 tx=0).stop 2023-11-08T12:27:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.993+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15c150 msgr2=0x7fd2bc13fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.993+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15c150 0x7fd2bc13fb10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000e930 tx=0x7fd2b000ecf0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 shutdown_connections 2023-11-08T12:27:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd29c064ee0 0x7fd29c067390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2bc15fc30 0x7fd2bc142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2bc15c150 0x7fd2bc13fb10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 --2- 172.21.15.112:0/1764330716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2bc06ff10 0x7fd2bc1f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 >> 172.21.15.112:0/1764330716 conn(0x7fd2bc0d3680 msgr2=0x7fd2bc1561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 shutdown_connections 2023-11-08T12:27:51.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:50.997+0000 7fd2bb59e700 1 -- 172.21.15.112:0/1764330716 wait complete. 2023-11-08T12:27:51.028 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:27:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.205+0000 7f3ff2bb7700 1 Processor -- start 2023-11-08T12:27:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.205+0000 7f3ff2bb7700 1 -- start start 2023-11-08T12:27:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.205+0000 7f3ff2bb7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fec15e190 0x7f3fec0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.205+0000 7f3ff2bb7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3fec161560 0x7f3fec069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.205+0000 7f3ff2bb7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec15e560 con 0x7f3fec06ff10 2023-11-08T12:27:51.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.205+0000 7f3ff2bb7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec06be80 con 0x7f3fec161560 2023-11-08T12:27:51.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.205+0000 7f3ff2bb7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0ce330 con 0x7f3fec15e190 2023-11-08T12:27:51.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff23b6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3fec06ff10 0x7f3fec06c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35796/0 (socket says 172.21.15.112:35796) 2023-11-08T12:27:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff23b6700 1 -- 172.21.15.112:0/116042591 learned_addr learned my addr 172.21.15.112:0/116042591 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff13b4700 1 --2- 172.21.15.112:0/116042591 >> v2:172.21.15.112:3300/0 conn(0x7f3fec161560 0x7f3fec069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff1bb5700 1 --2- 172.21.15.112:0/116042591 >> v2:172.21.15.133:3300/0 conn(0x7f3fec15e190 0x7f3fec0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff13b4700 1 -- 172.21.15.112:0/116042591 >> v2:172.21.15.133:3300/0 conn(0x7f3fec15e190 msgr2=0x7f3fec0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:51.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff13b4700 1 --2- 172.21.15.112:0/116042591 >> v2:172.21.15.133:3300/0 conn(0x7f3fec15e190 0x7f3fec0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff13b4700 1 -- 172.21.15.112:0/116042591 >> v1:172.21.15.112:6789/0 conn(0x7f3fec06ff10 legacy=0x7f3fec06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff13b4700 1 -- 172.21.15.112:0/116042591 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0af990 con 0x7f3fec161560 2023-11-08T12:27:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff0bb3700 1 -- 172.21.15.112:0/116042591 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984648952 0 0) 0x7f3fe4001490 con 0x7f3fec06ff10 2023-11-08T12:27:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff13b4700 1 --2- 172.21.15.112:0/116042591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec069bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0cb9b0 tx=0x7f3fdc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8157fa45e88238ce server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:51.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff0bb3700 1 -- 172.21.15.112:0/116042591 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc011830 con 0x7f3fec161560 2023-11-08T12:27:51.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff0bb3700 1 -- 172.21.15.112:0/116042591 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc011990 con 0x7f3fec161560 2023-11-08T12:27:51.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff0bb3700 1 -- 172.21.15.112:0/116042591 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc011d20 con 0x7f3fec161560 2023-11-08T12:27:51.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/116042591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 msgr2=0x7f3fec069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/116042591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec069bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0cb9b0 tx=0x7f3fdc009b30 comp rx=0 tx=0).stop 2023-11-08T12:27:51.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/116042591 shutdown_connections 2023-11-08T12:27:51.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/116042591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec069bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/116042591 >> v2:172.21.15.133:3300/0 conn(0x7f3fec15e190 0x7f3fec0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/116042591 >> 172.21.15.112:0/116042591 conn(0x7f3fec0cf280 msgr2=0x7f3fec0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:51.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/116042591 shutdown_connections 2023-11-08T12:27:51.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.209+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/116042591 wait complete. 2023-11-08T12:27:51.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 Processor -- start 2023-11-08T12:27:51.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 -- start start 2023-11-08T12:27:51.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fec06ff10 0x7f3fec156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fec15e190 0x7f3fec15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15d890 con 0x7f3fec161560 2023-11-08T12:27:51.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15cc10 con 0x7f3fec15e190 2023-11-08T12:27:51.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff2bb7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15cef0 con 0x7f3fec06ff10 2023-11-08T12:27:51.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff23b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff23b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60930/0 (socket says 172.21.15.112:60930) 2023-11-08T12:27:51.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff23b6700 1 -- 172.21.15.112:0/1251714223 learned_addr learned my addr 172.21.15.112:0/1251714223 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:51.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff1bb5700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fec06ff10 0x7f3fec156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff13b4700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fec15e190 0x7f3fec15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.213+0000 7f3ff23b6700 1 -- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fec06ff10 msgr2=0x7f3fec156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff23b6700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fec06ff10 0x7f3fec156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff23b6700 1 -- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fec15e190 msgr2=0x7f3fec15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff23b6700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fec15e190 0x7f3fec15a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff23b6700 1 -- 172.21.15.112:0/1251714223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0094b0 con 0x7f3fec161560 2023-11-08T12:27:51.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff1bb5700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fec06ff10 0x7f3fec156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:51.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff23b6700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec15a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400cba0 tx=0x7f3fe400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:51.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3fe27fc700 1 -- 172.21.15.112:0/1251714223 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400ab80 con 0x7f3fec161560 2023-11-08T12:27:51.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3fe27fc700 1 -- 172.21.15.112:0/1251714223 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400ad00 con 0x7f3fec161560 2023-11-08T12:27:51.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3fe27fc700 1 -- 172.21.15.112:0/1251714223 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4007310 con 0x7f3fec161560 2023-11-08T12:27:51.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec0aff50 con 0x7f3fec161560 2023-11-08T12:27:51.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec0afc70 con 0x7f3fec161560 2023-11-08T12:27:51.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec06a130 con 0x7f3fec161560 2023-11-08T12:27:51.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.217+0000 7f3fe27fc700 1 -- 172.21.15.112:0/1251714223 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3fe4010070 con 0x7f3fec161560 2023-11-08T12:27:51.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.221+0000 7f3fe27fc700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fd0064ee0 0x7f3fd0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.221+0000 7f3fe27fc700 1 -- 172.21.15.112:0/1251714223 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3fe4081430 con 0x7f3fec161560 2023-11-08T12:27:51.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.221+0000 7f3ff1bb5700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fd0064ee0 0x7f3fd0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.221+0000 7f3ff1bb5700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fd0064ee0 0x7f3fd0067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009c40 tx=0x7f3fe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:51.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.225+0000 7f3fe27fc700 1 -- 172.21.15.112:0/1251714223 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3fe404f830 con 0x7f3fec161560 2023-11-08T12:27:51.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.405+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fec15d9d0 con 0x7f3fec161560 2023-11-08T12:27:51.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.405+0000 7f3fe27fc700 1 -- 172.21.15.112:0/1251714223 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fe4018020 con 0x7f3fec161560 2023-11-08T12:27:51.411 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:27:51.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fd0064ee0 msgr2=0x7f3fd0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fd0064ee0 0x7f3fd0067390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009c40 tx=0x7f3fe8008040 comp rx=0 tx=0).stop 2023-11-08T12:27:51.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 msgr2=0x7f3fec15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec15a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400cba0 tx=0x7f3fe400cf60 comp rx=0 tx=0).stop 2023-11-08T12:27:51.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 shutdown_connections 2023-11-08T12:27:51.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fd0064ee0 0x7f3fd0067390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fec161560 0x7f3fec15a870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fec15e190 0x7f3fec15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 --2- 172.21.15.112:0/1251714223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fec06ff10 0x7f3fec156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 >> 172.21.15.112:0/1251714223 conn(0x7f3fec0cf280 msgr2=0x7f3fec15e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:51.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 shutdown_connections 2023-11-08T12:27:51.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.409+0000 7f3ff2bb7700 1 -- 172.21.15.112:0/1251714223 wait complete. 2023-11-08T12:27:51.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T12:27:51.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.609+0000 7f88a2c66700 1 Processor -- start 2023-11-08T12:27:51.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.613+0000 7f88a2c66700 1 -- start start 2023-11-08T12:27:51.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.613+0000 7f88a2c66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 0x7f889c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.613+0000 7f88a2c66700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c0ad6c0 con 0x7f889c160710 2023-11-08T12:27:51.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.613+0000 7f88a2c66700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c0adc60 con 0x7f889c164250 2023-11-08T12:27:51.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.613+0000 7f88a2c66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c06b1c0 con 0x7f889c070080 2023-11-08T12:27:51.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a1c64700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f889c160710 0x7f889c0cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35802/0 (socket says 172.21.15.112:35802) 2023-11-08T12:27:51.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a1c64700 1 -- 172.21.15.112:0/3582162209 learned_addr learned my addr 172.21.15.112:0/3582162209 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:51.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a1463700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 0x7f889c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100934203 0 0) 0x7f889c0ad6c0 con 0x7f889c160710 2023-11-08T12:27:51.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88880035d0 con 0x7f889c160710 2023-11-08T12:27:51.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989219808 0 0) 0x7f889c0adc60 con 0x7f889c164250 2023-11-08T12:27:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f889c0ad6c0 con 0x7f889c164250 2023-11-08T12:27:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 756854883 0 0) 0x7f88880035d0 con 0x7f889c160710 2023-11-08T12:27:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 msgr2=0x7f889c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 0x7f889c0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 >> v1:172.21.15.133:6789/0 conn(0x7f889c164250 legacy=0x7f889c1646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0709f0 con 0x7f889c160710 2023-11-08T12:27:51.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f8898001670 con 0x7f889c160710 2023-11-08T12:27:51.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 >> v1:172.21.15.112:6789/0 conn(0x7f889c160710 legacy=0x7f889c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 0x7f8888003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8888004140 0x7f8888004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888004db0 0x7f8888005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c06b1c0 con 0x7f8888004db0 2023-11-08T12:27:51.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888800bae0 con 0x7f8888004140 2023-11-08T12:27:51.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888800bca0 con 0x7f889c070080 2023-11-08T12:27:51.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a2465700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888004db0 0x7f8888005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a1c64700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 0x7f8888003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a1463700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8888004140 0x7f8888004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a2465700 1 -- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 msgr2=0x7f8888003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:51.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a2465700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c070080 0x7f8888003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a2465700 1 -- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8888004140 msgr2=0x7f8888004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:51.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a2465700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8888004140 0x7f8888004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a2465700 1 -- 172.21.15.112:0/3582162209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88880035d0 con 0x7f8888004db0 2023-11-08T12:27:51.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a2465700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888004db0 0x7f8888005220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8894002230 tx=0x7f88880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205c88c3b4bc3781 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:51.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894001f30 con 0x7f8888004db0 2023-11-08T12:27:51.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889400ce80 con 0x7f8888004db0 2023-11-08T12:27:51.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.617+0000 7f88a0c62700 1 -- 172.21.15.112:0/3582162209 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894003c60 con 0x7f8888004db0 2023-11-08T12:27:51.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.621+0000 7f88a2c66700 1 -- 172.21.15.112:0/3582162209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888004db0 msgr2=0x7f8888005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.621+0000 7f88a2c66700 1 --2- 172.21.15.112:0/3582162209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888004db0 0x7f8888005220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8894002230 tx=0x7f88880058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.621+0000 7f88a2465700 1 -- 172.21.15.112:0/3582162209 reap_dead start 2023-11-08T12:27:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.621+0000 7f88a2c66700 1 -- 172.21.15.112:0/3582162209 shutdown_connections 2023-11-08T12:27:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.621+0000 7f88a2c66700 1 -- 172.21.15.112:0/3582162209 >> 172.21.15.112:0/3582162209 conn(0x7f889c0b0f80 msgr2=0x7f889c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.621+0000 7f88a2c66700 1 -- 172.21.15.112:0/3582162209 shutdown_connections 2023-11-08T12:27:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.621+0000 7f88a2c66700 1 -- 172.21.15.112:0/3582162209 wait complete. 2023-11-08T12:27:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 Processor -- start 2023-11-08T12:27:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 -- start start 2023-11-08T12:27:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889c0aee60 0x7f889c1f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f889c1f9e70 0x7f889c0af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c1f6e30 0x7f889c1f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1f6c70 con 0x7f889c1f9e70 2023-11-08T12:27:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1631b0 con 0x7f889c0aee60 2023-11-08T12:27:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1f99e0 con 0x7f889c1f6e30 2023-11-08T12:27:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f889c1f9e70 0x7f889c0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f889c1f9e70 0x7f889c0af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60948/0 (socket says 172.21.15.112:60948) 2023-11-08T12:27:51.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 -- 172.21.15.112:0/1759864979 learned_addr learned my addr 172.21.15.112:0/1759864979 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:51.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2465700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c1f6e30 0x7f889c1f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1c64700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889c0aee60 0x7f889c1f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 -- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c1f6e30 msgr2=0x7f889c1f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c1f6e30 0x7f889c1f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 -- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889c0aee60 msgr2=0x7f889c1f6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889c0aee60 0x7f889c1f6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 -- 172.21.15.112:0/1759864979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c06b3d0 con 0x7f889c1f9e70 2023-11-08T12:27:51.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2465700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c1f6e30 0x7f889c1f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:51.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1c64700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889c0aee60 0x7f889c1f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:51.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a1463700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f889c1f9e70 0x7f889c0af230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f888c0116d0 tx=0x7f888c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:51.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88927fc700 1 -- 172.21.15.112:0/1759864979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c015870 con 0x7f889c1f9e70 2023-11-08T12:27:51.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88927fc700 1 -- 172.21.15.112:0/1759864979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0159d0 con 0x7f889c1f9e70 2023-11-08T12:27:51.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c0cca30 con 0x7f889c1f9e70 2023-11-08T12:27:51.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88927fc700 1 -- 172.21.15.112:0/1759864979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c015d40 con 0x7f889c1f9e70 2023-11-08T12:27:51.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.625+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c06b6b0 con 0x7f889c1f9e70 2023-11-08T12:27:51.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.629+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c073cb0 con 0x7f889c1f9e70 2023-11-08T12:27:51.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.629+0000 7f88927fc700 1 -- 172.21.15.112:0/1759864979 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f888c012040 con 0x7f889c1f9e70 2023-11-08T12:27:51.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.633+0000 7f88927fc700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8880064f10 0x7f88800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:51.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.633+0000 7f88927fc700 1 -- 172.21.15.112:0/1759864979 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f888c082190 con 0x7f889c1f9e70 2023-11-08T12:27:51.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.633+0000 7f88a1c64700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8880064f10 0x7f88800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:51.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.633+0000 7f88a1c64700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8880064f10 0x7f88800673c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8898000f60 tx=0x7f8898000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:51.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.637+0000 7f88927fc700 1 -- 172.21.15.112:0/1759864979 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f888c050590 con 0x7f889c1f9e70 2023-11-08T12:27:51.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.821+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f889c1f9b20 con 0x7f889c1f9e70 2023-11-08T12:27:51.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.821+0000 7f88927fc700 1 -- 172.21.15.112:0/1759864979 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7f888c053bb0 con 0x7f889c1f9e70 2023-11-08T12:27:51.828 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:51.828 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-11-08T12:27:51.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:27:51.828 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-11-08T12:27:51.829 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-11-08T12:27:51.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:27:51.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:27:51.829 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2023-11-08T12:27:51.829 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2023-11-08T12:27:51.830 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:27:51.830 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-11-08T12:27:51.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8880064f10 msgr2=0x7f88800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8880064f10 0x7f88800673c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8898000f60 tx=0x7f8898000ed0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f889c1f9e70 msgr2=0x7f889c0af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:51.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f889c1f9e70 0x7f889c0af230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f888c0116d0 tx=0x7f888c011a90 comp rx=0 tx=0).stop 2023-11-08T12:27:51.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 shutdown_connections 2023-11-08T12:27:51.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8880064f10 0x7f88800673c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889c1f6e30 0x7f889c1f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f889c1f9e70 0x7f889c0af230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 --2- 172.21.15.112:0/1759864979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889c0aee60 0x7f889c1f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:51.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 >> 172.21.15.112:0/1759864979 conn(0x7f889c0b0f80 msgr2=0x7f889c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:51.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 shutdown_connections 2023-11-08T12:27:51.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:51.825+0000 7f88a2c66700 1 -- 172.21.15.112:0/1759864979 wait complete. 2023-11-08T12:27:51.855 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T12:27:51.855 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T12:27:52.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.033+0000 7f137e184700 1 Processor -- start 2023-11-08T12:27:52.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.033+0000 7f137e184700 1 -- start start 2023-11-08T12:27:52.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137e184700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f137815c6e0 0x7f1378071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137e184700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1378071fe0 0x7f1378069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137e184700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137806a790 con 0x7f137806a340 2023-11-08T12:27:52.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137e184700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780d2800 con 0x7f137815c6e0 2023-11-08T12:27:52.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137e184700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137815cab0 con 0x7f1378071fe0 2023-11-08T12:27:52.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f137815c6e0 0x7f1378071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f137815c6e0 0x7f1378071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60956/0 (socket says 172.21.15.112:60956) 2023-11-08T12:27:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 -- 172.21.15.112:0/2692065361 learned_addr learned my addr 172.21.15.112:0/2692065361 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137c981700 1 --2- 172.21.15.112:0/2692065361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1378071fe0 0x7f1378069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 -- 172.21.15.112:0/2692065361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1378071fe0 msgr2=0x7f1378069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 --2- 172.21.15.112:0/2692065361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1378071fe0 0x7f1378069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 -- 172.21.15.112:0/2692065361 >> v1:172.21.15.112:6789/0 conn(0x7f137806a340 legacy=0x7f13780b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 -- 172.21.15.112:0/2692065361 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780702d0 con 0x7f137815c6e0 2023-11-08T12:27:52.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.037+0000 7f137d182700 1 --2- 172.21.15.112:0/2692065361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137815c6e0 0x7f1378071aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1374009910 tx=0x7f1374009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828da42437f2719 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:52.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f136ffff700 1 -- 172.21.15.112:0/2692065361 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374011830 con 0x7f137815c6e0 2023-11-08T12:27:52.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f136ffff700 1 -- 172.21.15.112:0/2692065361 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374011990 con 0x7f137815c6e0 2023-11-08T12:27:52.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f136ffff700 1 -- 172.21.15.112:0/2692065361 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374011d40 con 0x7f137815c6e0 2023-11-08T12:27:52.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 -- 172.21.15.112:0/2692065361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137815c6e0 msgr2=0x7f1378071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 --2- 172.21.15.112:0/2692065361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137815c6e0 0x7f1378071aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1374009910 tx=0x7f1374009c20 comp rx=0 tx=0).stop 2023-11-08T12:27:52.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 -- 172.21.15.112:0/2692065361 shutdown_connections 2023-11-08T12:27:52.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 --2- 172.21.15.112:0/2692065361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1378071fe0 0x7f1378069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 --2- 172.21.15.112:0/2692065361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137815c6e0 0x7f1378071aa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 -- 172.21.15.112:0/2692065361 >> 172.21.15.112:0/2692065361 conn(0x7f13780b65b0 msgr2=0x7f1378071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:52.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 -- 172.21.15.112:0/2692065361 shutdown_connections 2023-11-08T12:27:52.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 -- 172.21.15.112:0/2692065361 wait complete. 2023-11-08T12:27:52.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 Processor -- start 2023-11-08T12:27:52.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.041+0000 7f137e184700 1 -- start start 2023-11-08T12:27:52.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137806a340 0x7f13780cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1378071fe0 0x7f137809bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f137815c6e0 0x7f13780cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780cd4e0 con 0x7f137806a340 2023-11-08T12:27:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780ce060 con 0x7f1378071fe0 2023-11-08T12:27:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780cc120 con 0x7f137815c6e0 2023-11-08T12:27:52.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137806a340 0x7f13780cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137806a340 0x7f13780cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60962/0 (socket says 172.21.15.112:60962) 2023-11-08T12:27:52.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 -- 172.21.15.112:0/813484600 learned_addr learned my addr 172.21.15.112:0/813484600 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:52.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137c981700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1378071fe0 0x7f137809bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d983700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f137815c6e0 0x7f13780cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 -- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f137815c6e0 msgr2=0x7f13780cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f137815c6e0 0x7f13780cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 -- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1378071fe0 msgr2=0x7f137809bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1378071fe0 0x7f137809bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 -- 172.21.15.112:0/813484600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009570 con 0x7f137806a340 2023-11-08T12:27:52.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137d182700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137806a340 0x7f13780cabf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1374009f70 tx=0x7f1374004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:52.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f136dffb700 1 -- 172.21.15.112:0/813484600 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374004590 con 0x7f137806a340 2023-11-08T12:27:52.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f136dffb700 1 -- 172.21.15.112:0/813484600 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137401e070 con 0x7f137806a340 2023-11-08T12:27:52.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13780d2cf0 con 0x7f137806a340 2023-11-08T12:27:52.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f136dffb700 1 -- 172.21.15.112:0/813484600 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374003900 con 0x7f137806a340 2023-11-08T12:27:52.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.045+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13780d2a10 con 0x7f137806a340 2023-11-08T12:27:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.049+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13780d2fd0 con 0x7f137806a340 2023-11-08T12:27:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.049+0000 7f136dffb700 1 -- 172.21.15.112:0/813484600 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f137400f050 con 0x7f137806a340 2023-11-08T12:27:52.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.049+0000 7f136dffb700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f135c064f30 0x7f135c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.049+0000 7f136dffb700 1 -- 172.21.15.112:0/813484600 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f13740829c0 con 0x7f137806a340 2023-11-08T12:27:52.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.049+0000 7f137c981700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f135c064f30 0x7f135c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.053+0000 7f137c981700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f135c064f30 0x7f135c0673e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1378160040 tx=0x7f1368008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:52.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.057+0000 7f136dffb700 1 -- 172.21.15.112:0/813484600 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1374050e40 con 0x7f137806a340 2023-11-08T12:27:52.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.229+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f137806dd50 con 0x7f137806a340 2023-11-08T12:27:52.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.581+0000 7f136dffb700 1 -- 172.21.15.112:0/813484600 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13740200b0 con 0x7f137806a340 2023-11-08T12:27:52.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f135c064f30 msgr2=0x7f135c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f135c064f30 0x7f135c0673e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1378160040 tx=0x7f1368008040 comp rx=0 tx=0).stop 2023-11-08T12:27:52.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137806a340 msgr2=0x7f13780cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137806a340 0x7f13780cabf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1374009f70 tx=0x7f1374004770 comp rx=0 tx=0).stop 2023-11-08T12:27:52.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 shutdown_connections 2023-11-08T12:27:52.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f135c064f30 0x7f135c0673e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f137815c6e0 0x7f13780cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1378071fe0 0x7f137809bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 --2- 172.21.15.112:0/813484600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f137806a340 0x7f13780cabf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 >> 172.21.15.112:0/813484600 conn(0x7f13780b65b0 msgr2=0x7f13780d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:52.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 shutdown_connections 2023-11-08T12:27:52.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.585+0000 7f137e184700 1 -- 172.21.15.112:0/813484600 wait complete. 2023-11-08T12:27:52.594 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-11-08T12:27:52.613 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-08T12:27:52.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f1571dbf700 1 Processor -- start 2023-11-08T12:27:52.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f1571dbf700 1 -- start start 2023-11-08T12:27:52.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f1571dbf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f156c0b5410 0x7f156c0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f1571dbf700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c0ce6b0 con 0x7f156c069bf0 2023-11-08T12:27:52.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f1571dbf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c06aa50 con 0x7f156c0ce260 2023-11-08T12:27:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f1571dbf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0b57e0 con 0x7f156c0b5410 2023-11-08T12:27:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f156bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f156c069bf0 0x7f156c06a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35824/0 (socket says 172.21.15.112:35824) 2023-11-08T12:27:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.793+0000 7f156bfff700 1 -- 172.21.15.112:0/2060077664 learned_addr learned my addr 172.21.15.112:0/2060077664 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:52.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 --2- 172.21.15.112:0/2060077664 >> v2:172.21.15.133:3300/0 conn(0x7f156c0b5410 0x7f156c0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706522415 0 0) 0x7f156c0ce6b0 con 0x7f156c069bf0 2023-11-08T12:27:52.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15540035d0 con 0x7f156c069bf0 2023-11-08T12:27:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590915019 0 0) 0x7f156c06aa50 con 0x7f156c0ce260 2023-11-08T12:27:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f156c0ce6b0 con 0x7f156c0ce260 2023-11-08T12:27:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374786757 0 0) 0x7f15540035d0 con 0x7f156c069bf0 2023-11-08T12:27:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 >> v2:172.21.15.133:3300/0 conn(0x7f156c0b5410 msgr2=0x7f156c0b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 --2- 172.21.15.112:0/2060077664 >> v2:172.21.15.133:3300/0 conn(0x7f156c0b5410 0x7f156c0b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 >> v1:172.21.15.133:6789/0 conn(0x7f156c0ce260 legacy=0x7f156c06ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c15cb00 con 0x7f156c069bf0 2023-11-08T12:27:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f15640019f0 con 0x7f156c069bf0 2023-11-08T12:27:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 --2- 172.21.15.112:0/2060077664 >> v2:172.21.15.133:3300/0 conn(0x7f156c0b5410 0x7f156c0b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 >> v1:172.21.15.112:6789/0 conn(0x7f156c069bf0 legacy=0x7f156c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f1554003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1554004870 0x7f1554004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1554005220 0x7f155400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0b57e0 con 0x7f1554003bb0 2023-11-08T12:27:52.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155400c020 con 0x7f1554005220 2023-11-08T12:27:52.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155400c1b0 con 0x7f1554004870 2023-11-08T12:27:52.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f1554003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156affd700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1554004870 0x7f1554004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156bfff700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1554005220 0x7f155400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 -- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1554004870 msgr2=0x7f1554004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:52.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1554004870 0x7f1554004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 -- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1554005220 msgr2=0x7f155400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:52.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1554005220 0x7f155400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 -- 172.21.15.112:0/2060077664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540035d0 con 0x7f1554003bb0 2023-11-08T12:27:52.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156affd700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1554004870 0x7f1554004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:52.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156bfff700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1554005220 0x7f155400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:52.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156bfff700 1 -- 172.21.15.112:0/2060077664 reap_dead start 2023-11-08T12:27:52.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156b7fe700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f1554003fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f155c009d40 tx=0x7f15540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37505648196084d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:52.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c009e90 con 0x7f1554003bb0 2023-11-08T12:27:52.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c00e9a0 con 0x7f1554003bb0 2023-11-08T12:27:52.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.797+0000 7f156a7fc700 1 -- 172.21.15.112:0/2060077664 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00ed10 con 0x7f1554003bb0 2023-11-08T12:27:52.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 -- 172.21.15.112:0/2060077664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 msgr2=0x7f1554003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f1554003fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f155c009d40 tx=0x7f15540058a0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 -- 172.21.15.112:0/2060077664 shutdown_connections 2023-11-08T12:27:52.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 --2- 172.21.15.112:0/2060077664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f1554003fa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 -- 172.21.15.112:0/2060077664 >> 172.21.15.112:0/2060077664 conn(0x7f156c0d3990 msgr2=0x7f156c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:52.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 -- 172.21.15.112:0/2060077664 shutdown_connections 2023-11-08T12:27:52.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 -- 172.21.15.112:0/2060077664 wait complete. 2023-11-08T12:27:52.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.801+0000 7f1571dbf700 1 Processor -- start 2023-11-08T12:27:52.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 -- start start 2023-11-08T12:27:52.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f156c1ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f156c0ac1d0 0x7f156c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f156c0cb360 0x7f156c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0abc10 con 0x7f1554003bb0 2023-11-08T12:27:52.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0b6a20 con 0x7f156c0ac1d0 2023-11-08T12:27:52.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0ac790 con 0x7f156c0cb360 2023-11-08T12:27:52.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f156c1ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f156c1ef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60974/0 (socket says 172.21.15.112:60974) 2023-11-08T12:27:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 -- 172.21.15.112:0/3692451187 learned_addr learned my addr 172.21.15.112:0/3692451187 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156affd700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f156c0ac1d0 0x7f156c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156bfff700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f156c0cb360 0x7f156c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 -- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f156c0cb360 msgr2=0x7f156c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f156c0cb360 0x7f156c0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 -- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f156c0ac1d0 msgr2=0x7f156c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f156c0ac1d0 0x7f156c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 -- 172.21.15.112:0/3692451187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c06c040 con 0x7f1554003bb0 2023-11-08T12:27:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f156b7fe700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f156c1ef7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f155c0090b0 tx=0x7f155c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1553fff700 1 -- 172.21.15.112:0/3692451187 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c003ad0 con 0x7f1554003bb0 2023-11-08T12:27:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1553fff700 1 -- 172.21.15.112:0/3692451187 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c003c30 con 0x7f1554003bb0 2023-11-08T12:27:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1553fff700 1 -- 172.21.15.112:0/3692451187 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c009e90 con 0x7f1554003bb0 2023-11-08T12:27:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c0ce8e0 con 0x7f1554003bb0 2023-11-08T12:27:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.805+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c06c320 con 0x7f1554003bb0 2023-11-08T12:27:52.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.809+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c0716e0 con 0x7f1554003bb0 2023-11-08T12:27:52.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.809+0000 7f1553fff700 1 -- 172.21.15.112:0/3692451187 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f155c02b030 con 0x7f1554003bb0 2023-11-08T12:27:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.809+0000 7f1553fff700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1558064ee0 0x7f1558067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.809+0000 7f1553fff700 1 -- 172.21.15.112:0/3692451187 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f155c0832f0 con 0x7f1554003bb0 2023-11-08T12:27:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.813+0000 7f156affd700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1558064ee0 0x7f1558067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.813+0000 7f156affd700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1558064ee0 0x7f1558067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f156c0d1e70 tx=0x7f1560009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:52.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.817+0000 7f1553fff700 1 -- 172.21.15.112:0/3692451187 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f155c051670 con 0x7f1554003bb0 2023-11-08T12:27:52.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:52.989+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f156c0726c0 con 0x7f1554003bb0 2023-11-08T12:27:53.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.585+0000 7f1553fff700 1 -- 172.21.15.112:0/3692451187 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v23) v1 ==== 171+0+0 (secure 0 0 0) 0x7f155c054c90 con 0x7f1554003bb0 2023-11-08T12:27:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1558064ee0 msgr2=0x7f1558067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1558064ee0 0x7f1558067390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f156c0d1e70 tx=0x7f1560009040 comp rx=0 tx=0).stop 2023-11-08T12:27:53.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 msgr2=0x7f156c1ef7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f156c1ef7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f155c0090b0 tx=0x7f155c0047e0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 shutdown_connections 2023-11-08T12:27:53.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1558064ee0 0x7f1558067390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f156c0cb360 0x7f156c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f156c0ac1d0 0x7f156c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 --2- 172.21.15.112:0/3692451187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1554003bb0 0x7f156c1ef7e0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f155c0090b0 tx=0x7f155c0047e0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.601+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 >> 172.21.15.112:0/3692451187 conn(0x7f156c0d3990 msgr2=0x7f156c0cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:53.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.605+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 shutdown_connections 2023-11-08T12:27:53.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.605+0000 7f1571dbf700 1 -- 172.21.15.112:0/3692451187 wait complete. 2023-11-08T12:27:53.617 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-11-08T12:27:53.641 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T12:27:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.813+0000 7fa24a91d700 1 Processor -- start 2023-11-08T12:27:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.813+0000 7fa24a91d700 1 -- start start 2023-11-08T12:27:53.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24a91d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa24415c150 0x7fa2440b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:53.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24a91d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa24406ff10 0x7fa244070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:53.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24a91d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24415c520 con 0x7fa24415fc30 2023-11-08T12:27:53.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24a91d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440b4240 con 0x7fa24415c150 2023-11-08T12:27:53.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24a91d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440708a0 con 0x7fa24406ff10 2023-11-08T12:27:53.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24991b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa24415c150 0x7fa2440b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:53.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24a11c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa24415fc30 0x7fa244160050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35832/0 (socket says 172.21.15.112:35832) 2023-11-08T12:27:53.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24a11c700 1 -- 172.21.15.112:0/3952654954 learned_addr learned my addr 172.21.15.112:0/3952654954 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:53.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24911a700 1 --2- 172.21.15.112:0/3952654954 >> v2:172.21.15.133:3300/0 conn(0x7fa24406ff10 0x7fa244070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:53.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24991b700 1 -- 172.21.15.112:0/3952654954 >> v2:172.21.15.133:3300/0 conn(0x7fa24406ff10 msgr2=0x7fa244070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:53.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24991b700 1 --2- 172.21.15.112:0/3952654954 >> v2:172.21.15.133:3300/0 conn(0x7fa24406ff10 0x7fa244070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24991b700 1 -- 172.21.15.112:0/3952654954 >> v1:172.21.15.112:6789/0 conn(0x7fa24415fc30 legacy=0x7fa244160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:53.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa24991b700 1 -- 172.21.15.112:0/3952654954 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24406ac00 con 0x7fa24415c150 2023-11-08T12:27:53.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.817+0000 7fa248919700 1 -- 172.21.15.112:0/3952654954 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11310648 0 0) 0x7fa24415c520 con 0x7fa24415fc30 2023-11-08T12:27:53.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24991b700 1 --2- 172.21.15.112:0/3952654954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415c150 0x7fa2440b3d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa244066d30 tx=0x7fa240009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2442dc3eb234ab4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:53.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa248919700 1 -- 172.21.15.112:0/3952654954 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240011830 con 0x7fa24415c150 2023-11-08T12:27:53.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa248919700 1 -- 172.21.15.112:0/3952654954 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa240011990 con 0x7fa24415c150 2023-11-08T12:27:53.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa248919700 1 -- 172.21.15.112:0/3952654954 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240011d20 con 0x7fa24415c150 2023-11-08T12:27:53.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 -- 172.21.15.112:0/3952654954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415c150 msgr2=0x7fa2440b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:53.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 --2- 172.21.15.112:0/3952654954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415c150 0x7fa2440b3d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa244066d30 tx=0x7fa240009b30 comp rx=0 tx=0).stop 2023-11-08T12:27:53.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 -- 172.21.15.112:0/3952654954 shutdown_connections 2023-11-08T12:27:53.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 --2- 172.21.15.112:0/3952654954 >> v2:172.21.15.133:3300/0 conn(0x7fa24406ff10 0x7fa244070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 --2- 172.21.15.112:0/3952654954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415c150 0x7fa2440b3d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 -- 172.21.15.112:0/3952654954 >> 172.21.15.112:0/3952654954 conn(0x7fa2440d3680 msgr2=0x7fa2440cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:53.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 -- 172.21.15.112:0/3952654954 shutdown_connections 2023-11-08T12:27:53.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 -- 172.21.15.112:0/3952654954 wait complete. 2023-11-08T12:27:53.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 Processor -- start 2023-11-08T12:27:53.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.821+0000 7fa24a91d700 1 -- start start 2023-11-08T12:27:53.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24406ff10 0x7fa2440ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:53.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa24415c150 0x7fa24415e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:53.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415fc30 0x7fa2440cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:53.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24414faa0 con 0x7fa24415fc30 2023-11-08T12:27:53.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440cd510 con 0x7fa24415c150 2023-11-08T12:27:53.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440cd7f0 con 0x7fa24406ff10 2023-11-08T12:27:53.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a11c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415fc30 0x7fa2440cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:53.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24406ff10 0x7fa2440ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:53.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24406ff10 0x7fa2440ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:33006/0 (socket says 172.21.15.112:33006) 2023-11-08T12:27:53.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 -- 172.21.15.112:0/1666765735 learned_addr learned my addr 172.21.15.112:0/1666765735 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:53.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24911a700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa24415c150 0x7fa24415e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:53.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 -- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa24415c150 msgr2=0x7fa24415e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:53.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa24415c150 0x7fa24415e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 -- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415fc30 msgr2=0x7fa2440cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:53.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415fc30 0x7fa2440cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:53.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 -- 172.21.15.112:0/1666765735 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400094b0 con 0x7fa24406ff10 2023-11-08T12:27:53.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24991b700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24406ff10 0x7fa2440ce5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa240009fd0 tx=0x7fa240004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:53.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa23a7fc700 1 -- 172.21.15.112:0/1666765735 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240004480 con 0x7fa24406ff10 2023-11-08T12:27:53.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa23a7fc700 1 -- 172.21.15.112:0/1666765735 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24001f070 con 0x7fa24406ff10 2023-11-08T12:27:53.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2440d2450 con 0x7fa24406ff10 2023-11-08T12:27:53.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa23a7fc700 1 -- 172.21.15.112:0/1666765735 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240003900 con 0x7fa24406ff10 2023-11-08T12:27:53.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.825+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24406cc50 con 0x7fa24406ff10 2023-11-08T12:27:53.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.829+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2440d2730 con 0x7fa24406ff10 2023-11-08T12:27:53.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.829+0000 7fa23a7fc700 1 -- 172.21.15.112:0/1666765735 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa24002a020 con 0x7fa24406ff10 2023-11-08T12:27:53.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.833+0000 7fa23a7fc700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa228064f10 0x7fa2280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:53.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.833+0000 7fa23a7fc700 1 -- 172.21.15.112:0/1666765735 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa2400833f0 con 0x7fa24406ff10 2023-11-08T12:27:53.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.833+0000 7fa24911a700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa228064f10 0x7fa2280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:53.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.833+0000 7fa24911a700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa228064f10 0x7fa2280673c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2440b4c50 tx=0x7fa2340091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:53.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:53.841+0000 7fa23a7fc700 1 -- 172.21.15.112:0/1666765735 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa240051480 con 0x7fa24406ff10 2023-11-08T12:27:54.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.053+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa2440cd930 con 0x7fa24406ff10 2023-11-08T12:27:54.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.069+0000 7fa23a7fc700 1 -- 172.21.15.112:0/1666765735 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa2440cd930 con 0x7fa24406ff10 2023-11-08T12:27:54.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa228064f10 msgr2=0x7fa2280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:54.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa228064f10 0x7fa2280673c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2440b4c50 tx=0x7fa2340091c0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24406ff10 msgr2=0x7fa2440ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24406ff10 0x7fa2440ce5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa240009fd0 tx=0x7fa240004770 comp rx=0 tx=0).stop 2023-11-08T12:27:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 shutdown_connections 2023-11-08T12:27:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa228064f10 0x7fa2280673c0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2440b4c50 tx=0x7fa2340091c0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24415fc30 0x7fa2440cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa24415c150 0x7fa24415e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 --2- 172.21.15.112:0/1666765735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa24406ff10 0x7fa2440ce5b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.073+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 >> 172.21.15.112:0/1666765735 conn(0x7fa2440d3680 msgr2=0x7fa24415b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:54.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.077+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 shutdown_connections 2023-11-08T12:27:54.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.077+0000 7fa24a91d700 1 -- 172.21.15.112:0/1666765735 wait complete. 2023-11-08T12:27:54.086 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 3 and data pool 4 2023-11-08T12:27:54.113 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-08T12:27:54.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-08T12:27:54.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.293+0000 7f761359e700 1 Processor -- start 2023-11-08T12:27:54.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.293+0000 7f761359e700 1 -- start start 2023-11-08T12:27:54.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.293+0000 7f761359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f761415c6e0 0x7f7614071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:54.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.293+0000 7f761359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761415cab0 con 0x7f7614071fe0 2023-11-08T12:27:54.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.293+0000 7f761359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76140702d0 con 0x7f761406a510 2023-11-08T12:27:54.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.293+0000 7f761359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76140d2800 con 0x7f761415c6e0 2023-11-08T12:27:54.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f7611d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7614071fe0 0x7f7614069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35836/0 (socket says 172.21.15.112:35836) 2023-11-08T12:27:54.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f7611d9b700 1 -- 172.21.15.112:0/2718728786 learned_addr learned my addr 172.21.15.112:0/2718728786 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:54.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761259c700 1 --2- 172.21.15.112:0/2718728786 >> v2:172.21.15.112:3300/0 conn(0x7f761415c6e0 0x7f7614071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:54.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761159a700 1 -- 172.21.15.112:0/2718728786 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976380517 0 0) 0x7f761415cab0 con 0x7f7614071fe0 2023-11-08T12:27:54.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761159a700 1 -- 172.21.15.112:0/2718728786 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75fc0035d0 con 0x7f7614071fe0 2023-11-08T12:27:54.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761259c700 1 -- 172.21.15.112:0/2718728786 >> v1:172.21.15.133:6789/0 conn(0x7f761406a510 legacy=0x7f761406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:54.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761259c700 1 -- 172.21.15.112:0/2718728786 >> v1:172.21.15.112:6789/0 conn(0x7f7614071fe0 legacy=0x7f7614069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:54.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761259c700 1 -- 172.21.15.112:0/2718728786 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140d2a10 con 0x7f761415c6e0 2023-11-08T12:27:54.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761259c700 1 --2- 172.21.15.112:0/2718728786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761415c6e0 0x7f7614071aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7604009850 tx=0x7f7604009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e21c3a9fce3f44b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:54.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761159a700 1 -- 172.21.15.112:0/2718728786 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604011830 con 0x7f761415c6e0 2023-11-08T12:27:54.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761159a700 1 -- 172.21.15.112:0/2718728786 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604011990 con 0x7f761415c6e0 2023-11-08T12:27:54.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761159a700 1 -- 172.21.15.112:0/2718728786 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604011d40 con 0x7f761415c6e0 2023-11-08T12:27:54.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761359e700 1 -- 172.21.15.112:0/2718728786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761415c6e0 msgr2=0x7f7614071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:54.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761359e700 1 --2- 172.21.15.112:0/2718728786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761415c6e0 0x7f7614071aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7604009850 tx=0x7f7604009b60 comp rx=0 tx=0).stop 2023-11-08T12:27:54.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761359e700 1 -- 172.21.15.112:0/2718728786 shutdown_connections 2023-11-08T12:27:54.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761359e700 1 --2- 172.21.15.112:0/2718728786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761415c6e0 0x7f7614071aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761359e700 1 -- 172.21.15.112:0/2718728786 >> 172.21.15.112:0/2718728786 conn(0x7f76140b65b0 msgr2=0x7f7614071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:54.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761359e700 1 -- 172.21.15.112:0/2718728786 shutdown_connections 2023-11-08T12:27:54.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.297+0000 7f761359e700 1 -- 172.21.15.112:0/2718728786 wait complete. 2023-11-08T12:27:54.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 Processor -- start 2023-11-08T12:27:54.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 -- start start 2023-11-08T12:27:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761406a510 0x7f76141f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7614071fe0 0x7f76140ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f761415c6e0 0x7f76140cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76141516b0 con 0x7f761406a510 2023-11-08T12:27:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76140ce360 con 0x7f7614071fe0 2023-11-08T12:27:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761409b850 con 0x7f761415c6e0 2023-11-08T12:27:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761406a510 0x7f76141f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761406a510 0x7f76141f8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32796/0 (socket says 172.21.15.112:32796) 2023-11-08T12:27:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 -- 172.21.15.112:0/2184429579 learned_addr learned my addr 172.21.15.112:0/2184429579 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 -- 172.21.15.112:0/2184429579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f761415c6e0 msgr2=0x7f76140cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f761415c6e0 0x7f76140cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 -- 172.21.15.112:0/2184429579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7614071fe0 msgr2=0x7f76140ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7614071fe0 0x7f76140ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 -- 172.21.15.112:0/2184429579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040094b0 con 0x7f761406a510 2023-11-08T12:27:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761259c700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761406a510 0x7f76141f8b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7604014040 tx=0x7f7604004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f7602ffd700 1 -- 172.21.15.112:0/2184429579 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604019ba0 con 0x7f761406a510 2023-11-08T12:27:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f7602ffd700 1 -- 172.21.15.112:0/2184429579 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760401e070 con 0x7f761406a510 2023-11-08T12:27:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76140d2fd0 con 0x7f761406a510 2023-11-08T12:27:54.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f7602ffd700 1 -- 172.21.15.112:0/2184429579 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760401a420 con 0x7f761406a510 2023-11-08T12:27:54.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.301+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76140d2cf0 con 0x7f761406a510 2023-11-08T12:27:54.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.305+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76140d32b0 con 0x7f761406a510 2023-11-08T12:27:54.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.305+0000 7f7602ffd700 1 -- 172.21.15.112:0/2184429579 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f760400f050 con 0x7f761406a510 2023-11-08T12:27:54.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.309+0000 7f7602ffd700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75f4064ee0 0x7f75f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:54.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.309+0000 7f7602ffd700 1 -- 172.21.15.112:0/2184429579 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7604083100 con 0x7f761406a510 2023-11-08T12:27:54.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.309+0000 7f7611d9b700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75f4064ee0 0x7f75f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:54.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.309+0000 7f7611d9b700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75f4064ee0 0x7f75f4067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f76140d00a0 tx=0x7f76080079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:54.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.313+0000 7f7602ffd700 1 -- 172.21.15.112:0/2184429579 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f76040511b0 con 0x7f761406a510 2023-11-08T12:27:54.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:54.493+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7614073cb0 con 0x7f761406a510 2023-11-08T12:27:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.077+0000 7f7602ffd700 1 -- 172.21.15.112:0/2184429579 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7f76040200e0 con 0x7f761406a510 2023-11-08T12:27:55.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75f4064ee0 msgr2=0x7f75f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:55.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75f4064ee0 0x7f75f4067390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f76140d00a0 tx=0x7f76080079e0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761406a510 msgr2=0x7f76141f8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:55.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761406a510 0x7f76141f8b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7604014040 tx=0x7f7604004770 comp rx=0 tx=0).stop 2023-11-08T12:27:55.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 shutdown_connections 2023-11-08T12:27:55.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75f4064ee0 0x7f75f4067390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f761415c6e0 0x7f76140cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7614071fe0 0x7f76140ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.081+0000 7f761359e700 1 --2- 172.21.15.112:0/2184429579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f761406a510 0x7f76141f8b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.085+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 >> 172.21.15.112:0/2184429579 conn(0x7f76140b65b0 msgr2=0x7f76140d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:55.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.085+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 shutdown_connections 2023-11-08T12:27:55.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.085+0000 7f761359e700 1 -- 172.21.15.112:0/2184429579 wait complete. 2023-11-08T12:27:55.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T12:27:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.305+0000 7f871759e700 1 Processor -- start 2023-11-08T12:27:55.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.305+0000 7f871759e700 1 -- start start 2023-11-08T12:27:55.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87180b11f0 0x7f87180c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:55.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180cb0b0 con 0x7f871815d610 2023-11-08T12:27:55.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180ca220 con 0x7f871815ca70 2023-11-08T12:27:55.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87180c8f20 con 0x7f87180b11f0 2023-11-08T12:27:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f8715d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f871815d610 0x7f87180ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36400/0 (socket says 172.21.15.112:36400) 2023-11-08T12:27:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f8715d9b700 1 -- 172.21.15.112:0/3046096243 learned_addr learned my addr 172.21.15.112:0/3046096243 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871659c700 1 --2- 172.21.15.112:0/3046096243 >> v2:172.21.15.133:3300/0 conn(0x7f87180b11f0 0x7f87180c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871559a700 1 -- 172.21.15.112:0/3046096243 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589646821 0 0) 0x7f87180ca220 con 0x7f871815ca70 2023-11-08T12:27:55.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871559a700 1 -- 172.21.15.112:0/3046096243 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87000035d0 con 0x7f871815ca70 2023-11-08T12:27:55.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871559a700 1 -- 172.21.15.112:0/3046096243 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038443630 0 0) 0x7f87180cb0b0 con 0x7f871815d610 2023-11-08T12:27:55.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871559a700 1 -- 172.21.15.112:0/3046096243 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87180ca220 con 0x7f871815d610 2023-11-08T12:27:55.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871659c700 1 -- 172.21.15.112:0/3046096243 >> v1:172.21.15.133:6789/0 conn(0x7f871815ca70 legacy=0x7f87180afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:55.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871659c700 1 -- 172.21.15.112:0/3046096243 >> v1:172.21.15.112:6789/0 conn(0x7f871815d610 legacy=0x7f87180ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:55.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871659c700 1 -- 172.21.15.112:0/3046096243 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180c9200 con 0x7f87180b11f0 2023-11-08T12:27:55.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.309+0000 7f871659c700 1 --2- 172.21.15.112:0/3046096243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87180b11f0 0x7f87180c9ce0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8708009850 tx=0x7f8708009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e843871fb1adedfc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:55.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871559a700 1 -- 172.21.15.112:0/3046096243 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708011830 con 0x7f87180b11f0 2023-11-08T12:27:55.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871559a700 1 -- 172.21.15.112:0/3046096243 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708011990 con 0x7f87180b11f0 2023-11-08T12:27:55.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871559a700 1 -- 172.21.15.112:0/3046096243 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708011d00 con 0x7f87180b11f0 2023-11-08T12:27:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871759e700 1 -- 172.21.15.112:0/3046096243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87180b11f0 msgr2=0x7f87180c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871759e700 1 --2- 172.21.15.112:0/3046096243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87180b11f0 0x7f87180c9ce0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8708009850 tx=0x7f8708009b60 comp rx=0 tx=0).stop 2023-11-08T12:27:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871759e700 1 -- 172.21.15.112:0/3046096243 shutdown_connections 2023-11-08T12:27:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871759e700 1 --2- 172.21.15.112:0/3046096243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87180b11f0 0x7f87180c9ce0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871759e700 1 -- 172.21.15.112:0/3046096243 >> 172.21.15.112:0/3046096243 conn(0x7f87180cb2b0 msgr2=0x7f87180cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:55.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871759e700 1 -- 172.21.15.112:0/3046096243 shutdown_connections 2023-11-08T12:27:55.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.313+0000 7f871759e700 1 -- 172.21.15.112:0/3046096243 wait complete. 2023-11-08T12:27:55.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 Processor -- start 2023-11-08T12:27:55.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 -- start start 2023-11-08T12:27:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871815ca70 0x7f871814f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f871815d610 0x7f8718153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:55.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87181548f0 0x7f8718154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:55.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87181552b0 con 0x7f87181548f0 2023-11-08T12:27:55.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180b17e0 con 0x7f871815ca70 2023-11-08T12:27:55.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87180b4160 con 0x7f871815d610 2023-11-08T12:27:55.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87181548f0 0x7f8718154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:55.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871815ca70 0x7f871814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:55.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87181548f0 0x7f8718154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38286/0 (socket says 172.21.15.112:38286) 2023-11-08T12:27:55.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 -- 172.21.15.112:0/2376564198 learned_addr learned my addr 172.21.15.112:0/2376564198 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:55.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8715d9b700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f871815d610 0x7f8718153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:55.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 -- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f871815d610 msgr2=0x7f8718153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:55.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f871815d610 0x7f8718153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 -- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871815ca70 msgr2=0x7f871814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:55.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871815ca70 0x7f871814f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:55.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8716d9d700 1 -- 172.21.15.112:0/2376564198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87080094b0 con 0x7f87181548f0 2023-11-08T12:27:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f8715d9b700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f871815d610 0x7f8718153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:27:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.317+0000 7f871659c700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871815ca70 0x7f871814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:27:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.321+0000 7f8716d9d700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87181548f0 0x7f8718154d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f871000cc20 tx=0x7f871000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.321+0000 7f8706ffd700 1 -- 172.21.15.112:0/2376564198 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710003c20 con 0x7f87181548f0 2023-11-08T12:27:55.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.321+0000 7f8706ffd700 1 -- 172.21.15.112:0/2376564198 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710003d80 con 0x7f87181548f0 2023-11-08T12:27:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.321+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87180c97c0 con 0x7f87181548f0 2023-11-08T12:27:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.321+0000 7f8706ffd700 1 -- 172.21.15.112:0/2376564198 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000ab90 con 0x7f87181548f0 2023-11-08T12:27:55.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.321+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87180c94e0 con 0x7f87181548f0 2023-11-08T12:27:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.321+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871815cef0 con 0x7f87181548f0 2023-11-08T12:27:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.325+0000 7f8706ffd700 1 -- 172.21.15.112:0/2376564198 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8710010050 con 0x7f87181548f0 2023-11-08T12:27:55.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.325+0000 7f8706ffd700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f86f8064ee0 0x7f86f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.325+0000 7f8706ffd700 1 -- 172.21.15.112:0/2376564198 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f87100820b0 con 0x7f87181548f0 2023-11-08T12:27:55.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.325+0000 7f871659c700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f86f8064ee0 0x7f86f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:55.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.325+0000 7f871659c700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f86f8064ee0 0x7f86f8067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87080090b0 tx=0x7f8708008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:55.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.333+0000 7f8706ffd700 1 -- 172.21.15.112:0/2376564198 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8710050010 con 0x7f87181548f0 2023-11-08T12:27:55.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:55.505+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8718073d20 con 0x7f87181548f0 2023-11-08T12:27:57.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.105+0000 7f8706ffd700 1 -- 172.21.15.112:0/2376564198 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f8710053630 con 0x7f87181548f0 2023-11-08T12:27:57.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f86f8064ee0 msgr2=0x7f86f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:57.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f86f8064ee0 0x7f86f8067390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87080090b0 tx=0x7f8708008030 comp rx=0 tx=0).stop 2023-11-08T12:27:57.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87181548f0 msgr2=0x7f8718154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:57.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87181548f0 0x7f8718154d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f871000cc20 tx=0x7f871000cf30 comp rx=0 tx=0).stop 2023-11-08T12:27:57.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 shutdown_connections 2023-11-08T12:27:57.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f86f8064ee0 0x7f86f8067390 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87080090b0 tx=0x7f8708008030 comp rx=0 tx=0).stop 2023-11-08T12:27:57.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87181548f0 0x7f8718154d70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f871815d610 0x7f8718153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 --2- 172.21.15.112:0/2376564198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871815ca70 0x7f871814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 >> 172.21.15.112:0/2376564198 conn(0x7f87180cb2b0 msgr2=0x7f8718158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:57.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 shutdown_connections 2023-11-08T12:27:57.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.113+0000 7f871759e700 1 -- 172.21.15.112:0/2376564198 wait complete. 2023-11-08T12:27:57.121 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data_ec' created 2023-11-08T12:27:57.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-08T12:27:57.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.325+0000 7f59cd6a7700 1 Processor -- start 2023-11-08T12:27:57.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.325+0000 7f59cd6a7700 1 -- start start 2023-11-08T12:27:57.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59cd6a7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59c81418c0 0x7f59c80706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59cd6a7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59c8070c20 0x7f59c80710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59cd6a7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59cd6a7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c8072230 con 0x7f59c8070c20 2023-11-08T12:27:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59cd6a7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c80b2190 con 0x7f59c81418c0 2023-11-08T12:27:57.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59cd6a7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b2470 con 0x7f59c815c370 2023-11-08T12:27:57.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59c81418c0 0x7f59c80706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:57.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:57.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c815c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:33322/0 (socket says 172.21.15.112:33322) 2023-11-08T12:27:57.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 -- 172.21.15.112:0/1078653470 learned_addr learned my addr 172.21.15.112:0/1078653470 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:57.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59c81418c0 0x7f59c80706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:49378/0 (socket says 172.21.15.112:49378) 2023-11-08T12:27:57.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c67fc700 1 --2- 172.21.15.112:0/1078653470 >> v2:172.21.15.112:3300/0 conn(0x7f59c8070c20 0x7f59c80710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:57.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 -- 172.21.15.112:0/1078653470 >> v2:172.21.15.133:3300/0 conn(0x7f59c81418c0 msgr2=0x7f59c80706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:57.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 --2- 172.21.15.112:0/1078653470 >> v2:172.21.15.133:3300/0 conn(0x7f59c81418c0 0x7f59c80706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 -- 172.21.15.112:0/1078653470 >> v2:172.21.15.112:3300/0 conn(0x7f59c8070c20 msgr2=0x7f59c80710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:57.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 --2- 172.21.15.112:0/1078653470 >> v2:172.21.15.112:3300/0 conn(0x7f59c8070c20 0x7f59c80710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.329+0000 7f59c77fe700 1 -- 172.21.15.112:0/1078653470 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80b2750 con 0x7f59c815c370 2023-11-08T12:27:57.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59c77fe700 1 --2- 172.21.15.112:0/1078653470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c815c7f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e50 tx=0x7f59c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b72d0f6e81eeca86 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:57.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59c5ffb700 1 -- 172.21.15.112:0/1078653470 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000e070 con 0x7f59c815c370 2023-11-08T12:27:57.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59c5ffb700 1 -- 172.21.15.112:0/1078653470 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000b8d0 con 0x7f59c815c370 2023-11-08T12:27:57.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59c5ffb700 1 -- 172.21.15.112:0/1078653470 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000bc80 con 0x7f59c815c370 2023-11-08T12:27:57.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 -- 172.21.15.112:0/1078653470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 msgr2=0x7f59c815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:57.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/1078653470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c815c7f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e50 tx=0x7f59c000b330 comp rx=0 tx=0).stop 2023-11-08T12:27:57.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 -- 172.21.15.112:0/1078653470 shutdown_connections 2023-11-08T12:27:57.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/1078653470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c815c7f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/1078653470 >> v2:172.21.15.112:3300/0 conn(0x7f59c8070c20 0x7f59c80710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/1078653470 >> v2:172.21.15.133:3300/0 conn(0x7f59c81418c0 0x7f59c80706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 -- 172.21.15.112:0/1078653470 >> 172.21.15.112:0/1078653470 conn(0x7f59c806bfc0 msgr2=0x7f59c806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:57.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 -- 172.21.15.112:0/1078653470 shutdown_connections 2023-11-08T12:27:57.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.333+0000 7f59cd6a7700 1 -- 172.21.15.112:0/1078653470 wait complete. 2023-11-08T12:27:57.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 Processor -- start 2023-11-08T12:27:57.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 -- start start 2023-11-08T12:27:57.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c8070c20 0x7f59c81511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:57.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c81418c0 0x7f59c8154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:57.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c8157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:57.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81523e0 con 0x7f59c81418c0 2023-11-08T12:27:57.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8152630 con 0x7f59c8070c20 2023-11-08T12:27:57.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8152910 con 0x7f59c815c370 2023-11-08T12:27:57.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c81418c0 0x7f59c8154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:57.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c81418c0 0x7f59c8154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38316/0 (socket says 172.21.15.112:38316) 2023-11-08T12:27:57.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 -- 172.21.15.112:0/301392308 learned_addr learned my addr 172.21.15.112:0/301392308 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:57.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c6ffd700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c8070c20 0x7f59c81511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:57.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c77fe700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c8157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:57.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 -- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 msgr2=0x7f59c8157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:57.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c8157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 -- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c8070c20 msgr2=0x7f59c81511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:57.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c8070c20 0x7f59c81511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:57.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 -- 172.21.15.112:0/301392308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c0009b30 con 0x7f59c81418c0 2023-11-08T12:27:57.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c6ffd700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c8070c20 0x7f59c81511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:57.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c77fe700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:27:57.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59c67fc700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c81418c0 0x7f59c8154120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00e840 tx=0x7f59bc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:57.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59af7fe700 1 -- 172.21.15.112:0/301392308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0095a0 con 0x7f59c81418c0 2023-11-08T12:27:57.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59af7fe700 1 -- 172.21.15.112:0/301392308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00c690 con 0x7f59c81418c0 2023-11-08T12:27:57.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c8071e50 con 0x7f59c81418c0 2023-11-08T12:27:57.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59af7fe700 1 -- 172.21.15.112:0/301392308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00ca00 con 0x7f59c81418c0 2023-11-08T12:27:57.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.337+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80b2a30 con 0x7f59c81418c0 2023-11-08T12:27:57.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.341+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c8071fe0 con 0x7f59c81418c0 2023-11-08T12:27:57.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.341+0000 7f59af7fe700 1 -- 172.21.15.112:0/301392308 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f59bc019030 con 0x7f59c81418c0 2023-11-08T12:27:57.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.341+0000 7f59af7fe700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59b4064ee0 0x7f59b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:57.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.341+0000 7f59af7fe700 1 -- 172.21.15.112:0/301392308 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f59bc082850 con 0x7f59c81418c0 2023-11-08T12:27:57.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.341+0000 7f59c6ffd700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59b4064ee0 0x7f59b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:57.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.345+0000 7f59c6ffd700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59b4064ee0 0x7f59b4067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59c8070440 tx=0x7f59b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:57.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.349+0000 7f59af7fe700 1 -- 172.21.15.112:0/301392308 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f59bc0506c0 con 0x7f59c81418c0 2023-11-08T12:27:57.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:57.517+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f59c80726c0 con 0x7f59c81418c0 2023-11-08T12:27:58.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.113+0000 7f59af7fe700 1 -- 172.21.15.112:0/301392308 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f59bc053ce0 con 0x7f59c81418c0 2023-11-08T12:27:58.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.121+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59b4064ee0 msgr2=0x7f59b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.121+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59b4064ee0 0x7f59b4067390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59c8070440 tx=0x7f59b8008040 comp rx=0 tx=0).stop 2023-11-08T12:27:58.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.121+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c81418c0 msgr2=0x7f59c8154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.121+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c81418c0 0x7f59c8154120 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00e840 tx=0x7f59bc00ec00 comp rx=0 tx=0).stop 2023-11-08T12:27:58.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.125+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 shutdown_connections 2023-11-08T12:27:58.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.125+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59b4064ee0 0x7f59b4067390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.125+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c815c370 0x7f59c8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.125+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c81418c0 0x7f59c8154120 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.125+0000 7f59cd6a7700 1 --2- 172.21.15.112:0/301392308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c8070c20 0x7f59c81511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.125+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 >> 172.21.15.112:0/301392308 conn(0x7f59c806bfc0 msgr2=0x7f59c80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:58.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.125+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 shutdown_connections 2023-11-08T12:27:58.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.129+0000 7f59cd6a7700 1 -- 172.21.15.112:0/301392308 wait complete. 2023-11-08T12:27:58.136 INFO:teuthology.orchestra.run.smithi112.stderr:set pool 5 allow_ec_overwrites to true 2023-11-08T12:27:58.162 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-08T12:27:58.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.325+0000 7efe0f65e700 1 Processor -- start 2023-11-08T12:27:58.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0f65e700 1 -- start start 2023-11-08T12:27:58.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0f65e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe080ca9e0 0x7efe0815a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0f65e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0815a7a0 con 0x7efe0806b360 2023-11-08T12:27:58.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0f65e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080c9630 con 0x7efe080adeb0 2023-11-08T12:27:58.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0f65e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe081596e0 con 0x7efe080ca9e0 2023-11-08T12:27:58.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0d3fa700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efe0806b360 0x7efe080c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36408/0 (socket says 172.21.15.112:36408) 2023-11-08T12:27:58.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0d3fa700 1 -- 172.21.15.112:0/677414737 learned_addr learned my addr 172.21.15.112:0/677414737 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.329+0000 7efe0cbf9700 1 --2- 172.21.15.112:0/677414737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe080ca9e0 0x7efe0815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efdfffff700 1 -- 172.21.15.112:0/677414737 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530643639 0 0) 0x7efe04001110 con 0x7efe0806b360 2023-11-08T12:27:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efdfffff700 1 -- 172.21.15.112:0/677414737 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf40035d0 con 0x7efe0806b360 2023-11-08T12:27:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0cbf9700 1 -- 172.21.15.112:0/677414737 >> v1:172.21.15.133:6789/0 conn(0x7efe080adeb0 legacy=0x7efe080afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efdfffff700 1 -- 172.21.15.112:0/677414737 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086953550 0 0) 0x7efe080c9630 con 0x7efe080adeb0 2023-11-08T12:27:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0cbf9700 1 -- 172.21.15.112:0/677414737 >> v1:172.21.15.112:6789/0 conn(0x7efe0806b360 legacy=0x7efe080c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0cbf9700 1 -- 172.21.15.112:0/677414737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080cb150 con 0x7efe080ca9e0 2023-11-08T12:27:58.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0cbf9700 1 --2- 172.21.15.112:0/677414737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe080ca9e0 0x7efe0815a260 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009880 tx=0x7efdf8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee940122b3712be server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:58.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efdfffff700 1 -- 172.21.15.112:0/677414737 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8011830 con 0x7efe080ca9e0 2023-11-08T12:27:58.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efdfffff700 1 -- 172.21.15.112:0/677414737 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8011990 con 0x7efe080ca9e0 2023-11-08T12:27:58.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efdfffff700 1 -- 172.21.15.112:0/677414737 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8011d20 con 0x7efe080ca9e0 2023-11-08T12:27:58.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0f65e700 1 -- 172.21.15.112:0/677414737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe080ca9e0 msgr2=0x7efe0815a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0f65e700 1 --2- 172.21.15.112:0/677414737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe080ca9e0 0x7efe0815a260 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009880 tx=0x7efdf8009b90 comp rx=0 tx=0).stop 2023-11-08T12:27:58.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0f65e700 1 -- 172.21.15.112:0/677414737 shutdown_connections 2023-11-08T12:27:58.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0f65e700 1 --2- 172.21.15.112:0/677414737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe080ca9e0 0x7efe0815a260 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0f65e700 1 -- 172.21.15.112:0/677414737 >> 172.21.15.112:0/677414737 conn(0x7efe080cf580 msgr2=0x7efe080cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:58.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0f65e700 1 -- 172.21.15.112:0/677414737 shutdown_connections 2023-11-08T12:27:58.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.333+0000 7efe0f65e700 1 -- 172.21.15.112:0/677414737 wait complete. 2023-11-08T12:27:58.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 Processor -- start 2023-11-08T12:27:58.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 -- start start 2023-11-08T12:27:58.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe0806b360 0x7efe081f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe080adeb0 0x7efe08155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe080ca9e0 0x7efe080b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081f1e70 con 0x7efe080ca9e0 2023-11-08T12:27:58.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c7830 con 0x7efe080adeb0 2023-11-08T12:27:58.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0f65e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c6a10 con 0x7efe0806b360 2023-11-08T12:27:58.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0dbfb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe080ca9e0 0x7efe080b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0dbfb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe080ca9e0 0x7efe080b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38326/0 (socket says 172.21.15.112:38326) 2023-11-08T12:27:58.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0cbf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe080adeb0 0x7efe08155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0dbfb700 1 -- 172.21.15.112:0/2312661153 learned_addr learned my addr 172.21.15.112:0/2312661153 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:58.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.337+0000 7efe0d3fa700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe0806b360 0x7efe081f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0dbfb700 1 -- 172.21.15.112:0/2312661153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe0806b360 msgr2=0x7efe081f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0dbfb700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe0806b360 0x7efe081f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0dbfb700 1 -- 172.21.15.112:0/2312661153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe080adeb0 msgr2=0x7efe08155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0dbfb700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe080adeb0 0x7efe08155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0dbfb700 1 -- 172.21.15.112:0/2312661153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80094b0 con 0x7efe080ca9e0 2023-11-08T12:27:58.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0dbfb700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe080ca9e0 0x7efe080b0a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe0000cc70 tx=0x7efe0000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:58.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efdfdffb700 1 -- 172.21.15.112:0/2312661153 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00003e50 con 0x7efe080ca9e0 2023-11-08T12:27:58.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efdfdffb700 1 -- 172.21.15.112:0/2312661153 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0000a6f0 con 0x7efe080ca9e0 2023-11-08T12:27:58.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efdfdffb700 1 -- 172.21.15.112:0/2312661153 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0000aaa0 con 0x7efe080ca9e0 2023-11-08T12:27:58.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe080cae70 con 0x7efe080ca9e0 2023-11-08T12:27:58.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe080adc00 con 0x7efe080ca9e0 2023-11-08T12:27:58.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.341+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe080c8fe0 con 0x7efe080ca9e0 2023-11-08T12:27:58.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.345+0000 7efdfdffb700 1 -- 172.21.15.112:0/2312661153 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efe00019030 con 0x7efe080ca9e0 2023-11-08T12:27:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.345+0000 7efdfdffb700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efdec064ee0 0x7efdec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.345+0000 7efdfdffb700 1 -- 172.21.15.112:0/2312661153 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6781+0+0 (secure 0 0 0) 0x7efe00081bb0 con 0x7efe080ca9e0 2023-11-08T12:27:58.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.345+0000 7efe0d3fa700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efdec064ee0 0x7efdec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.345+0000 7efe0d3fa700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efdec064ee0 0x7efdec067390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe04007fd0 tx=0x7efe04007c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:58.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.353+0000 7efdfdffb700 1 -- 172.21.15.112:0/2312661153 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efe0004f990 con 0x7efe080ca9e0 2023-11-08T12:27:58.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.561+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7efe080733b0 con 0x7efe080ca9e0 2023-11-08T12:27:58.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.569+0000 7efdfdffb700 1 -- 172.21.15.112:0/2312661153 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7efe000170b0 con 0x7efe080ca9e0 2023-11-08T12:27:58.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efdec064ee0 msgr2=0x7efdec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efdec064ee0 0x7efdec067390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe04007fd0 tx=0x7efe04007c60 comp rx=0 tx=0).stop 2023-11-08T12:27:58.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe080ca9e0 msgr2=0x7efe080b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe080ca9e0 0x7efe080b0a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe0000cc70 tx=0x7efe0000cf80 comp rx=0 tx=0).stop 2023-11-08T12:27:58.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 shutdown_connections 2023-11-08T12:27:58.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efdec064ee0 0x7efdec067390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe080ca9e0 0x7efe080b0a60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe080adeb0 0x7efe08155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 --2- 172.21.15.112:0/2312661153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efe0806b360 0x7efe081f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 >> 172.21.15.112:0/2312661153 conn(0x7efe080cf580 msgr2=0x7efe080ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:58.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 shutdown_connections 2023-11-08T12:27:58.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.577+0000 7efe0f65e700 1 -- 172.21.15.112:0/2312661153 wait complete. 2023-11-08T12:27:58.582 INFO:teuthology.orchestra.run.smithi112.stderr:added data pool 5 to fsmap 2023-11-08T12:27:58.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:27:58.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.765+0000 7fcf04dfc700 1 Processor -- start 2023-11-08T12:27:58.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.765+0000 7fcf04dfc700 1 -- start start 2023-11-08T12:27:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcf04dfc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf000704b0 0x7fcf00164960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcf04dfc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000ad6c0 con 0x7fcf00070080 2023-11-08T12:27:58.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcf04dfc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000adc60 con 0x7fcf00160710 2023-11-08T12:27:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcf04dfc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0006b1c0 con 0x7fcf000704b0 2023-11-08T12:27:58.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcef6ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcf00070080 0x7fcf00164250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36412/0 (socket says 172.21.15.112:36412) 2023-11-08T12:27:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcef6ffd700 1 -- 172.21.15.112:0/2137856969 learned_addr learned my addr 172.21.15.112:0/2137856969 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcefffff700 1 --2- 172.21.15.112:0/2137856969 >> v2:172.21.15.133:3300/0 conn(0x7fcf000704b0 0x7fcf00164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcefeffd700 1 -- 172.21.15.112:0/2137856969 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218276855 0 0) 0x7fcf000ad6c0 con 0x7fcf00070080 2023-11-08T12:27:58.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.769+0000 7fcefeffd700 1 -- 172.21.15.112:0/2137856969 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceec0035d0 con 0x7fcf00070080 2023-11-08T12:27:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefeffd700 1 -- 172.21.15.112:0/2137856969 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838920254 0 0) 0x7fcf000adc60 con 0x7fcf00160710 2023-11-08T12:27:58.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefeffd700 1 -- 172.21.15.112:0/2137856969 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf000ad6c0 con 0x7fcf00160710 2023-11-08T12:27:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefffff700 1 -- 172.21.15.112:0/2137856969 >> v1:172.21.15.133:6789/0 conn(0x7fcf00160710 legacy=0x7fcf000cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefffff700 1 -- 172.21.15.112:0/2137856969 >> v1:172.21.15.112:6789/0 conn(0x7fcf00070080 legacy=0x7fcf00164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefffff700 1 -- 172.21.15.112:0/2137856969 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000cca30 con 0x7fcf000704b0 2023-11-08T12:27:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefffff700 1 --2- 172.21.15.112:0/2137856969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 0x7fcf00164960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009850 tx=0x7fcef8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6de2d8e75892e261 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefeffd700 1 -- 172.21.15.112:0/2137856969 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8011830 con 0x7fcf000704b0 2023-11-08T12:27:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefeffd700 1 -- 172.21.15.112:0/2137856969 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef8011990 con 0x7fcf000704b0 2023-11-08T12:27:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcefeffd700 1 -- 172.21.15.112:0/2137856969 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8011d40 con 0x7fcf000704b0 2023-11-08T12:27:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcf04dfc700 1 -- 172.21.15.112:0/2137856969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 msgr2=0x7fcf00164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/2137856969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 0x7fcf00164960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009850 tx=0x7fcef8009b60 comp rx=0 tx=0).stop 2023-11-08T12:27:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcf04dfc700 1 -- 172.21.15.112:0/2137856969 shutdown_connections 2023-11-08T12:27:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/2137856969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 0x7fcf00164960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcf04dfc700 1 -- 172.21.15.112:0/2137856969 >> 172.21.15.112:0/2137856969 conn(0x7fcf000b0f80 msgr2=0x7fcf000ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:58.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcf04dfc700 1 -- 172.21.15.112:0/2137856969 shutdown_connections 2023-11-08T12:27:58.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.773+0000 7fcf04dfc700 1 -- 172.21.15.112:0/2137856969 wait complete. 2023-11-08T12:27:58.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 Processor -- start 2023-11-08T12:27:58.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 -- start start 2023-11-08T12:27:58.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf00070080 0x7fcf000c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 0x7fcf0015fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf00160710 0x7fcf000c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000c1130 con 0x7fcf00070080 2023-11-08T12:27:58.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0015f020 con 0x7fcf000704b0 2023-11-08T12:27:58.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcf04dfc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0015f300 con 0x7fcf00160710 2023-11-08T12:27:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf00070080 0x7fcf000c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf00070080 0x7fcf000c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38342/0 (socket says 172.21.15.112:38342) 2023-11-08T12:27:58.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 -- 172.21.15.112:0/622056546 learned_addr learned my addr 172.21.15.112:0/622056546 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:58.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcef6ffd700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 0x7fcf0015fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fcefffff700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf00160710 0x7fcf000c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 -- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf00160710 msgr2=0x7fcf000c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf00160710 0x7fcf000c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 -- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 msgr2=0x7fcf0015fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:58.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 0x7fcf0015fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:58.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 -- 172.21.15.112:0/622056546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80094b0 con 0x7fcf00070080 2023-11-08T12:27:58.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.777+0000 7fceff7fe700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf00070080 0x7fcf000c3c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcef000cc50 tx=0x7fcef000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:58.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.781+0000 7fcefcff9700 1 -- 172.21.15.112:0/622056546 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0003c20 con 0x7fcf00070080 2023-11-08T12:27:58.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.781+0000 7fcefcff9700 1 -- 172.21.15.112:0/622056546 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0003d80 con 0x7fcf00070080 2023-11-08T12:27:58.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.781+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0006b6b0 con 0x7fcf00070080 2023-11-08T12:27:58.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.781+0000 7fcefcff9700 1 -- 172.21.15.112:0/622056546 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000ab10 con 0x7fcf00070080 2023-11-08T12:27:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.781+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0006b3d0 con 0x7fcf00070080 2023-11-08T12:27:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.781+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000ad8f0 con 0x7fcf00070080 2023-11-08T12:27:58.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.781+0000 7fcefcff9700 1 -- 172.21.15.112:0/622056546 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcef0010050 con 0x7fcf00070080 2023-11-08T12:27:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.785+0000 7fcefcff9700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcee0064f30 0x7fcee00673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.785+0000 7fcefcff9700 1 -- 172.21.15.112:0/622056546 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcef00820d0 con 0x7fcf00070080 2023-11-08T12:27:58.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.785+0000 7fcef6ffd700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcee0064f30 0x7fcee00673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:58.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.785+0000 7fcef6ffd700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcee0064f30 0x7fcee00673e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf000c43c0 tx=0x7fcee8007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:58.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:58.789+0000 7fcefcff9700 1 -- 172.21.15.112:0/622056546 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcef004ff10 con 0x7fcf00070080 2023-11-08T12:27:59.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.001+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf00073cb0 con 0x7fcf00070080 2023-11-08T12:27:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.001+0000 7fcefcff9700 1 -- 172.21.15.112:0/622056546 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4647 (secure 0 0 0) 0x7fcef0053530 con 0x7fcf00070080 2023-11-08T12:27:59.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:59.004 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:27:58.563157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-08T12:27:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcee0064f30 msgr2=0x7fcee00673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcee0064f30 0x7fcee00673e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf000c43c0 tx=0x7fcee8007de0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf00070080 msgr2=0x7fcf000c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf00070080 0x7fcf000c3c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcef000cc50 tx=0x7fcef000cf60 comp rx=0 tx=0).stop 2023-11-08T12:27:59.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 shutdown_connections 2023-11-08T12:27:59.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcee0064f30 0x7fcee00673e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf00160710 0x7fcf000c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf000704b0 0x7fcf0015fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 --2- 172.21.15.112:0/622056546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf00070080 0x7fcf000c3c00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 >> 172.21.15.112:0/622056546 conn(0x7fcf000b0f80 msgr2=0x7fcf00163450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 shutdown_connections 2023-11-08T12:27:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.005+0000 7fcf04dfc700 1 -- 172.21.15.112:0/622056546 wait complete. 2023-11-08T12:27:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-11-08T12:27:59.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:59.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.189+0000 7f3fa57f9700 1 Processor -- start 2023-11-08T12:27:59.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.189+0000 7f3fa57f9700 1 -- start start 2023-11-08T12:27:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3fa57f9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3fa01586d0 0x7f3fa00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3fa57f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fa006fa30 0x7f3fa015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3fa57f9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa00cdc80 con 0x7f3fa00ceef0 2023-11-08T12:27:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3fa57f9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa00ce520 con 0x7f3fa01586d0 2023-11-08T12:27:59.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3fa57f9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa015d000 con 0x7f3fa006fa30 2023-11-08T12:27:59.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3fa01586d0 0x7f3fa00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3fa01586d0 0x7f3fa00ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38354/0 (socket says 172.21.15.112:38354) 2023-11-08T12:27:59.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 -- 172.21.15.112:0/3387225779 learned_addr learned my addr 172.21.15.112:0/3387225779 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:59.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 -- 172.21.15.112:0/3387225779 >> v2:172.21.15.133:3300/0 conn(0x7f3fa006fa30 msgr2=0x7f3fa015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:59.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 --2- 172.21.15.112:0/3387225779 >> v2:172.21.15.133:3300/0 conn(0x7f3fa006fa30 0x7f3fa015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 -- 172.21.15.112:0/3387225779 >> v1:172.21.15.112:6789/0 conn(0x7f3fa00ceef0 legacy=0x7f3fa006f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:27:59.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 -- 172.21.15.112:0/3387225779 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00cded0 con 0x7f3fa01586d0 2023-11-08T12:27:59.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9effd700 1 --2- 172.21.15.112:0/3387225779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa01586d0 0x7f3fa00ce9b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00cd8c0 tx=0x7f3f90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e3b436790aa56b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:59.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9dffb700 1 -- 172.21.15.112:0/3387225779 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90004230 con 0x7f3fa01586d0 2023-11-08T12:27:59.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9dffb700 1 -- 172.21.15.112:0/3387225779 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90004390 con 0x7f3fa01586d0 2023-11-08T12:27:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.193+0000 7f3f9dffb700 1 -- 172.21.15.112:0/3387225779 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900036c0 con 0x7f3fa01586d0 2023-11-08T12:27:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 -- 172.21.15.112:0/3387225779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa01586d0 msgr2=0x7f3fa00ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/3387225779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa01586d0 0x7f3fa00ce9b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00cd8c0 tx=0x7f3f90009bf0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 -- 172.21.15.112:0/3387225779 shutdown_connections 2023-11-08T12:27:59.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/3387225779 >> v2:172.21.15.133:3300/0 conn(0x7f3fa006fa30 0x7f3fa015c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/3387225779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa01586d0 0x7f3fa00ce9b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 -- 172.21.15.112:0/3387225779 >> 172.21.15.112:0/3387225779 conn(0x7f3fa00ccb30 msgr2=0x7f3fa00ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:59.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 -- 172.21.15.112:0/3387225779 shutdown_connections 2023-11-08T12:27:59.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.197+0000 7f3fa57f9700 1 -- 172.21.15.112:0/3387225779 wait complete. 2023-11-08T12:27:59.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 Processor -- start 2023-11-08T12:27:59.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 -- start start 2023-11-08T12:27:59.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa006fa30 0x7f3fa006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa00ceef0 0x7f3fa00b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa01586d0 0x7f3fa00b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015a080 con 0x7f3fa00ceef0 2023-11-08T12:27:59.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa006c140 con 0x7f3fa01586d0 2023-11-08T12:27:59.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.201+0000 7f3fa57f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015a320 con 0x7f3fa006fa30 2023-11-08T12:27:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa00ceef0 0x7f3fa00b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa00ceef0 0x7f3fa00b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38360/0 (socket says 172.21.15.112:38360) 2023-11-08T12:27:59.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 -- 172.21.15.112:0/1620357128 learned_addr learned my addr 172.21.15.112:0/1620357128 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9ffff700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa01586d0 0x7f3fa00b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9effd700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa006fa30 0x7f3fa006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 -- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa006fa30 msgr2=0x7f3fa006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa006fa30 0x7f3fa006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 -- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa01586d0 msgr2=0x7f3fa00b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa01586d0 0x7f3fa00b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 -- 172.21.15.112:0/1620357128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009570 con 0x7f3fa00ceef0 2023-11-08T12:27:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f9e7fc700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa00ceef0 0x7f3fa00b1b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c4e0 tx=0x7f3f9400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f877fe700 1 -- 172.21.15.112:0/1620357128 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94011790 con 0x7f3fa00ceef0 2023-11-08T12:27:59.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f877fe700 1 -- 172.21.15.112:0/1620357128 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f94011910 con 0x7f3fa00ceef0 2023-11-08T12:27:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa0158aa0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3f877fe700 1 -- 172.21.15.112:0/1620357128 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94011cc0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa00ce1b0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.205+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa0159db0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.209+0000 7f3f877fe700 1 -- 172.21.15.112:0/1620357128 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3f94010050 con 0x7f3fa00ceef0 2023-11-08T12:27:59.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.209+0000 7f3f877fe700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3f8c064ee0 0x7f3f8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.209+0000 7f3f877fe700 1 -- 172.21.15.112:0/1620357128 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f94081df0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.209+0000 7f3f9effd700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3f8c064ee0 0x7f3f8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.213+0000 7f3f9effd700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3f8c064ee0 0x7f3f8c067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00cd8c0 tx=0x7f3f90008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:59.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.217+0000 7f3f877fe700 1 -- 172.21.15.112:0/1620357128 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3fa0159db0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.397+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fa0159db0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.397+0000 7f3f877fe700 1 -- 172.21.15.112:0/1620357128 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7f3fa0159db0 con 0x7f3fa00ceef0 2023-11-08T12:27:59.402 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:59.402 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:59.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3f8c064ee0 msgr2=0x7f3f8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3f8c064ee0 0x7f3f8c067390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00cd8c0 tx=0x7f3f90008030 comp rx=0 tx=0).stop 2023-11-08T12:27:59.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa00ceef0 msgr2=0x7f3fa00b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa00ceef0 0x7f3fa00b1b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c4e0 tx=0x7f3f9400c7f0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 shutdown_connections 2023-11-08T12:27:59.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3f8c064ee0 0x7f3f8c067390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa01586d0 0x7f3fa00b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fa00ceef0 0x7f3fa00b1b80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 --2- 172.21.15.112:0/1620357128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa006fa30 0x7f3fa006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 >> 172.21.15.112:0/1620357128 conn(0x7f3fa00ccb30 msgr2=0x7f3fa01555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:59.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 shutdown_connections 2023-11-08T12:27:59.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.401+0000 7f3fa57f9700 1 -- 172.21.15.112:0/1620357128 wait complete. 2023-11-08T12:27:59.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:27:59.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.593+0000 7f6c0759e700 1 Processor -- start 2023-11-08T12:27:59.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.593+0000 7f6c0759e700 1 -- start start 2023-11-08T12:27:59.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c0759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c0759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c08069bf0 con 0x7f6c080c8da0 2023-11-08T12:27:59.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c0759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c080ae100 con 0x7f6c08158840 2023-11-08T12:27:59.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c0759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0815c890 con 0x7f6c0815c3b0 2023-11-08T12:27:59.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c06d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6c080c8da0 0x7f6c0806a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36416/0 (socket says 172.21.15.112:36416) 2023-11-08T12:27:59.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c06d9d700 1 -- 172.21.15.112:0/2794106279 learned_addr learned my addr 172.21.15.112:0/2794106279 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:27:59.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6bfffff700 1 --2- 172.21.15.112:0/2794106279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c05d9b700 1 -- 172.21.15.112:0/2794106279 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432742103 0 0) 0x7f6c08069bf0 con 0x7f6c080c8da0 2023-11-08T12:27:59.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c05d9b700 1 -- 172.21.15.112:0/2794106279 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf40035d0 con 0x7f6c080c8da0 2023-11-08T12:27:59.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6bfffff700 1 -- 172.21.15.112:0/2794106279 >> v1:172.21.15.133:6789/0 conn(0x7f6c08158840 legacy=0x7f6c080ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6bfffff700 1 -- 172.21.15.112:0/2794106279 >> v1:172.21.15.112:6789/0 conn(0x7f6c080c8da0 legacy=0x7f6c0806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6bfffff700 1 -- 172.21.15.112:0/2794106279 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0815cb70 con 0x7f6c0815c3b0 2023-11-08T12:27:59.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6bfffff700 1 --2- 172.21.15.112:0/2794106279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08070080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000aa20 tx=0x7f6bf000ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1e1dfa160c46c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:59.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c05d9b700 1 -- 172.21.15.112:0/2794106279 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000cb70 con 0x7f6c0815c3b0 2023-11-08T12:27:59.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.597+0000 7f6c05d9b700 1 -- 172.21.15.112:0/2794106279 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf000ccd0 con 0x7f6c0815c3b0 2023-11-08T12:27:59.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c05d9b700 1 -- 172.21.15.112:0/2794106279 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0018620 con 0x7f6c0815c3b0 2023-11-08T12:27:59.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c0759e700 1 -- 172.21.15.112:0/2794106279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 msgr2=0x7f6c08070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2794106279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08070080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000aa20 tx=0x7f6bf000ad30 comp rx=0 tx=0).stop 2023-11-08T12:27:59.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c0759e700 1 -- 172.21.15.112:0/2794106279 shutdown_connections 2023-11-08T12:27:59.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2794106279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08070080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c0759e700 1 -- 172.21.15.112:0/2794106279 >> 172.21.15.112:0/2794106279 conn(0x7f6c080b0f80 msgr2=0x7f6c080ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:59.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c0759e700 1 -- 172.21.15.112:0/2794106279 shutdown_connections 2023-11-08T12:27:59.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.601+0000 7f6c0759e700 1 -- 172.21.15.112:0/2794106279 wait complete. 2023-11-08T12:27:59.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 Processor -- start 2023-11-08T12:27:59.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 -- start start 2023-11-08T12:27:59.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c080c8da0 0x7f6c08158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c08158840 0x7f6c08150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08150ad0 con 0x7f6c080c8da0 2023-11-08T12:27:59.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0815c0f0 con 0x7f6c08158840 2023-11-08T12:27:59.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080b3ac0 con 0x7f6c0815c3b0 2023-11-08T12:27:59.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c080c8da0 0x7f6c08158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c080c8da0 0x7f6c08158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38370/0 (socket says 172.21.15.112:38370) 2023-11-08T12:27:59.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 -- 172.21.15.112:0/2537646998 learned_addr learned my addr 172.21.15.112:0/2537646998 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:27:59.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6bfffff700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c08158840 0x7f6c08150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c06d9d700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 -- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 msgr2=0x7f6c08155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 -- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c08158840 msgr2=0x7f6c08150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c08158840 0x7f6c08150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.605+0000 7f6c0659c700 1 -- 172.21.15.112:0/2537646998 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf000a650 con 0x7f6c080c8da0 2023-11-08T12:27:59.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6c0659c700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c080c8da0 0x7f6c08158e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c530 tx=0x7f6bf800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:59.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6bfeffd700 1 -- 172.21.15.112:0/2537646998 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80052d0 con 0x7f6c080c8da0 2023-11-08T12:27:59.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6bfeffd700 1 -- 172.21.15.112:0/2537646998 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8005430 con 0x7f6c080c8da0 2023-11-08T12:27:59.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0815d130 con 0x7f6c080c8da0 2023-11-08T12:27:59.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6bfeffd700 1 -- 172.21.15.112:0/2537646998 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80055a0 con 0x7f6c080c8da0 2023-11-08T12:27:59.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0815ce50 con 0x7f6c080c8da0 2023-11-08T12:27:59.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c08158c10 con 0x7f6c080c8da0 2023-11-08T12:27:59.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.609+0000 7f6bfeffd700 1 -- 172.21.15.112:0/2537646998 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6bf8019030 con 0x7f6c080c8da0 2023-11-08T12:27:59.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.613+0000 7f6bfeffd700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6be8064ee0 0x7f6be8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:27:59.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.613+0000 7f6bfeffd700 1 -- 172.21.15.112:0/2537646998 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6bf80814e0 con 0x7f6c080c8da0 2023-11-08T12:27:59.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.613+0000 7f6bfffff700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6be8064ee0 0x7f6be8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:27:59.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.613+0000 7f6bfffff700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6be8064ee0 0x7f6be8067390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c0815c7c0 tx=0x7f6bf001b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:27:59.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.617+0000 7f6bfeffd700 1 -- 172.21.15.112:0/2537646998 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6bf804f2a0 con 0x7f6c080c8da0 2023-11-08T12:27:59.719 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-11-08T12:27:59.713+0000 7f519b765700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:27:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.789+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c08073cb0 con 0x7f6c080c8da0 2023-11-08T12:27:59.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6bfeffd700 1 -- 172.21.15.112:0/2537646998 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7f6bf80528c0 con 0x7f6c080c8da0 2023-11-08T12:27:59.794 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:27:59.795 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:27:59.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6be8064ee0 msgr2=0x7f6be8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6be8064ee0 0x7f6be8067390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c0815c7c0 tx=0x7f6bf001b040 comp rx=0 tx=0).stop 2023-11-08T12:27:59.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c080c8da0 msgr2=0x7f6c08158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:27:59.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c080c8da0 0x7f6c08158e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c530 tx=0x7f6bf800c840 comp rx=0 tx=0).stop 2023-11-08T12:27:59.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 shutdown_connections 2023-11-08T12:27:59.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6be8064ee0 0x7f6be8067390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c0815c3b0 0x7f6c08155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c08158840 0x7f6c08150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 --2- 172.21.15.112:0/2537646998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c080c8da0 0x7f6c08158e80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:27:59.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 >> 172.21.15.112:0/2537646998 conn(0x7f6c080b0f80 msgr2=0x7f6c080cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:27:59.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 shutdown_connections 2023-11-08T12:27:59.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:27:59.793+0000 7f6c0759e700 1 -- 172.21.15.112:0/2537646998 wait complete. 2023-11-08T12:27:59.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:28:00.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.009+0000 7fba194e7700 1 Processor -- start 2023-11-08T12:28:00.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.009+0000 7fba194e7700 1 -- start start 2023-11-08T12:28:00.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba194e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba140b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba194e7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba140cdaa0 0x7fba1406b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba194e7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1415cde0 con 0x7fba140b1780 2023-11-08T12:28:00.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba194e7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140b1bf0 con 0x7fba140cdaa0 2023-11-08T12:28:00.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba194e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba140af040 con 0x7fba14159320 2023-11-08T12:28:00.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba137fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba140cdaa0 0x7fba1406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba137fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba140cdaa0 0x7fba1406b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38384/0 (socket says 172.21.15.112:38384) 2023-11-08T12:28:00.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba137fe700 1 -- 172.21.15.112:0/3296890352 learned_addr learned my addr 172.21.15.112:0/3296890352 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba12ffd700 1 --2- 172.21.15.112:0/3296890352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba140b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba12ffd700 1 -- 172.21.15.112:0/3296890352 >> v2:172.21.15.112:3300/0 conn(0x7fba140cdaa0 msgr2=0x7fba1406b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba12ffd700 1 --2- 172.21.15.112:0/3296890352 >> v2:172.21.15.112:3300/0 conn(0x7fba140cdaa0 0x7fba1406b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba12ffd700 1 -- 172.21.15.112:0/3296890352 >> v1:172.21.15.133:6789/0 conn(0x7fba140b1780 legacy=0x7fba140cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba12ffd700 1 -- 172.21.15.112:0/3296890352 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140ca7f0 con 0x7fba14159320 2023-11-08T12:28:00.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba137fe700 1 --2- 172.21.15.112:0/3296890352 >> v2:172.21.15.112:3300/0 conn(0x7fba140cdaa0 0x7fba1406b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:00.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba12ffd700 1 --2- 172.21.15.112:0/3296890352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba140b1240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba04009850 tx=0x7fba04009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c70e3729d0598b2a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.013+0000 7fba11ffb700 1 -- 172.21.15.112:0/3296890352 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04011830 con 0x7fba14159320 2023-11-08T12:28:00.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba11ffb700 1 -- 172.21.15.112:0/3296890352 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba04011990 con 0x7fba14159320 2023-11-08T12:28:00.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba11ffb700 1 -- 172.21.15.112:0/3296890352 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04011d40 con 0x7fba14159320 2023-11-08T12:28:00.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 -- 172.21.15.112:0/3296890352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 msgr2=0x7fba140b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 --2- 172.21.15.112:0/3296890352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba140b1240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba04009850 tx=0x7fba04009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:00.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 -- 172.21.15.112:0/3296890352 shutdown_connections 2023-11-08T12:28:00.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 --2- 172.21.15.112:0/3296890352 >> v2:172.21.15.112:3300/0 conn(0x7fba140cdaa0 0x7fba1406b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 --2- 172.21.15.112:0/3296890352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba140b1240 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 -- 172.21.15.112:0/3296890352 >> 172.21.15.112:0/3296890352 conn(0x7fba140cc240 msgr2=0x7fba140cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 -- 172.21.15.112:0/3296890352 shutdown_connections 2023-11-08T12:28:00.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.017+0000 7fba194e7700 1 -- 172.21.15.112:0/3296890352 wait complete. 2023-11-08T12:28:00.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 Processor -- start 2023-11-08T12:28:00.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 -- start start 2023-11-08T12:28:00.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba140b1780 0x7fba140b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba140cdaa0 0x7fba14156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba14156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14157640 con 0x7fba140cdaa0 2023-11-08T12:28:00.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14157920 con 0x7fba140b1780 2023-11-08T12:28:00.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba194e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba14157c00 con 0x7fba14159320 2023-11-08T12:28:00.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba127fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba140cdaa0 0x7fba14156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba127fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba140cdaa0 0x7fba14156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38386/0 (socket says 172.21.15.112:38386) 2023-11-08T12:28:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba127fc700 1 -- 172.21.15.112:0/2428856787 learned_addr learned my addr 172.21.15.112:0/2428856787 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba137fe700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba14156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.021+0000 7fba12ffd700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba140b1780 0x7fba140b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba127fc700 1 -- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 msgr2=0x7fba14156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba127fc700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba14156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba127fc700 1 -- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba140b1780 msgr2=0x7fba140b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba127fc700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba140b1780 0x7fba140b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba127fc700 1 -- 172.21.15.112:0/2428856787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c009b30 con 0x7fba140cdaa0 2023-11-08T12:28:00.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba137fe700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba14156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba12ffd700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba140b1780 0x7fba140b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba127fc700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba140cdaa0 0x7fba14156a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c500 tx=0x7fba0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fb9fb7fe700 1 -- 172.21.15.112:0/2428856787 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080052d0 con 0x7fba140cdaa0 2023-11-08T12:28:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fb9fb7fe700 1 -- 172.21.15.112:0/2428856787 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08005430 con 0x7fba140cdaa0 2023-11-08T12:28:00.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba040094b0 con 0x7fba140cdaa0 2023-11-08T12:28:00.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fb9fb7fe700 1 -- 172.21.15.112:0/2428856787 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080055a0 con 0x7fba140cdaa0 2023-11-08T12:28:00.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1415d030 con 0x7fba140cdaa0 2023-11-08T12:28:00.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba141596f0 con 0x7fba140cdaa0 2023-11-08T12:28:00.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.025+0000 7fb9fb7fe700 1 -- 172.21.15.112:0/2428856787 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba08019030 con 0x7fba140cdaa0 2023-11-08T12:28:00.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.029+0000 7fb9fb7fe700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba00064ee0 0x7fba00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.029+0000 7fb9fb7fe700 1 -- 172.21.15.112:0/2428856787 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba080814a0 con 0x7fba140cdaa0 2023-11-08T12:28:00.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.029+0000 7fba12ffd700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba00064ee0 0x7fba00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.029+0000 7fba12ffd700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba00064ee0 0x7fba00067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba040090b0 tx=0x7fba04008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.033+0000 7fb9fb7fe700 1 -- 172.21.15.112:0/2428856787 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba0804f350 con 0x7fba140cdaa0 2023-11-08T12:28:00.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.237+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba1415d310 con 0x7fba140cdaa0 2023-11-08T12:28:00.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.237+0000 7fb9fb7fe700 1 -- 172.21.15.112:0/2428856787 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4647 (secure 0 0 0) 0x7fba08052970 con 0x7fba140cdaa0 2023-11-08T12:28:00.241 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:00.241 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:27:58.563157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-08T12:28:00.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba00064ee0 msgr2=0x7fba00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba00064ee0 0x7fba00067390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba040090b0 tx=0x7fba04008030 comp rx=0 tx=0).stop 2023-11-08T12:28:00.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba140cdaa0 msgr2=0x7fba14156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba140cdaa0 0x7fba14156a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c500 tx=0x7fba0800c8c0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 shutdown_connections 2023-11-08T12:28:00.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba00064ee0 0x7fba00067390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba14159320 0x7fba14156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba140cdaa0 0x7fba14156a80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 --2- 172.21.15.112:0/2428856787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba140b1780 0x7fba140b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 >> 172.21.15.112:0/2428856787 conn(0x7fba140cc240 msgr2=0x7fba140711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 shutdown_connections 2023-11-08T12:28:00.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.241+0000 7fba194e7700 1 -- 172.21.15.112:0/2428856787 wait complete. 2023-11-08T12:28:00.248 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 7 2023-11-08T12:28:00.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T12:27:54.061640+0000', 'modified': '2023-11-08T12:27:58.563157+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6833/67340016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 67340016}, {'type': 'v1', 'addr': '172.21.15.133:6833', 'nonce': 67340016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-08T12:28:00.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T12:28:00.669 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-08T12:28:00.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.885+0000 7f4eb08c7700 1 Processor -- start 2023-11-08T12:28:00.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.885+0000 7f4eb08c7700 1 -- start start 2023-11-08T12:28:00.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eb08c7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4eac15c1a0 0x7f4eac06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eb08c7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0cdeb0 0x7f4eac070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eb08c7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4eac0705c0 0x7f4eac15fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eb08c7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac069bf0 con 0x7f4eac15c1a0 2023-11-08T12:28:00.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eb08c7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac070a40 con 0x7f4eac0705c0 2023-11-08T12:28:00.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eb08c7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0adf90 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4eac15c1a0 0x7f4eac06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4eac15c1a0 0x7f4eac06c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38398/0 (socket says 172.21.15.112:38398) 2023-11-08T12:28:00.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 -- 172.21.15.112:0/1799913264 learned_addr learned my addr 172.21.15.112:0/1799913264 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eab59e700 1 --2- 172.21.15.112:0/1799913264 >> v2:172.21.15.133:3300/0 conn(0x7f4eac0705c0 0x7f4eac15fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/1799913264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0cdeb0 0x7f4eac070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 -- 172.21.15.112:0/1799913264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0cdeb0 msgr2=0x7f4eac070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/1799913264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0cdeb0 0x7f4eac070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 -- 172.21.15.112:0/1799913264 >> v2:172.21.15.133:3300/0 conn(0x7f4eac0705c0 msgr2=0x7f4eac15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/1799913264 >> v2:172.21.15.133:3300/0 conn(0x7f4eac0705c0 0x7f4eac15fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 -- 172.21.15.112:0/1799913264 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0ce370 con 0x7f4eac15c1a0 2023-11-08T12:28:00.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.889+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/1799913264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac15c1a0 0x7f4eac06c8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06d520 tx=0x7f4e9c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e3f252a4e80fa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4ea9d9b700 1 -- 172.21.15.112:0/1799913264 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c011830 con 0x7f4eac15c1a0 2023-11-08T12:28:00.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4ea9d9b700 1 -- 172.21.15.112:0/1799913264 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c011990 con 0x7f4eac15c1a0 2023-11-08T12:28:00.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4ea9d9b700 1 -- 172.21.15.112:0/1799913264 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c011d20 con 0x7f4eac15c1a0 2023-11-08T12:28:00.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 -- 172.21.15.112:0/1799913264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac15c1a0 msgr2=0x7f4eac06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/1799913264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac15c1a0 0x7f4eac06c8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06d520 tx=0x7f4e9c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 -- 172.21.15.112:0/1799913264 shutdown_connections 2023-11-08T12:28:00.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/1799913264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0cdeb0 0x7f4eac070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/1799913264 >> v2:172.21.15.133:3300/0 conn(0x7f4eac0705c0 0x7f4eac15fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/1799913264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac15c1a0 0x7f4eac06c8b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 -- 172.21.15.112:0/1799913264 >> 172.21.15.112:0/1799913264 conn(0x7f4eac0b0f80 msgr2=0x7f4eac0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 -- 172.21.15.112:0/1799913264 shutdown_connections 2023-11-08T12:28:00.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.893+0000 7f4eb08c7700 1 -- 172.21.15.112:0/1799913264 wait complete. 2023-11-08T12:28:00.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 Processor -- start 2023-11-08T12:28:00.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 -- start start 2023-11-08T12:28:00.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0705c0 0x7f4eac155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac0cdeb0 0x7f4eac1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac15c1a0 0x7f4eac1f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0ca550 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0ca830 con 0x7f4eac15c1a0 2023-11-08T12:28:00.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eb08c7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0cab10 con 0x7f4eac0705c0 2023-11-08T12:28:00.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eaa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac0cdeb0 0x7f4eac1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eaa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac0cdeb0 0x7f4eac1586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38410/0 (socket says 172.21.15.112:38410) 2023-11-08T12:28:00.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eaa59c700 1 -- 172.21.15.112:0/4224929280 learned_addr learned my addr 172.21.15.112:0/4224929280 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.897+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0705c0 0x7f4eac155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eab59e700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac15c1a0 0x7f4eac1f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eaa59c700 1 -- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0705c0 msgr2=0x7f4eac155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0705c0 0x7f4eac155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eaa59c700 1 -- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac15c1a0 msgr2=0x7f4eac1f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac15c1a0 0x7f4eac1f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eaa59c700 1 -- 172.21.15.112:0/4224929280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c009570 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac0cdeb0 0x7f4eac1586a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e980 tx=0x7f4ea000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4e937fe700 1 -- 172.21.15.112:0/4224929280 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00096e0 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4e937fe700 1 -- 172.21.15.112:0/4224929280 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000eed0 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4e937fe700 1 -- 172.21.15.112:0/4224929280 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000ca70 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac0cc780 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.901+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac0cc4a0 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.905+0000 7f4e937fe700 1 -- 172.21.15.112:0/4224929280 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ea0019030 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.905+0000 7f4e937fe700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4e98064ee0 0x7f4e98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.905+0000 7f4e937fe700 1 -- 172.21.15.112:0/4224929280 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ea0082210 con 0x7f4eac0cdeb0 2023-11-08T12:28:00.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.905+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4e98064ee0 0x7f4e98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.905+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4e98064ee0 0x7f4e98067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c000c00 tx=0x7f4e9c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 Processor -- start 2023-11-08T12:28:00.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 -- start start 2023-11-08T12:28:00.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0ae0 0xda0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xda1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xda1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xc5fae0 con 0xaf0ae0 2023-11-08T12:28:00.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xccfbd0 con 0xaf0710 2023-11-08T12:28:00.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xcc8ed0 con 0xb3b790 2023-11-08T12:28:00.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0ae0 0xda0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0ae0 0xda0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38418/0 (socket says 172.21.15.112:38418) 2023-11-08T12:28:00.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2365046108 learned_addr learned my addr 172.21.15.112:0/2365046108 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xda1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eab59e700 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xda1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 msgr2=0xda1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xda1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 msgr2=0xda1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xda1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2365046108 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xceecc0 con 0xaf0ae0 2023-11-08T12:28:00.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xda1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:00.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.909+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0ae0 0xda0e00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009f40 tx=0x7f4e9c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fbd785fc18931b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4e90ff9700 1 -- 172.21.15.112:0/2365046108 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c01f070 con 0xaf0ae0 2023-11-08T12:28:00.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4e90ff9700 1 -- 172.21.15.112:0/2365046108 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c006d20 con 0xaf0ae0 2023-11-08T12:28:00.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4e90ff9700 1 -- 172.21.15.112:0/2365046108 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0036c0 con 0xaf0ae0 2023-11-08T12:28:00.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 -- 172.21.15.112:0/2365046108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0ae0 msgr2=0xda0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0ae0 0xda0e00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009f40 tx=0x7f4e9c010000 comp rx=0 tx=0).stop 2023-11-08T12:28:00.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 -- 172.21.15.112:0/2365046108 shutdown_connections 2023-11-08T12:28:00.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xda1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xda1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2365046108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0ae0 0xda0e00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 -- 172.21.15.112:0/2365046108 >> 172.21.15.112:0/2365046108 conn(0xaf0eb0 msgr2=0xd89700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 -- 172.21.15.112:0/2365046108 shutdown_connections 2023-11-08T12:28:00.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 -- 172.21.15.112:0/2365046108 wait complete. 2023-11-08T12:28:00.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 -- start start 2023-11-08T12:28:00.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 Processor -- start 2023-11-08T12:28:00.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.913+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xd87aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0ae0 0xdadd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xdae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xb75b20 con 0xaf0710 2023-11-08T12:28:00.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xda2f50 con 0xaf0ae0 2023-11-08T12:28:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xd61b40 con 0xb3b790 2023-11-08T12:28:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 10 client.0 _ll_register_callbacks cb 0xd250d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:28:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xd87aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xd87aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38434/0 (socket says 172.21.15.112:38434) 2023-11-08T12:28:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 -- 172.21.15.112:0/278723649 learned_addr learned my addr 172.21.15.112:0/278723649 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0ae0 0xdadd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eab59e700 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xdae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 -- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 msgr2=0xdae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xdae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 -- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0ae0 msgr2=0xdadd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0ae0 0xdadd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 -- 172.21.15.112:0/278723649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac0ce370 con 0xaf0710 2023-11-08T12:28:00.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xd87aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009f40 tx=0x7f4e9c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1337b95791f3af28 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4e89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:28:00.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4e89ffb700 1 -- 172.21.15.112:0/278723649 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c003c90 con 0xaf0710 2023-11-08T12:28:00.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4e89ffb700 1 -- 172.21.15.112:0/278723649 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e9c003df0 con 0xaf0710 2023-11-08T12:28:00.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xcc1f50 con 0xaf0710 2023-11-08T12:28:00.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4e89ffb700 1 -- 172.21.15.112:0/278723649 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e9c03a430 con 0xaf0710 2023-11-08T12:28:00.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 10 client.4449 fetch_fsmap learned FSMap version 7 2023-11-08T12:28:00.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0xb3c9e0 con 0xaf0710 2023-11-08T12:28:00.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4e89ffb700 1 -- 172.21.15.112:0/278723649 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xcc1f50 con 0xaf0710 2023-11-08T12:28:00.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4e89ffb700 1 -- 172.21.15.112:0/278723649 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4e9c03a590 con 0xaf0710 2023-11-08T12:28:00.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2023-11-08T12:28:00.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 10 client.4449 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T12:28:00.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 20 client.4449 populate_metadata read hostname 'smithi112' 2023-11-08T12:28:00.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd8a930 0xdba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 4 client.4449 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:28:00.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.917+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 --> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xcc1c70 con 0xd8a930 2023-11-08T12:28:00.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd8a930 0xdba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4e89ffb700 10 client.4449 ms_handle_connect on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:00.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd8a930 0xdba4a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de03d122a122d157 server_cookie=93bd41408d1b413b in_seq=0 out_seq=0 2023-11-08T12:28:00.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4e89ffb700 1 -- 172.21.15.112:0/278723649 <== mds.0 v2:172.21.15.133:6832/67340016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xcc1c70 con 0xd8a930 2023-11-08T12:28:00.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4e89ffb700 10 client.4449 handle_command_reply: tid=0 2023-11-08T12:28:00.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 client.4449 shutdown 2023-11-08T12:28:00.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 msgr2=0xd87aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xd87aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009f40 tx=0x7f4e9c0047e0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 shutdown_connections 2023-11-08T12:28:00.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd8a930 0xdba4a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb3b790 0xdae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0ae0 0xdadd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4e89ffb700 0 client.4449 ms_handle_reset on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:00.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 --2- 172.21.15.112:0/278723649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xd87aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 >> 172.21.15.112:0/278723649 conn(0xaf0eb0 msgr2=0xd897d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.921+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 shutdown_connections 2023-11-08T12:28:00.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.925+0000 7f4eb4351740 1 -- 172.21.15.112:0/278723649 wait complete. 2023-11-08T12:28:00.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.925+0000 7f4eb4351740 20 client.4449 trim_cache size 0 max 16384 2023-11-08T12:28:00.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 Processor -- start 2023-11-08T12:28:00.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 -- start start 2023-11-08T12:28:00.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xd62390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xd882b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb3b790 0xd887f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xc7ea40 con 0xb3b790 2023-11-08T12:28:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xc79260 con 0xaf0710 2023-11-08T12:28:00.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xcc86e0 con 0xaf0ae0 2023-11-08T12:28:00.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eab59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb3b790 0xd887f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eab59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb3b790 0xd887f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38440/0 (socket says 172.21.15.112:38440) 2023-11-08T12:28:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eab59e700 1 -- 172.21.15.112:0/2206637891 learned_addr learned my addr 172.21.15.112:0/2206637891 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xd62390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.945+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xd882b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eab59e700 1 -- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 msgr2=0xd882b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eab59e700 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xd882b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eab59e700 1 -- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 msgr2=0xd62390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eab59e700 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xd62390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eab59e700 1 -- 172.21.15.112:0/2206637891 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac156a10 con 0xb3b790 2023-11-08T12:28:00.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xd62390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:00.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eab59e700 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb3b790 0xd887f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4007650 tx=0x7f4ea400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7449678c2d3651fe server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4e917fa700 1 -- 172.21.15.112:0/2206637891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4018620 con 0xb3b790 2023-11-08T12:28:00.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4e917fa700 1 -- 172.21.15.112:0/2206637891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea4011040 con 0xb3b790 2023-11-08T12:28:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4e917fa700 1 -- 172.21.15.112:0/2206637891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40189c0 con 0xb3b790 2023-11-08T12:28:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 -- 172.21.15.112:0/2206637891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb3b790 msgr2=0xd887f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb3b790 0xd887f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4007650 tx=0x7f4ea400b040 comp rx=0 tx=0).stop 2023-11-08T12:28:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 -- 172.21.15.112:0/2206637891 shutdown_connections 2023-11-08T12:28:00.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb3b790 0xd887f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xd882b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2206637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xaf0710 0xd62390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 -- 172.21.15.112:0/2206637891 >> 172.21.15.112:0/2206637891 conn(0xaf0eb0 msgr2=0xd61c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 -- 172.21.15.112:0/2206637891 shutdown_connections 2023-11-08T12:28:00.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.949+0000 7f4eb4351740 1 -- 172.21.15.112:0/2206637891 wait complete. 2023-11-08T12:28:00.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 -- start start 2023-11-08T12:28:00.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 Processor -- start 2023-11-08T12:28:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xe0bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xdb52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb3b790 0xdb57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb0140 con 0xaf0710 2023-11-08T12:28:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xd60560 con 0xb3b790 2023-11-08T12:28:00.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xd60800 con 0xaf0ae0 2023-11-08T12:28:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eb4351740 10 client.0 _ll_register_callbacks cb 0xc752d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:28:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xe0bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xe0bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38442/0 (socket says 172.21.15.112:38442) 2023-11-08T12:28:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2856169674 learned_addr learned my addr 172.21.15.112:0/2856169674 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xdb52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eab59e700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb3b790 0xdb57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 msgr2=0xdb52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xdb52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb3b790 msgr2=0xdb57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:00.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb3b790 0xdb57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 -- 172.21.15.112:0/2856169674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xb3c9e0 con 0xaf0710 2023-11-08T12:28:00.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eab59e700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb3b790 0xdb57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:00.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4eaad9d700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xe0bbc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c004320 tx=0x7f4e9c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1105ac32d502ef server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:00.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.953+0000 7f4e89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:28:00.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 1 -- 172.21.15.112:0/2856169674 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c03a630 con 0xaf0710 2023-11-08T12:28:00.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 1 -- 172.21.15.112:0/2856169674 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e9c03aaf0 con 0xaf0710 2023-11-08T12:28:00.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e9c006d20 con 0xaf0710 2023-11-08T12:28:00.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 1 -- 172.21.15.112:0/2856169674 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e9c003a90 con 0xaf0710 2023-11-08T12:28:00.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 10 client.4455 fetch_fsmap learned FSMap version 7 2023-11-08T12:28:00.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f4ea4007330 con 0xaf0710 2023-11-08T12:28:00.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 1 -- 172.21.15.112:0/2856169674 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c006d20 con 0xaf0710 2023-11-08T12:28:00.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 1 -- 172.21.15.112:0/2856169674 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4e9c003bf0 con 0xaf0710 2023-11-08T12:28:00.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 10 client.4455 fetch_fsmap finished waiting for FSMap version 7 2023-11-08T12:28:00.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 10 client.4455 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T12:28:00.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 20 client.4455 populate_metadata read hostname 'smithi112' 2023-11-08T12:28:00.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd5f720 0xd5faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:00.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 4 client.4455 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-11-08T12:28:00.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 --> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] -- command(tid 0: {"prefix": "status"}) v1 -- 0xb6d260 con 0xd5f720 2023-11-08T12:28:00.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd5f720 0xd5faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:00.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eaa59c700 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd5f720 0xd5faf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d1c9d06aea16f8b server_cookie=7a83f3a86fd56e1f in_seq=0 out_seq=0 2023-11-08T12:28:00.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 10 client.4455 ms_handle_connect on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:00.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 1 -- 172.21.15.112:0/2856169674 <== mds.0 v2:172.21.15.133:6832/67340016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xb6d260 con 0xd5f720 2023-11-08T12:28:00.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4e89ffb700 10 client.4455 handle_command_reply: tid=0 2023-11-08T12:28:00.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.957+0000 7f4eb4351740 1 client.4455 shutdown 2023-11-08T12:28:00.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 msgr2=0xe0bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xe0bbc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c004320 tx=0x7f4e9c011000 comp rx=0 tx=0).stop 2023-11-08T12:28:00.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 shutdown_connections 2023-11-08T12:28:00.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0xd5f720 0xd5faf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb3b790 0xdb57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xaf0ae0 0xdb52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 --2- 172.21.15.112:0/2856169674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xaf0710 0xe0bbc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4e89ffb700 0 client.4455 ms_handle_reset on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:00.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 >> 172.21.15.112:0/2856169674 conn(0xaf0eb0 msgr2=0xd88b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 shutdown_connections 2023-11-08T12:28:00.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 1 -- 172.21.15.112:0/2856169674 wait complete. 2023-11-08T12:28:00.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb4351740 20 client.4455 trim_cache size 0 max 16384 2023-11-08T12:28:00.972 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:28:00.973 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "c14663df-4425-4498-9232-3ffa5f578bfa", 2023-11-08T12:28:00.973 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-11-08T12:28:00.973 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4302, 2023-11-08T12:28:00.973 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-11-08T12:28:00.974 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-11-08T12:28:00.974 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-11-08T12:28:00.974 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.8940383199999999, 2023-11-08T12:28:00.974 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 7, 2023-11-08T12:28:00.975 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 29, 2023-11-08T12:28:00.975 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 28, 2023-11-08T12:28:00.975 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 12.242736189 2023-11-08T12:28:00.975 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:28:00.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4e98064ee0 msgr2=0x7f4e98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4e98064ee0 0x7f4e98067390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c000c00 tx=0x7f4e9c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:00.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac0cdeb0 msgr2=0x7f4eac1586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac0cdeb0 0x7f4eac1586a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000e980 tx=0x7f4ea000ec90 comp rx=0 tx=0).stop 2023-11-08T12:28:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 shutdown_connections 2023-11-08T12:28:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4e98064ee0 0x7f4e98067390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4eac15c1a0 0x7f4eac1f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac0cdeb0 0x7f4eac1586a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 --2- 172.21.15.112:0/4224929280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4eac0705c0 0x7f4eac155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 >> 172.21.15.112:0/4224929280 conn(0x7f4eac0b0f80 msgr2=0x7f4eac0ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 shutdown_connections 2023-11-08T12:28:00.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:00.961+0000 7f4eb08c7700 1 -- 172.21.15.112:0/4224929280 wait complete. 2023-11-08T12:28:00.987 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T12:28:00.987 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:00.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:28:01.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f920de6f700 1 Processor -- start 2023-11-08T12:28:01.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f920de6f700 1 -- start start 2023-11-08T12:28:01.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f920de6f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92080b43a0 0x7f920815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:01.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f920de6f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920815a550 con 0x7f92080b1640 2023-11-08T12:28:01.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f920de6f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920806b0a0 con 0x7f9208070790 2023-11-08T12:28:01.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f920de6f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92080caac0 con 0x7f92080b43a0 2023-11-08T12:28:01.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f9207fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f92080b1640 0x7f9208070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36420/0 (socket says 172.21.15.112:36420) 2023-11-08T12:28:01.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f9207fff700 1 -- 172.21.15.112:0/3973000646 learned_addr learned my addr 172.21.15.112:0/3973000646 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:01.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f920ce6d700 1 --2- 172.21.15.112:0/3973000646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92080b43a0 0x7f920815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597171005 0 0) 0x7f91f4001110 con 0x7f92080b1640 2023-11-08T12:28:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f80035d0 con 0x7f92080b1640 2023-11-08T12:28:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449185452 0 0) 0x7f920806b0a0 con 0x7f9208070790 2023-11-08T12:28:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.173+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f4001110 con 0x7f9208070790 2023-11-08T12:28:01.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4258642234 0 0) 0x7f91f80035d0 con 0x7f92080b1640 2023-11-08T12:28:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920ce6d700 1 -- 172.21.15.112:0/3973000646 >> v1:172.21.15.133:6789/0 conn(0x7f9208070790 legacy=0x7f920806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920ce6d700 1 -- 172.21.15.112:0/3973000646 >> v1:172.21.15.112:6789/0 conn(0x7f92080b1640 legacy=0x7f9208070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:01.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920ce6d700 1 -- 172.21.15.112:0/3973000646 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080cada0 con 0x7f92080b43a0 2023-11-08T12:28:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920ce6d700 1 --2- 172.21.15.112:0/3973000646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92080b43a0 0x7f920815e5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009880 tx=0x7f91fc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e2b1f4369a52dc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4001800 con 0x7f92080b43a0 2023-11-08T12:28:01.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc004030 con 0x7f92080b43a0 2023-11-08T12:28:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f92077fe700 1 -- 172.21.15.112:0/3973000646 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0043c0 con 0x7f92080b43a0 2023-11-08T12:28:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920de6f700 1 -- 172.21.15.112:0/3973000646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92080b43a0 msgr2=0x7f920815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920de6f700 1 --2- 172.21.15.112:0/3973000646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92080b43a0 0x7f920815e5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009880 tx=0x7f91fc009b90 comp rx=0 tx=0).stop 2023-11-08T12:28:01.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920de6f700 1 -- 172.21.15.112:0/3973000646 shutdown_connections 2023-11-08T12:28:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920de6f700 1 --2- 172.21.15.112:0/3973000646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92080b43a0 0x7f920815e5d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920de6f700 1 -- 172.21.15.112:0/3973000646 >> 172.21.15.112:0/3973000646 conn(0x7f92080b0f80 msgr2=0x7f92080ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:01.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920de6f700 1 -- 172.21.15.112:0/3973000646 shutdown_connections 2023-11-08T12:28:01.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.177+0000 7f920de6f700 1 -- 172.21.15.112:0/3973000646 wait complete. 2023-11-08T12:28:01.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 Processor -- start 2023-11-08T12:28:01.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 -- start start 2023-11-08T12:28:01.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208070790 0x7f920814bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:01.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92080b1640 0x7f92081587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:01.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92080b43a0 0x7f920806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920814c170 con 0x7f92080b1640 2023-11-08T12:28:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92080c33b0 con 0x7f92080b43a0 2023-11-08T12:28:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920de6f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92080c27a0 con 0x7f9208070790 2023-11-08T12:28:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f9207fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92080b1640 0x7f92081587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f9207fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92080b1640 0x7f92081587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38444/0 (socket says 172.21.15.112:38444) 2023-11-08T12:28:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f9207fff700 1 -- 172.21.15.112:0/2388474260 learned_addr learned my addr 172.21.15.112:0/2388474260 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920d66e700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92080b43a0 0x7f920806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:01.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.181+0000 7f920ce6d700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208070790 0x7f920814bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:01.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f9207fff700 1 -- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208070790 msgr2=0x7f920814bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:01.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f9207fff700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208070790 0x7f920814bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f9207fff700 1 -- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92080b43a0 msgr2=0x7f920806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:01.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f9207fff700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92080b43a0 0x7f920806bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f9207fff700 1 -- 172.21.15.112:0/2388474260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0094b0 con 0x7f92080b1640 2023-11-08T12:28:01.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f920ce6d700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208070790 0x7f920814bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:01.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f9207fff700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92080b1640 0x7f92081587c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91f400cad0 tx=0x7f91f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:01.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f92057fa700 1 -- 172.21.15.112:0/2388474260 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4004ca0 con 0x7f92080b1640 2023-11-08T12:28:01.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f92057fa700 1 -- 172.21.15.112:0/2388474260 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f4004e00 con 0x7f92080b1640 2023-11-08T12:28:01.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920806b5d0 con 0x7f92080b1640 2023-11-08T12:28:01.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f92057fa700 1 -- 172.21.15.112:0/2388474260 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4007310 con 0x7f92080b1640 2023-11-08T12:28:01.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920806b2f0 con 0x7f92080b1640 2023-11-08T12:28:01.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.185+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920815eb10 con 0x7f92080b1640 2023-11-08T12:28:01.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.189+0000 7f92057fa700 1 -- 172.21.15.112:0/2388474260 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f91f401a030 con 0x7f92080b1640 2023-11-08T12:28:01.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.189+0000 7f92057fa700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91ec064ee0 0x7f91ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:01.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.189+0000 7f92057fa700 1 -- 172.21.15.112:0/2388474260 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f91f4081600 con 0x7f92080b1640 2023-11-08T12:28:01.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.189+0000 7f920ce6d700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91ec064ee0 0x7f91ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:01.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.193+0000 7f920ce6d700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91ec064ee0 0x7f91ec067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0090b0 tx=0x7f91fc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:01.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.197+0000 7f92057fa700 1 -- 172.21.15.112:0/2388474260 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f91f404f360 con 0x7f92080b1640 2023-11-08T12:28:01.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.405+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f920815a530 con 0x7f92080b1640 2023-11-08T12:28:01.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.405+0000 7f92057fa700 1 -- 172.21.15.112:0/2388474260 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f91f4052980 con 0x7f92080b1640 2023-11-08T12:28:01.408 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T12:28:01.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91ec064ee0 msgr2=0x7f91ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:01.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91ec064ee0 0x7f91ec067390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0090b0 tx=0x7f91fc010000 comp rx=0 tx=0).stop 2023-11-08T12:28:01.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92080b1640 msgr2=0x7f92081587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92080b1640 0x7f92081587c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91f400cad0 tx=0x7f91f400cde0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 shutdown_connections 2023-11-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91ec064ee0 0x7f91ec067390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92080b43a0 0x7f920806bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92080b1640 0x7f92081587c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 --2- 172.21.15.112:0/2388474260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208070790 0x7f920814bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 >> 172.21.15.112:0/2388474260 conn(0x7f92080b0f80 msgr2=0x7f9208069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 shutdown_connections 2023-11-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:01.409+0000 7f920de6f700 1 -- 172.21.15.112:0/2388474260 wait complete. 2023-11-08T12:28:01.433 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T12:28:01.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:28:01.434 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-11-08T12:28:01.434 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-08T12:28:01.434 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:01.434 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T12:28:01.435 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T12:28:01.435 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:28:01.435 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-08T12:28:01.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.436 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-11-08T12:28:01.455 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:01.456 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:01.456 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:01.456 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:01.456 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:01.457 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:01.457 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:01.457 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:01.457 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-11-08T12:28:01.457 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:01.458 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:01.458 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-11-08T12:28:01.458 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:01.458 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:01.458 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:28:01.459 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:01.459 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:28:01.459 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42349sec preferred_lft 42349sec 2023-11-08T12:28:01.459 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-11-08T12:28:01.459 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:01.460 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:28:01.460 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:61:4e:41:39 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:01.460 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:28:01.460 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:01.461 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-08T12:28:01.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.462 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:01.462 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:01.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2023-11-08T12:28:01.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2023-11-08T12:28:01.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2023-11-08T12:28:01.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-08T12:28:01.464 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:01.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.607 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:28:01.639 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-11-08T12:28:01.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.642 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-11-08T12:28:01.726 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-11-08T12:28:01.726 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:28:01.726 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:28:01.727 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:28:01.727 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:28:01.727 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:28:01.727 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:28:01.727 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:28:01.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.728 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:01.729 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:01.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:28:01.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:28:01.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:28:01.730 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:01.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.867 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:28:01.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.886 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-11-08T12:28:01.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:01.944 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:01.944 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:01.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T12:28:01.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-08T12:28:01.945 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:02.062 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-08T12:28:02.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:02.063 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:02.063 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:02.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-08T12:28:02.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-08T12:28:02.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-08T12:28:02.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-08T12:28:02.065 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-08T12:28:02.065 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:02.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:02.247 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:02.247 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:02.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-11-08T12:28:02.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2023-11-08T12:28:02.248 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:02.325 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-08T12:28:02.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:02.326 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:02.343 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-08T12:28:02.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:02.344 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:02.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2023-11-08T12:28:02.485 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-08T12:28:02.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-08T12:28:02.564 INFO:teuthology.orchestra.run.smithi112.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-08T12:28:02.567 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-08T12:28:02.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:02.569 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2023-11-08T12:28:02.634 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-08T12:28:02.635 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2023-11-08T12:28:02.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2023-11-08T12:28:02.726 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-08T12:28:02.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-08T12:28:02.805 INFO:teuthology.orchestra.run.smithi112.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-08T12:28:02.806 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-08T12:28:02.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:02.808 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2023-11-08T12:28:02.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:2023-11-08T12:28:02.837+0000 7fb865f96640 -1 init, newargv = 0x558b5920f830 newargc=15 2023-11-08T12:28:02.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[41359]: starting ceph client 2023-11-08T12:28:02.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[41359]: starting fuse 2023-11-08T12:28:03.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2023-11-08T12:28:03.997 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-08T12:28:03.998 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-08T12:28:04.080 INFO:teuthology.orchestra.run.smithi112.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-08T12:28:04.081 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-08T12:28:04.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:04.083 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2023-11-08T12:28:04.145 INFO:teuthology.orchestra.run.smithi112.stdout:49 2023-11-08T12:28:04.146 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-08T12:28:04.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:28:04.147 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2023-11-08T12:28:04.147 DEBUG:teuthology.orchestra.run.smithi112:> import re 2023-11-08T12:28:04.147 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:28:04.148 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2023-11-08T12:28:04.148 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:28:04.148 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2023-11-08T12:28:04.149 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-08T12:28:04.149 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2023-11-08T12:28:04.149 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-08T12:28:04.150 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:28:04.150 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2023-11-08T12:28:04.150 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2023-11-08T12:28:04.151 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2023-11-08T12:28:04.151 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2023-11-08T12:28:04.151 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:28:04.152 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2023-11-08T12:28:04.152 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-08T12:28:04.152 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-08T12:28:04.153 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-08T12:28:04.153 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2023-11-08T12:28:04.153 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2023-11-08T12:28:04.154 DEBUG:teuthology.orchestra.run.smithi112:> return f 2023-11-08T12:28:04.154 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-08T12:28:04.154 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:28:04.155 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.admin")) 2023-11-08T12:28:04.155 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:28:04.317 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.admin.41359.asok 2023-11-08T12:28:04.496 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41359.asok 2023-11-08T12:28:04.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:04.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41359.asok status 2023-11-08T12:28:04.687 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:28:04.687 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2023-11-08T12:28:04.688 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "b820560f30d310ab2570761b9a294523225d6998", 2023-11-08T12:28:04.688 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 18.0.0-2698-gb820560f (b820560f30d310ab2570761b9a294523225d6998) reef (dev)", 2023-11-08T12:28:04.688 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "admin", 2023-11-08T12:28:04.688 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2023-11-08T12:28:04.689 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-08T12:28:04.689 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "41359", 2023-11-08T12:28:04.689 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2023-11-08T12:28:04.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:28:04.689 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2023-11-08T12:28:04.690 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2023-11-08T12:28:04.690 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4467, 2023-11-08T12:28:04.690 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2023-11-08T12:28:04.690 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2023-11-08T12:28:04.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2023-11-08T12:28:04.691 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 4467 2023-11-08T12:28:04.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:28:04.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2023-11-08T12:28:04.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2023-11-08T12:28:04.693 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2023-11-08T12:28:04.694 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 902663250 2023-11-08T12:28:04.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:28:04.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:28:04.694 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2023-11-08T12:28:04.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2023-11-08T12:28:04.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2023-11-08T12:28:04.695 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 902663250 2023-11-08T12:28:04.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:28:04.695 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.4467 192.168.0.1:0/902663250", 2023-11-08T12:28:04.695 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/902663250", 2023-11-08T12:28:04.696 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2023-11-08T12:28:04.696 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 7, 2023-11-08T12:28:04.696 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 29, 2023-11-08T12:28:04.696 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2023-11-08T12:28:04.696 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2023-11-08T12:28:04.697 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2023-11-08T12:28:04.697 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:28:04.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:04.703 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2023-11-08T12:28:04.703 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:04.721 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2023-11-08T12:28:04.722 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:04.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:04.723 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:04.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:04.804 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-08T12:28:04.917 INFO:teuthology.orchestra.run.smithi112.stdout:# file: . 2023-11-08T12:28:04.917 INFO:teuthology.orchestra.run.smithi112.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-08T12:28:04.917 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:04.919 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:04.919 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:04.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:05.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.153+0000 7fbe04381700 1 Processor -- start 2023-11-08T12:28:05.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.153+0000 7fbe04381700 1 -- start start 2023-11-08T12:28:05.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe04381700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc1534a0 0x7fbdfc15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe04381700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdfc0b6200 0x7fbdfc070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe04381700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc15d080 con 0x7fbdfc160920 2023-11-08T12:28:05.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe04381700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc153870 con 0x7fbdfc0b6200 2023-11-08T12:28:05.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe04381700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc0b53c0 con 0x7fbdfc1534a0 2023-11-08T12:28:05.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe0211d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc1534a0 0x7fbdfc15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe0191c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbdfc160920 0x7fbdfc0b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:56896/0 (socket says 172.21.15.112:56896) 2023-11-08T12:28:05.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe0291e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdfc0b6200 0x7fbdfc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe0191c700 1 -- 172.21.15.112:0/3349295723 learned_addr learned my addr 172.21.15.112:0/3349295723 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:05.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe0211d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc1534a0 0x7fbdfc15d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:33510/0 (socket says 172.21.15.112:33510) 2023-11-08T12:28:05.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe0111b700 1 -- 172.21.15.112:0/3349295723 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38294113 0 0) 0x7fbdfc15d080 con 0x7fbdfc160920 2023-11-08T12:28:05.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.157+0000 7fbe0111b700 1 -- 172.21.15.112:0/3349295723 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde80035d0 con 0x7fbdfc160920 2023-11-08T12:28:05.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0291e700 1 -- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc1534a0 msgr2=0x7fbdfc15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:05.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0291e700 1 --2- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc1534a0 0x7fbdfc15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0291e700 1 -- 172.21.15.112:0/3349295723 >> v1:172.21.15.133:6789/0 conn(0x7fbdfc160920 legacy=0x7fbdfc0b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0291e700 1 -- 172.21.15.112:0/3349295723 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0b56a0 con 0x7fbdfc0b6200 2023-11-08T12:28:05.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0211d700 1 --2- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc1534a0 0x7fbdfc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:05.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0291e700 1 --2- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc070630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009d90 tx=0x7fbdf400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c14b9e13940a6a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0111b700 1 -- 172.21.15.112:0/3349295723 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400e070 con 0x7fbdfc0b6200 2023-11-08T12:28:05.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0111b700 1 -- 172.21.15.112:0/3349295723 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400bb20 con 0x7fbdfc0b6200 2023-11-08T12:28:05.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe0111b700 1 -- 172.21.15.112:0/3349295723 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4012430 con 0x7fbdfc0b6200 2023-11-08T12:28:05.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 -- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 msgr2=0x7fbdfc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 --2- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc070630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009d90 tx=0x7fbdf400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 -- 172.21.15.112:0/3349295723 shutdown_connections 2023-11-08T12:28:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 --2- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc070630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 --2- 172.21.15.112:0/3349295723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc1534a0 0x7fbdfc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 -- 172.21.15.112:0/3349295723 >> 172.21.15.112:0/3349295723 conn(0x7fbdfc06bfc0 msgr2=0x7fbdfc06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 -- 172.21.15.112:0/3349295723 shutdown_connections 2023-11-08T12:28:05.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.161+0000 7fbe04381700 1 -- 172.21.15.112:0/3349295723 wait complete. 2023-11-08T12:28:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.165+0000 7fbe04381700 1 Processor -- start 2023-11-08T12:28:05.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.165+0000 7fbe04381700 1 -- start start 2023-11-08T12:28:05.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc1534a0 0x7fbdfc1f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc160920 0x7fbdfc0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1f5d10 con 0x7fbdfc1534a0 2023-11-08T12:28:05.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc159690 con 0x7fbdfc0b6200 2023-11-08T12:28:05.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc159970 con 0x7fbdfc160920 2023-11-08T12:28:05.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0191c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc1534a0 0x7fbdfc1f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:49524/0 (socket says 172.21.15.112:49524) 2023-11-08T12:28:05.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 -- 172.21.15.112:0/203641936 learned_addr learned my addr 172.21.15.112:0/203641936 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:05.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0191c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc1534a0 0x7fbdfc1f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38454/0 (socket says 172.21.15.112:38454) 2023-11-08T12:28:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0291e700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc160920 0x7fbdfc0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 -- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc160920 msgr2=0x7fbdfc0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc160920 0x7fbdfc0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 -- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc1534a0 msgr2=0x7fbdfc1f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc1534a0 0x7fbdfc1f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 -- 172.21.15.112:0/203641936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80094b0 con 0x7fbdfc0b6200 2023-11-08T12:28:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe0211d700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc158fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800ebe0 tx=0x7fbdf800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbdf2ffd700 1 -- 172.21.15.112:0/203641936 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800c850 con 0x7fbdfc0b6200 2023-11-08T12:28:05.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbdf2ffd700 1 -- 172.21.15.112:0/203641936 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf800c9b0 con 0x7fbdfc0b6200 2023-11-08T12:28:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbdf2ffd700 1 -- 172.21.15.112:0/203641936 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800cd40 con 0x7fbdfc0b6200 2023-11-08T12:28:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf4009a70 con 0x7fbdfc0b6200 2023-11-08T12:28:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.169+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc15cd10 con 0x7fbdfc0b6200 2023-11-08T12:28:05.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.173+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc15ca30 con 0x7fbdfc0b6200 2023-11-08T12:28:05.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.173+0000 7fbdf2ffd700 1 -- 172.21.15.112:0/203641936 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbdf8019030 con 0x7fbdfc0b6200 2023-11-08T12:28:05.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.177+0000 7fbdf2ffd700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbde0064f60 0x7fbde0067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.177+0000 7fbdf2ffd700 1 -- 172.21.15.112:0/203641936 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbdf80820c0 con 0x7fbdfc0b6200 2023-11-08T12:28:05.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.177+0000 7fbe0191c700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbde0064f60 0x7fbde0067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.177+0000 7fbe0191c700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbde0064f60 0x7fbde0067410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc1572e0 tx=0x7fbdec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.185+0000 7fbdf2ffd700 1 -- 172.21.15.112:0/203641936 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbdf804ff00 con 0x7fbdfc0b6200 2023-11-08T12:28:05.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.361+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdfc0b7f10 con 0x7fbdfc0b6200 2023-11-08T12:28:05.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.365+0000 7fbdf2ffd700 1 -- 172.21.15.112:0/203641936 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7fbdf800cea0 con 0x7fbdfc0b6200 2023-11-08T12:28:05.369 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:05.370 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbde0064f60 msgr2=0x7fbde0067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbde0064f60 0x7fbde0067410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc1572e0 tx=0x7fbdec009040 comp rx=0 tx=0).stop 2023-11-08T12:28:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 msgr2=0x7fbdfc158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc158fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800ebe0 tx=0x7fbdf800eef0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 shutdown_connections 2023-11-08T12:28:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbde0064f60 0x7fbde0067410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdfc160920 0x7fbdfc0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbdfc1534a0 0x7fbdfc1f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 --2- 172.21.15.112:0/203641936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0b6200 0x7fbdfc158fb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 >> 172.21.15.112:0/203641936 conn(0x7fbdfc06bfc0 msgr2=0x7fbdfc06c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:05.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 shutdown_connections 2023-11-08T12:28:05.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.369+0000 7fbe04381700 1 -- 172.21.15.112:0/203641936 wait complete. 2023-11-08T12:28:05.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:05.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:05.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.569+0000 7feba6329700 1 Processor -- start 2023-11-08T12:28:05.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.569+0000 7feba6329700 1 -- start start 2023-11-08T12:28:05.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.569+0000 7feba6329700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feba0159f10 0x7feba0070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.569+0000 7feba6329700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feba015a9f0 0x7feba006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.569+0000 7feba6329700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba0070600 con 0x7feba00c8c90 2023-11-08T12:28:05.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.569+0000 7feba6329700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba00c9130 con 0x7feba015a9f0 2023-11-08T12:28:05.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.569+0000 7feba6329700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba006b840 con 0x7feba0159f10 2023-11-08T12:28:05.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feba015a9f0 0x7feba006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feba015a9f0 0x7feba006b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54836/0 (socket says 172.21.15.112:54836) 2023-11-08T12:28:05.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 -- 172.21.15.112:0/4237944479 learned_addr learned my addr 172.21.15.112:0/4237944479 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:05.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5327700 1 --2- 172.21.15.112:0/4237944479 >> v2:172.21.15.133:3300/0 conn(0x7feba0159f10 0x7feba0070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 -- 172.21.15.112:0/4237944479 >> v2:172.21.15.133:3300/0 conn(0x7feba0159f10 msgr2=0x7feba0070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 --2- 172.21.15.112:0/4237944479 >> v2:172.21.15.133:3300/0 conn(0x7feba0159f10 0x7feba0070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 -- 172.21.15.112:0/4237944479 >> v1:172.21.15.133:6789/0 conn(0x7feba00c8c90 legacy=0x7feba015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 -- 172.21.15.112:0/4237944479 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba015adf0 con 0x7feba015a9f0 2023-11-08T12:28:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feb97fff700 1 -- 172.21.15.112:0/4237944479 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300082775 0 0) 0x7feba0070600 con 0x7feba00c8c90 2023-11-08T12:28:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba5b28700 1 --2- 172.21.15.112:0/4237944479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba015a9f0 0x7feba006b300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feba00cc0e0 tx=0x7feb9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7d0b1daee1db3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feb97fff700 1 -- 172.21.15.112:0/4237944479 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800e070 con 0x7feba015a9f0 2023-11-08T12:28:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feb97fff700 1 -- 172.21.15.112:0/4237944479 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800b910 con 0x7feba015a9f0 2023-11-08T12:28:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feb97fff700 1 -- 172.21.15.112:0/4237944479 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800bcc0 con 0x7feba015a9f0 2023-11-08T12:28:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba6329700 1 -- 172.21.15.112:0/4237944479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba015a9f0 msgr2=0x7feba006b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba6329700 1 --2- 172.21.15.112:0/4237944479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba015a9f0 0x7feba006b300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feba00cc0e0 tx=0x7feb9800b330 comp rx=0 tx=0).stop 2023-11-08T12:28:05.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba6329700 1 -- 172.21.15.112:0/4237944479 shutdown_connections 2023-11-08T12:28:05.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.573+0000 7feba6329700 1 --2- 172.21.15.112:0/4237944479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba015a9f0 0x7feba006b300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.577+0000 7feba6329700 1 --2- 172.21.15.112:0/4237944479 >> v2:172.21.15.133:3300/0 conn(0x7feba0159f10 0x7feba0070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.577+0000 7feba6329700 1 -- 172.21.15.112:0/4237944479 >> 172.21.15.112:0/4237944479 conn(0x7feba00cf280 msgr2=0x7feba00cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:05.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.577+0000 7feba6329700 1 -- 172.21.15.112:0/4237944479 shutdown_connections 2023-11-08T12:28:05.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.577+0000 7feba6329700 1 -- 172.21.15.112:0/4237944479 wait complete. 2023-11-08T12:28:05.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.577+0000 7feba6329700 1 Processor -- start 2023-11-08T12:28:05.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.577+0000 7feba6329700 1 -- start start 2023-11-08T12:28:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba00c8c90 0x7feba01f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159f10 0x7feba00cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015a9f0 0x7feba00c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01f1c30 con 0x7feba00c8c90 2023-11-08T12:28:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01f1f10 con 0x7feba015a9f0 2023-11-08T12:28:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba01f21f0 con 0x7feba0159f10 2023-11-08T12:28:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba00c8c90 0x7feba01f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba00c8c90 0x7feba01f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54844/0 (socket says 172.21.15.112:54844) 2023-11-08T12:28:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 -- 172.21.15.112:0/2550778262 learned_addr learned my addr 172.21.15.112:0/2550778262 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:05.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5b28700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015a9f0 0x7feba00c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba4b26700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159f10 0x7feba00cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 -- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159f10 msgr2=0x7feba00cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159f10 0x7feba00cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 -- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015a9f0 msgr2=0x7feba00c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015a9f0 0x7feba00c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 -- 172.21.15.112:0/2550778262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009b30 con 0x7feba00c8c90 2023-11-08T12:28:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5b28700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015a9f0 0x7feba00c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba4b26700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159f10 0x7feba00cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba5327700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba00c8c90 0x7feba01f1620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e9d0 tx=0x7feb9c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feb95ffb700 1 -- 172.21.15.112:0/2550778262 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c009720 con 0x7feba00c8c90 2023-11-08T12:28:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feb95ffb700 1 -- 172.21.15.112:0/2550778262 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00c850 con 0x7feba00c8c90 2023-11-08T12:28:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba006ffb0 con 0x7feba00c8c90 2023-11-08T12:28:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feb95ffb700 1 -- 172.21.15.112:0/2550778262 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00cbc0 con 0x7feba00c8c90 2023-11-08T12:28:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.581+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba00afcc0 con 0x7feba00c8c90 2023-11-08T12:28:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.585+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba0070290 con 0x7feba00c8c90 2023-11-08T12:28:05.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.585+0000 7feb95ffb700 1 -- 172.21.15.112:0/2550778262 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb9c019030 con 0x7feba00c8c90 2023-11-08T12:28:05.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.585+0000 7feb95ffb700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb84064ee0 0x7feb84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.585+0000 7feb95ffb700 1 -- 172.21.15.112:0/2550778262 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb9c0822b0 con 0x7feba00c8c90 2023-11-08T12:28:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.585+0000 7feba4b26700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb84064ee0 0x7feb84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.589+0000 7feba4b26700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb84064ee0 0x7feb84067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feba015d1b0 tx=0x7feb90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.593+0000 7feb95ffb700 1 -- 172.21.15.112:0/2550778262 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb9c050070 con 0x7feba00c8c90 2023-11-08T12:28:05.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.761+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feba006cf30 con 0x7feba00c8c90 2023-11-08T12:28:05.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.761+0000 7feb95ffb700 1 -- 172.21.15.112:0/2550778262 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb9c053690 con 0x7feba00c8c90 2023-11-08T12:28:05.764 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb84064ee0 msgr2=0x7feb84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb84064ee0 0x7feb84067390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feba015d1b0 tx=0x7feb90009040 comp rx=0 tx=0).stop 2023-11-08T12:28:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba00c8c90 msgr2=0x7feba01f1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba00c8c90 0x7feba01f1620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e9d0 tx=0x7feb9c00ed90 comp rx=0 tx=0).stop 2023-11-08T12:28:05.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 shutdown_connections 2023-11-08T12:28:05.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb84064ee0 0x7feb84067390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba015a9f0 0x7feba00c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feba0159f10 0x7feba00cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 --2- 172.21.15.112:0/2550778262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feba00c8c90 0x7feba01f1620 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 >> 172.21.15.112:0/2550778262 conn(0x7feba00cf280 msgr2=0x7feba00affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:05.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 shutdown_connections 2023-11-08T12:28:05.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.765+0000 7feba6329700 1 -- 172.21.15.112:0/2550778262 wait complete. 2023-11-08T12:28:05.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:05.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.965+0000 7fec3b59e700 1 Processor -- start 2023-11-08T12:28:05.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.965+0000 7fec3b59e700 1 -- start start 2023-11-08T12:28:05.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fec3c159f10 0x7fec3c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec3c0c8c90 0x7fec3c06b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3c070600 con 0x7fec3c15a2e0 2023-11-08T12:28:05.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3b59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c0c9130 con 0x7fec3c159f10 2023-11-08T12:28:05.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c06b840 con 0x7fec3c0c8c90 2023-11-08T12:28:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fec3c159f10 0x7fec3c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fec3c159f10 0x7fec3c070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54850/0 (socket says 172.21.15.112:54850) 2023-11-08T12:28:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 -- 172.21.15.112:0/3428390816 learned_addr learned my addr 172.21.15.112:0/3428390816 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec39d9b700 1 --2- 172.21.15.112:0/3428390816 >> v2:172.21.15.133:3300/0 conn(0x7fec3c0c8c90 0x7fec3c06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3959a700 1 -- 172.21.15.112:0/3428390816 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033808651 0 0) 0x7fec3c070600 con 0x7fec3c15a2e0 2023-11-08T12:28:05.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 -- 172.21.15.112:0/3428390816 >> v2:172.21.15.133:3300/0 conn(0x7fec3c0c8c90 msgr2=0x7fec3c06b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:05.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 --2- 172.21.15.112:0/3428390816 >> v2:172.21.15.133:3300/0 conn(0x7fec3c0c8c90 0x7fec3c06b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 -- 172.21.15.112:0/3428390816 >> v1:172.21.15.133:6789/0 conn(0x7fec3c15a2e0 legacy=0x7fec3c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 -- 172.21.15.112:0/3428390816 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c15adf0 con 0x7fec3c159f10 2023-11-08T12:28:05.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.969+0000 7fec3a59c700 1 --2- 172.21.15.112:0/3428390816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c070a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0c93e0 tx=0x7fec2c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2bd37fa5e810ca server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3959a700 1 -- 172.21.15.112:0/3428390816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c011830 con 0x7fec3c159f10 2023-11-08T12:28:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3959a700 1 -- 172.21.15.112:0/3428390816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c011990 con 0x7fec3c159f10 2023-11-08T12:28:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3959a700 1 -- 172.21.15.112:0/3428390816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c011d20 con 0x7fec3c159f10 2023-11-08T12:28:05.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 -- 172.21.15.112:0/3428390816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 msgr2=0x7fec3c070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 --2- 172.21.15.112:0/3428390816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c070a90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0c93e0 tx=0x7fec2c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 -- 172.21.15.112:0/3428390816 shutdown_connections 2023-11-08T12:28:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 --2- 172.21.15.112:0/3428390816 >> v2:172.21.15.133:3300/0 conn(0x7fec3c0c8c90 0x7fec3c06b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 --2- 172.21.15.112:0/3428390816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c070a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 -- 172.21.15.112:0/3428390816 >> 172.21.15.112:0/3428390816 conn(0x7fec3c0cf280 msgr2=0x7fec3c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 -- 172.21.15.112:0/3428390816 shutdown_connections 2023-11-08T12:28:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.973+0000 7fec3b59e700 1 -- 172.21.15.112:0/3428390816 wait complete. 2023-11-08T12:28:05.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 Processor -- start 2023-11-08T12:28:05.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 -- start start 2023-11-08T12:28:05.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec3c0c8c90 0x7fec3c0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3c15a2e0 0x7fec3c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0b3950 con 0x7fec3c159f10 2023-11-08T12:28:05.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c154d20 con 0x7fec3c15a2e0 2023-11-08T12:28:05.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c0b1a40 con 0x7fec3c0c8c90 2023-11-08T12:28:05.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c0b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54864/0 (socket says 172.21.15.112:54864) 2023-11-08T12:28:05.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 -- 172.21.15.112:0/1241502508 learned_addr learned my addr 172.21.15.112:0/1241502508 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:05.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3a59c700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec3c0c8c90 0x7fec3c0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec3ad9d700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3c15a2e0 0x7fec3c0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 -- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec3c0c8c90 msgr2=0x7fec3c0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec3c0c8c90 0x7fec3c0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 -- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3c15a2e0 msgr2=0x7fec3c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3c15a2e0 0x7fec3c0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.977+0000 7fec39d9b700 1 -- 172.21.15.112:0/1241502508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c009570 con 0x7fec3c159f10 2023-11-08T12:28:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.981+0000 7fec39d9b700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c0b3af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fec3000e9d0 tx=0x7fec3000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.981+0000 7fec2affd700 1 -- 172.21.15.112:0/1241502508 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec30009720 con 0x7fec3c159f10 2023-11-08T12:28:05.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.981+0000 7fec2affd700 1 -- 172.21.15.112:0/1241502508 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3000ee70 con 0x7fec3c159f10 2023-11-08T12:28:05.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.981+0000 7fec2affd700 1 -- 172.21.15.112:0/1241502508 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3000ca50 con 0x7fec3c159f10 2023-11-08T12:28:05.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.981+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c06ffb0 con 0x7fec3c159f10 2023-11-08T12:28:05.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.981+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c0afcc0 con 0x7fec3c159f10 2023-11-08T12:28:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.981+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c070290 con 0x7fec3c159f10 2023-11-08T12:28:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.985+0000 7fec2affd700 1 -- 172.21.15.112:0/1241502508 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fec30019030 con 0x7fec3c159f10 2023-11-08T12:28:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.985+0000 7fec2affd700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec1c064ee0 0x7fec1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.985+0000 7fec2affd700 1 -- 172.21.15.112:0/1241502508 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec30082110 con 0x7fec3c159f10 2023-11-08T12:28:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.985+0000 7fec3a59c700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec1c064ee0 0x7fec1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.985+0000 7fec3a59c700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec1c064ee0 0x7fec1c067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec2c000c00 tx=0x7fec2c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:05.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:05.993+0000 7fec2affd700 1 -- 172.21.15.112:0/1241502508 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fec3004fed0 con 0x7fec3c159f10 2023-11-08T12:28:06.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.169+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec3c06cf30 con 0x7fec3c159f10 2023-11-08T12:28:06.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec2affd700 1 -- 172.21.15.112:0/1241502508 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec300534f0 con 0x7fec3c159f10 2023-11-08T12:28:06.174 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:06.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec1c064ee0 msgr2=0x7fec1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec1c064ee0 0x7fec1c067390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec2c000c00 tx=0x7fec2c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:06.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 msgr2=0x7fec3c0b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c0b3af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fec3000e9d0 tx=0x7fec3000ece0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 shutdown_connections 2023-11-08T12:28:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec1c064ee0 0x7fec1c067390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3c15a2e0 0x7fec3c0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec3c159f10 0x7fec3c0b3af0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 --2- 172.21.15.112:0/1241502508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec3c0c8c90 0x7fec3c0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 >> 172.21.15.112:0/1241502508 conn(0x7fec3c0cf280 msgr2=0x7fec3c0c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 shutdown_connections 2023-11-08T12:28:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.173+0000 7fec3b59e700 1 -- 172.21.15.112:0/1241502508 wait complete. 2023-11-08T12:28:06.196 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:06.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.369+0000 7f0378e66700 1 Processor -- start 2023-11-08T12:28:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.369+0000 7f0378e66700 1 -- start start 2023-11-08T12:28:06.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0378e66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 0x7f03740b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0378e66700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740b65c0 con 0x7f037415c0f0 2023-11-08T12:28:06.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0378e66700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740b5c90 con 0x7f037406bbe0 2023-11-08T12:28:06.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0378e66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740b8c40 con 0x7f03740d35d0 2023-11-08T12:28:06.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03737fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f037415c0f0 0x7f03740b6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46794/0 (socket says 172.21.15.112:46794) 2023-11-08T12:28:06.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03737fe700 1 -- 172.21.15.112:0/2506304944 learned_addr learned my addr 172.21.15.112:0/2506304944 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:06.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0372ffd700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 0x7f03740b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993314407 0 0) 0x7f03740b65c0 con 0x7f037415c0f0 2023-11-08T12:28:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f035c0035d0 con 0x7f037415c0f0 2023-11-08T12:28:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2392948904 0 0) 0x7f035c0035d0 con 0x7f037415c0f0 2023-11-08T12:28:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 msgr2=0x7f03740b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 0x7f03740b85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 >> v1:172.21.15.133:6789/0 conn(0x7f037406bbe0 legacy=0x7f037415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740b5f70 con 0x7f037415c0f0 2023-11-08T12:28:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f0364001670 con 0x7f037415c0f0 2023-11-08T12:28:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 >> v1:172.21.15.112:6789/0 conn(0x7f037415c0f0 legacy=0x7f03740b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 0x7f035c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c003fd0 0x7f035c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c004db0 0x7f035c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740b8c40 con 0x7f035c004db0 2023-11-08T12:28:06.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00bb10 con 0x7f035c003fd0 2023-11-08T12:28:06.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00bcd0 con 0x7f03740d35d0 2023-11-08T12:28:06.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0373fff700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c004db0 0x7f035c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03737fe700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 0x7f035c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0372ffd700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c003fd0 0x7f035c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0373fff700 1 -- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 msgr2=0x7f035c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:06.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0373fff700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740d35d0 0x7f035c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0373fff700 1 -- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c003fd0 msgr2=0x7f035c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:06.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0373fff700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c003fd0 0x7f035c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0373fff700 1 -- 172.21.15.112:0/2506304944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0035d0 con 0x7f035c004db0 2023-11-08T12:28:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f0373fff700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c004db0 0x7f035c005220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c160 tx=0x7f035c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd7df44cda9455f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c001db0 con 0x7f035c004db0 2023-11-08T12:28:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00cca0 con 0x7f035c004db0 2023-11-08T12:28:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.373+0000 7f03727fc700 1 -- 172.21.15.112:0/2506304944 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c003c60 con 0x7f035c004db0 2023-11-08T12:28:06.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 -- 172.21.15.112:0/2506304944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c004db0 msgr2=0x7f035c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 --2- 172.21.15.112:0/2506304944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f035c004db0 0x7f035c005220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c160 tx=0x7f035c0058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0373fff700 1 -- 172.21.15.112:0/2506304944 reap_dead start 2023-11-08T12:28:06.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 -- 172.21.15.112:0/2506304944 shutdown_connections 2023-11-08T12:28:06.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 -- 172.21.15.112:0/2506304944 >> 172.21.15.112:0/2506304944 conn(0x7f03740d01d0 msgr2=0x7f03740d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:06.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 -- 172.21.15.112:0/2506304944 shutdown_connections 2023-11-08T12:28:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 -- 172.21.15.112:0/2506304944 wait complete. 2023-11-08T12:28:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 Processor -- start 2023-11-08T12:28:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.377+0000 7f0378e66700 1 -- start start 2023-11-08T12:28:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c004db0 0x7f03740c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740c9660 0x7f0374151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0374153dc0 0x7f0374154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740b7160 con 0x7f0374153dc0 2023-11-08T12:28:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740c85c0 con 0x7f035c004db0 2023-11-08T12:28:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740c88a0 con 0x7f03740c9660 2023-11-08T12:28:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0374153dc0 0x7f0374154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0374153dc0 0x7f0374154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54880/0 (socket says 172.21.15.112:54880) 2023-11-08T12:28:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 -- 172.21.15.112:0/3094282252 learned_addr learned my addr 172.21.15.112:0/3094282252 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f03737fe700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c004db0 0x7f03740c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0372ffd700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740c9660 0x7f0374151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 -- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740c9660 msgr2=0x7f0374151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740c9660 0x7f0374151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 -- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c004db0 msgr2=0x7f03740c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c004db0 0x7f03740c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 -- 172.21.15.112:0/3094282252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740b5170 con 0x7f0374153dc0 2023-11-08T12:28:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0373fff700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0374153dc0 0x7f0374154230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f036c001220 tx=0x7f036c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:06.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f035bfff700 1 -- 172.21.15.112:0/3094282252 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c003c30 con 0x7f0374153dc0 2023-11-08T12:28:06.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f035bfff700 1 -- 172.21.15.112:0/3094282252 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c003d90 con 0x7f0374153dc0 2023-11-08T12:28:06.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f035bfff700 1 -- 172.21.15.112:0/3094282252 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c005310 con 0x7f0374153dc0 2023-11-08T12:28:06.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03740b6250 con 0x7f0374153dc0 2023-11-08T12:28:06.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.381+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03740b85f0 con 0x7f0374153dc0 2023-11-08T12:28:06.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.385+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0374073cb0 con 0x7f0374153dc0 2023-11-08T12:28:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.385+0000 7f035bfff700 1 -- 172.21.15.112:0/3094282252 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f036c02e070 con 0x7f0374153dc0 2023-11-08T12:28:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.385+0000 7f035bfff700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0360064ee0 0x7f0360067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.385+0000 7f035bfff700 1 -- 172.21.15.112:0/3094282252 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f036c082ef0 con 0x7f0374153dc0 2023-11-08T12:28:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.389+0000 7f03737fe700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0360064ee0 0x7f0360067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.389+0000 7f03737fe700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0360064ee0 0x7f0360067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0364000f60 tx=0x7f0364007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:06.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.393+0000 7f035bfff700 1 -- 172.21.15.112:0/3094282252 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f036c050da0 con 0x7f0374153dc0 2023-11-08T12:28:06.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.561+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0374071210 con 0x7f0374153dc0 2023-11-08T12:28:06.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f035bfff700 1 -- 172.21.15.112:0/3094282252 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f036c0543c0 con 0x7f0374153dc0 2023-11-08T12:28:06.566 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:06.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0360064ee0 msgr2=0x7f0360067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0360064ee0 0x7f0360067390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0364000f60 tx=0x7f0364007040 comp rx=0 tx=0).stop 2023-11-08T12:28:06.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0374153dc0 msgr2=0x7f0374154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0374153dc0 0x7f0374154230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f036c001220 tx=0x7f036c0014a0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 shutdown_connections 2023-11-08T12:28:06.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0360064ee0 0x7f0360067390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0374153dc0 0x7f0374154230 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03740c9660 0x7f0374151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 --2- 172.21.15.112:0/3094282252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035c004db0 0x7f03740c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.565+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 >> 172.21.15.112:0/3094282252 conn(0x7f03740d01d0 msgr2=0x7f03741595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:06.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.569+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 shutdown_connections 2023-11-08T12:28:06.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.569+0000 7f0378e66700 1 -- 172.21.15.112:0/3094282252 wait complete. 2023-11-08T12:28:06.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:06.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.769+0000 7fe771b48700 1 Processor -- start 2023-11-08T12:28:06.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.769+0000 7fe771b48700 1 -- start start 2023-11-08T12:28:06.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe76c159f10 0x7fe76c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe76c0c8c90 0x7fe76c06b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c070600 con 0x7fe76c15a2e0 2023-11-08T12:28:06.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c0c9130 con 0x7fe76c159f10 2023-11-08T12:28:06.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c06b840 con 0x7fe76c0c8c90 2023-11-08T12:28:06.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe76c159f10 0x7fe76c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe76c159f10 0x7fe76c070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54882/0 (socket says 172.21.15.112:54882) 2023-11-08T12:28:06.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 -- 172.21.15.112:0/1090100922 learned_addr learned my addr 172.21.15.112:0/1090100922 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:06.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 -- 172.21.15.112:0/1090100922 >> v2:172.21.15.133:3300/0 conn(0x7fe76c0c8c90 msgr2=0x7fe76c06b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:06.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 --2- 172.21.15.112:0/1090100922 >> v2:172.21.15.133:3300/0 conn(0x7fe76c0c8c90 0x7fe76c06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 -- 172.21.15.112:0/1090100922 >> v1:172.21.15.133:6789/0 conn(0x7fe76c15a2e0 legacy=0x7fe76c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:06.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 -- 172.21.15.112:0/1090100922 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c15adf0 con 0x7fe76c159f10 2023-11-08T12:28:06.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe770b46700 1 --2- 172.21.15.112:0/1090100922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c070a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0c93e0 tx=0x7fe768009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b581bb65da8c0bb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:06.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe7637fe700 1 -- 172.21.15.112:0/1090100922 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768004230 con 0x7fe76c159f10 2023-11-08T12:28:06.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe7637fe700 1 -- 172.21.15.112:0/1090100922 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe768004390 con 0x7fe76c159f10 2023-11-08T12:28:06.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe7637fe700 1 -- 172.21.15.112:0/1090100922 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7680036c0 con 0x7fe76c159f10 2023-11-08T12:28:06.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 -- 172.21.15.112:0/1090100922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 msgr2=0x7fe76c070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 --2- 172.21.15.112:0/1090100922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c070a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0c93e0 tx=0x7fe768009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 -- 172.21.15.112:0/1090100922 shutdown_connections 2023-11-08T12:28:06.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 --2- 172.21.15.112:0/1090100922 >> v2:172.21.15.133:3300/0 conn(0x7fe76c0c8c90 0x7fe76c06b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 --2- 172.21.15.112:0/1090100922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c070a90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.773+0000 7fe771b48700 1 -- 172.21.15.112:0/1090100922 >> 172.21.15.112:0/1090100922 conn(0x7fe76c0cf280 msgr2=0x7fe76c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:06.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.777+0000 7fe771b48700 1 -- 172.21.15.112:0/1090100922 shutdown_connections 2023-11-08T12:28:06.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.777+0000 7fe771b48700 1 -- 172.21.15.112:0/1090100922 wait complete. 2023-11-08T12:28:06.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.777+0000 7fe771b48700 1 Processor -- start 2023-11-08T12:28:06.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.777+0000 7fe771b48700 1 -- start start 2023-11-08T12:28:06.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe76c0c8c90 0x7fe76c0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c15a2e0 0x7fe76c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0b1a80 con 0x7fe76c159f10 2023-11-08T12:28:06.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1f21a0 con 0x7fe76c15a2e0 2023-11-08T12:28:06.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0b3040 con 0x7fe76c0c8c90 2023-11-08T12:28:06.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c0b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54886/0 (socket says 172.21.15.112:54886) 2023-11-08T12:28:06.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 -- 172.21.15.112:0/1224159315 learned_addr learned my addr 172.21.15.112:0/1224159315 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:06.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe770b46700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe76c0c8c90 0x7fe76c0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771347700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c15a2e0 0x7fe76c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 -- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe76c0c8c90 msgr2=0x7fe76c0b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe76c0c8c90 0x7fe76c0b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 -- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c15a2e0 msgr2=0x7fe76c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c15a2e0 0x7fe76c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 -- 172.21.15.112:0/1224159315 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768009570 con 0x7fe76c159f10 2023-11-08T12:28:06.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771347700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c15a2e0 0x7fe76c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:06.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe763fff700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c0b3400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00b550 tx=0x7fe75c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe7617fa700 1 -- 172.21.15.112:0/1224159315 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011830 con 0x7fe76c159f10 2023-11-08T12:28:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe7617fa700 1 -- 172.21.15.112:0/1224159315 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c011990 con 0x7fe76c159f10 2023-11-08T12:28:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c06ffb0 con 0x7fe76c159f10 2023-11-08T12:28:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe7617fa700 1 -- 172.21.15.112:0/1224159315 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011d40 con 0x7fe76c159f10 2023-11-08T12:28:06.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.781+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c0afcc0 con 0x7fe76c159f10 2023-11-08T12:28:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.785+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c070290 con 0x7fe76c159f10 2023-11-08T12:28:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.785+0000 7fe7617fa700 1 -- 172.21.15.112:0/1224159315 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe75c021070 con 0x7fe76c159f10 2023-11-08T12:28:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.789+0000 7fe7617fa700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe758064ee0 0x7fe758067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.789+0000 7fe7617fa700 1 -- 172.21.15.112:0/1224159315 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe75c0821e0 con 0x7fe76c159f10 2023-11-08T12:28:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.789+0000 7fe770b46700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe758064ee0 0x7fe758067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.789+0000 7fe770b46700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe758064ee0 0x7fe758067390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0c93e0 tx=0x7fe768008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:06.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.793+0000 7fe7617fa700 1 -- 172.21.15.112:0/1224159315 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe75c04ff40 con 0x7fe76c159f10 2023-11-08T12:28:06.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.965+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe76c06cf30 con 0x7fe76c159f10 2023-11-08T12:28:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.965+0000 7fe7617fa700 1 -- 172.21.15.112:0/1224159315 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe75c053560 con 0x7fe76c159f10 2023-11-08T12:28:06.969 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe758064ee0 msgr2=0x7fe758067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe758064ee0 0x7fe758067390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0c93e0 tx=0x7fe768008030 comp rx=0 tx=0).stop 2023-11-08T12:28:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 msgr2=0x7fe76c0b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c0b3400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00b550 tx=0x7fe75c00b910 comp rx=0 tx=0).stop 2023-11-08T12:28:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 shutdown_connections 2023-11-08T12:28:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe758064ee0 0x7fe758067390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c15a2e0 0x7fe76c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c159f10 0x7fe76c0b3400 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 --2- 172.21.15.112:0/1224159315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe76c0c8c90 0x7fe76c0b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 >> 172.21.15.112:0/1224159315 conn(0x7fe76c0cf280 msgr2=0x7fe76c06c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 shutdown_connections 2023-11-08T12:28:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:06.969+0000 7fe771b48700 1 -- 172.21.15.112:0/1224159315 wait complete. 2023-11-08T12:28:06.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:07.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.173+0000 7f83d1220700 1 Processor -- start 2023-11-08T12:28:07.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.173+0000 7f83d1220700 1 -- start start 2023-11-08T12:28:07.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.173+0000 7f83d1220700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.173+0000 7f83d1220700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83cc069bf0 0x7f83cc06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.173+0000 7f83d1220700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc15c520 con 0x7f83cc15c150 2023-11-08T12:28:07.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.173+0000 7f83d1220700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0b4240 con 0x7f83cc069bf0 2023-11-08T12:28:07.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc06cc50 con 0x7f83cc070620 2023-11-08T12:28:07.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83cc069bf0 0x7f83cc06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f83cc069bf0 0x7f83cc06a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54898/0 (socket says 172.21.15.112:54898) 2023-11-08T12:28:07.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 -- 172.21.15.112:0/2165762181 learned_addr learned my addr 172.21.15.112:0/2165762181 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:07.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83c37fe700 1 --2- 172.21.15.112:0/2165762181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 -- 172.21.15.112:0/2165762181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 msgr2=0x7f83cc0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:07.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 --2- 172.21.15.112:0/2165762181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 -- 172.21.15.112:0/2165762181 >> v1:172.21.15.133:6789/0 conn(0x7f83cc15c150 legacy=0x7f83cc06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 -- 172.21.15.112:0/2165762181 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc0d2450 con 0x7f83cc069bf0 2023-11-08T12:28:07.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83c37fe700 1 --2- 172.21.15.112:0/2165762181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:07.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d0a1f700 1 --2- 172.21.15.112:0/2165762181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc06a050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e50 tx=0x7f83c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b724d0ecc78ff15 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:07.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83cb7fe700 1 -- 172.21.15.112:0/2165762181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400e070 con 0x7f83cc069bf0 2023-11-08T12:28:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83cb7fe700 1 -- 172.21.15.112:0/2165762181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400b9c0 con 0x7f83cc069bf0 2023-11-08T12:28:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83cb7fe700 1 -- 172.21.15.112:0/2165762181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400bd70 con 0x7f83cc069bf0 2023-11-08T12:28:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 -- 172.21.15.112:0/2165762181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 msgr2=0x7f83cc06a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 --2- 172.21.15.112:0/2165762181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc06a050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e50 tx=0x7f83c400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:07.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 -- 172.21.15.112:0/2165762181 shutdown_connections 2023-11-08T12:28:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 --2- 172.21.15.112:0/2165762181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc06a050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 --2- 172.21.15.112:0/2165762181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 -- 172.21.15.112:0/2165762181 >> 172.21.15.112:0/2165762181 conn(0x7f83cc0d3680 msgr2=0x7f83cc0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 -- 172.21.15.112:0/2165762181 shutdown_connections 2023-11-08T12:28:07.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.177+0000 7f83d1220700 1 -- 172.21.15.112:0/2165762181 wait complete. 2023-11-08T12:28:07.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.181+0000 7f83d1220700 1 Processor -- start 2023-11-08T12:28:07.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.181+0000 7f83d1220700 1 -- start start 2023-11-08T12:28:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc15c150 0x7f83cc0cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0cff90 con 0x7f83cc069bf0 2023-11-08T12:28:07.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0c9f50 con 0x7f83cc15c150 2023-11-08T12:28:07.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc150be0 con 0x7f83cc070620 2023-11-08T12:28:07.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc1506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54914/0 (socket says 172.21.15.112:54914) 2023-11-08T12:28:07.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 -- 172.21.15.112:0/131237517 learned_addr learned my addr 172.21.15.112:0/131237517 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:07.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83c37fe700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d0a1f700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc15c150 0x7f83cc0cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 -- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 msgr2=0x7f83cc0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 -- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc15c150 msgr2=0x7f83cc0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc15c150 0x7f83cc0cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 -- 172.21.15.112:0/131237517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009b30 con 0x7f83cc069bf0 2023-11-08T12:28:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83c37fe700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83cbfff700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc1506a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c500 tx=0x7f83bc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83c97fa700 1 -- 172.21.15.112:0/131237517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0052d0 con 0x7f83cc069bf0 2023-11-08T12:28:07.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83c97fa700 1 -- 172.21.15.112:0/131237517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc005430 con 0x7f83cc069bf0 2023-11-08T12:28:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc0d05e0 con 0x7f83cc069bf0 2023-11-08T12:28:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83c97fa700 1 -- 172.21.15.112:0/131237517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0055a0 con 0x7f83cc069bf0 2023-11-08T12:28:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.185+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc0d2730 con 0x7f83cc069bf0 2023-11-08T12:28:07.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.189+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc0d2140 con 0x7f83cc069bf0 2023-11-08T12:28:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.189+0000 7f83c97fa700 1 -- 172.21.15.112:0/131237517 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f83bc019030 con 0x7f83cc069bf0 2023-11-08T12:28:07.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.193+0000 7f83c97fa700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83ac064f10 0x7f83ac0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.193+0000 7f83c97fa700 1 -- 172.21.15.112:0/131237517 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83bc081430 con 0x7f83cc069bf0 2023-11-08T12:28:07.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.193+0000 7f83c37fe700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83ac064f10 0x7f83ac0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.193+0000 7f83c37fe700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83ac064f10 0x7f83ac0673c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0cc990 tx=0x7f83b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:07.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.197+0000 7f83c97fa700 1 -- 172.21.15.112:0/131237517 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f83bc04f1f0 con 0x7f83cc069bf0 2023-11-08T12:28:07.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:28:07.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:28:07.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.373+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f83cc073d20 con 0x7f83cc069bf0 2023-11-08T12:28:07.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.373+0000 7f83c97fa700 1 -- 172.21.15.112:0/131237517 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f83bc052810 con 0x7f83cc069bf0 2023-11-08T12:28:07.375 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:07.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.373+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83ac064f10 msgr2=0x7f83ac0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.373+0000 7f83d1220700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83ac064f10 0x7f83ac0673c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0cc990 tx=0x7f83b4008040 comp rx=0 tx=0).stop 2023-11-08T12:28:07.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.373+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 msgr2=0x7f83cc1506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.373+0000 7f83d1220700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc1506a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c500 tx=0x7f83bc00c810 comp rx=0 tx=0).stop 2023-11-08T12:28:07.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 shutdown_connections 2023-11-08T12:28:07.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83ac064f10 0x7f83ac0673c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc15c150 0x7f83cc0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc070620 0x7f83cc0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 --2- 172.21.15.112:0/131237517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83cc069bf0 0x7f83cc1506a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 >> 172.21.15.112:0/131237517 conn(0x7f83cc0d3680 msgr2=0x7f83cc155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:07.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 shutdown_connections 2023-11-08T12:28:07.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.377+0000 7f83d1220700 1 -- 172.21.15.112:0/131237517 wait complete. 2023-11-08T12:28:07.401 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:28:07.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.613+0000 7ff39b59e700 1 Processor -- start 2023-11-08T12:28:07.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.613+0000 7ff39b59e700 1 -- start start 2023-11-08T12:28:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.613+0000 7ff39b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff39c15c650 0x7ff39c06b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.613+0000 7ff39b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c0cd0d0 0x7ff39c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.613+0000 7ff39b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39c0c9d40 con 0x7ff39c0b1b80 2023-11-08T12:28:07.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.613+0000 7ff39b59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39c06b140 con 0x7ff39c15c650 2023-11-08T12:28:07.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.613+0000 7ff39b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c06b820 con 0x7ff39c0cd0d0 2023-11-08T12:28:07.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff39c15c650 0x7ff39c06b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39ad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff39c0b1b80 0x7ff39c06bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:35666/0 (socket says 172.21.15.112:35666) 2023-11-08T12:28:07.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39ad9d700 1 -- 172.21.15.112:0/1081581836 learned_addr learned my addr 172.21.15.112:0/1081581836 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:07.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff393fff700 1 --2- 172.21.15.112:0/1081581836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c0cd0d0 0x7ff39c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39a59c700 1 -- 172.21.15.112:0/1081581836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c0cd0d0 msgr2=0x7ff39c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:07.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff399d9b700 1 -- 172.21.15.112:0/1081581836 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475315709 0 0) 0x7ff39c0c9d40 con 0x7ff39c0b1b80 2023-11-08T12:28:07.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39a59c700 1 --2- 172.21.15.112:0/1081581836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c0cd0d0 0x7ff39c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39a59c700 1 -- 172.21.15.112:0/1081581836 >> v1:172.21.15.133:6789/0 conn(0x7ff39c0b1b80 legacy=0x7ff39c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39a59c700 1 -- 172.21.15.112:0/1081581836 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c0cd5d0 con 0x7ff39c15c650 2023-11-08T12:28:07.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39a59c700 1 --2- 172.21.15.112:0/1081581836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c15c650 0x7ff39c06b2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009850 tx=0x7ff38c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2db8209471e530 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:07.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff399d9b700 1 -- 172.21.15.112:0/1081581836 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011830 con 0x7ff39c15c650 2023-11-08T12:28:07.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff399d9b700 1 -- 172.21.15.112:0/1081581836 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c011990 con 0x7ff39c15c650 2023-11-08T12:28:07.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff399d9b700 1 -- 172.21.15.112:0/1081581836 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c011d40 con 0x7ff39c15c650 2023-11-08T12:28:07.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 -- 172.21.15.112:0/1081581836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c15c650 msgr2=0x7ff39c06b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 --2- 172.21.15.112:0/1081581836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c15c650 0x7ff39c06b2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009850 tx=0x7ff38c009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 -- 172.21.15.112:0/1081581836 shutdown_connections 2023-11-08T12:28:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 --2- 172.21.15.112:0/1081581836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c0cd0d0 0x7ff39c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 --2- 172.21.15.112:0/1081581836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c15c650 0x7ff39c06b2e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 -- 172.21.15.112:0/1081581836 >> 172.21.15.112:0/1081581836 conn(0x7ff39c0b0f80 msgr2=0x7ff39c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 -- 172.21.15.112:0/1081581836 shutdown_connections 2023-11-08T12:28:07.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.617+0000 7ff39b59e700 1 -- 172.21.15.112:0/1081581836 wait complete. 2023-11-08T12:28:07.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.621+0000 7ff39b59e700 1 Processor -- start 2023-11-08T12:28:07.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.621+0000 7ff39b59e700 1 -- start start 2023-11-08T12:28:07.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c0b1b80 0x7ff39c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0cd0d0 0x7ff39c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c15c650 0x7ff39c0c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c0c7670 con 0x7ff39c0b1b80 2023-11-08T12:28:07.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c1575b0 con 0x7ff39c0cd0d0 2023-11-08T12:28:07.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c157850 con 0x7ff39c15c650 2023-11-08T12:28:07.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c0b1b80 0x7ff39c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c0b1b80 0x7ff39c151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54934/0 (socket says 172.21.15.112:54934) 2023-11-08T12:28:07.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 -- 172.21.15.112:0/4113441088 learned_addr learned my addr 172.21.15.112:0/4113441088 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:07.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39ad9d700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c15c650 0x7ff39c0c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff393fff700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0cd0d0 0x7ff39c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 -- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c15c650 msgr2=0x7ff39c0c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c15c650 0x7ff39c0c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 -- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0cd0d0 msgr2=0x7ff39c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0cd0d0 0x7ff39c155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 -- 172.21.15.112:0/4113441088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0094b0 con 0x7ff39c0b1b80 2023-11-08T12:28:07.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39a59c700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c0b1b80 0x7ff39c151d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009ba0 tx=0x7ff38c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:07.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff392ffd700 1 -- 172.21.15.112:0/4113441088 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c004610 con 0x7ff39c0b1b80 2023-11-08T12:28:07.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff392ffd700 1 -- 172.21.15.112:0/4113441088 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c01f070 con 0x7ff39c0b1b80 2023-11-08T12:28:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff392ffd700 1 -- 172.21.15.112:0/4113441088 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0038e0 con 0x7ff39c0b1b80 2023-11-08T12:28:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c0c99d0 con 0x7ff39c0b1b80 2023-11-08T12:28:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.625+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c0cd8b0 con 0x7ff39c0b1b80 2023-11-08T12:28:07.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.629+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c0c9680 con 0x7ff39c0b1b80 2023-11-08T12:28:07.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.629+0000 7ff392ffd700 1 -- 172.21.15.112:0/4113441088 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff38c00f050 con 0x7ff39c0b1b80 2023-11-08T12:28:07.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.629+0000 7ff392ffd700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064f10 0x7ff37c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:07.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.629+0000 7ff392ffd700 1 -- 172.21.15.112:0/4113441088 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff38c021070 con 0x7ff39c0b1b80 2023-11-08T12:28:07.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.629+0000 7ff393fff700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064f10 0x7ff37c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:07.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.633+0000 7ff393fff700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064f10 0x7ff37c0673c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0b0280 tx=0x7ff384009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.637+0000 7ff392ffd700 1 -- 172.21.15.112:0/4113441088 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff38c051130 con 0x7ff39c0b1b80 2023-11-08T12:28:07.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.821+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff39c0c74b0 con 0x7ff39c0b1b80 2023-11-08T12:28:07.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.821+0000 7ff392ffd700 1 -- 172.21.15.112:0/4113441088 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff38c054750 con 0x7ff39c0b1b80 2023-11-08T12:28:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064f10 msgr2=0x7ff37c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064f10 0x7ff37c0673c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0b0280 tx=0x7ff384009240 comp rx=0 tx=0).stop 2023-11-08T12:28:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c0b1b80 msgr2=0x7ff39c151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c0b1b80 0x7ff39c151d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009ba0 tx=0x7ff38c004770 comp rx=0 tx=0).stop 2023-11-08T12:28:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 shutdown_connections 2023-11-08T12:28:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064f10 0x7ff37c0673c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff39c15c650 0x7ff39c0c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0cd0d0 0x7ff39c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 --2- 172.21.15.112:0/4113441088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff39c0b1b80 0x7ff39c151d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 >> 172.21.15.112:0/4113441088 conn(0x7ff39c0b0f80 msgr2=0x7ff39c0ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 shutdown_connections 2023-11-08T12:28:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:07.825+0000 7ff39b59e700 1 -- 172.21.15.112:0/4113441088 wait complete. 2023-11-08T12:28:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:28:07.847 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:07.848 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:07.863 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:08.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.089+0000 7f887f274700 1 Processor -- start 2023-11-08T12:28:08.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.089+0000 7f887f274700 1 -- start start 2023-11-08T12:28:08.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887f274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780b43a0 0x7f887815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887f274700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88780b1640 0x7f8878070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887f274700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887815a550 con 0x7f88780c9040 2023-11-08T12:28:08.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887f274700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887806b0a0 con 0x7f88780b1640 2023-11-08T12:28:08.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887f274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780caac0 con 0x7f88780b43a0 2023-11-08T12:28:08.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887ea73700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f88780c9040 0x7f8878069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46804/0 (socket says 172.21.15.112:46804) 2023-11-08T12:28:08.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887ea73700 1 -- 172.21.15.112:0/1313802672 learned_addr learned my addr 172.21.15.112:0/1313802672 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:08.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887e272700 1 --2- 172.21.15.112:0/1313802672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780b43a0 0x7f887815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887da71700 1 --2- 172.21.15.112:0/1313802672 >> v2:172.21.15.133:3300/0 conn(0x7f88780b1640 0x7f8878070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887e272700 1 -- 172.21.15.112:0/1313802672 >> v2:172.21.15.133:3300/0 conn(0x7f88780b1640 msgr2=0x7f8878070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:08.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887e272700 1 --2- 172.21.15.112:0/1313802672 >> v2:172.21.15.133:3300/0 conn(0x7f88780b1640 0x7f8878070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887e272700 1 -- 172.21.15.112:0/1313802672 >> v1:172.21.15.112:6789/0 conn(0x7f88780c9040 legacy=0x7f8878069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887e272700 1 -- 172.21.15.112:0/1313802672 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780cada0 con 0x7f88780b43a0 2023-11-08T12:28:08.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887d270700 1 -- 172.21.15.112:0/1313802672 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229092874 0 0) 0x7f8870001110 con 0x7f88780c9040 2023-11-08T12:28:08.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.093+0000 7f887e272700 1 --2- 172.21.15.112:0/1313802672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780b43a0 0x7f887815e5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8874009d90 tx=0x7f887400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd87552449b3bdc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887d270700 1 -- 172.21.15.112:0/1313802672 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887400e070 con 0x7f88780b43a0 2023-11-08T12:28:08.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887d270700 1 -- 172.21.15.112:0/1313802672 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887400bb20 con 0x7f88780b43a0 2023-11-08T12:28:08.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887d270700 1 -- 172.21.15.112:0/1313802672 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874012430 con 0x7f88780b43a0 2023-11-08T12:28:08.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 -- 172.21.15.112:0/1313802672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780b43a0 msgr2=0x7f887815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 --2- 172.21.15.112:0/1313802672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780b43a0 0x7f887815e5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8874009d90 tx=0x7f887400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 -- 172.21.15.112:0/1313802672 shutdown_connections 2023-11-08T12:28:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 --2- 172.21.15.112:0/1313802672 >> v2:172.21.15.133:3300/0 conn(0x7f88780b1640 0x7f8878070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 --2- 172.21.15.112:0/1313802672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780b43a0 0x7f887815e5d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 -- 172.21.15.112:0/1313802672 >> 172.21.15.112:0/1313802672 conn(0x7f88780b0f80 msgr2=0x7f88780ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 -- 172.21.15.112:0/1313802672 shutdown_connections 2023-11-08T12:28:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.097+0000 7f887f274700 1 -- 172.21.15.112:0/1313802672 wait complete. 2023-11-08T12:28:08.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 Processor -- start 2023-11-08T12:28:08.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 -- start start 2023-11-08T12:28:08.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88780b1640 0x7f88781493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88780b43a0 0x7f887814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780c9040 0x7f88780cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780b2760 con 0x7f88780b43a0 2023-11-08T12:28:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780b2a40 con 0x7f88780b1640 2023-11-08T12:28:08.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887f274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887815c190 con 0x7f88780c9040 2023-11-08T12:28:08.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88780b43a0 0x7f887814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88780b43a0 0x7f887814b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54936/0 (socket says 172.21.15.112:54936) 2023-11-08T12:28:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 -- 172.21.15.112:0/1500620880 learned_addr learned my addr 172.21.15.112:0/1500620880 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887e272700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88780b1640 0x7f88781493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887ea73700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780c9040 0x7f88780cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 -- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780c9040 msgr2=0x7f88780cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780c9040 0x7f88780cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 -- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88780b1640 msgr2=0x7f88781493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88780b1640 0x7f88781493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 -- 172.21.15.112:0/1500620880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8874009a70 con 0x7f88780b43a0 2023-11-08T12:28:08.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887ea73700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780c9040 0x7f88780cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:08.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f887da71700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88780b43a0 0x7f887814b1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f886800e840 tx=0x7f886800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f886effd700 1 -- 172.21.15.112:0/1500620880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680095a0 con 0x7f88780b43a0 2023-11-08T12:28:08.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.101+0000 7f886effd700 1 -- 172.21.15.112:0/1500620880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868013680 con 0x7f88780b43a0 2023-11-08T12:28:08.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.105+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887806b5d0 con 0x7f88780b43a0 2023-11-08T12:28:08.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.105+0000 7f886effd700 1 -- 172.21.15.112:0/1500620880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680139f0 con 0x7f88780b43a0 2023-11-08T12:28:08.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.105+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887806b2f0 con 0x7f88780b43a0 2023-11-08T12:28:08.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.105+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887815eb10 con 0x7f88780b43a0 2023-11-08T12:28:08.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.105+0000 7f886effd700 1 -- 172.21.15.112:0/1500620880 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8868019030 con 0x7f88780b43a0 2023-11-08T12:28:08.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.109+0000 7f886effd700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f885c064ee0 0x7f885c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.109+0000 7f886effd700 1 -- 172.21.15.112:0/1500620880 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8868081f10 con 0x7f88780b43a0 2023-11-08T12:28:08.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.109+0000 7f887e272700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f885c064ee0 0x7f885c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.109+0000 7f887e272700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f885c064ee0 0x7f885c067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8874014040 tx=0x7f8874011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.113+0000 7f886effd700 1 -- 172.21.15.112:0/1500620880 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f886804fdc0 con 0x7f88780b43a0 2023-11-08T12:28:08.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.293+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8878073cb0 con 0x7f88780b43a0 2023-11-08T12:28:08.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.293+0000 7f886effd700 1 -- 172.21.15.112:0/1500620880 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7f88680533e0 con 0x7f88780b43a0 2023-11-08T12:28:08.298 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:08.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f885c064ee0 msgr2=0x7f885c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f885c064ee0 0x7f885c067390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8874014040 tx=0x7f8874011000 comp rx=0 tx=0).stop 2023-11-08T12:28:08.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88780b43a0 msgr2=0x7f887814b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88780b43a0 0x7f887814b1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f886800e840 tx=0x7f886800eb50 comp rx=0 tx=0).stop 2023-11-08T12:28:08.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 shutdown_connections 2023-11-08T12:28:08.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f885c064ee0 0x7f885c067390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88780c9040 0x7f88780cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88780b43a0 0x7f887814b1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 --2- 172.21.15.112:0/1500620880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88780b1640 0x7f88781493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 >> 172.21.15.112:0/1500620880 conn(0x7f88780b0f80 msgr2=0x7f88781585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 shutdown_connections 2023-11-08T12:28:08.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.297+0000 7f887f274700 1 -- 172.21.15.112:0/1500620880 wait complete. 2023-11-08T12:28:08.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:08.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 Processor -- start 2023-11-08T12:28:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 -- start start 2023-11-08T12:28:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed415c150 0x7efed40b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed406ff10 0x7efed4070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efed415fc30 0x7efed41600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40b4240 con 0x7efed415fc30 2023-11-08T12:28:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed415c520 con 0x7efed415c150 2023-11-08T12:28:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.525+0000 7efed359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed40708a0 con 0x7efed406ff10 2023-11-08T12:28:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efed415fc30 0x7efed41600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed1d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed406ff10 0x7efed4070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed1d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed406ff10 0x7efed4070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:57994/0 (socket says 172.21.15.112:57994) 2023-11-08T12:28:08.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed1d9b700 1 -- 172.21.15.112:0/539716977 learned_addr learned my addr 172.21.15.112:0/539716977 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed415c150 0x7efed40b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efed415fc30 0x7efed41600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54948/0 (socket says 172.21.15.112:54948) 2023-11-08T12:28:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 -- 172.21.15.112:0/539716977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed406ff10 msgr2=0x7efed4070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 --2- 172.21.15.112:0/539716977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed406ff10 0x7efed4070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 -- 172.21.15.112:0/539716977 >> v2:172.21.15.133:3300/0 conn(0x7efed415c150 msgr2=0x7efed40b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 --2- 172.21.15.112:0/539716977 >> v2:172.21.15.133:3300/0 conn(0x7efed415c150 0x7efed40b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 -- 172.21.15.112:0/539716977 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed406cc50 con 0x7efed415fc30 2023-11-08T12:28:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed2d9d700 1 --2- 172.21.15.112:0/539716977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed415fc30 0x7efed41600b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efed4071900 tx=0x7efecc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb68fd4f65fe457 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed159a700 1 -- 172.21.15.112:0/539716977 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00e070 con 0x7efed415fc30 2023-11-08T12:28:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed159a700 1 -- 172.21.15.112:0/539716977 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc00bae0 con 0x7efed415fc30 2023-11-08T12:28:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed159a700 1 -- 172.21.15.112:0/539716977 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00be90 con 0x7efed415fc30 2023-11-08T12:28:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed359e700 1 -- 172.21.15.112:0/539716977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed415fc30 msgr2=0x7efed41600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.529+0000 7efed359e700 1 --2- 172.21.15.112:0/539716977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed415fc30 0x7efed41600b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efed4071900 tx=0x7efecc00b330 comp rx=0 tx=0).stop 2023-11-08T12:28:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 -- 172.21.15.112:0/539716977 shutdown_connections 2023-11-08T12:28:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 --2- 172.21.15.112:0/539716977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed406ff10 0x7efed4070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 --2- 172.21.15.112:0/539716977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed415fc30 0x7efed41600b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 --2- 172.21.15.112:0/539716977 >> v2:172.21.15.133:3300/0 conn(0x7efed415c150 0x7efed40b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 -- 172.21.15.112:0/539716977 >> 172.21.15.112:0/539716977 conn(0x7efed40d3680 msgr2=0x7efed40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 -- 172.21.15.112:0/539716977 shutdown_connections 2023-11-08T12:28:08.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 -- 172.21.15.112:0/539716977 wait complete. 2023-11-08T12:28:08.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 Processor -- start 2023-11-08T12:28:08.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.533+0000 7efed359e700 1 -- start start 2023-11-08T12:28:08.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed406ff10 0x7efed41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed415c150 0x7efed4158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed415fc30 0x7efed4157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4157e60 con 0x7efed406ff10 2023-11-08T12:28:08.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4156880 con 0x7efed415c150 2023-11-08T12:28:08.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed4156b60 con 0x7efed415fc30 2023-11-08T12:28:08.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed406ff10 0x7efed41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed406ff10 0x7efed41561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54956/0 (socket says 172.21.15.112:54956) 2023-11-08T12:28:08.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 -- 172.21.15.112:0/618410955 learned_addr learned my addr 172.21.15.112:0/618410955 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:08.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed2d9d700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed415fc30 0x7efed4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed1d9b700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed415c150 0x7efed4158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 -- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed415fc30 msgr2=0x7efed4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed415fc30 0x7efed4157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 -- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed415c150 msgr2=0x7efed4158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed415c150 0x7efed4158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 -- 172.21.15.112:0/618410955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc009a70 con 0x7efed406ff10 2023-11-08T12:28:08.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed2d9d700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed415fc30 0x7efed4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:08.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed1d9b700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed415c150 0x7efed4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:08.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed259c700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed406ff10 0x7efed41561c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efec400e9d0 tx=0x7efec400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efec2ffd700 1 -- 172.21.15.112:0/618410955 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4009720 con 0x7efed406ff10 2023-11-08T12:28:08.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efec2ffd700 1 -- 172.21.15.112:0/618410955 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400c850 con 0x7efed406ff10 2023-11-08T12:28:08.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed40d2730 con 0x7efed406ff10 2023-11-08T12:28:08.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efec2ffd700 1 -- 172.21.15.112:0/618410955 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400cbc0 con 0x7efed406ff10 2023-11-08T12:28:08.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.537+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed40d2450 con 0x7efed406ff10 2023-11-08T12:28:08.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.541+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed40d05e0 con 0x7efed406ff10 2023-11-08T12:28:08.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.541+0000 7efec2ffd700 1 -- 172.21.15.112:0/618410955 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efec4019030 con 0x7efed406ff10 2023-11-08T12:28:08.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.545+0000 7efec2ffd700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb4064ee0 0x7efeb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.545+0000 7efec2ffd700 1 -- 172.21.15.112:0/618410955 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efec40822a0 con 0x7efed406ff10 2023-11-08T12:28:08.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.545+0000 7efed1d9b700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb4064ee0 0x7efeb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.545+0000 7efed1d9b700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb4064ee0 0x7efeb4067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efed415af90 tx=0x7efec8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.549+0000 7efec2ffd700 1 -- 172.21.15.112:0/618410955 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efec4050060 con 0x7efed406ff10 2023-11-08T12:28:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.721+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efed4073d20 con 0x7efed406ff10 2023-11-08T12:28:08.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.721+0000 7efec2ffd700 1 -- 172.21.15.112:0/618410955 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7efec4053680 con 0x7efed406ff10 2023-11-08T12:28:08.726 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:08.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.725+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb4064ee0 msgr2=0x7efeb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.725+0000 7efed359e700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb4064ee0 0x7efeb4067390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efed415af90 tx=0x7efec8008040 comp rx=0 tx=0).stop 2023-11-08T12:28:08.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.725+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed406ff10 msgr2=0x7efed41561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.725+0000 7efed359e700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed406ff10 0x7efed41561c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efec400e9d0 tx=0x7efec400ed90 comp rx=0 tx=0).stop 2023-11-08T12:28:08.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 shutdown_connections 2023-11-08T12:28:08.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb4064ee0 0x7efeb4067390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed415fc30 0x7efed4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed415c150 0x7efed4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 --2- 172.21.15.112:0/618410955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efed406ff10 0x7efed41561c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 >> 172.21.15.112:0/618410955 conn(0x7efed40d3680 msgr2=0x7efed40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 shutdown_connections 2023-11-08T12:28:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.729+0000 7efed359e700 1 -- 172.21.15.112:0/618410955 wait complete. 2023-11-08T12:28:08.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:08.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.929+0000 7f2626a20700 1 Processor -- start 2023-11-08T12:28:08.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.929+0000 7f2626a20700 1 -- start start 2023-11-08T12:28:08.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2626a20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f26200b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2626a20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f262006ff10 0x7f2620070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2626a20700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262015c520 con 0x7f262015fc30 2023-11-08T12:28:08.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2626a20700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26200b4240 con 0x7f262006ff10 2023-11-08T12:28:08.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2626a20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200708a0 con 0x7f262015c150 2023-11-08T12:28:08.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f262621f700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f262015fc30 0x7f26201600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46816/0 (socket says 172.21.15.112:46816) 2023-11-08T12:28:08.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f262621f700 1 -- 172.21.15.112:0/3070570762 learned_addr learned my addr 172.21.15.112:0/3070570762 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:08.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2625a1e700 1 --2- 172.21.15.112:0/3070570762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f26200b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f262521d700 1 --2- 172.21.15.112:0/3070570762 >> v2:172.21.15.133:3300/0 conn(0x7f262006ff10 0x7f2620070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2625a1e700 1 -- 172.21.15.112:0/3070570762 >> v2:172.21.15.133:3300/0 conn(0x7f262006ff10 msgr2=0x7f2620070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:08.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2625a1e700 1 --2- 172.21.15.112:0/3070570762 >> v2:172.21.15.133:3300/0 conn(0x7f262006ff10 0x7f2620070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2625a1e700 1 -- 172.21.15.112:0/3070570762 >> v1:172.21.15.112:6789/0 conn(0x7f262015fc30 legacy=0x7f26201600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2625a1e700 1 -- 172.21.15.112:0/3070570762 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262006ac00 con 0x7f262015c150 2023-11-08T12:28:08.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2624a1c700 1 -- 172.21.15.112:0/3070570762 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826474229 0 0) 0x7f262015c520 con 0x7f262015fc30 2023-11-08T12:28:08.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2625a1e700 1 --2- 172.21.15.112:0/3070570762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f26200b3d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f261c009850 tx=0x7f261c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70499aa79f6c2657 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2624a1c700 1 -- 172.21.15.112:0/3070570762 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c011830 con 0x7f262015c150 2023-11-08T12:28:08.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2624a1c700 1 -- 172.21.15.112:0/3070570762 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c011990 con 0x7f262015c150 2023-11-08T12:28:08.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.933+0000 7f2624a1c700 1 -- 172.21.15.112:0/3070570762 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c011d40 con 0x7f262015c150 2023-11-08T12:28:08.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 -- 172.21.15.112:0/3070570762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 msgr2=0x7f26200b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 --2- 172.21.15.112:0/3070570762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f26200b3d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f261c009850 tx=0x7f261c009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:08.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 -- 172.21.15.112:0/3070570762 shutdown_connections 2023-11-08T12:28:08.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 --2- 172.21.15.112:0/3070570762 >> v2:172.21.15.133:3300/0 conn(0x7f262006ff10 0x7f2620070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 --2- 172.21.15.112:0/3070570762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f26200b3d00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 -- 172.21.15.112:0/3070570762 >> 172.21.15.112:0/3070570762 conn(0x7f26200d3680 msgr2=0x7f26200cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:08.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 -- 172.21.15.112:0/3070570762 shutdown_connections 2023-11-08T12:28:08.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 -- 172.21.15.112:0/3070570762 wait complete. 2023-11-08T12:28:08.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 Processor -- start 2023-11-08T12:28:08.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.937+0000 7f2626a20700 1 -- start start 2023-11-08T12:28:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f262006ff10 0x7f26200cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f262015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262015fc30 0x7f26200cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262015b470 con 0x7f262015fc30 2023-11-08T12:28:08.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200b38c0 con 0x7f262006ff10 2023-11-08T12:28:08.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200cf9d0 con 0x7f262015c150 2023-11-08T12:28:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262015fc30 0x7f26200cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262521d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f262015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262015fc30 0x7f26200cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54970/0 (socket says 172.21.15.112:54970) 2023-11-08T12:28:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 -- 172.21.15.112:0/1453508692 learned_addr learned my addr 172.21.15.112:0/1453508692 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:08.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2625a1e700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f262006ff10 0x7f26200cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 -- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 msgr2=0x7f262015af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f262015af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 -- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f262006ff10 msgr2=0x7f26200cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:08.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f262006ff10 0x7f26200cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:08.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 -- 172.21.15.112:0/1453508692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0094b0 con 0x7f262015fc30 2023-11-08T12:28:08.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262521d700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f262015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:08.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f262621f700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262015fc30 0x7f26200cf490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f261800cba0 tx=0x7f261800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f26167fc700 1 -- 172.21.15.112:0/1453508692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800aaa0 con 0x7f262015fc30 2023-11-08T12:28:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f26167fc700 1 -- 172.21.15.112:0/1453508692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800ac20 con 0x7f262015fc30 2023-11-08T12:28:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26200d2450 con 0x7f262015fc30 2023-11-08T12:28:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f26167fc700 1 -- 172.21.15.112:0/1453508692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180070d0 con 0x7f262015fc30 2023-11-08T12:28:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.941+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262006cc50 con 0x7f262015fc30 2023-11-08T12:28:08.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.945+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26200d2730 con 0x7f262015fc30 2023-11-08T12:28:08.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.945+0000 7f26167fc700 1 -- 172.21.15.112:0/1453508692 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2618010070 con 0x7f262015fc30 2023-11-08T12:28:08.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.949+0000 7f26167fc700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2604064ee0 0x7f2604067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:08.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.949+0000 7f26167fc700 1 -- 172.21.15.112:0/1453508692 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2618081aa0 con 0x7f262015fc30 2023-11-08T12:28:08.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.949+0000 7f2625a1e700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2604064ee0 0x7f2604067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.949+0000 7f2625a1e700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2604064ee0 0x7f2604067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f261c0097a0 tx=0x7f261c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:08.953+0000 7f26167fc700 1 -- 172.21.15.112:0/1453508692 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f261804f950 con 0x7f262015fc30 2023-11-08T12:28:09.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.125+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2620073d20 con 0x7f262015fc30 2023-11-08T12:28:09.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.125+0000 7f26167fc700 1 -- 172.21.15.112:0/1453508692 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f26180180a0 con 0x7f262015fc30 2023-11-08T12:28:09.128 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:09.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2604064ee0 msgr2=0x7f2604067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2604064ee0 0x7f2604067390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f261c0097a0 tx=0x7f261c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:09.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262015fc30 msgr2=0x7f26200cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262015fc30 0x7f26200cf490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f261800cba0 tx=0x7f261800ceb0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 shutdown_connections 2023-11-08T12:28:09.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2604064ee0 0x7f2604067390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f262015fc30 0x7f26200cf490 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f262015c150 0x7f262015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 --2- 172.21.15.112:0/1453508692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f262006ff10 0x7f26200cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 >> 172.21.15.112:0/1453508692 conn(0x7f26200d3680 msgr2=0x7f2620160090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:09.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 shutdown_connections 2023-11-08T12:28:09.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.129+0000 7f2626a20700 1 -- 172.21.15.112:0/1453508692 wait complete. 2023-11-08T12:28:09.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:09.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.325+0000 7fe2c9451700 1 Processor -- start 2023-11-08T12:28:09.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.325+0000 7fe2c9451700 1 -- start start 2023-11-08T12:28:09.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2c415c700 0x7fe2c40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c4070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c406ac00 con 0x7fe2c40b1be0 2023-11-08T12:28:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c40cd360 con 0x7fe2c415c700 2023-11-08T12:28:09.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4160190 con 0x7fe2c40b2130 2023-11-08T12:28:09.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2c415c700 0x7fe2c40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe2c415c700 0x7fe2c40702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54976/0 (socket says 172.21.15.112:54976) 2023-11-08T12:28:09.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 -- 172.21.15.112:0/1822151425 learned_addr learned my addr 172.21.15.112:0/1822151425 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:09.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c27fc700 1 --2- 172.21.15.112:0/1822151425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c4070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 -- 172.21.15.112:0/1822151425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 msgr2=0x7fe2c4070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:09.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 --2- 172.21.15.112:0/1822151425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c4070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 -- 172.21.15.112:0/1822151425 >> v1:172.21.15.133:6789/0 conn(0x7fe2c40b1be0 legacy=0x7fe2c406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 -- 172.21.15.112:0/1822151425 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4160470 con 0x7fe2c415c700 2023-11-08T12:28:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c2ffd700 1 --2- 172.21.15.112:0/1822151425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40702f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009910 tx=0x7fe2b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5aaf4963e9722aa server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c1ffb700 1 -- 172.21.15.112:0/1822151425 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400ba60 con 0x7fe2c415c700 2023-11-08T12:28:09.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c1ffb700 1 -- 172.21.15.112:0/1822151425 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b400bbc0 con 0x7fe2c415c700 2023-11-08T12:28:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c1ffb700 1 -- 172.21.15.112:0/1822151425 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4009e60 con 0x7fe2c415c700 2023-11-08T12:28:09.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- 172.21.15.112:0/1822151425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 msgr2=0x7fe2c40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 --2- 172.21.15.112:0/1822151425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40702f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009910 tx=0x7fe2b4009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- 172.21.15.112:0/1822151425 shutdown_connections 2023-11-08T12:28:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 --2- 172.21.15.112:0/1822151425 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c4070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 --2- 172.21.15.112:0/1822151425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40702f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- 172.21.15.112:0/1822151425 >> 172.21.15.112:0/1822151425 conn(0x7fe2c40d2d10 msgr2=0x7fe2c40d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:09.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- 172.21.15.112:0/1822151425 shutdown_connections 2023-11-08T12:28:09.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.329+0000 7fe2c9451700 1 -- 172.21.15.112:0/1822151425 wait complete. 2023-11-08T12:28:09.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.333+0000 7fe2c9451700 1 Processor -- start 2023-11-08T12:28:09.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.333+0000 7fe2c9451700 1 -- start start 2023-11-08T12:28:09.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.333+0000 7fe2c9451700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2c40b1be0 0x7fe2c41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.333+0000 7fe2c9451700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c40c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c9451700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c9451700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c41f2fe0 con 0x7fe2c415c700 2023-11-08T12:28:09.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c9451700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4154800 con 0x7fe2c40b1be0 2023-11-08T12:28:09.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c9451700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40c7850 con 0x7fe2c40b2130 2023-11-08T12:28:09.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54984/0 (socket says 172.21.15.112:54984) 2023-11-08T12:28:09.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 -- 172.21.15.112:0/2188738319 learned_addr learned my addr 172.21.15.112:0/2188738319 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:09.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c2ffd700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2c40b1be0 0x7fe2c41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c27fc700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c40c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 -- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 msgr2=0x7fe2c40c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c40c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 -- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2c40b1be0 msgr2=0x7fe2c41542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2c40b1be0 0x7fe2c41542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 -- 172.21.15.112:0/2188738319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4009570 con 0x7fe2c415c700 2023-11-08T12:28:09.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c37fe700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40c90b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00cb50 tx=0x7fe2bc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:09.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2ab7fe700 1 -- 172.21.15.112:0/2188738319 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc003c20 con 0x7fe2c415c700 2023-11-08T12:28:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2ab7fe700 1 -- 172.21.15.112:0/2188738319 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc003d80 con 0x7fe2c415c700 2023-11-08T12:28:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2ab7fe700 1 -- 172.21.15.112:0/2188738319 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00aa20 con 0x7fe2c415c700 2023-11-08T12:28:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c4160a30 con 0x7fe2c415c700 2023-11-08T12:28:09.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.337+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c4160750 con 0x7fe2c415c700 2023-11-08T12:28:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.341+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c406b530 con 0x7fe2c415c700 2023-11-08T12:28:09.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.341+0000 7fe2ab7fe700 1 -- 172.21.15.112:0/2188738319 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe2bc010050 con 0x7fe2c415c700 2023-11-08T12:28:09.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.341+0000 7fe2ab7fe700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe2b0064f10 0x7fe2b00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.341+0000 7fe2ab7fe700 1 -- 172.21.15.112:0/2188738319 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe2bc0820f0 con 0x7fe2c415c700 2023-11-08T12:28:09.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.341+0000 7fe2c2ffd700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe2b0064f10 0x7fe2b00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.345+0000 7fe2c2ffd700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe2b0064f10 0x7fe2b00673c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4000c00 tx=0x7fe2b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.349+0000 7fe2ab7fe700 1 -- 172.21.15.112:0/2188738319 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe2bc04feb0 con 0x7fe2c415c700 2023-11-08T12:28:09.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.517+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2c40726c0 con 0x7fe2c415c700 2023-11-08T12:28:09.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2ab7fe700 1 -- 172.21.15.112:0/2188738319 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2bc0534d0 con 0x7fe2c415c700 2023-11-08T12:28:09.523 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:09.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe2b0064f10 msgr2=0x7fe2b00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe2b0064f10 0x7fe2b00673c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4000c00 tx=0x7fe2b4008030 comp rx=0 tx=0).stop 2023-11-08T12:28:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 msgr2=0x7fe2c40c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40c90b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00cb50 tx=0x7fe2bc00ce60 comp rx=0 tx=0).stop 2023-11-08T12:28:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 shutdown_connections 2023-11-08T12:28:09.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe2b0064f10 0x7fe2b00673c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c415c700 0x7fe2c40c90b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2c40b2130 0x7fe2c40c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 --2- 172.21.15.112:0/2188738319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2c40b1be0 0x7fe2c41542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 >> 172.21.15.112:0/2188738319 conn(0x7fe2c40d2d10 msgr2=0x7fe2c40b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:09.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 shutdown_connections 2023-11-08T12:28:09.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.521+0000 7fe2c9451700 1 -- 172.21.15.112:0/2188738319 wait complete. 2023-11-08T12:28:09.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7ccdbc700 1 Processor -- start 2023-11-08T12:28:09.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7ccdbc700 1 -- start start 2023-11-08T12:28:09.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7ccdbc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb7c8159f10 0x7fb7c8070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7ccdbc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c8070600 con 0x7fb7c815a9f0 2023-11-08T12:28:09.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7ccdbc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c815adf0 con 0x7fb7c80c8c90 2023-11-08T12:28:09.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7ccdbc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c80c9130 con 0x7fb7c8159f10 2023-11-08T12:28:09.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7c7fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb7c815a9f0 0x7fb7c806be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46822/0 (socket says 172.21.15.112:46822) 2023-11-08T12:28:09.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7c7fff700 1 -- 172.21.15.112:0/1361656901 learned_addr learned my addr 172.21.15.112:0/1361656901 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:09.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.737+0000 7fb7c77fe700 1 --2- 172.21.15.112:0/1361656901 >> v2:172.21.15.112:3300/0 conn(0x7fb7c8159f10 0x7fb7c8070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c67fc700 1 -- 172.21.15.112:0/1361656901 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390489688 0 0) 0x7fb7c8070600 con 0x7fb7c815a9f0 2023-11-08T12:28:09.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c67fc700 1 -- 172.21.15.112:0/1361656901 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b00035d0 con 0x7fb7c815a9f0 2023-11-08T12:28:09.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c67fc700 1 -- 172.21.15.112:0/1361656901 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3874873429 0 0) 0x7fb7b00035d0 con 0x7fb7c815a9f0 2023-11-08T12:28:09.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c77fe700 1 -- 172.21.15.112:0/1361656901 >> v1:172.21.15.133:6789/0 conn(0x7fb7c80c8c90 legacy=0x7fb7c815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c77fe700 1 -- 172.21.15.112:0/1361656901 >> v1:172.21.15.112:6789/0 conn(0x7fb7c815a9f0 legacy=0x7fb7c806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c77fe700 1 -- 172.21.15.112:0/1361656901 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c80afcc0 con 0x7fb7c8159f10 2023-11-08T12:28:09.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c77fe700 1 --2- 172.21.15.112:0/1361656901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c8159f10 0x7fb7c8070a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009850 tx=0x7fb7b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea3c3ac28783672 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:09.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c67fc700 1 -- 172.21.15.112:0/1361656901 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00019f0 con 0x7fb7c8159f10 2023-11-08T12:28:09.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c67fc700 1 -- 172.21.15.112:0/1361656901 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b8004030 con 0x7fb7c8159f10 2023-11-08T12:28:09.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7c67fc700 1 -- 172.21.15.112:0/1361656901 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80043c0 con 0x7fb7c8159f10 2023-11-08T12:28:09.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1361656901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c8159f10 msgr2=0x7fb7c8070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1361656901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c8159f10 0x7fb7c8070a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009850 tx=0x7fb7b8009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:09.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1361656901 shutdown_connections 2023-11-08T12:28:09.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1361656901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c8159f10 0x7fb7c8070a90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1361656901 >> 172.21.15.112:0/1361656901 conn(0x7fb7c80cf280 msgr2=0x7fb7c80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:09.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1361656901 shutdown_connections 2023-11-08T12:28:09.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.741+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1361656901 wait complete. 2023-11-08T12:28:09.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 Processor -- start 2023-11-08T12:28:09.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 -- start start 2023-11-08T12:28:09.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c80c8c90 0x7fb7c8149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c8159f10 0x7fb7c814a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c815a9f0 0x7fb7c81f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8154450 con 0x7fb7c80c8c90 2023-11-08T12:28:09.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8153880 con 0x7fb7c8159f10 2023-11-08T12:28:09.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7ccdbc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c81efeb0 con 0x7fb7c815a9f0 2023-11-08T12:28:09.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.745+0000 7fb7c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c80c8c90 0x7fb7c8149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c80c8c90 0x7fb7c8149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55002/0 (socket says 172.21.15.112:55002) 2023-11-08T12:28:09.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 -- 172.21.15.112:0/1762484830 learned_addr learned my addr 172.21.15.112:0/1762484830 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:09.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c6ffd700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c8159f10 0x7fb7c814a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c7fff700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c815a9f0 0x7fb7c81f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 -- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c815a9f0 msgr2=0x7fb7c81f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c815a9f0 0x7fb7c81f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 -- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c8159f10 msgr2=0x7fb7c814a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c8159f10 0x7fb7c814a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 -- 172.21.15.112:0/1762484830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b80094b0 con 0x7fb7c80c8c90 2023-11-08T12:28:09.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7c77fe700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c80c8c90 0x7fb7c8149f70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80717e0 tx=0x7fb7b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:09.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7affff700 1 -- 172.21.15.112:0/1762484830 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011830 con 0x7fb7c80c8c90 2023-11-08T12:28:09.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7affff700 1 -- 172.21.15.112:0/1762484830 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b801f070 con 0x7fb7c80c8c90 2023-11-08T12:28:09.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c8070290 con 0x7fb7c80c8c90 2023-11-08T12:28:09.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7affff700 1 -- 172.21.15.112:0/1762484830 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011bd0 con 0x7fb7c80c8c90 2023-11-08T12:28:09.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c806ffb0 con 0x7fb7c80c8c90 2023-11-08T12:28:09.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.749+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c80affa0 con 0x7fb7c80c8c90 2023-11-08T12:28:09.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.753+0000 7fb7affff700 1 -- 172.21.15.112:0/1762484830 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7b8017020 con 0x7fb7c80c8c90 2023-11-08T12:28:09.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.753+0000 7fb7affff700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7b4064ee0 0x7fb7b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:09.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.753+0000 7fb7affff700 1 -- 172.21.15.112:0/1762484830 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb7b8021070 con 0x7fb7c80c8c90 2023-11-08T12:28:09.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.753+0000 7fb7c6ffd700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7b4064ee0 0x7fb7b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:09.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.753+0000 7fb7c6ffd700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7b4064ee0 0x7fb7b4067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8156c40 tx=0x7fb7bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:09.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.761+0000 7fb7affff700 1 -- 172.21.15.112:0/1762484830 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7b8051a40 con 0x7fb7c80c8c90 2023-11-08T12:28:09.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.933+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7c806cf30 con 0x7fb7c80c8c90 2023-11-08T12:28:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.933+0000 7fb7affff700 1 -- 172.21.15.112:0/1762484830 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7b802b020 con 0x7fb7c80c8c90 2023-11-08T12:28:09.936 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7b4064ee0 msgr2=0x7fb7b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7b4064ee0 0x7fb7b4067390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8156c40 tx=0x7fb7bc009040 comp rx=0 tx=0).stop 2023-11-08T12:28:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c80c8c90 msgr2=0x7fb7c8149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c80c8c90 0x7fb7c8149f70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80717e0 tx=0x7fb7b8004770 comp rx=0 tx=0).stop 2023-11-08T12:28:09.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 shutdown_connections 2023-11-08T12:28:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7b4064ee0 0x7fb7b4067390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7c815a9f0 0x7fb7c81f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7c8159f10 0x7fb7c814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 --2- 172.21.15.112:0/1762484830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c80c8c90 0x7fb7c8149f70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 >> 172.21.15.112:0/1762484830 conn(0x7fb7c80cf280 msgr2=0x7fb7c80b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 shutdown_connections 2023-11-08T12:28:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:09.937+0000 7fb7ccdbc700 1 -- 172.21.15.112:0/1762484830 wait complete. 2023-11-08T12:28:09.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:10.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.137+0000 7f39c1ed1700 1 Processor -- start 2023-11-08T12:28:10.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.137+0000 7f39c1ed1700 1 -- start start 2023-11-08T12:28:10.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39c1ed1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f39bc159f10 0x7f39bc070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39c1ed1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39bc0c8c90 0x7f39bc06b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39c1ed1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc070600 con 0x7f39bc15a2e0 2023-11-08T12:28:10.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39c1ed1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0c9130 con 0x7f39bc0c8c90 2023-11-08T12:28:10.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39c1ed1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc06b840 con 0x7f39bc159f10 2023-11-08T12:28:10.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39bc0c8c90 0x7f39bc06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39bc0c8c90 0x7f39bc06b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55006/0 (socket says 172.21.15.112:55006) 2023-11-08T12:28:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 -- 172.21.15.112:0/2262941219 learned_addr learned my addr 172.21.15.112:0/2262941219 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39c0ecf700 1 --2- 172.21.15.112:0/2262941219 >> v2:172.21.15.133:3300/0 conn(0x7f39bc159f10 0x7f39bc070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39c16d0700 1 --1- 172.21.15.112:0/2262941219 >> v1:172.21.15.112:6789/0 conn(0x7f39bc15a2e0 0x7f39bc15a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46836/0 (socket says 172.21.15.112:46836) 2023-11-08T12:28:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 -- 172.21.15.112:0/2262941219 >> v2:172.21.15.133:3300/0 conn(0x7f39bc159f10 msgr2=0x7f39bc070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 --2- 172.21.15.112:0/2262941219 >> v2:172.21.15.133:3300/0 conn(0x7f39bc159f10 0x7f39bc070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 -- 172.21.15.112:0/2262941219 >> v1:172.21.15.112:6789/0 conn(0x7f39bc15a2e0 legacy=0x7f39bc15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 -- 172.21.15.112:0/2262941219 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc15adf0 con 0x7f39bc0c8c90 2023-11-08T12:28:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b3fff700 1 --2- 172.21.15.112:0/2262941219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc0c8c90 0x7f39bc06b300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0cc0e0 tx=0x7f39ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d136b8837a502f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:10.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b37fe700 1 -- 172.21.15.112:0/2262941219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac011830 con 0x7f39bc0c8c90 2023-11-08T12:28:10.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b37fe700 1 -- 172.21.15.112:0/2262941219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac011990 con 0x7f39bc0c8c90 2023-11-08T12:28:10.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.141+0000 7f39b37fe700 1 -- 172.21.15.112:0/2262941219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac011d20 con 0x7f39bc0c8c90 2023-11-08T12:28:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 -- 172.21.15.112:0/2262941219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc0c8c90 msgr2=0x7f39bc06b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/2262941219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc0c8c90 0x7f39bc06b300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0cc0e0 tx=0x7f39ac009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 -- 172.21.15.112:0/2262941219 shutdown_connections 2023-11-08T12:28:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/2262941219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc0c8c90 0x7f39bc06b300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/2262941219 >> v2:172.21.15.133:3300/0 conn(0x7f39bc159f10 0x7f39bc070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 -- 172.21.15.112:0/2262941219 >> 172.21.15.112:0/2262941219 conn(0x7f39bc0cf280 msgr2=0x7f39bc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 -- 172.21.15.112:0/2262941219 shutdown_connections 2023-11-08T12:28:10.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 -- 172.21.15.112:0/2262941219 wait complete. 2023-11-08T12:28:10.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 Processor -- start 2023-11-08T12:28:10.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.145+0000 7f39c1ed1700 1 -- start start 2023-11-08T12:28:10.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39bc0c8c90 0x7f39bc0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39bc159f10 0x7f39bc0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc15a2e0 0x7f39bc1f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0c67c0 con 0x7f39bc15a2e0 2023-11-08T12:28:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0b1b90 con 0x7f39bc159f10 2023-11-08T12:28:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0b1e70 con 0x7f39bc0c8c90 2023-11-08T12:28:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc15a2e0 0x7f39bc1f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc15a2e0 0x7f39bc1f06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55018/0 (socket says 172.21.15.112:55018) 2023-11-08T12:28:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 -- 172.21.15.112:0/1340245148 learned_addr learned my addr 172.21.15.112:0/1340245148 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39b3fff700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39bc159f10 0x7f39bc0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c0ecf700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39bc0c8c90 0x7f39bc0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 -- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39bc0c8c90 msgr2=0x7f39bc0b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39bc0c8c90 0x7f39bc0b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 -- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39bc159f10 msgr2=0x7f39bc0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39bc159f10 0x7f39bc0c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 -- 172.21.15.112:0/1340245148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009570 con 0x7f39bc15a2e0 2023-11-08T12:28:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c16d0700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc15a2e0 0x7f39bc1f06f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f39b400cbc0 tx=0x7f39b400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39b17fa700 1 -- 172.21.15.112:0/1340245148 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b400a9e0 con 0x7f39bc15a2e0 2023-11-08T12:28:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39b17fa700 1 -- 172.21.15.112:0/1340245148 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b400ab40 con 0x7f39bc15a2e0 2023-11-08T12:28:10.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc06ffb0 con 0x7f39bc15a2e0 2023-11-08T12:28:10.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39b17fa700 1 -- 172.21.15.112:0/1340245148 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4007070 con 0x7f39bc15a2e0 2023-11-08T12:28:10.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.149+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0afcc0 con 0x7f39bc15a2e0 2023-11-08T12:28:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.153+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc070290 con 0x7f39bc15a2e0 2023-11-08T12:28:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.153+0000 7f39b17fa700 1 -- 172.21.15.112:0/1340245148 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f39b4019030 con 0x7f39bc15a2e0 2023-11-08T12:28:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.153+0000 7f39b17fa700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f39a8064ee0 0x7f39a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.157+0000 7f39b17fa700 1 -- 172.21.15.112:0/1340245148 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39b4081c90 con 0x7f39bc15a2e0 2023-11-08T12:28:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.157+0000 7f39c0ecf700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f39a8064ee0 0x7f39a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.157+0000 7f39c0ecf700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f39a8064ee0 0x7f39a8067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0caea0 tx=0x7f39b8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.161+0000 7f39b17fa700 1 -- 172.21.15.112:0/1340245148 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f39b404a400 con 0x7f39bc15a2e0 2023-11-08T12:28:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.341+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f39bc06cf30 con 0x7f39bc15a2e0 2023-11-08T12:28:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.345+0000 7f39b17fa700 1 -- 172.21.15.112:0/1340245148 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f39b4017020 con 0x7f39bc15a2e0 2023-11-08T12:28:10.347 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:10.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f39a8064ee0 msgr2=0x7f39a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f39a8064ee0 0x7f39a8067390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0caea0 tx=0x7f39b8009240 comp rx=0 tx=0).stop 2023-11-08T12:28:10.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc15a2e0 msgr2=0x7f39bc1f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc15a2e0 0x7f39bc1f06f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f39b400cbc0 tx=0x7f39b400ced0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 shutdown_connections 2023-11-08T12:28:10.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f39a8064ee0 0x7f39a8067390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39bc15a2e0 0x7f39bc1f06f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39bc159f10 0x7f39bc0c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 --2- 172.21.15.112:0/1340245148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39bc0c8c90 0x7f39bc0b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 >> 172.21.15.112:0/1340245148 conn(0x7f39bc0cf280 msgr2=0x7f39bc06c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:10.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 shutdown_connections 2023-11-08T12:28:10.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.349+0000 7f39c1ed1700 1 -- 172.21.15.112:0/1340245148 wait complete. 2023-11-08T12:28:10.376 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:28:10.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.549+0000 7f2ced882700 1 Processor -- start 2023-11-08T12:28:10.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.549+0000 7f2ced882700 1 -- start start 2023-11-08T12:28:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ced882700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ce80cfa50 0x7f2ce80d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ced882700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ce80cfef0 0x7f2ce80d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ced882700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce815d780 con 0x7f2ce80d0e30 2023-11-08T12:28:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ced882700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce80cec90 con 0x7f2ce80cfa50 2023-11-08T12:28:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ced882700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce80cef70 con 0x7f2ce80cfef0 2023-11-08T12:28:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce67fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ce80cfa50 0x7f2ce80d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce67fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ce80cfa50 0x7f2ce80d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55034/0 (socket says 172.21.15.112:55034) 2023-11-08T12:28:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce67fc700 1 -- 172.21.15.112:0/2181802768 learned_addr learned my addr 172.21.15.112:0/2181802768 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce7fff700 1 --2- 172.21.15.112:0/2181802768 >> v2:172.21.15.133:3300/0 conn(0x7f2ce80cfef0 0x7f2ce80d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce7fff700 1 -- 172.21.15.112:0/2181802768 >> v2:172.21.15.112:3300/0 conn(0x7f2ce80cfa50 msgr2=0x7f2ce80d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce7fff700 1 --2- 172.21.15.112:0/2181802768 >> v2:172.21.15.112:3300/0 conn(0x7f2ce80cfa50 0x7f2ce80d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce7fff700 1 -- 172.21.15.112:0/2181802768 >> v1:172.21.15.133:6789/0 conn(0x7f2ce80d0e30 legacy=0x7f2ce80d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce7fff700 1 -- 172.21.15.112:0/2181802768 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce80cf250 con 0x7f2ce80cfef0 2023-11-08T12:28:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.553+0000 7f2ce7fff700 1 --2- 172.21.15.112:0/2181802768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfef0 0x7f2ce80d2c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009d90 tx=0x7f2ce000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=decb20f0d8964daf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ce5ffb700 1 -- 172.21.15.112:0/2181802768 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000e070 con 0x7f2ce80cfef0 2023-11-08T12:28:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ce5ffb700 1 -- 172.21.15.112:0/2181802768 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce000bae0 con 0x7f2ce80cfef0 2023-11-08T12:28:10.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ce5ffb700 1 -- 172.21.15.112:0/2181802768 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000be90 con 0x7f2ce80cfef0 2023-11-08T12:28:10.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 -- 172.21.15.112:0/2181802768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfef0 msgr2=0x7f2ce80d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 --2- 172.21.15.112:0/2181802768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfef0 0x7f2ce80d2c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009d90 tx=0x7f2ce000b330 comp rx=0 tx=0).stop 2023-11-08T12:28:10.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 -- 172.21.15.112:0/2181802768 shutdown_connections 2023-11-08T12:28:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 --2- 172.21.15.112:0/2181802768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfef0 0x7f2ce80d2c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 --2- 172.21.15.112:0/2181802768 >> v2:172.21.15.112:3300/0 conn(0x7f2ce80cfa50 0x7f2ce80d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 -- 172.21.15.112:0/2181802768 >> 172.21.15.112:0/2181802768 conn(0x7f2ce806e100 msgr2=0x7f2ce806e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:10.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 -- 172.21.15.112:0/2181802768 shutdown_connections 2023-11-08T12:28:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.557+0000 7f2ced882700 1 -- 172.21.15.112:0/2181802768 wait complete. 2023-11-08T12:28:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 Processor -- start 2023-11-08T12:28:10.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 -- start start 2023-11-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfa50 0x7f2ce81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ce80cfef0 0x7f2ce8150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80d0e30 0x7f2ce80b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8158040 con 0x7f2ce80d0e30 2023-11-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8150e50 con 0x7f2ce80cfa50 2023-11-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ced882700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8157710 con 0x7f2ce80cfef0 2023-11-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80d0e30 0x7f2ce80b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80d0e30 0x7f2ce80b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55048/0 (socket says 172.21.15.112:55048) 2023-11-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ce7fff700 1 -- 172.21.15.112:0/4229350269 learned_addr learned my addr 172.21.15.112:0/4229350269 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ce67fc700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ce80cfef0 0x7f2ce8150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.561+0000 7f2ce6ffd700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfa50 0x7f2ce81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ce7fff700 1 -- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ce80cfef0 msgr2=0x7f2ce8150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ce7fff700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ce80cfef0 0x7f2ce8150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ce7fff700 1 -- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfa50 msgr2=0x7f2ce81584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ce7fff700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfa50 0x7f2ce81584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ce7fff700 1 -- 172.21.15.112:0/4229350269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce0009a70 con 0x7f2ce80d0e30 2023-11-08T12:28:10.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ce7fff700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80d0e30 0x7f2ce80b62c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0014040 tx=0x7f2ce0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:10.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ccffff700 1 -- 172.21.15.112:0/4229350269 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00045d0 con 0x7f2ce80d0e30 2023-11-08T12:28:10.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ccffff700 1 -- 172.21.15.112:0/4229350269 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0020070 con 0x7f2ce80d0e30 2023-11-08T12:28:10.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce80d31b0 con 0x7f2ce80d0e30 2023-11-08T12:28:10.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ccffff700 1 -- 172.21.15.112:0/4229350269 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0004990 con 0x7f2ce80d0e30 2023-11-08T12:28:10.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80cf530 con 0x7f2ce80d0e30 2023-11-08T12:28:10.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.565+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce815c560 con 0x7f2ce80d0e30 2023-11-08T12:28:10.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.569+0000 7f2ccffff700 1 -- 172.21.15.112:0/4229350269 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2ce002e070 con 0x7f2ce80d0e30 2023-11-08T12:28:10.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.569+0000 7f2ccffff700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064ee0 0x7f2cd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:10.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.569+0000 7f2ccffff700 1 -- 172.21.15.112:0/4229350269 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ce0022070 con 0x7f2ce80d0e30 2023-11-08T12:28:10.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.569+0000 7f2ce6ffd700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064ee0 0x7f2cd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:10.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.573+0000 7f2ce6ffd700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064ee0 0x7f2cd4067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ce808e350 tx=0x7f2cd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:10.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.577+0000 7f2ccffff700 1 -- 172.21.15.112:0/4229350269 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2ce0051bb0 con 0x7f2ce80d0e30 2023-11-08T12:28:10.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.765+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2ce81581f0 con 0x7f2ce80d0e30 2023-11-08T12:28:10.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.769+0000 7f2ccffff700 1 -- 172.21.15.112:0/4229350269 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2ce81581f0 con 0x7f2ce80d0e30 2023-11-08T12:28:10.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064ee0 msgr2=0x7f2cd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064ee0 0x7f2cd4067390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ce808e350 tx=0x7f2cd8009040 comp rx=0 tx=0).stop 2023-11-08T12:28:10.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80d0e30 msgr2=0x7f2ce80b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:10.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80d0e30 0x7f2ce80b62c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0014040 tx=0x7f2ce0004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 shutdown_connections 2023-11-08T12:28:10.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064ee0 0x7f2cd4067390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ce80d0e30 0x7f2ce80b62c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ce80cfef0 0x7f2ce8150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 --2- 172.21.15.112:0/4229350269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce80cfa50 0x7f2ce81584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:10.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 >> 172.21.15.112:0/4229350269 conn(0x7f2ce806e100 msgr2=0x7f2ce8151e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:10.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 shutdown_connections 2023-11-08T12:28:10.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:10.773+0000 7f2ced882700 1 -- 172.21.15.112:0/4229350269 wait complete. 2023-11-08T12:28:10.778 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:28:10.795 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2023-11-08T12:28:10.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:10.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-08T12:28:10.834 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[41359]: fuse finished with error 0 and tester_r 0 2023-11-08T12:28:10.842 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:28:16.944 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:28:16.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:16.945 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-08T12:28:16.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:17.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.193+0000 7f2ea248c700 1 Processor -- start 2023-11-08T12:28:17.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.193+0000 7f2ea248c700 1 -- start start 2023-11-08T12:28:17.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea248c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e9c160710 0x7f2e9c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea248c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e9c0cc860 0x7f2e9c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea248c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea248c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c070a60 con 0x7f2e9c160710 2023-11-08T12:28:17.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea248c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c06b1c0 con 0x7f2e9c0cc860 2023-11-08T12:28:17.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea248c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ad6c0 con 0x7f2e9c0705c0 2023-11-08T12:28:17.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea148a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2e9c160710 0x7f2e9c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54044/0 (socket says 172.21.15.112:54044) 2023-11-08T12:28:17.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1580091784 learned_addr learned my addr 172.21.15.112:0/1580091784 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:17.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea148a700 1 --2- 172.21.15.112:0/1580091784 >> v2:172.21.15.112:3300/0 conn(0x7f2e9c160710 0x7f2e9c0cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34688/0 (socket says 172.21.15.112:34688) 2023-11-08T12:28:17.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea0c89700 1 --2- 172.21.15.112:0/1580091784 >> v2:172.21.15.133:3300/0 conn(0x7f2e9c0cc860 0x7f2e9c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1580091784 >> v2:172.21.15.133:3300/0 conn(0x7f2e9c0cc860 msgr2=0x7f2e9c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:17.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 --2- 172.21.15.112:0/1580091784 >> v2:172.21.15.133:3300/0 conn(0x7f2e9c0cc860 0x7f2e9c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1580091784 >> v2:172.21.15.112:3300/0 conn(0x7f2e9c160710 msgr2=0x7f2e9c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:17.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 --2- 172.21.15.112:0/1580091784 >> v2:172.21.15.112:3300/0 conn(0x7f2e9c160710 0x7f2e9c0cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1580091784 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0adc60 con 0x7f2e9c0705c0 2023-11-08T12:28:17.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.197+0000 7f2ea1c8b700 1 --2- 172.21.15.112:0/1580091784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c069bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c1641b0 tx=0x7f2e9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1882bd15fff1d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:17.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2e93fff700 1 -- 172.21.15.112:0/1580091784 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9400e070 con 0x7f2e9c0705c0 2023-11-08T12:28:17.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2e93fff700 1 -- 172.21.15.112:0/1580091784 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9400b910 con 0x7f2e9c0705c0 2023-11-08T12:28:17.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2e93fff700 1 -- 172.21.15.112:0/1580091784 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9400bcc0 con 0x7f2e9c0705c0 2023-11-08T12:28:17.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 -- 172.21.15.112:0/1580091784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 msgr2=0x7f2e9c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1580091784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c069bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c1641b0 tx=0x7f2e9400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:17.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 -- 172.21.15.112:0/1580091784 shutdown_connections 2023-11-08T12:28:17.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1580091784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c069bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1580091784 >> v2:172.21.15.133:3300/0 conn(0x7f2e9c0cc860 0x7f2e9c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1580091784 >> v2:172.21.15.112:3300/0 conn(0x7f2e9c160710 0x7f2e9c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 -- 172.21.15.112:0/1580091784 >> 172.21.15.112:0/1580091784 conn(0x7f2e9c0b0f80 msgr2=0x7f2e9c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:17.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 -- 172.21.15.112:0/1580091784 shutdown_connections 2023-11-08T12:28:17.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 -- 172.21.15.112:0/1580091784 wait complete. 2023-11-08T12:28:17.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.201+0000 7f2ea248c700 1 Processor -- start 2023-11-08T12:28:17.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 -- start start 2023-11-08T12:28:17.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9c0cc860 0x7f2e9c0c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9c160710 0x7f2e9c0c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c4630 con 0x7f2e9c160710 2023-11-08T12:28:17.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c1050 con 0x7f2e9c0cc860 2023-11-08T12:28:17.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0bd4f0 con 0x7f2e9c0705c0 2023-11-08T12:28:17.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9c160710 0x7f2e9c0c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9c160710 0x7f2e9c0c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34698/0 (socket says 172.21.15.112:34698) 2023-11-08T12:28:17.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1004707702 learned_addr learned my addr 172.21.15.112:0/1004707702 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:17.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea0c89700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9c0cc860 0x7f2e9c0c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea148a700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 msgr2=0x7f2e9c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9c0cc860 msgr2=0x7f2e9c0c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9c0cc860 0x7f2e9c0c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 -- 172.21.15.112:0/1004707702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94009b30 con 0x7f2e9c160710 2023-11-08T12:28:17.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea1c8b700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9c160710 0x7f2e9c0c0b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400b370 tx=0x7f2e94004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:17.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2e91ffb700 1 -- 172.21.15.112:0/1004707702 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940099b0 con 0x7f2e9c160710 2023-11-08T12:28:17.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2e91ffb700 1 -- 172.21.15.112:0/1004707702 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9400ce80 con 0x7f2e9c160710 2023-11-08T12:28:17.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2e91ffb700 1 -- 172.21.15.112:0/1004707702 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94004470 con 0x7f2e9c160710 2023-11-08T12:28:17.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.205+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c06b6b0 con 0x7f2e9c160710 2023-11-08T12:28:17.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.209+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c06b3d0 con 0x7f2e9c160710 2023-11-08T12:28:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.209+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0ad8f0 con 0x7f2e9c160710 2023-11-08T12:28:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.209+0000 7f2e91ffb700 1 -- 172.21.15.112:0/1004707702 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2e9402c070 con 0x7f2e9c160710 2023-11-08T12:28:17.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.213+0000 7f2e91ffb700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2e80064ee0 0x7f2e80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.213+0000 7f2e91ffb700 1 -- 172.21.15.112:0/1004707702 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e94083360 con 0x7f2e9c160710 2023-11-08T12:28:17.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.213+0000 7f2ea148a700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2e80064ee0 0x7f2e80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.213+0000 7f2ea148a700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2e80064ee0 0x7f2e80067390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009ad0 tx=0x7f2e98009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:17.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.217+0000 7f2e91ffb700 1 -- 172.21.15.112:0/1004707702 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2e94051190 con 0x7f2e9c160710 2023-11-08T12:28:17.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.397+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e9c073cb0 con 0x7f2e9c160710 2023-11-08T12:28:17.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.401+0000 7f2e91ffb700 1 -- 172.21.15.112:0/1004707702 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7f2e940547b0 con 0x7f2e9c160710 2023-11-08T12:28:17.403 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:17.403 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:17.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2e80064ee0 msgr2=0x7f2e80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2e80064ee0 0x7f2e80067390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009ad0 tx=0x7f2e98009240 comp rx=0 tx=0).stop 2023-11-08T12:28:17.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9c160710 msgr2=0x7f2e9c0c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9c160710 0x7f2e9c0c0b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400b370 tx=0x7f2e94004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 shutdown_connections 2023-11-08T12:28:17.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2e80064ee0 0x7f2e80067390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e9c160710 0x7f2e9c0c0b10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9c0cc860 0x7f2e9c0c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 --2- 172.21.15.112:0/1004707702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9c0705c0 0x7f2e9c15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 >> 172.21.15.112:0/1004707702 conn(0x7f2e9c0b0f80 msgr2=0x7f2e9c0af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:17.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 shutdown_connections 2023-11-08T12:28:17.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.405+0000 7f2ea248c700 1 -- 172.21.15.112:0/1004707702 wait complete. 2023-11-08T12:28:17.430 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:17.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.605+0000 7f865f59e700 1 Processor -- start 2023-11-08T12:28:17.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.605+0000 7f865f59e700 1 -- start start 2023-11-08T12:28:17.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8660160710 0x7f86600cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8660070790 0x7f8660164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600ad6c0 con 0x7f86600cc860 2023-11-08T12:28:17.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866006b1c0 con 0x7f8660070790 2023-11-08T12:28:17.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600adc60 con 0x7f8660160710 2023-11-08T12:28:17.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8660160710 0x7f86600cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8660160710 0x7f86600cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54060/0 (socket says 172.21.15.112:54060) 2023-11-08T12:28:17.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865e59c700 1 -- 172.21.15.112:0/2280954797 learned_addr learned my addr 172.21.15.112:0/2280954797 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:17.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865ed9d700 1 --2- 172.21.15.112:0/2280954797 >> v2:172.21.15.133:3300/0 conn(0x7f8660070790 0x7f8660164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865e59c700 1 -- 172.21.15.112:0/2280954797 >> v2:172.21.15.133:3300/0 conn(0x7f8660070790 msgr2=0x7f8660164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:17.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865e59c700 1 --2- 172.21.15.112:0/2280954797 >> v2:172.21.15.133:3300/0 conn(0x7f8660070790 0x7f8660164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865e59c700 1 -- 172.21.15.112:0/2280954797 >> v1:172.21.15.133:6789/0 conn(0x7f86600cc860 legacy=0x7f8660070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865e59c700 1 -- 172.21.15.112:0/2280954797 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866006b3d0 con 0x7f8660160710 2023-11-08T12:28:17.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.609+0000 7f865dd9b700 1 -- 172.21.15.112:0/2280954797 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747011174 0 0) 0x7f86600ad6c0 con 0x7f86600cc860 2023-11-08T12:28:17.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865e59c700 1 --2- 172.21.15.112:0/2280954797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8660160710 0x7f86600cc320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8650009e50 tx=0x7f865000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf56b4df2da17890 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:17.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865dd9b700 1 -- 172.21.15.112:0/2280954797 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000e070 con 0x7f8660160710 2023-11-08T12:28:17.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865dd9b700 1 -- 172.21.15.112:0/2280954797 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000b910 con 0x7f8660160710 2023-11-08T12:28:17.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865dd9b700 1 -- 172.21.15.112:0/2280954797 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000bcc0 con 0x7f8660160710 2023-11-08T12:28:17.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 -- 172.21.15.112:0/2280954797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8660160710 msgr2=0x7f86600cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 --2- 172.21.15.112:0/2280954797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8660160710 0x7f86600cc320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8650009e50 tx=0x7f865000b330 comp rx=0 tx=0).stop 2023-11-08T12:28:17.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 -- 172.21.15.112:0/2280954797 shutdown_connections 2023-11-08T12:28:17.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 --2- 172.21.15.112:0/2280954797 >> v2:172.21.15.133:3300/0 conn(0x7f8660070790 0x7f8660164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 --2- 172.21.15.112:0/2280954797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8660160710 0x7f86600cc320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 -- 172.21.15.112:0/2280954797 >> 172.21.15.112:0/2280954797 conn(0x7f86600b0f80 msgr2=0x7f86600ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 -- 172.21.15.112:0/2280954797 shutdown_connections 2023-11-08T12:28:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.613+0000 7f865f59e700 1 -- 172.21.15.112:0/2280954797 wait complete. 2023-11-08T12:28:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.617+0000 7f865f59e700 1 Processor -- start 2023-11-08T12:28:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 -- start start 2023-11-08T12:28:17.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8660070790 0x7f86600c2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86600cc860 0x7f86600c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8660160710 0x7f86600b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86601f6f70 con 0x7f8660070790 2023-11-08T12:28:17.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600c3bc0 con 0x7f8660160710 2023-11-08T12:28:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600c3ea0 con 0x7f86600cc860 2023-11-08T12:28:17.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8660070790 0x7f86600c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8660070790 0x7f86600c2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34710/0 (socket says 172.21.15.112:34710) 2023-11-08T12:28:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 -- 172.21.15.112:0/4220689652 learned_addr learned my addr 172.21.15.112:0/4220689652 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865ed9d700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8660160710 0x7f86600b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f8655d9b700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86600cc860 0x7f86600c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 -- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86600cc860 msgr2=0x7f86600c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86600cc860 0x7f86600c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 -- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8660160710 msgr2=0x7f86600b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8660160710 0x7f86600b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 -- 172.21.15.112:0/4220689652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8650009b30 con 0x7f8660070790 2023-11-08T12:28:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865e59c700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8660070790 0x7f86600c2000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f865000b370 tx=0x7f8650004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:17.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f86577fe700 1 -- 172.21.15.112:0/4220689652 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500048c0 con 0x7f8660070790 2023-11-08T12:28:17.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f86577fe700 1 -- 172.21.15.112:0/4220689652 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86500099b0 con 0x7f8660070790 2023-11-08T12:28:17.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86600ad8f0 con 0x7f8660070790 2023-11-08T12:28:17.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f86577fe700 1 -- 172.21.15.112:0/4220689652 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865001b670 con 0x7f8660070790 2023-11-08T12:28:17.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.621+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866006b6b0 con 0x7f8660070790 2023-11-08T12:28:17.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.625+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660160ae0 con 0x7f8660070790 2023-11-08T12:28:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.625+0000 7f86577fe700 1 -- 172.21.15.112:0/4220689652 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8650021030 con 0x7f8660070790 2023-11-08T12:28:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.625+0000 7f86577fe700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8640064f10 0x7f86400673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.625+0000 7f86577fe700 1 -- 172.21.15.112:0/4220689652 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f86500835c0 con 0x7f8660070790 2023-11-08T12:28:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.625+0000 7f8655d9b700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8640064f10 0x7f86400673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:17.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.629+0000 7f8655d9b700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8640064f10 0x7f86400673c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8660162390 tx=0x7f8648009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:17.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.633+0000 7f86577fe700 1 -- 172.21.15.112:0/4220689652 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8650051380 con 0x7f8660070790 2023-11-08T12:28:17.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.813+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8660073cb0 con 0x7f8660070790 2023-11-08T12:28:17.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.813+0000 7f86577fe700 1 -- 172.21.15.112:0/4220689652 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7f86500549a0 con 0x7f8660070790 2023-11-08T12:28:17.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:17.817 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8640064f10 msgr2=0x7f86400673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8640064f10 0x7f86400673c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8660162390 tx=0x7f8648009040 comp rx=0 tx=0).stop 2023-11-08T12:28:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8660070790 msgr2=0x7f86600c2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8660070790 0x7f86600c2000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f865000b370 tx=0x7f8650004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 shutdown_connections 2023-11-08T12:28:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8640064f10 0x7f86400673c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8660160710 0x7f86600b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86600cc860 0x7f86600c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 --2- 172.21.15.112:0/4220689652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8660070790 0x7f86600c2000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 >> 172.21.15.112:0/4220689652 conn(0x7f86600b0f80 msgr2=0x7f86600ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 shutdown_connections 2023-11-08T12:28:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:17.817+0000 7f865f59e700 1 -- 172.21.15.112:0/4220689652 wait complete. 2023-11-08T12:28:17.841 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T12:28:18.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.017+0000 7f6ce40ae700 1 Processor -- start 2023-11-08T12:28:18.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.017+0000 7f6ce40ae700 1 -- start start 2023-11-08T12:28:18.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.017+0000 7f6ce40ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6cdc06c720 0x7f6cdc06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:18.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.017+0000 7f6ce40ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc0b0b60 0x7f6cdc06a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:18.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.017+0000 7f6ce40ae700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc0b1000 con 0x7f6cdc15a2c0 2023-11-08T12:28:18.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.017+0000 7f6ce40ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0b1240 con 0x7f6cdc06c720 2023-11-08T12:28:18.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.017+0000 7f6ce40ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0ae060 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1e4a700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6cdc15a2c0 0x7f6cdc06c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35940/0 (socket says 172.21.15.112:35940) 2023-11-08T12:28:18.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1e4a700 1 -- 172.21.15.112:0/3413626559 learned_addr learned my addr 172.21.15.112:0/3413626559 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:18.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1649700 1 --2- 172.21.15.112:0/3413626559 >> v2:172.21.15.133:3300/0 conn(0x7f6cdc06c720 0x7f6cdc06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:18.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce264b700 1 --2- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc0b0b60 0x7f6cdc06a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:18.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce0e48700 1 -- 172.21.15.112:0/3413626559 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737378816 0 0) 0x7f6cd8001490 con 0x7f6cdc15a2c0 2023-11-08T12:28:18.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce0e48700 1 -- 172.21.15.112:0/3413626559 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cc80035d0 con 0x7f6cdc15a2c0 2023-11-08T12:28:18.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1649700 1 -- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc0b0b60 msgr2=0x7f6cdc06a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:18.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1649700 1 --2- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc0b0b60 0x7f6cdc06a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1649700 1 -- 172.21.15.112:0/3413626559 >> v1:172.21.15.112:6789/0 conn(0x7f6cdc15a2c0 legacy=0x7f6cdc06c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:18.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1649700 1 -- 172.21.15.112:0/3413626559 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0adc70 con 0x7f6cdc06c720 2023-11-08T12:28:18.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce1649700 1 --2- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc06c720 0x7f6cdc06d070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009850 tx=0x7f6ccc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddab681bc9d5dff6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce0e48700 1 -- 172.21.15.112:0/3413626559 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc011830 con 0x7f6cdc06c720 2023-11-08T12:28:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce0e48700 1 -- 172.21.15.112:0/3413626559 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc011990 con 0x7f6cdc06c720 2023-11-08T12:28:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.021+0000 7f6ce0e48700 1 -- 172.21.15.112:0/3413626559 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc011d00 con 0x7f6cdc06c720 2023-11-08T12:28:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 -- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc06c720 msgr2=0x7f6cdc06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:18.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc06c720 0x7f6cdc06d070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009850 tx=0x7f6ccc009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 -- 172.21.15.112:0/3413626559 shutdown_connections 2023-11-08T12:28:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc0b0b60 0x7f6cdc06a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/3413626559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc06c720 0x7f6cdc06d070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 -- 172.21.15.112:0/3413626559 >> 172.21.15.112:0/3413626559 conn(0x7f6cdc0cf3b0 msgr2=0x7f6cdc0cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:18.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 -- 172.21.15.112:0/3413626559 shutdown_connections 2023-11-08T12:28:18.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 -- 172.21.15.112:0/3413626559 wait complete. 2023-11-08T12:28:18.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.025+0000 7f6ce40ae700 1 Processor -- start 2023-11-08T12:28:18.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce40ae700 1 -- start start 2023-11-08T12:28:18.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce40ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc06c720 0x7f6cdc146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:18.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce40ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cdc0b0b60 0x7f6cdc158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:18.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce40ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc15a2c0 0x7f6cdc1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:18.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce40ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc1f5ec0 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce40ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc1f52b0 con 0x7f6cdc15a2c0 2023-11-08T12:28:18.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce40ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc1f5590 con 0x7f6cdc06c720 2023-11-08T12:28:18.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cdc0b0b60 0x7f6cdc158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:18.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cdc0b0b60 0x7f6cdc158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34722/0 (socket says 172.21.15.112:34722) 2023-11-08T12:28:18.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 -- 172.21.15.112:0/2027860901 learned_addr learned my addr 172.21.15.112:0/2027860901 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:18.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1e4a700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc06c720 0x7f6cdc146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:18.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce264b700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc15a2c0 0x7f6cdc1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:18.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 -- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc06c720 msgr2=0x7f6cdc146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:18.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc06c720 0x7f6cdc146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 -- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc15a2c0 msgr2=0x7f6cdc1592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:18.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc15a2c0 0x7f6cdc1592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 -- 172.21.15.112:0/2027860901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0094b0 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.029+0000 7f6ce1649700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cdc0b0b60 0x7f6cdc158d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0090b0 tx=0x7f6ccc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:18.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.033+0000 7f6cd27fc700 1 -- 172.21.15.112:0/2027860901 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004590 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.033+0000 7f6cd27fc700 1 -- 172.21.15.112:0/2027860901 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc01f070 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.033+0000 7f6cd27fc700 1 -- 172.21.15.112:0/2027860901 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0038e0 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.033+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc0ae5e0 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.033+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc0ae300 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.033+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc069c90 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.033+0000 7f6cd27fc700 1 -- 172.21.15.112:0/2027860901 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6ccc00f050 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.037+0000 7f6cd27fc700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cc0064ee0 0x7f6cc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:18.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.037+0000 7f6cd27fc700 1 -- 172.21.15.112:0/2027860901 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ccc021070 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.037+0000 7f6ce1e4a700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cc0064ee0 0x7f6cc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:18.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.037+0000 7f6ce1e4a700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cc0064ee0 0x7f6cc0067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8005cb0 tx=0x7f6cd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:18.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.045+0000 7f6cd27fc700 1 -- 172.21.15.112:0/2027860901 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6ccc051270 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.257+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6cdc0726c0 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.813+0000 7f6cd27fc700 1 -- 172.21.15.112:0/2027860901 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ccc0150b0 con 0x7f6cdc0b0b60 2023-11-08T12:28:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.813+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cc0064ee0 msgr2=0x7f6cc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.813+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cc0064ee0 0x7f6cc0067390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8005cb0 tx=0x7f6cd8009040 comp rx=0 tx=0).stop 2023-11-08T12:28:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.813+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cdc0b0b60 msgr2=0x7f6cdc158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:18.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.813+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cdc0b0b60 0x7f6cdc158d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0090b0 tx=0x7f6ccc004770 comp rx=0 tx=0).stop 2023-11-08T12:28:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 shutdown_connections 2023-11-08T12:28:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cc0064ee0 0x7f6cc0067390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cdc15a2c0 0x7f6cdc1592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cdc0b0b60 0x7f6cdc158d60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 --2- 172.21.15.112:0/2027860901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cdc06c720 0x7f6cdc146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 >> 172.21.15.112:0/2027860901 conn(0x7f6cdc0cf3b0 msgr2=0x7f6cdc0abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 shutdown_connections 2023-11-08T12:28:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:18.817+0000 7f6ce40ae700 1 -- 172.21.15.112:0/2027860901 wait complete. 2023-11-08T12:28:18.839 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-08T12:28:18.840 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T12:28:19.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.033+0000 7f5812948700 1 Processor -- start 2023-11-08T12:28:19.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.033+0000 7f5812948700 1 -- start start 2023-11-08T12:28:19.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812948700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f580c15c150 0x7f580c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:19.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812948700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f580c070360 0x7f580c160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:19.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812948700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580c15c520 con 0x7f580c06ff10 2023-11-08T12:28:19.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812948700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c0b4240 con 0x7f580c15c150 2023-11-08T12:28:19.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812948700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c06ac00 con 0x7f580c070360 2023-11-08T12:28:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f580c15c150 0x7f580c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f580c15c150 0x7f580c0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34730/0 (socket says 172.21.15.112:34730) 2023-11-08T12:28:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 -- 172.21.15.112:0/1341530489 learned_addr learned my addr 172.21.15.112:0/1341530489 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812147700 1 --2- 172.21.15.112:0/1341530489 >> v2:172.21.15.133:3300/0 conn(0x7f580c070360 0x7f580c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:19.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 -- 172.21.15.112:0/1341530489 >> v2:172.21.15.133:3300/0 conn(0x7f580c070360 msgr2=0x7f580c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:19.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 --2- 172.21.15.112:0/1341530489 >> v2:172.21.15.133:3300/0 conn(0x7f580c070360 0x7f580c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 -- 172.21.15.112:0/1341530489 >> v1:172.21.15.133:6789/0 conn(0x7f580c06ff10 legacy=0x7f580c15fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:19.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 -- 172.21.15.112:0/1341530489 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c06cc50 con 0x7f580c15c150 2023-11-08T12:28:19.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5811946700 1 --2- 172.21.15.112:0/1341530489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c15c150 0x7f580c0b3d00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f580c06de90 tx=0x7f5808009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6dba311c0143d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5810944700 1 -- 172.21.15.112:0/1341530489 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808011830 con 0x7f580c15c150 2023-11-08T12:28:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5810944700 1 -- 172.21.15.112:0/1341530489 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808011990 con 0x7f580c15c150 2023-11-08T12:28:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5810944700 1 -- 172.21.15.112:0/1341530489 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808011d20 con 0x7f580c15c150 2023-11-08T12:28:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812948700 1 -- 172.21.15.112:0/1341530489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c15c150 msgr2=0x7f580c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.037+0000 7f5812948700 1 --2- 172.21.15.112:0/1341530489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c15c150 0x7f580c0b3d00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f580c06de90 tx=0x7f5808009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.041+0000 7f5812948700 1 -- 172.21.15.112:0/1341530489 shutdown_connections 2023-11-08T12:28:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.041+0000 7f5812948700 1 --2- 172.21.15.112:0/1341530489 >> v2:172.21.15.133:3300/0 conn(0x7f580c070360 0x7f580c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.041+0000 7f5812948700 1 --2- 172.21.15.112:0/1341530489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c15c150 0x7f580c0b3d00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.041+0000 7f5812948700 1 -- 172.21.15.112:0/1341530489 >> 172.21.15.112:0/1341530489 conn(0x7f580c0d3680 msgr2=0x7f580c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.041+0000 7f5812948700 1 -- 172.21.15.112:0/1341530489 shutdown_connections 2023-11-08T12:28:19.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.041+0000 7f5812948700 1 -- 172.21.15.112:0/1341530489 wait complete. 2023-11-08T12:28:19.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 Processor -- start 2023-11-08T12:28:19.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 -- start start 2023-11-08T12:28:19.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c06ff10 0x7f580c1f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:19.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f580c070360 0x7f580c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:19.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f580c15c150 0x7f580c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:19.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0ce340 con 0x7f580c06ff10 2023-11-08T12:28:19.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0cdff0 con 0x7f580c15c150 2023-11-08T12:28:19.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812948700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c1509c0 con 0x7f580c070360 2023-11-08T12:28:19.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c06ff10 0x7f580c1f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:19.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c06ff10 0x7f580c1f93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34742/0 (socket says 172.21.15.112:34742) 2023-11-08T12:28:19.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 -- 172.21.15.112:0/4003113188 learned_addr learned my addr 172.21.15.112:0/4003113188 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:19.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5812147700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f580c15c150 0x7f580c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:19.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811145700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f580c070360 0x7f580c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:19.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 -- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f580c070360 msgr2=0x7f580c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:19.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f580c070360 0x7f580c0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 -- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f580c15c150 msgr2=0x7f580c0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:19.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f580c15c150 0x7f580c0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.045+0000 7f5811946700 1 -- 172.21.15.112:0/4003113188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808009570 con 0x7f580c06ff10 2023-11-08T12:28:19.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.049+0000 7f5811946700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c06ff10 0x7f580c1f93e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5808000c00 tx=0x7f5808004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:19.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.049+0000 7f58027fc700 1 -- 172.21.15.112:0/4003113188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808004610 con 0x7f580c06ff10 2023-11-08T12:28:19.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.049+0000 7f58027fc700 1 -- 172.21.15.112:0/4003113188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580801e070 con 0x7f580c06ff10 2023-11-08T12:28:19.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.049+0000 7f58027fc700 1 -- 172.21.15.112:0/4003113188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080038e0 con 0x7f580c06ff10 2023-11-08T12:28:19.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.049+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c0d2730 con 0x7f580c06ff10 2023-11-08T12:28:19.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.049+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c0d2450 con 0x7f580c06ff10 2023-11-08T12:28:19.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.049+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c0d05e0 con 0x7f580c06ff10 2023-11-08T12:28:19.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.053+0000 7f58027fc700 1 -- 172.21.15.112:0/4003113188 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f580800f050 con 0x7f580c06ff10 2023-11-08T12:28:19.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.053+0000 7f58027fc700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f57f0064ee0 0x7f57f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:19.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.053+0000 7f58027fc700 1 -- 172.21.15.112:0/4003113188 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5808083470 con 0x7f580c06ff10 2023-11-08T12:28:19.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.053+0000 7f5811145700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f57f0064ee0 0x7f57f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:19.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.057+0000 7f5811145700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f57f0064ee0 0x7f57f0067390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f580c0b7040 tx=0x7f57fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:19.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.061+0000 7f58027fc700 1 -- 172.21.15.112:0/4003113188 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5808051230 con 0x7f580c06ff10 2023-11-08T12:28:19.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.273+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f580c073d20 con 0x7f580c06ff10 2023-11-08T12:28:19.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.817+0000 7f58027fc700 1 -- 172.21.15.112:0/4003113188 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5808054850 con 0x7f580c06ff10 2023-11-08T12:28:19.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f57f0064ee0 msgr2=0x7f57f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:19.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f57f0064ee0 0x7f57f0067390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f580c0b7040 tx=0x7f57fc009040 comp rx=0 tx=0).stop 2023-11-08T12:28:19.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c06ff10 msgr2=0x7f580c1f93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:19.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c06ff10 0x7f580c1f93e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5808000c00 tx=0x7f5808004770 comp rx=0 tx=0).stop 2023-11-08T12:28:19.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 shutdown_connections 2023-11-08T12:28:19.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f57f0064ee0 0x7f57f0067390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f580c15c150 0x7f580c0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f580c070360 0x7f580c0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 --2- 172.21.15.112:0/4003113188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f580c06ff10 0x7f580c1f93e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:19.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 >> 172.21.15.112:0/4003113188 conn(0x7f580c0d3680 msgr2=0x7f580c0b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:19.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 shutdown_connections 2023-11-08T12:28:19.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:19.821+0000 7f5812948700 1 -- 172.21.15.112:0/4003113188 wait complete. 2023-11-08T12:28:19.848 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T12:28:19.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:28:20.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6c5a700 1 Processor -- start 2023-11-08T12:28:20.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6c5a700 1 -- start start 2023-11-08T12:28:20.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6c5a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7bc0160710 0x7f7bc00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6c5a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6c5a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00ad6c0 con 0x7f7bc00705c0 2023-11-08T12:28:20.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6c5a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc0070a60 con 0x7f7bc0160710 2023-11-08T12:28:20.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6c5a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc006b1c0 con 0x7f7bc00cc860 2023-11-08T12:28:20.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6459700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7bc00705c0 0x7f7bc0069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35956/0 (socket says 172.21.15.112:35956) 2023-11-08T12:28:20.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.021+0000 7f7bc6459700 1 -- 172.21.15.112:0/2643965112 learned_addr learned my addr 172.21.15.112:0/2643965112 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc5c58700 1 --2- 172.21.15.112:0/2643965112 >> v2:172.21.15.112:3300/0 conn(0x7f7bc0160710 0x7f7bc00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc5457700 1 --2- 172.21.15.112:0/2643965112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc4c56700 1 -- 172.21.15.112:0/2643965112 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571774625 0 0) 0x7f7bc00ad6c0 con 0x7f7bc00705c0 2023-11-08T12:28:20.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc5c58700 1 -- 172.21.15.112:0/2643965112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 msgr2=0x7f7bc0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc5c58700 1 --2- 172.21.15.112:0/2643965112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc0070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc5c58700 1 -- 172.21.15.112:0/2643965112 >> v1:172.21.15.112:6789/0 conn(0x7f7bc00705c0 legacy=0x7f7bc0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc5c58700 1 -- 172.21.15.112:0/2643965112 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00adc60 con 0x7f7bc0160710 2023-11-08T12:28:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc5c58700 1 --2- 172.21.15.112:0/2643965112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc0160710 0x7f7bc00cc320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009850 tx=0x7f7bbc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2001d94332b6ba7f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc4c56700 1 -- 172.21.15.112:0/2643965112 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc011830 con 0x7f7bc0160710 2023-11-08T12:28:20.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc4c56700 1 -- 172.21.15.112:0/2643965112 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc011990 con 0x7f7bc0160710 2023-11-08T12:28:20.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc4c56700 1 -- 172.21.15.112:0/2643965112 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc011d20 con 0x7f7bc0160710 2023-11-08T12:28:20.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/2643965112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc0160710 msgr2=0x7f7bc00cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/2643965112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc0160710 0x7f7bc00cc320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009850 tx=0x7f7bbc009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:20.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/2643965112 shutdown_connections 2023-11-08T12:28:20.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/2643965112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc0070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/2643965112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc0160710 0x7f7bc00cc320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/2643965112 >> 172.21.15.112:0/2643965112 conn(0x7f7bc00b0f80 msgr2=0x7f7bc00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:20.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/2643965112 shutdown_connections 2023-11-08T12:28:20.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.025+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/2643965112 wait complete. 2023-11-08T12:28:20.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 Processor -- start 2023-11-08T12:28:20.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 -- start start 2023-11-08T12:28:20.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc00705c0 0x7f7bc015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc0160710 0x7f7bc0164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00c2420 con 0x7f7bc00705c0 2023-11-08T12:28:20.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00c1830 con 0x7f7bc0160710 2023-11-08T12:28:20.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6c5a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00c1af0 con 0x7f7bc00cc860 2023-11-08T12:28:20.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc00705c0 0x7f7bc015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc00705c0 0x7f7bc015f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34752/0 (socket says 172.21.15.112:34752) 2023-11-08T12:28:20.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 -- 172.21.15.112:0/1651702462 learned_addr learned my addr 172.21.15.112:0/1651702462 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:20.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6459700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc0160710 0x7f7bc0164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 -- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 msgr2=0x7f7bc015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5457700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 -- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc0160710 msgr2=0x7f7bc0164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc0160710 0x7f7bc0164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5c58700 1 -- 172.21.15.112:0/1651702462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc0094b0 con 0x7f7bc00705c0 2023-11-08T12:28:20.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc6459700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc0160710 0x7f7bc0164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:20.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.029+0000 7f7bc5457700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:20.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.033+0000 7f7bc5c58700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc00705c0 0x7f7bc015f0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c00 tx=0x7f7bbc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.033+0000 7f7bb67fc700 1 -- 172.21.15.112:0/1651702462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0038c0 con 0x7f7bc00705c0 2023-11-08T12:28:20.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.033+0000 7f7bb67fc700 1 -- 172.21.15.112:0/1651702462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc01e070 con 0x7f7bc00705c0 2023-11-08T12:28:20.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.033+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc006b6b0 con 0x7f7bc00705c0 2023-11-08T12:28:20.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.033+0000 7f7bb67fc700 1 -- 172.21.15.112:0/1651702462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc003c40 con 0x7f7bc00705c0 2023-11-08T12:28:20.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.033+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc006b3d0 con 0x7f7bc00705c0 2023-11-08T12:28:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.033+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc00ad8f0 con 0x7f7bc00705c0 2023-11-08T12:28:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.037+0000 7f7bb67fc700 1 -- 172.21.15.112:0/1651702462 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7bbc00f050 con 0x7f7bc00705c0 2023-11-08T12:28:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.037+0000 7f7bb67fc700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7ba4064f30 0x7f7ba40673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.037+0000 7f7bb67fc700 1 -- 172.21.15.112:0/1651702462 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7bbc0832a0 con 0x7f7bc00705c0 2023-11-08T12:28:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.037+0000 7f7bc5457700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7ba4064f30 0x7f7ba40673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.037+0000 7f7bc5457700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7ba4064f30 0x7f7ba40673e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7bc015b610 tx=0x7f7bb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.041+0000 7f7bb67fc700 1 -- 172.21.15.112:0/1651702462 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7bbc0510e0 con 0x7f7bc00705c0 2023-11-08T12:28:20.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.257+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bc0073cb0 con 0x7f7bc00705c0 2023-11-08T12:28:20.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.257+0000 7f7bb67fc700 1 -- 172.21.15.112:0/1651702462 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f7bbc054700 con 0x7f7bc00705c0 2023-11-08T12:28:20.260 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:20.260 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:28:19.810915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T12:28:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7ba4064f30 msgr2=0x7f7ba40673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7ba4064f30 0x7f7ba40673e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7bc015b610 tx=0x7f7bb0008040 comp rx=0 tx=0).stop 2023-11-08T12:28:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc00705c0 msgr2=0x7f7bc015f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc00705c0 0x7f7bc015f0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c00 tx=0x7f7bbc004770 comp rx=0 tx=0).stop 2023-11-08T12:28:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 shutdown_connections 2023-11-08T12:28:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7ba4064f30 0x7f7ba40673e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc0160710 0x7f7bc0164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7bc00cc860 0x7f7bc015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 --2- 172.21.15.112:0/1651702462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bc00705c0 0x7f7bc015f0d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 >> 172.21.15.112:0/1651702462 conn(0x7f7bc00b0f80 msgr2=0x7f7bc0162af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 shutdown_connections 2023-11-08T12:28:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.261+0000 7f7bc6c5a700 1 -- 172.21.15.112:0/1651702462 wait complete. 2023-11-08T12:28:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-11-08T12:28:20.282 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:20.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.453+0000 7fc1523d2700 1 Processor -- start 2023-11-08T12:28:20.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.453+0000 7fc1523d2700 1 -- start start 2023-11-08T12:28:20.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.453+0000 7fc1523d2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc14c06afc0 0x7fc14c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.453+0000 7fc1523d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc14c0705c0 0x7fc14c069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.453+0000 7fc1523d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0709c0 con 0x7fc14c0ced50 2023-11-08T12:28:20.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.453+0000 7fc1523d2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c06b440 con 0x7fc14c06afc0 2023-11-08T12:28:20.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.453+0000 7fc1523d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0d24d0 con 0x7fc14c0705c0 2023-11-08T12:28:20.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc14c06afc0 0x7fc14c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc14c06afc0 0x7fc14c070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34768/0 (socket says 172.21.15.112:34768) 2023-11-08T12:28:20.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 -- 172.21.15.112:0/3235276452 learned_addr learned my addr 172.21.15.112:0/3235276452 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:20.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc151bd1700 1 --2- 172.21.15.112:0/3235276452 >> v2:172.21.15.133:3300/0 conn(0x7fc14c0705c0 0x7fc14c069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 -- 172.21.15.112:0/3235276452 >> v2:172.21.15.133:3300/0 conn(0x7fc14c0705c0 msgr2=0x7fc14c069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:20.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 --2- 172.21.15.112:0/3235276452 >> v2:172.21.15.133:3300/0 conn(0x7fc14c0705c0 0x7fc14c069cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 -- 172.21.15.112:0/3235276452 >> v1:172.21.15.133:6789/0 conn(0x7fc14c0ced50 legacy=0x7fc14c160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 -- 172.21.15.112:0/3235276452 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0d27b0 con 0x7fc14c06afc0 2023-11-08T12:28:20.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc150bcf700 1 --2- 172.21.15.112:0/3235276452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c070080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0b2380 tx=0x7fc13c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f09991c62213fd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc143fff700 1 -- 172.21.15.112:0/3235276452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00b8a0 con 0x7fc14c06afc0 2023-11-08T12:28:20.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc143fff700 1 -- 172.21.15.112:0/3235276452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00ba00 con 0x7fc14c06afc0 2023-11-08T12:28:20.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc143fff700 1 -- 172.21.15.112:0/3235276452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00bd90 con 0x7fc14c06afc0 2023-11-08T12:28:20.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 -- 172.21.15.112:0/3235276452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 msgr2=0x7fc14c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3235276452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c070080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0b2380 tx=0x7fc13c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 -- 172.21.15.112:0/3235276452 shutdown_connections 2023-11-08T12:28:20.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3235276452 >> v2:172.21.15.133:3300/0 conn(0x7fc14c0705c0 0x7fc14c069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3235276452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c070080 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 -- 172.21.15.112:0/3235276452 >> 172.21.15.112:0/3235276452 conn(0x7fc14c0b53a0 msgr2=0x7fc14c0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:20.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 -- 172.21.15.112:0/3235276452 shutdown_connections 2023-11-08T12:28:20.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.457+0000 7fc1523d2700 1 -- 172.21.15.112:0/3235276452 wait complete. 2023-11-08T12:28:20.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.461+0000 7fc1523d2700 1 Processor -- start 2023-11-08T12:28:20.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.461+0000 7fc1523d2700 1 -- start start 2023-11-08T12:28:20.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c1f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c1f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc14c0705c0 0x7fc14c0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c1f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34778/0 (socket says 172.21.15.112:34778) 2023-11-08T12:28:20.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc14c0ced50 0x7fc14c0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c1e6280 con 0x7fc14c06afc0 2023-11-08T12:28:20.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 -- 172.21.15.112:0/3447089081 learned_addr learned my addr 172.21.15.112:0/3447089081 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:20.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0c7d10 con 0x7fc14c0705c0 2023-11-08T12:28:20.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c1e5440 con 0x7fc14c0ced50 2023-11-08T12:28:20.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc151bd1700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc14c0ced50 0x7fc14c0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 -- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc14c0ced50 msgr2=0x7fc14c0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc14c0ced50 0x7fc14c0c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 -- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc14c0705c0 msgr2=0x7fc14c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc14c0705c0 0x7fc14c0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c009570 con 0x7fc14c06afc0 2023-11-08T12:28:20.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc151bd1700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc14c0ced50 0x7fc14c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:20.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1513d0700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c1f1940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc14800cbc0 tx=0x7fc14800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc141ffb700 1 -- 172.21.15.112:0/3447089081 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148003c20 con 0x7fc14c06afc0 2023-11-08T12:28:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc141ffb700 1 -- 172.21.15.112:0/3447089081 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148003d80 con 0x7fc14c06afc0 2023-11-08T12:28:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c0d0bb0 con 0x7fc14c06afc0 2023-11-08T12:28:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc141ffb700 1 -- 172.21.15.112:0/3447089081 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800abb0 con 0x7fc14c06afc0 2023-11-08T12:28:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.465+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c0d08d0 con 0x7fc14c06afc0 2023-11-08T12:28:20.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.469+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c0cf120 con 0x7fc14c06afc0 2023-11-08T12:28:20.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.469+0000 7fc141ffb700 1 -- 172.21.15.112:0/3447089081 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc148010050 con 0x7fc14c06afc0 2023-11-08T12:28:20.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.469+0000 7fc141ffb700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc130064ee0 0x7fc130067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.469+0000 7fc141ffb700 1 -- 172.21.15.112:0/3447089081 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc1480821b0 con 0x7fc14c06afc0 2023-11-08T12:28:20.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.473+0000 7fc150bcf700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc130064ee0 0x7fc130067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.473+0000 7fc150bcf700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc130064ee0 0x7fc130067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0b8990 tx=0x7fc13c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.477+0000 7fc141ffb700 1 -- 172.21.15.112:0/3447089081 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc14804ff70 con 0x7fc14c06afc0 2023-11-08T12:28:20.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.661+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc14c073cb0 con 0x7fc14c06afc0 2023-11-08T12:28:20.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.665+0000 7fc141ffb700 1 -- 172.21.15.112:0/3447089081 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7fc148053590 con 0x7fc14c06afc0 2023-11-08T12:28:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:20.667 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:20.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc130064ee0 msgr2=0x7fc130067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc130064ee0 0x7fc130067390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0b8990 tx=0x7fc13c010000 comp rx=0 tx=0).stop 2023-11-08T12:28:20.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 msgr2=0x7fc14c1f1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c1f1940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc14800cbc0 tx=0x7fc14800cf80 comp rx=0 tx=0).stop 2023-11-08T12:28:20.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 shutdown_connections 2023-11-08T12:28:20.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc130064ee0 0x7fc130067390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc14c0ced50 0x7fc14c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc14c0705c0 0x7fc14c0c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 --2- 172.21.15.112:0/3447089081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc14c06afc0 0x7fc14c1f1940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 >> 172.21.15.112:0/3447089081 conn(0x7fc14c0b53a0 msgr2=0x7fc14c0b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:20.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 shutdown_connections 2023-11-08T12:28:20.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.669+0000 7fc1523d2700 1 -- 172.21.15.112:0/3447089081 wait complete. 2023-11-08T12:28:20.693 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T12:28:20.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:28:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.873+0000 7fba4c956700 1 Processor -- start 2023-11-08T12:28:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.873+0000 7fba4c956700 1 -- start start 2023-11-08T12:28:20.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba48159020 0x7fba480cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba4806d9f0 0x7fba48069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4806a590 con 0x7fba4806a130 2023-11-08T12:28:20.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4806b0d0 con 0x7fba4806d9f0 2023-11-08T12:28:20.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba480cdd20 con 0x7fba48159020 2023-11-08T12:28:20.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba4806d9f0 0x7fba48069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba4806d9f0 0x7fba48069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34786/0 (socket says 172.21.15.112:34786) 2023-11-08T12:28:20.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 -- 172.21.15.112:0/3647162353 learned_addr learned my addr 172.21.15.112:0/3647162353 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba477fe700 1 --2- 172.21.15.112:0/3647162353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba48159020 0x7fba480cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 -- 172.21.15.112:0/3647162353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba48159020 msgr2=0x7fba480cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 --2- 172.21.15.112:0/3647162353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba48159020 0x7fba480cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 -- 172.21.15.112:0/3647162353 >> v1:172.21.15.133:6789/0 conn(0x7fba4806a130 legacy=0x7fba4806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 -- 172.21.15.112:0/3647162353 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba480c8b60 con 0x7fba4806d9f0 2023-11-08T12:28:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba46ffd700 1 --2- 172.21.15.112:0/3647162353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806d9f0 0x7fba48069bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009910 tx=0x7fba3c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceadf12640b18b79 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba467fc700 1 -- 172.21.15.112:0/3647162353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c011830 con 0x7fba4806d9f0 2023-11-08T12:28:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba467fc700 1 -- 172.21.15.112:0/3647162353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c011990 con 0x7fba4806d9f0 2023-11-08T12:28:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba467fc700 1 -- 172.21.15.112:0/3647162353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c011d40 con 0x7fba4806d9f0 2023-11-08T12:28:20.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- 172.21.15.112:0/3647162353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806d9f0 msgr2=0x7fba48069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 --2- 172.21.15.112:0/3647162353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806d9f0 0x7fba48069bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009910 tx=0x7fba3c009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- 172.21.15.112:0/3647162353 shutdown_connections 2023-11-08T12:28:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 --2- 172.21.15.112:0/3647162353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806d9f0 0x7fba48069bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 --2- 172.21.15.112:0/3647162353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba48159020 0x7fba480cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- 172.21.15.112:0/3647162353 >> 172.21.15.112:0/3647162353 conn(0x7fba480ce510 msgr2=0x7fba480ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- 172.21.15.112:0/3647162353 shutdown_connections 2023-11-08T12:28:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.877+0000 7fba4c956700 1 -- 172.21.15.112:0/3647162353 wait complete. 2023-11-08T12:28:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 Processor -- start 2023-11-08T12:28:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 -- start start 2023-11-08T12:28:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806a130 0x7fba480cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba4806d9f0 0x7fba480cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba48159020 0x7fba480cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba480c3090 con 0x7fba4806a130 2023-11-08T12:28:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba480c9d50 con 0x7fba48159020 2023-11-08T12:28:20.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba4c956700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba480ca030 con 0x7fba4806d9f0 2023-11-08T12:28:20.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806a130 0x7fba480cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806a130 0x7fba480cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34796/0 (socket says 172.21.15.112:34796) 2023-11-08T12:28:20.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 -- 172.21.15.112:0/1454277917 learned_addr learned my addr 172.21.15.112:0/1454277917 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:20.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba47fff700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba48159020 0x7fba480cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba46ffd700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba4806d9f0 0x7fba480cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 -- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba4806d9f0 msgr2=0x7fba480cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba4806d9f0 0x7fba480cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 -- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba48159020 msgr2=0x7fba480cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba48159020 0x7fba480cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 -- 172.21.15.112:0/1454277917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c009570 con 0x7fba4806a130 2023-11-08T12:28:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.881+0000 7fba477fe700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806a130 0x7fba480cab90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9b0 tx=0x7fba3800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.885+0000 7fba2ffff700 1 -- 172.21.15.112:0/1454277917 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38009670 con 0x7fba4806a130 2023-11-08T12:28:20.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.885+0000 7fba2ffff700 1 -- 172.21.15.112:0/1454277917 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800c850 con 0x7fba4806a130 2023-11-08T12:28:20.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.885+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba480cc280 con 0x7fba4806a130 2023-11-08T12:28:20.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.885+0000 7fba2ffff700 1 -- 172.21.15.112:0/1454277917 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800cbc0 con 0x7fba4806a130 2023-11-08T12:28:20.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.885+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4806b320 con 0x7fba4806a130 2023-11-08T12:28:20.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.885+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba480cc560 con 0x7fba4806a130 2023-11-08T12:28:20.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.885+0000 7fba2ffff700 1 -- 172.21.15.112:0/1454277917 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fba38023070 con 0x7fba4806a130 2023-11-08T12:28:20.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.889+0000 7fba2ffff700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba34064f10 0x7fba340673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:20.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.889+0000 7fba2ffff700 1 -- 172.21.15.112:0/1454277917 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba38082420 con 0x7fba4806a130 2023-11-08T12:28:20.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.889+0000 7fba46ffd700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba34064f10 0x7fba340673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.889+0000 7fba46ffd700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba34064f10 0x7fba340673c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba4806d8d0 tx=0x7fba3c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:20.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:20.893+0000 7fba2ffff700 1 -- 172.21.15.112:0/1454277917 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fba380502d0 con 0x7fba4806a130 2023-11-08T12:28:21.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.057+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba480ad200 con 0x7fba34064f10 2023-11-08T12:28:21.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.073+0000 7fba2ffff700 1 -- 172.21.15.112:0/1454277917 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367069 (secure 0 0 0) 0x7fba480ad200 con 0x7fba34064f10 2023-11-08T12:28:21.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:21.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba34064f10 msgr2=0x7fba340673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba34064f10 0x7fba340673c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba4806d8d0 tx=0x7fba3c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:21.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806a130 msgr2=0x7fba480cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806a130 0x7fba480cab90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9b0 tx=0x7fba3800ed70 comp rx=0 tx=0).stop 2023-11-08T12:28:21.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 shutdown_connections 2023-11-08T12:28:21.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fba34064f10 0x7fba340673c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba48159020 0x7fba480cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba4806d9f0 0x7fba480cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 --2- 172.21.15.112:0/1454277917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba4806a130 0x7fba480cab90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 >> 172.21.15.112:0/1454277917 conn(0x7fba480ce510 msgr2=0x7fba480b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:21.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 shutdown_connections 2023-11-08T12:28:21.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.085+0000 7fba4c956700 1 -- 172.21.15.112:0/1454277917 wait complete. 2023-11-08T12:28:21.090 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:28:21.110 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-11-08T12:28:20.715622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67592,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907128,"statfs":{"total":773094113280,"available":773024899072,"internally_reserved":0,"allocated":3678208,"data_stored":2187254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005234"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734482+0000","last_change":"2023-11-08T12:27:58.143715+0000","last_active":"2023-11-08T12:27:58.734482+0000","last_peered":"2023-11-08T12:27:58.734482+0000","last_clean":"2023-11-08T12:27:58.734482+0000","last_became_active":"2023-11-08T12:27:58.143212+0000","last_became_peered":"2023-11-08T12:27:58.143212+0000","last_unstale":"2023-11-08T12:27:58.734482+0000","last_undegraded":"2023-11-08T12:27:58.734482+0000","last_fullsized":"2023-11-08T12:27:58.734482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:00:05.519929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130697+0000","last_change":"2023-11-08T12:27:53.619554+0000","last_active":"2023-11-08T12:27:58.130697+0000","last_peered":"2023-11-08T12:27:58.130697+0000","last_clean":"2023-11-08T12:27:58.130697+0000","last_became_active":"2023-11-08T12:27:53.618719+0000","last_became_peered":"2023-11-08T12:27:53.618719+0000","last_unstale":"2023-11-08T12:27:58.130697+0000","last_undegraded":"2023-11-08T12:27:58.130697+0000","last_fullsized":"2023-11-08T12:27:58.130697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126104+0000","last_change":"2023-11-08T12:27:54.093845+0000","last_active":"2023-11-08T12:27:58.126104+0000","last_peered":"2023-11-08T12:27:58.126104+0000","last_clean":"2023-11-08T12:27:58.126104+0000","last_became_active":"2023-11-08T12:27:54.093578+0000","last_became_peered":"2023-11-08T12:27:54.093578+0000","last_unstale":"2023-11-08T12:27:58.126104+0000","last_undegraded":"2023-11-08T12:27:58.126104+0000","last_fullsized":"2023-11-08T12:27:58.126104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625901+0000","last_change":"2023-11-08T12:27:58.137408+0000","last_active":"2023-11-08T12:27:58.625901+0000","last_peered":"2023-11-08T12:27:58.625901+0000","last_clean":"2023-11-08T12:27:58.625901+0000","last_became_active":"2023-11-08T12:27:58.136515+0000","last_became_peered":"2023-11-08T12:27:58.136515+0000","last_unstale":"2023-11-08T12:27:58.625901+0000","last_undegraded":"2023-11-08T12:27:58.625901+0000","last_fullsized":"2023-11-08T12:27:58.625901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:02:41.434275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.116564+0000","last_change":"2023-11-08T12:27:53.619875+0000","last_active":"2023-11-08T12:27:58.116564+0000","last_peered":"2023-11-08T12:27:58.116564+0000","last_clean":"2023-11-08T12:27:58.116564+0000","last_became_active":"2023-11-08T12:27:53.619543+0000","last_became_peered":"2023-11-08T12:27:53.619543+0000","last_unstale":"2023-11-08T12:27:58.116564+0000","last_undegraded":"2023-11-08T12:27:58.116564+0000","last_fullsized":"2023-11-08T12:27:58.116564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111227+0000","last_change":"2023-11-08T12:27:54.083208+0000","last_active":"2023-11-08T12:27:58.111227+0000","last_peered":"2023-11-08T12:27:58.111227+0000","last_clean":"2023-11-08T12:27:58.111227+0000","last_became_active":"2023-11-08T12:27:54.082680+0000","last_became_peered":"2023-11-08T12:27:54.082680+0000","last_unstale":"2023-11-08T12:27:58.111227+0000","last_undegraded":"2023-11-08T12:27:58.111227+0000","last_fullsized":"2023-11-08T12:27:58.111227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574345+0000","last_change":"2023-11-08T12:27:58.142185+0000","last_active":"2023-11-08T12:27:58.574345+0000","last_peered":"2023-11-08T12:27:58.574345+0000","last_clean":"2023-11-08T12:27:58.574345+0000","last_became_active":"2023-11-08T12:27:58.141842+0000","last_became_peered":"2023-11-08T12:27:58.141842+0000","last_unstale":"2023-11-08T12:27:58.574345+0000","last_undegraded":"2023-11-08T12:27:58.574345+0000","last_fullsized":"2023-11-08T12:27:58.574345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:02:41.632614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110470+0000","last_change":"2023-11-08T12:27:53.624797+0000","last_active":"2023-11-08T12:27:58.110470+0000","last_peered":"2023-11-08T12:27:58.110470+0000","last_clean":"2023-11-08T12:27:58.110470+0000","last_became_active":"2023-11-08T12:27:53.624543+0000","last_became_peered":"2023-11-08T12:27:53.624543+0000","last_unstale":"2023-11-08T12:27:58.110470+0000","last_undegraded":"2023-11-08T12:27:58.110470+0000","last_fullsized":"2023-11-08T12:27:58.110470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:30.363156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127249+0000","last_change":"2023-11-08T12:27:54.100828+0000","last_active":"2023-11-08T12:27:58.127249+0000","last_peered":"2023-11-08T12:27:58.127249+0000","last_clean":"2023-11-08T12:27:58.127249+0000","last_became_active":"2023-11-08T12:27:54.100558+0000","last_became_peered":"2023-11-08T12:27:54.100558+0000","last_unstale":"2023-11-08T12:27:58.127249+0000","last_undegraded":"2023-11-08T12:27:58.127249+0000","last_fullsized":"2023-11-08T12:27:58.127249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879088+0000","last_change":"2023-11-08T12:27:58.154104+0000","last_active":"2023-11-08T12:27:58.879088+0000","last_peered":"2023-11-08T12:27:58.879088+0000","last_clean":"2023-11-08T12:27:58.879088+0000","last_became_active":"2023-11-08T12:27:58.153162+0000","last_became_peered":"2023-11-08T12:27:58.153162+0000","last_unstale":"2023-11-08T12:27:58.879088+0000","last_undegraded":"2023-11-08T12:27:58.879088+0000","last_fullsized":"2023-11-08T12:27:58.879088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109644+0000","last_change":"2023-11-08T12:27:53.622313+0000","last_active":"2023-11-08T12:27:58.109644+0000","last_peered":"2023-11-08T12:27:58.109644+0000","last_clean":"2023-11-08T12:27:58.109644+0000","last_became_active":"2023-11-08T12:27:53.621963+0000","last_became_peered":"2023-11-08T12:27:53.621963+0000","last_unstale":"2023-11-08T12:27:58.109644+0000","last_undegraded":"2023-11-08T12:27:58.109644+0000","last_fullsized":"2023-11-08T12:27:58.109644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:58.001489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127020+0000","last_change":"2023-11-08T12:27:54.096898+0000","last_active":"2023-11-08T12:27:58.127020+0000","last_peered":"2023-11-08T12:27:58.127020+0000","last_clean":"2023-11-08T12:27:58.127020+0000","last_became_active":"2023-11-08T12:27:54.096604+0000","last_became_peered":"2023-11-08T12:27:54.096604+0000","last_unstale":"2023-11-08T12:27:58.127020+0000","last_undegraded":"2023-11-08T12:27:58.127020+0000","last_fullsized":"2023-11-08T12:27:58.127020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735720+0000","last_change":"2023-11-08T12:27:58.144552+0000","last_active":"2023-11-08T12:27:58.735720+0000","last_peered":"2023-11-08T12:27:58.735720+0000","last_clean":"2023-11-08T12:27:58.735720+0000","last_became_active":"2023-11-08T12:27:58.144149+0000","last_became_peered":"2023-11-08T12:27:58.144149+0000","last_unstale":"2023-11-08T12:27:58.735720+0000","last_undegraded":"2023-11-08T12:27:58.735720+0000","last_fullsized":"2023-11-08T12:27:58.735720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.131880+0000","last_change":"2023-11-08T12:27:53.626681+0000","last_active":"2023-11-08T12:27:58.131880+0000","last_peered":"2023-11-08T12:27:58.131880+0000","last_clean":"2023-11-08T12:27:58.131880+0000","last_became_active":"2023-11-08T12:27:53.625885+0000","last_became_peered":"2023-11-08T12:27:53.625885+0000","last_unstale":"2023-11-08T12:27:58.131880+0000","last_undegraded":"2023-11-08T12:27:58.131880+0000","last_fullsized":"2023-11-08T12:27:58.131880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112234+0000","last_change":"2023-11-08T12:27:54.089379+0000","last_active":"2023-11-08T12:27:58.112234+0000","last_peered":"2023-11-08T12:27:58.112234+0000","last_clean":"2023-11-08T12:27:58.112234+0000","last_became_active":"2023-11-08T12:27:54.089095+0000","last_became_peered":"2023-11-08T12:27:54.089095+0000","last_unstale":"2023-11-08T12:27:58.112234+0000","last_undegraded":"2023-11-08T12:27:58.112234+0000","last_fullsized":"2023-11-08T12:27:58.112234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:02.028291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.626502+0000","last_change":"2023-11-08T12:27:58.143308+0000","last_active":"2023-11-08T12:27:58.626502+0000","last_peered":"2023-11-08T12:27:58.626502+0000","last_clean":"2023-11-08T12:27:58.626502+0000","last_became_active":"2023-11-08T12:27:58.142966+0000","last_became_peered":"2023-11-08T12:27:58.142966+0000","last_unstale":"2023-11-08T12:27:58.626502+0000","last_undegraded":"2023-11-08T12:27:58.626502+0000","last_fullsized":"2023-11-08T12:27:58.626502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:55.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127396+0000","last_change":"2023-11-08T12:27:53.627388+0000","last_active":"2023-11-08T12:27:58.127396+0000","last_peered":"2023-11-08T12:27:58.127396+0000","last_clean":"2023-11-08T12:27:58.127396+0000","last_became_active":"2023-11-08T12:27:53.625097+0000","last_became_peered":"2023-11-08T12:27:53.625097+0000","last_unstale":"2023-11-08T12:27:58.127396+0000","last_undegraded":"2023-11-08T12:27:58.127396+0000","last_fullsized":"2023-11-08T12:27:58.127396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:48.205657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112661+0000","last_change":"2023-11-08T12:27:54.091732+0000","last_active":"2023-11-08T12:27:58.112661+0000","last_peered":"2023-11-08T12:27:58.112661+0000","last_clean":"2023-11-08T12:27:58.112661+0000","last_became_active":"2023-11-08T12:27:54.090672+0000","last_became_peered":"2023-11-08T12:27:54.090672+0000","last_unstale":"2023-11-08T12:27:58.112661+0000","last_undegraded":"2023-11-08T12:27:58.112661+0000","last_fullsized":"2023-11-08T12:27:58.112661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.068573+0000","last_change":"2023-11-08T12:27:58.149046+0000","last_active":"2023-11-08T12:27:59.068573+0000","last_peered":"2023-11-08T12:27:59.068573+0000","last_clean":"2023-11-08T12:27:59.068573+0000","last_became_active":"2023-11-08T12:27:58.148283+0000","last_became_peered":"2023-11-08T12:27:58.148283+0000","last_unstale":"2023-11-08T12:27:59.068573+0000","last_undegraded":"2023-11-08T12:27:59.068573+0000","last_fullsized":"2023-11-08T12:27:59.068573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:06.214828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123874+0000","last_change":"2023-11-08T12:27:53.618474+0000","last_active":"2023-11-08T12:27:58.123874+0000","last_peered":"2023-11-08T12:27:58.123874+0000","last_clean":"2023-11-08T12:27:58.123874+0000","last_became_active":"2023-11-08T12:27:53.617981+0000","last_became_peered":"2023-11-08T12:27:53.617981+0000","last_unstale":"2023-11-08T12:27:58.123874+0000","last_undegraded":"2023-11-08T12:27:58.123874+0000","last_fullsized":"2023-11-08T12:27:58.123874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128422+0000","last_change":"2023-11-08T12:27:54.116480+0000","last_active":"2023-11-08T12:27:58.128422+0000","last_peered":"2023-11-08T12:27:58.128422+0000","last_clean":"2023-11-08T12:27:58.128422+0000","last_became_active":"2023-11-08T12:27:54.116211+0000","last_became_peered":"2023-11-08T12:27:54.116211+0000","last_unstale":"2023-11-08T12:27:58.128422+0000","last_undegraded":"2023-11-08T12:27:58.128422+0000","last_fullsized":"2023-11-08T12:27:58.128422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727992+0000","last_change":"2023-11-08T12:27:58.145667+0000","last_active":"2023-11-08T12:27:58.727992+0000","last_peered":"2023-11-08T12:27:58.727992+0000","last_clean":"2023-11-08T12:27:58.727992+0000","last_became_active":"2023-11-08T12:27:58.145298+0000","last_became_peered":"2023-11-08T12:27:58.145298+0000","last_unstale":"2023-11-08T12:27:58.727992+0000","last_undegraded":"2023-11-08T12:27:58.727992+0000","last_fullsized":"2023-11-08T12:27:58.727992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112268+0000","last_change":"2023-11-08T12:27:53.612017+0000","last_active":"2023-11-08T12:27:58.112268+0000","last_peered":"2023-11-08T12:27:58.112268+0000","last_clean":"2023-11-08T12:27:58.112268+0000","last_became_active":"2023-11-08T12:27:53.611179+0000","last_became_peered":"2023-11-08T12:27:53.611179+0000","last_unstale":"2023-11-08T12:27:58.112268+0000","last_undegraded":"2023-11-08T12:27:58.112268+0000","last_fullsized":"2023-11-08T12:27:58.112268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135571+0000","last_change":"2023-11-08T12:27:54.089485+0000","last_active":"2023-11-08T12:27:58.135571+0000","last_peered":"2023-11-08T12:27:58.135571+0000","last_clean":"2023-11-08T12:27:58.135571+0000","last_became_active":"2023-11-08T12:27:54.089151+0000","last_became_peered":"2023-11-08T12:27:54.089151+0000","last_unstale":"2023-11-08T12:27:58.135571+0000","last_undegraded":"2023-11-08T12:27:58.135571+0000","last_fullsized":"2023-11-08T12:27:58.135571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:14.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111497+0000","last_change":"2023-11-08T12:27:54.084403+0000","last_active":"2023-11-08T12:27:58.111497+0000","last_peered":"2023-11-08T12:27:58.111497+0000","last_clean":"2023-11-08T12:27:58.111497+0000","last_became_active":"2023-11-08T12:27:54.084144+0000","last_became_peered":"2023-11-08T12:27:54.084144+0000","last_unstale":"2023-11-08T12:27:58.111497+0000","last_undegraded":"2023-11-08T12:27:58.111497+0000","last_fullsized":"2023-11-08T12:27:58.111497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130737+0000","last_change":"2023-11-08T12:27:53.621364+0000","last_active":"2023-11-08T12:27:58.130737+0000","last_peered":"2023-11-08T12:27:58.130737+0000","last_clean":"2023-11-08T12:27:58.130737+0000","last_became_active":"2023-11-08T12:27:53.619170+0000","last_became_peered":"2023-11-08T12:27:53.619170+0000","last_unstale":"2023-11-08T12:27:58.130737+0000","last_undegraded":"2023-11-08T12:27:58.130737+0000","last_fullsized":"2023-11-08T12:27:58.130737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067445+0000","last_change":"2023-11-08T12:27:58.143148+0000","last_active":"2023-11-08T12:27:59.067445+0000","last_peered":"2023-11-08T12:27:59.067445+0000","last_clean":"2023-11-08T12:27:59.067445+0000","last_became_active":"2023-11-08T12:27:58.142740+0000","last_became_peered":"2023-11-08T12:27:58.142740+0000","last_unstale":"2023-11-08T12:27:59.067445+0000","last_undegraded":"2023-11-08T12:27:59.067445+0000","last_fullsized":"2023-11-08T12:27:59.067445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:35.390792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111098+0000","last_change":"2023-11-08T12:27:54.117016+0000","last_active":"2023-11-08T12:27:58.111098+0000","last_peered":"2023-11-08T12:27:58.111098+0000","last_clean":"2023-11-08T12:27:58.111098+0000","last_became_active":"2023-11-08T12:27:54.116727+0000","last_became_peered":"2023-11-08T12:27:54.116727+0000","last_unstale":"2023-11-08T12:27:58.111098+0000","last_undegraded":"2023-11-08T12:27:58.111098+0000","last_fullsized":"2023-11-08T12:27:58.111098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110642+0000","last_change":"2023-11-08T12:27:53.615988+0000","last_active":"2023-11-08T12:27:58.110642+0000","last_peered":"2023-11-08T12:27:58.110642+0000","last_clean":"2023-11-08T12:27:58.110642+0000","last_became_active":"2023-11-08T12:27:53.615438+0000","last_became_peered":"2023-11-08T12:27:53.615438+0000","last_unstale":"2023-11-08T12:27:58.110642+0000","last_undegraded":"2023-11-08T12:27:58.110642+0000","last_fullsized":"2023-11-08T12:27:58.110642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:35.164663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878583+0000","last_change":"2023-11-08T12:27:58.153999+0000","last_active":"2023-11-08T12:27:58.878583+0000","last_peered":"2023-11-08T12:27:58.878583+0000","last_clean":"2023-11-08T12:27:58.878583+0000","last_became_active":"2023-11-08T12:27:58.152623+0000","last_became_peered":"2023-11-08T12:27:58.152623+0000","last_unstale":"2023-11-08T12:27:58.878583+0000","last_undegraded":"2023-11-08T12:27:58.878583+0000","last_fullsized":"2023-11-08T12:27:58.878583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122939+0000","last_change":"2023-11-08T12:27:53.621214+0000","last_active":"2023-11-08T12:27:58.122939+0000","last_peered":"2023-11-08T12:27:58.122939+0000","last_clean":"2023-11-08T12:27:58.122939+0000","last_became_active":"2023-11-08T12:27:53.620914+0000","last_became_peered":"2023-11-08T12:27:53.620914+0000","last_unstale":"2023-11-08T12:27:58.122939+0000","last_undegraded":"2023-11-08T12:27:58.122939+0000","last_fullsized":"2023-11-08T12:27:58.122939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:07.559515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127137+0000","last_change":"2023-11-08T12:27:54.093415+0000","last_active":"2023-11-08T12:27:58.127137+0000","last_peered":"2023-11-08T12:27:58.127137+0000","last_clean":"2023-11-08T12:27:58.127137+0000","last_became_active":"2023-11-08T12:27:54.092409+0000","last_became_peered":"2023-11-08T12:27:54.092409+0000","last_unstale":"2023-11-08T12:27:58.127137+0000","last_undegraded":"2023-11-08T12:27:58.127137+0000","last_fullsized":"2023-11-08T12:27:58.127137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572683+0000","last_change":"2023-11-08T12:27:58.143576+0000","last_active":"2023-11-08T12:27:58.572683+0000","last_peered":"2023-11-08T12:27:58.572683+0000","last_clean":"2023-11-08T12:27:58.572683+0000","last_became_active":"2023-11-08T12:27:58.143166+0000","last_became_peered":"2023-11-08T12:27:58.143166+0000","last_unstale":"2023-11-08T12:27:58.572683+0000","last_undegraded":"2023-11-08T12:27:58.572683+0000","last_fullsized":"2023-11-08T12:27:58.572683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:28:10.838649+0000","last_change":"2023-11-08T12:27:53.627035+0000","last_active":"2023-11-08T12:28:10.838649+0000","last_peered":"2023-11-08T12:28:10.838649+0000","last_clean":"2023-11-08T12:28:10.838649+0000","last_became_active":"2023-11-08T12:27:53.625128+0000","last_became_peered":"2023-11-08T12:27:53.625128+0000","last_unstale":"2023-11-08T12:28:10.838649+0000","last_undegraded":"2023-11-08T12:28:10.838649+0000","last_fullsized":"2023-11-08T12:28:10.838649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127106+0000","last_change":"2023-11-08T12:27:54.095419+0000","last_active":"2023-11-08T12:27:58.127106+0000","last_peered":"2023-11-08T12:27:58.127106+0000","last_clean":"2023-11-08T12:27:58.127106+0000","last_became_active":"2023-11-08T12:27:54.095149+0000","last_became_peered":"2023-11-08T12:27:54.095149+0000","last_unstale":"2023-11-08T12:27:58.127106+0000","last_undegraded":"2023-11-08T12:27:58.127106+0000","last_fullsized":"2023-11-08T12:27:58.127106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734672+0000","last_change":"2023-11-08T12:27:58.153991+0000","last_active":"2023-11-08T12:27:58.734672+0000","last_peered":"2023-11-08T12:27:58.734672+0000","last_clean":"2023-11-08T12:27:58.734672+0000","last_became_active":"2023-11-08T12:27:58.153570+0000","last_became_peered":"2023-11-08T12:27:58.153570+0000","last_unstale":"2023-11-08T12:27:58.734672+0000","last_undegraded":"2023-11-08T12:27:58.734672+0000","last_fullsized":"2023-11-08T12:27:58.734672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:18:44.567768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126320+0000","last_change":"2023-11-08T12:27:54.097273+0000","last_active":"2023-11-08T12:27:58.126320+0000","last_peered":"2023-11-08T12:27:58.126320+0000","last_clean":"2023-11-08T12:27:58.126320+0000","last_became_active":"2023-11-08T12:27:54.097022+0000","last_became_peered":"2023-11-08T12:27:54.097022+0000","last_unstale":"2023-11-08T12:27:58.126320+0000","last_undegraded":"2023-11-08T12:27:58.126320+0000","last_fullsized":"2023-11-08T12:27:58.126320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135667+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:27:58.135667+0000","last_peered":"2023-11-08T12:27:58.135667+0000","last_clean":"2023-11-08T12:27:58.135667+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:27:58.135667+0000","last_undegraded":"2023-11-08T12:27:58.135667+0000","last_fullsized":"2023-11-08T12:27:58.135667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.728537+0000","last_change":"2023-11-08T12:27:53.620399+0000","last_active":"2023-11-08T12:27:58.728537+0000","last_peered":"2023-11-08T12:27:58.728537+0000","last_clean":"2023-11-08T12:27:58.728537+0000","last_became_active":"2023-11-08T12:27:53.619858+0000","last_became_peered":"2023-11-08T12:27:53.619858+0000","last_unstale":"2023-11-08T12:27:58.728537+0000","last_undegraded":"2023-11-08T12:27:58.728537+0000","last_fullsized":"2023-11-08T12:27:58.728537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572203+0000","last_change":"2023-11-08T12:27:58.138249+0000","last_active":"2023-11-08T12:27:58.572203+0000","last_peered":"2023-11-08T12:27:58.572203+0000","last_clean":"2023-11-08T12:27:58.572203+0000","last_became_active":"2023-11-08T12:27:58.136905+0000","last_became_peered":"2023-11-08T12:27:58.136905+0000","last_unstale":"2023-11-08T12:27:58.572203+0000","last_undegraded":"2023-11-08T12:27:58.572203+0000","last_fullsized":"2023-11-08T12:27:58.572203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111643+0000","last_change":"2023-11-08T12:27:54.113672+0000","last_active":"2023-11-08T12:27:58.111643+0000","last_peered":"2023-11-08T12:27:58.111643+0000","last_clean":"2023-11-08T12:27:58.111643+0000","last_became_active":"2023-11-08T12:27:54.113329+0000","last_became_peered":"2023-11-08T12:27:54.113329+0000","last_unstale":"2023-11-08T12:27:58.111643+0000","last_undegraded":"2023-11-08T12:27:58.111643+0000","last_fullsized":"2023-11-08T12:27:58.111643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126943+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:27:58.126943+0000","last_peered":"2023-11-08T12:27:58.126943+0000","last_clean":"2023-11-08T12:27:58.126943+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:27:58.126943+0000","last_undegraded":"2023-11-08T12:27:58.126943+0000","last_fullsized":"2023-11-08T12:27:58.126943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.118099+0000","last_change":"2023-11-08T12:27:53.617273+0000","last_active":"2023-11-08T12:27:58.118099+0000","last_peered":"2023-11-08T12:27:58.118099+0000","last_clean":"2023-11-08T12:27:58.118099+0000","last_became_active":"2023-11-08T12:27:53.616974+0000","last_became_peered":"2023-11-08T12:27:53.616974+0000","last_unstale":"2023-11-08T12:27:58.118099+0000","last_undegraded":"2023-11-08T12:27:58.118099+0000","last_fullsized":"2023-11-08T12:27:58.118099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625634+0000","last_change":"2023-11-08T12:27:58.149407+0000","last_active":"2023-11-08T12:27:58.625634+0000","last_peered":"2023-11-08T12:27:58.625634+0000","last_clean":"2023-11-08T12:27:58.625634+0000","last_became_active":"2023-11-08T12:27:58.148897+0000","last_became_peered":"2023-11-08T12:27:58.148897+0000","last_unstale":"2023-11-08T12:27:58.625634+0000","last_undegraded":"2023-11-08T12:27:58.625634+0000","last_fullsized":"2023-11-08T12:27:58.625634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:49.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129170+0000","last_change":"2023-11-08T12:27:54.116232+0000","last_active":"2023-11-08T12:27:58.129170+0000","last_peered":"2023-11-08T12:27:58.129170+0000","last_clean":"2023-11-08T12:27:58.129170+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129170+0000","last_undegraded":"2023-11-08T12:27:58.129170+0000","last_fullsized":"2023-11-08T12:27:58.129170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123167+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:27:58.123167+0000","last_peered":"2023-11-08T12:27:58.123167+0000","last_clean":"2023-11-08T12:27:58.123167+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:27:58.123167+0000","last_undegraded":"2023-11-08T12:27:58.123167+0000","last_fullsized":"2023-11-08T12:27:58.123167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126485+0000","last_change":"2023-11-08T12:27:53.615162+0000","last_active":"2023-11-08T12:27:58.126485+0000","last_peered":"2023-11-08T12:27:58.126485+0000","last_clean":"2023-11-08T12:27:58.126485+0000","last_became_active":"2023-11-08T12:27:53.613969+0000","last_became_peered":"2023-11-08T12:27:53.613969+0000","last_unstale":"2023-11-08T12:27:58.126485+0000","last_undegraded":"2023-11-08T12:27:58.126485+0000","last_fullsized":"2023-11-08T12:27:58.126485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067771+0000","last_change":"2023-11-08T12:27:58.135959+0000","last_active":"2023-11-08T12:27:59.067771+0000","last_peered":"2023-11-08T12:27:59.067771+0000","last_clean":"2023-11-08T12:27:59.067771+0000","last_became_active":"2023-11-08T12:27:58.135005+0000","last_became_peered":"2023-11-08T12:27:58.135005+0000","last_unstale":"2023-11-08T12:27:59.067771+0000","last_undegraded":"2023-11-08T12:27:59.067771+0000","last_fullsized":"2023-11-08T12:27:59.067771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:40.554359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127218+0000","last_change":"2023-11-08T12:27:54.101570+0000","last_active":"2023-11-08T12:27:58.127218+0000","last_peered":"2023-11-08T12:27:58.127218+0000","last_clean":"2023-11-08T12:27:58.127218+0000","last_became_active":"2023-11-08T12:27:54.101436+0000","last_became_peered":"2023-11-08T12:27:54.101436+0000","last_unstale":"2023-11-08T12:27:58.127218+0000","last_undegraded":"2023-11-08T12:27:58.127218+0000","last_fullsized":"2023-11-08T12:27:58.127218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127048+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:27:58.127048+0000","last_peered":"2023-11-08T12:27:58.127048+0000","last_clean":"2023-11-08T12:27:58.127048+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:27:58.127048+0000","last_undegraded":"2023-11-08T12:27:58.127048+0000","last_fullsized":"2023-11-08T12:27:58.127048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110574+0000","last_change":"2023-11-08T12:27:53.610684+0000","last_active":"2023-11-08T12:27:58.110574+0000","last_peered":"2023-11-08T12:27:58.110574+0000","last_clean":"2023-11-08T12:27:58.110574+0000","last_became_active":"2023-11-08T12:27:53.610294+0000","last_became_peered":"2023-11-08T12:27:53.610294+0000","last_unstale":"2023-11-08T12:27:58.110574+0000","last_undegraded":"2023-11-08T12:27:58.110574+0000","last_fullsized":"2023-11-08T12:27:58.110574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727740+0000","last_change":"2023-11-08T12:27:58.142126+0000","last_active":"2023-11-08T12:27:58.727740+0000","last_peered":"2023-11-08T12:27:58.727740+0000","last_clean":"2023-11-08T12:27:58.727740+0000","last_became_active":"2023-11-08T12:27:58.139937+0000","last_became_peered":"2023-11-08T12:27:58.139937+0000","last_unstale":"2023-11-08T12:27:58.727740+0000","last_undegraded":"2023-11-08T12:27:58.727740+0000","last_fullsized":"2023-11-08T12:27:58.727740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:25:36.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126398+0000","last_change":"2023-11-08T12:27:54.098374+0000","last_active":"2023-11-08T12:27:58.126398+0000","last_peered":"2023-11-08T12:27:58.126398+0000","last_clean":"2023-11-08T12:27:58.126398+0000","last_became_active":"2023-11-08T12:27:54.095259+0000","last_became_peered":"2023-11-08T12:27:54.095259+0000","last_unstale":"2023-11-08T12:27:58.126398+0000","last_undegraded":"2023-11-08T12:27:58.126398+0000","last_fullsized":"2023-11-08T12:27:58.126398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127272+0000","last_change":"2023-11-08T12:27:53.624589+0000","last_active":"2023-11-08T12:27:58.127272+0000","last_peered":"2023-11-08T12:27:58.127272+0000","last_clean":"2023-11-08T12:27:58.127272+0000","last_became_active":"2023-11-08T12:27:53.624171+0000","last_became_peered":"2023-11-08T12:27:53.624171+0000","last_unstale":"2023-11-08T12:27:58.127272+0000","last_undegraded":"2023-11-08T12:27:58.127272+0000","last_fullsized":"2023-11-08T12:27:58.127272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109600+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:27:58.109600+0000","last_peered":"2023-11-08T12:27:58.109600+0000","last_clean":"2023-11-08T12:27:58.109600+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:27:58.109600+0000","last_undegraded":"2023-11-08T12:27:58.109600+0000","last_fullsized":"2023-11-08T12:27:58.109600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727835+0000","last_change":"2023-11-08T12:27:58.142674+0000","last_active":"2023-11-08T12:27:58.727835+0000","last_peered":"2023-11-08T12:27:58.727835+0000","last_clean":"2023-11-08T12:27:58.727835+0000","last_became_active":"2023-11-08T12:27:58.142302+0000","last_became_peered":"2023-11-08T12:27:58.142302+0000","last_unstale":"2023-11-08T12:27:58.727835+0000","last_undegraded":"2023-11-08T12:27:58.727835+0000","last_fullsized":"2023-11-08T12:27:58.727835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127069+0000","last_change":"2023-11-08T12:27:54.102964+0000","last_active":"2023-11-08T12:27:58.127069+0000","last_peered":"2023-11-08T12:27:58.127069+0000","last_clean":"2023-11-08T12:27:58.127069+0000","last_became_active":"2023-11-08T12:27:54.102407+0000","last_became_peered":"2023-11-08T12:27:54.102407+0000","last_unstale":"2023-11-08T12:27:58.127069+0000","last_undegraded":"2023-11-08T12:27:58.127069+0000","last_fullsized":"2023-11-08T12:27:58.127069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:05.031348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130328+0000","last_change":"2023-11-08T12:27:53.616006+0000","last_active":"2023-11-08T12:27:58.130328+0000","last_peered":"2023-11-08T12:27:58.130328+0000","last_clean":"2023-11-08T12:27:58.130328+0000","last_became_active":"2023-11-08T12:27:53.615753+0000","last_became_peered":"2023-11-08T12:27:53.615753+0000","last_unstale":"2023-11-08T12:27:58.130328+0000","last_undegraded":"2023-11-08T12:27:58.130328+0000","last_fullsized":"2023-11-08T12:27:58.130328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112019+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:27:58.112019+0000","last_peered":"2023-11-08T12:27:58.112019+0000","last_clean":"2023-11-08T12:27:58.112019+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:27:58.112019+0000","last_undegraded":"2023-11-08T12:27:58.112019+0000","last_fullsized":"2023-11-08T12:27:58.112019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575827+0000","last_change":"2023-11-08T12:27:58.150621+0000","last_active":"2023-11-08T12:27:58.575827+0000","last_peered":"2023-11-08T12:27:58.575827+0000","last_clean":"2023-11-08T12:27:58.575827+0000","last_became_active":"2023-11-08T12:27:58.150173+0000","last_became_peered":"2023-11-08T12:27:58.150173+0000","last_unstale":"2023-11-08T12:27:58.575827+0000","last_undegraded":"2023-11-08T12:27:58.575827+0000","last_fullsized":"2023-11-08T12:27:58.575827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:48.495503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128502+0000","last_change":"2023-11-08T12:27:54.105866+0000","last_active":"2023-11-08T12:27:58.128502+0000","last_peered":"2023-11-08T12:27:58.128502+0000","last_clean":"2023-11-08T12:27:58.128502+0000","last_became_active":"2023-11-08T12:27:54.105572+0000","last_became_peered":"2023-11-08T12:27:54.105572+0000","last_unstale":"2023-11-08T12:27:58.128502+0000","last_undegraded":"2023-11-08T12:27:58.128502+0000","last_fullsized":"2023-11-08T12:27:58.128502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.120729+0000","last_change":"2023-11-08T12:27:53.626369+0000","last_active":"2023-11-08T12:27:58.120729+0000","last_peered":"2023-11-08T12:27:58.120729+0000","last_clean":"2023-11-08T12:27:58.120729+0000","last_became_active":"2023-11-08T12:27:53.625999+0000","last_became_peered":"2023-11-08T12:27:53.625999+0000","last_unstale":"2023-11-08T12:27:58.120729+0000","last_undegraded":"2023-11-08T12:27:58.120729+0000","last_fullsized":"2023-11-08T12:27:58.120729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124321+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:27:58.124321+0000","last_peered":"2023-11-08T12:27:58.124321+0000","last_clean":"2023-11-08T12:27:58.124321+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:27:58.124321+0000","last_undegraded":"2023-11-08T12:27:58.124321+0000","last_fullsized":"2023-11-08T12:27:58.124321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574864+0000","last_change":"2023-11-08T12:27:58.143351+0000","last_active":"2023-11-08T12:27:58.574864+0000","last_peered":"2023-11-08T12:27:58.574864+0000","last_clean":"2023-11-08T12:27:58.574864+0000","last_became_active":"2023-11-08T12:27:58.142889+0000","last_became_peered":"2023-11-08T12:27:58.142889+0000","last_unstale":"2023-11-08T12:27:58.574864+0000","last_undegraded":"2023-11-08T12:27:58.574864+0000","last_fullsized":"2023-11-08T12:27:58.574864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134390+0000","last_change":"2023-11-08T12:27:54.094331+0000","last_active":"2023-11-08T12:27:58.134390+0000","last_peered":"2023-11-08T12:27:58.134390+0000","last_clean":"2023-11-08T12:27:58.134390+0000","last_became_active":"2023-11-08T12:27:54.093211+0000","last_became_peered":"2023-11-08T12:27:54.093211+0000","last_unstale":"2023-11-08T12:27:58.134390+0000","last_undegraded":"2023-11-08T12:27:58.134390+0000","last_fullsized":"2023-11-08T12:27:58.134390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112852+0000","last_change":"2023-11-08T12:27:53.602187+0000","last_active":"2023-11-08T12:27:58.112852+0000","last_peered":"2023-11-08T12:27:58.112852+0000","last_clean":"2023-11-08T12:27:58.112852+0000","last_became_active":"2023-11-08T12:27:53.601789+0000","last_became_peered":"2023-11-08T12:27:53.601789+0000","last_unstale":"2023-11-08T12:27:58.112852+0000","last_undegraded":"2023-11-08T12:27:58.112852+0000","last_fullsized":"2023-11-08T12:27:58.112852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109985+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:27:58.109985+0000","last_peered":"2023-11-08T12:27:58.109985+0000","last_clean":"2023-11-08T12:27:58.109985+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:27:58.109985+0000","last_undegraded":"2023-11-08T12:27:58.109985+0000","last_fullsized":"2023-11-08T12:27:58.109985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124400+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:27:58.124400+0000","last_peered":"2023-11-08T12:27:58.124400+0000","last_clean":"2023-11-08T12:27:58.124400+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:27:58.124400+0000","last_undegraded":"2023-11-08T12:27:58.124400+0000","last_fullsized":"2023-11-08T12:27:58.124400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879351+0000","last_change":"2023-11-08T12:27:58.142022+0000","last_active":"2023-11-08T12:27:58.879351+0000","last_peered":"2023-11-08T12:27:58.879351+0000","last_clean":"2023-11-08T12:27:58.879351+0000","last_became_active":"2023-11-08T12:27:58.141645+0000","last_became_peered":"2023-11-08T12:27:58.141645+0000","last_unstale":"2023-11-08T12:27:58.879351+0000","last_undegraded":"2023-11-08T12:27:58.879351+0000","last_fullsized":"2023-11-08T12:27:58.879351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126920+0000","last_change":"2023-11-08T12:27:54.098077+0000","last_active":"2023-11-08T12:27:58.126920+0000","last_peered":"2023-11-08T12:27:58.126920+0000","last_clean":"2023-11-08T12:27:58.126920+0000","last_became_active":"2023-11-08T12:27:54.097691+0000","last_became_peered":"2023-11-08T12:27:54.097691+0000","last_unstale":"2023-11-08T12:27:58.126920+0000","last_undegraded":"2023-11-08T12:27:58.126920+0000","last_fullsized":"2023-11-08T12:27:58.126920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112388+0000","last_change":"2023-11-08T12:27:53.618293+0000","last_active":"2023-11-08T12:27:58.112388+0000","last_peered":"2023-11-08T12:27:58.112388+0000","last_clean":"2023-11-08T12:27:58.112388+0000","last_became_active":"2023-11-08T12:27:53.618041+0000","last_became_peered":"2023-11-08T12:27:53.618041+0000","last_unstale":"2023-11-08T12:27:58.112388+0000","last_undegraded":"2023-11-08T12:27:58.112388+0000","last_fullsized":"2023-11-08T12:27:58.112388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.627085+0000","last_change":"2023-11-08T12:27:58.147482+0000","last_active":"2023-11-08T12:27:58.627085+0000","last_peered":"2023-11-08T12:27:58.627085+0000","last_clean":"2023-11-08T12:27:58.627085+0000","last_became_active":"2023-11-08T12:27:58.142932+0000","last_became_peered":"2023-11-08T12:27:58.142932+0000","last_unstale":"2023-11-08T12:27:58.627085+0000","last_undegraded":"2023-11-08T12:27:58.627085+0000","last_fullsized":"2023-11-08T12:27:58.627085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:44:57.061749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127731+0000","last_change":"2023-11-08T12:27:54.096854+0000","last_active":"2023-11-08T12:27:58.127731+0000","last_peered":"2023-11-08T12:27:58.127731+0000","last_clean":"2023-11-08T12:27:58.127731+0000","last_became_active":"2023-11-08T12:27:54.095714+0000","last_became_peered":"2023-11-08T12:27:54.095714+0000","last_unstale":"2023-11-08T12:27:58.127731+0000","last_undegraded":"2023-11-08T12:27:58.127731+0000","last_fullsized":"2023-11-08T12:27:58.127731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:27.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126342+0000","last_change":"2023-11-08T12:27:53.615271+0000","last_active":"2023-11-08T12:27:58.126342+0000","last_peered":"2023-11-08T12:27:58.126342+0000","last_clean":"2023-11-08T12:27:58.126342+0000","last_became_active":"2023-11-08T12:27:53.614914+0000","last_became_peered":"2023-11-08T12:27:53.614914+0000","last_unstale":"2023-11-08T12:27:58.126342+0000","last_undegraded":"2023-11-08T12:27:58.126342+0000","last_fullsized":"2023-11-08T12:27:58.126342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574743+0000","last_change":"2023-11-08T12:27:58.137274+0000","last_active":"2023-11-08T12:27:58.574743+0000","last_peered":"2023-11-08T12:27:58.574743+0000","last_clean":"2023-11-08T12:27:58.574743+0000","last_became_active":"2023-11-08T12:27:58.136837+0000","last_became_peered":"2023-11-08T12:27:58.136837+0000","last_unstale":"2023-11-08T12:27:58.574743+0000","last_undegraded":"2023-11-08T12:27:58.574743+0000","last_fullsized":"2023-11-08T12:27:58.574743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126782+0000","last_change":"2023-11-08T12:27:54.099673+0000","last_active":"2023-11-08T12:27:58.126782+0000","last_peered":"2023-11-08T12:27:58.126782+0000","last_clean":"2023-11-08T12:27:58.126782+0000","last_became_active":"2023-11-08T12:27:54.096740+0000","last_became_peered":"2023-11-08T12:27:54.096740+0000","last_unstale":"2023-11-08T12:27:58.126782+0000","last_undegraded":"2023-11-08T12:27:58.126782+0000","last_fullsized":"2023-11-08T12:27:58.126782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134615+0000","last_change":"2023-11-08T12:27:53.628166+0000","last_active":"2023-11-08T12:27:58.134615+0000","last_peered":"2023-11-08T12:27:58.134615+0000","last_clean":"2023-11-08T12:27:58.134615+0000","last_became_active":"2023-11-08T12:27:53.627825+0000","last_became_peered":"2023-11-08T12:27:53.627825+0000","last_unstale":"2023-11-08T12:27:58.134615+0000","last_undegraded":"2023-11-08T12:27:58.134615+0000","last_fullsized":"2023-11-08T12:27:58.134615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735076+0000","last_change":"2023-11-08T12:27:58.140971+0000","last_active":"2023-11-08T12:27:58.735076+0000","last_peered":"2023-11-08T12:27:58.735076+0000","last_clean":"2023-11-08T12:27:58.735076+0000","last_became_active":"2023-11-08T12:27:58.140628+0000","last_became_peered":"2023-11-08T12:27:58.140628+0000","last_unstale":"2023-11-08T12:27:58.735076+0000","last_undegraded":"2023-11-08T12:27:58.735076+0000","last_fullsized":"2023-11-08T12:27:58.735076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127582+0000","last_change":"2023-11-08T12:27:54.099418+0000","last_active":"2023-11-08T12:27:58.127582+0000","last_peered":"2023-11-08T12:27:58.127582+0000","last_clean":"2023-11-08T12:27:58.127582+0000","last_became_active":"2023-11-08T12:27:54.098046+0000","last_became_peered":"2023-11-08T12:27:54.098046+0000","last_unstale":"2023-11-08T12:27:58.127582+0000","last_undegraded":"2023-11-08T12:27:58.127582+0000","last_fullsized":"2023-11-08T12:27:58.127582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112929+0000","last_change":"2023-11-08T12:27:53.623957+0000","last_active":"2023-11-08T12:27:58.112929+0000","last_peered":"2023-11-08T12:27:58.112929+0000","last_clean":"2023-11-08T12:27:58.112929+0000","last_became_active":"2023-11-08T12:27:53.623625+0000","last_became_peered":"2023-11-08T12:27:53.623625+0000","last_unstale":"2023-11-08T12:27:58.112929+0000","last_undegraded":"2023-11-08T12:27:58.112929+0000","last_fullsized":"2023-11-08T12:27:58.112929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575667+0000","last_change":"2023-11-08T12:27:58.144841+0000","last_active":"2023-11-08T12:27:58.575667+0000","last_peered":"2023-11-08T12:27:58.575667+0000","last_clean":"2023-11-08T12:27:58.575667+0000","last_became_active":"2023-11-08T12:27:58.144375+0000","last_became_peered":"2023-11-08T12:27:58.144375+0000","last_unstale":"2023-11-08T12:27:58.575667+0000","last_undegraded":"2023-11-08T12:27:58.575667+0000","last_fullsized":"2023-11-08T12:27:58.575667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:58:16.447050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129079+0000","last_change":"2023-11-08T12:27:54.116845+0000","last_active":"2023-11-08T12:27:58.129079+0000","last_peered":"2023-11-08T12:27:58.129079+0000","last_clean":"2023-11-08T12:27:58.129079+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129079+0000","last_undegraded":"2023-11-08T12:27:58.129079+0000","last_fullsized":"2023-11-08T12:27:58.129079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109551+0000","last_change":"2023-11-08T12:27:53.610197+0000","last_active":"2023-11-08T12:27:58.109551+0000","last_peered":"2023-11-08T12:27:58.109551+0000","last_clean":"2023-11-08T12:27:58.109551+0000","last_became_active":"2023-11-08T12:27:53.609789+0000","last_became_peered":"2023-11-08T12:27:53.609789+0000","last_unstale":"2023-11-08T12:27:58.109551+0000","last_undegraded":"2023-11-08T12:27:58.109551+0000","last_fullsized":"2023-11-08T12:27:58.109551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575442+0000","last_change":"2023-11-08T12:27:58.138875+0000","last_active":"2023-11-08T12:27:58.575442+0000","last_peered":"2023-11-08T12:27:58.575442+0000","last_clean":"2023-11-08T12:27:58.575442+0000","last_became_active":"2023-11-08T12:27:58.138194+0000","last_became_peered":"2023-11-08T12:27:58.138194+0000","last_unstale":"2023-11-08T12:27:58.575442+0000","last_undegraded":"2023-11-08T12:27:58.575442+0000","last_fullsized":"2023-11-08T12:27:58.575442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.510559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134393+0000","last_change":"2023-11-08T12:27:54.091331+0000","last_active":"2023-11-08T12:27:58.134393+0000","last_peered":"2023-11-08T12:27:58.134393+0000","last_clean":"2023-11-08T12:27:58.134393+0000","last_became_active":"2023-11-08T12:27:54.090934+0000","last_became_peered":"2023-11-08T12:27:54.090934+0000","last_unstale":"2023-11-08T12:27:58.134393+0000","last_undegraded":"2023-11-08T12:27:58.134393+0000","last_fullsized":"2023-11-08T12:27:58.134393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:31.377393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123027+0000","last_change":"2023-11-08T12:27:53.619884+0000","last_active":"2023-11-08T12:27:58.123027+0000","last_peered":"2023-11-08T12:27:58.123027+0000","last_clean":"2023-11-08T12:27:58.123027+0000","last_became_active":"2023-11-08T12:27:53.619224+0000","last_became_peered":"2023-11-08T12:27:53.619224+0000","last_unstale":"2023-11-08T12:27:58.123027+0000","last_undegraded":"2023-11-08T12:27:58.123027+0000","last_fullsized":"2023-11-08T12:27:58.123027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:13.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575454+0000","last_change":"2023-11-08T12:27:58.146347+0000","last_active":"2023-11-08T12:27:58.575454+0000","last_peered":"2023-11-08T12:27:58.575454+0000","last_clean":"2023-11-08T12:27:58.575454+0000","last_became_active":"2023-11-08T12:27:58.141366+0000","last_became_peered":"2023-11-08T12:27:58.141366+0000","last_unstale":"2023-11-08T12:27:58.575454+0000","last_undegraded":"2023-11-08T12:27:58.575454+0000","last_fullsized":"2023-11-08T12:27:58.575454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:21:31.033260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126220+0000","last_change":"2023-11-08T12:27:54.096017+0000","last_active":"2023-11-08T12:27:58.126220+0000","last_peered":"2023-11-08T12:27:58.126220+0000","last_clean":"2023-11-08T12:27:58.126220+0000","last_became_active":"2023-11-08T12:27:54.095626+0000","last_became_peered":"2023-11-08T12:27:54.095626+0000","last_unstale":"2023-11-08T12:27:58.126220+0000","last_undegraded":"2023-11-08T12:27:58.126220+0000","last_fullsized":"2023-11-08T12:27:58.126220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:39.760166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122741+0000","last_change":"2023-11-08T12:27:53.629941+0000","last_active":"2023-11-08T12:27:58.122741+0000","last_peered":"2023-11-08T12:27:58.122741+0000","last_clean":"2023-11-08T12:27:58.122741+0000","last_became_active":"2023-11-08T12:27:53.629616+0000","last_became_peered":"2023-11-08T12:27:53.629616+0000","last_unstale":"2023-11-08T12:27:58.122741+0000","last_undegraded":"2023-11-08T12:27:58.122741+0000","last_fullsized":"2023-11-08T12:27:58.122741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:41:54.461363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575103+0000","last_change":"2023-11-08T12:27:58.134296+0000","last_active":"2023-11-08T12:27:58.575103+0000","last_peered":"2023-11-08T12:27:58.575103+0000","last_clean":"2023-11-08T12:27:58.575103+0000","last_became_active":"2023-11-08T12:27:58.133923+0000","last_became_peered":"2023-11-08T12:27:58.133923+0000","last_unstale":"2023-11-08T12:27:58.575103+0000","last_undegraded":"2023-11-08T12:27:58.575103+0000","last_fullsized":"2023-11-08T12:27:58.575103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:19:06.502167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109786+0000","last_change":"2023-11-08T12:27:54.114859+0000","last_active":"2023-11-08T12:27:58.109786+0000","last_peered":"2023-11-08T12:27:58.109786+0000","last_clean":"2023-11-08T12:27:58.109786+0000","last_became_active":"2023-11-08T12:27:54.114573+0000","last_became_peered":"2023-11-08T12:27:54.114573+0000","last_unstale":"2023-11-08T12:27:58.109786+0000","last_undegraded":"2023-11-08T12:27:58.109786+0000","last_fullsized":"2023-11-08T12:27:58.109786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121705+0000","last_change":"2023-11-08T12:27:53.632041+0000","last_active":"2023-11-08T12:27:58.121705+0000","last_peered":"2023-11-08T12:27:58.121705+0000","last_clean":"2023-11-08T12:27:58.121705+0000","last_became_active":"2023-11-08T12:27:53.631715+0000","last_became_peered":"2023-11-08T12:27:53.631715+0000","last_unstale":"2023-11-08T12:27:58.121705+0000","last_undegraded":"2023-11-08T12:27:58.121705+0000","last_fullsized":"2023-11-08T12:27:58.121705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:13.451343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878943+0000","last_change":"2023-11-08T12:27:58.153252+0000","last_active":"2023-11-08T12:27:58.878943+0000","last_peered":"2023-11-08T12:27:58.878943+0000","last_clean":"2023-11-08T12:27:58.878943+0000","last_became_active":"2023-11-08T12:27:58.152715+0000","last_became_peered":"2023-11-08T12:27:58.152715+0000","last_unstale":"2023-11-08T12:27:58.878943+0000","last_undegraded":"2023-11-08T12:27:58.878943+0000","last_fullsized":"2023-11-08T12:27:58.878943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574571+0000","last_change":"2023-11-08T12:27:58.134922+0000","last_active":"2023-11-08T12:27:58.574571+0000","last_peered":"2023-11-08T12:27:58.574571+0000","last_clean":"2023-11-08T12:27:58.574571+0000","last_became_active":"2023-11-08T12:27:58.134553+0000","last_became_peered":"2023-11-08T12:27:58.134553+0000","last_unstale":"2023-11-08T12:27:58.574571+0000","last_undegraded":"2023-11-08T12:27:58.574571+0000","last_fullsized":"2023-11-08T12:27:58.574571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130484+0000","last_change":"2023-11-08T12:27:53.613363+0000","last_active":"2023-11-08T12:27:58.130484+0000","last_peered":"2023-11-08T12:27:58.130484+0000","last_clean":"2023-11-08T12:27:58.130484+0000","last_became_active":"2023-11-08T12:27:53.613054+0000","last_became_peered":"2023-11-08T12:27:53.613054+0000","last_unstale":"2023-11-08T12:27:58.130484+0000","last_undegraded":"2023-11-08T12:27:58.130484+0000","last_fullsized":"2023-11-08T12:27:58.130484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.117992+0000","last_change":"2023-11-08T12:27:54.113407+0000","last_active":"2023-11-08T12:27:58.117992+0000","last_peered":"2023-11-08T12:27:58.117992+0000","last_clean":"2023-11-08T12:27:58.117992+0000","last_became_active":"2023-11-08T12:27:54.113143+0000","last_became_peered":"2023-11-08T12:27:54.113143+0000","last_unstale":"2023-11-08T12:27:58.117992+0000","last_undegraded":"2023-11-08T12:27:58.117992+0000","last_fullsized":"2023-11-08T12:27:58.117992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574644+0000","last_change":"2023-11-08T12:27:58.152343+0000","last_active":"2023-11-08T12:27:58.574644+0000","last_peered":"2023-11-08T12:27:58.574644+0000","last_clean":"2023-11-08T12:27:58.574644+0000","last_became_active":"2023-11-08T12:27:58.150007+0000","last_became_peered":"2023-11-08T12:27:58.150007+0000","last_unstale":"2023-11-08T12:27:58.574644+0000","last_undegraded":"2023-11-08T12:27:58.574644+0000","last_fullsized":"2023-11-08T12:27:58.574644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127705+0000","last_change":"2023-11-08T12:27:53.629979+0000","last_active":"2023-11-08T12:27:58.127705+0000","last_peered":"2023-11-08T12:27:58.127705+0000","last_clean":"2023-11-08T12:27:58.127705+0000","last_became_active":"2023-11-08T12:27:53.629610+0000","last_became_peered":"2023-11-08T12:27:53.629610+0000","last_unstale":"2023-11-08T12:27:58.127705+0000","last_undegraded":"2023-11-08T12:27:58.127705+0000","last_fullsized":"2023-11-08T12:27:58.127705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:10:20.186679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128585+0000","last_change":"2023-11-08T12:27:54.105236+0000","last_active":"2023-11-08T12:27:58.128585+0000","last_peered":"2023-11-08T12:27:58.128585+0000","last_clean":"2023-11-08T12:27:58.128585+0000","last_became_active":"2023-11-08T12:27:54.101882+0000","last_became_peered":"2023-11-08T12:27:54.101882+0000","last_unstale":"2023-11-08T12:27:58.128585+0000","last_undegraded":"2023-11-08T12:27:58.128585+0000","last_fullsized":"2023-11-08T12:27:58.128585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122039+0000","last_change":"2023-11-08T12:27:53.623671+0000","last_active":"2023-11-08T12:27:58.122039+0000","last_peered":"2023-11-08T12:27:58.122039+0000","last_clean":"2023-11-08T12:27:58.122039+0000","last_became_active":"2023-11-08T12:27:53.623278+0000","last_became_peered":"2023-11-08T12:27:53.623278+0000","last_unstale":"2023-11-08T12:27:58.122039+0000","last_undegraded":"2023-11-08T12:27:58.122039+0000","last_fullsized":"2023-11-08T12:27:58.122039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110357+0000","last_change":"2023-11-08T12:27:54.112710+0000","last_active":"2023-11-08T12:27:58.110357+0000","last_peered":"2023-11-08T12:27:58.110357+0000","last_clean":"2023-11-08T12:27:58.110357+0000","last_became_active":"2023-11-08T12:27:54.111530+0000","last_became_peered":"2023-11-08T12:27:54.111530+0000","last_unstale":"2023-11-08T12:27:58.110357+0000","last_undegraded":"2023-11-08T12:27:58.110357+0000","last_fullsized":"2023-11-08T12:27:58.110357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.573865+0000","last_change":"2023-11-08T12:27:58.147598+0000","last_active":"2023-11-08T12:27:58.573865+0000","last_peered":"2023-11-08T12:27:58.573865+0000","last_clean":"2023-11-08T12:27:58.573865+0000","last_became_active":"2023-11-08T12:27:58.142637+0000","last_became_peered":"2023-11-08T12:27:58.142637+0000","last_unstale":"2023-11-08T12:27:58.573865+0000","last_undegraded":"2023-11-08T12:27:58.573865+0000","last_fullsized":"2023-11-08T12:27:58.573865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:15.627959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121493+0000","last_change":"2023-11-08T12:27:53.629943+0000","last_active":"2023-11-08T12:27:58.121493+0000","last_peered":"2023-11-08T12:27:58.121493+0000","last_clean":"2023-11-08T12:27:58.121493+0000","last_became_active":"2023-11-08T12:27:53.629644+0000","last_became_peered":"2023-11-08T12:27:53.629644+0000","last_unstale":"2023-11-08T12:27:58.121493+0000","last_undegraded":"2023-11-08T12:27:58.121493+0000","last_fullsized":"2023-11-08T12:27:58.121493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.958287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112153+0000","last_change":"2023-11-08T12:27:54.087612+0000","last_active":"2023-11-08T12:27:58.112153+0000","last_peered":"2023-11-08T12:27:58.112153+0000","last_clean":"2023-11-08T12:27:58.112153+0000","last_became_active":"2023-11-08T12:27:54.087329+0000","last_became_peered":"2023-11-08T12:27:54.087329+0000","last_unstale":"2023-11-08T12:27:58.112153+0000","last_undegraded":"2023-11-08T12:27:58.112153+0000","last_fullsized":"2023-11-08T12:27:58.112153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574522+0000","last_change":"2023-11-08T12:27:58.143756+0000","last_active":"2023-11-08T12:27:58.574522+0000","last_peered":"2023-11-08T12:27:58.574522+0000","last_clean":"2023-11-08T12:27:58.574522+0000","last_became_active":"2023-11-08T12:27:58.142849+0000","last_became_peered":"2023-11-08T12:27:58.142849+0000","last_unstale":"2023-11-08T12:27:58.574522+0000","last_undegraded":"2023-11-08T12:27:58.574522+0000","last_fullsized":"2023-11-08T12:27:58.574522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130357+0000","last_change":"2023-11-08T12:27:54.090219+0000","last_active":"2023-11-08T12:27:58.130357+0000","last_peered":"2023-11-08T12:27:58.130357+0000","last_clean":"2023-11-08T12:27:58.130357+0000","last_became_active":"2023-11-08T12:27:54.089953+0000","last_became_peered":"2023-11-08T12:27:54.089953+0000","last_unstale":"2023-11-08T12:27:58.130357+0000","last_undegraded":"2023-11-08T12:27:58.130357+0000","last_fullsized":"2023-11-08T12:27:58.130357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:59.015726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110954+0000","last_change":"2023-11-08T12:27:54.089673+0000","last_active":"2023-11-08T12:27:58.110954+0000","last_peered":"2023-11-08T12:27:58.110954+0000","last_clean":"2023-11-08T12:27:58.110954+0000","last_became_active":"2023-11-08T12:27:54.088838+0000","last_became_peered":"2023-11-08T12:27:54.088838+0000","last_unstale":"2023-11-08T12:27:58.110954+0000","last_undegraded":"2023-11-08T12:27:58.110954+0000","last_fullsized":"2023-11-08T12:27:58.110954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127306+0000","last_change":"2023-11-08T12:27:54.101563+0000","last_active":"2023-11-08T12:27:58.127306+0000","last_peered":"2023-11-08T12:27:58.127306+0000","last_clean":"2023-11-08T12:27:58.127306+0000","last_became_active":"2023-11-08T12:27:54.101287+0000","last_became_peered":"2023-11-08T12:27:54.101287+0000","last_unstale":"2023-11-08T12:27:58.127306+0000","last_undegraded":"2023-11-08T12:27:58.127306+0000","last_fullsized":"2023-11-08T12:27:58.127306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112764+0000","last_change":"2023-11-08T12:27:54.112891+0000","last_active":"2023-11-08T12:27:58.112764+0000","last_peered":"2023-11-08T12:27:58.112764+0000","last_clean":"2023-11-08T12:27:58.112764+0000","last_became_active":"2023-11-08T12:27:54.112236+0000","last_became_peered":"2023-11-08T12:27:54.112236+0000","last_unstale":"2023-11-08T12:27:58.112764+0000","last_undegraded":"2023-11-08T12:27:58.112764+0000","last_fullsized":"2023-11-08T12:27:58.112764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127544+0000","last_change":"2023-11-08T12:27:54.112391+0000","last_active":"2023-11-08T12:27:58.127544+0000","last_peered":"2023-11-08T12:27:58.127544+0000","last_clean":"2023-11-08T12:27:58.127544+0000","last_became_active":"2023-11-08T12:27:54.112033+0000","last_became_peered":"2023-11-08T12:27:54.112033+0000","last_unstale":"2023-11-08T12:27:58.127544+0000","last_undegraded":"2023-11-08T12:27:58.127544+0000","last_fullsized":"2023-11-08T12:27:58.127544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110253+0000","last_change":"2023-11-08T12:27:54.111812+0000","last_active":"2023-11-08T12:27:58.110253+0000","last_peered":"2023-11-08T12:27:58.110253+0000","last_clean":"2023-11-08T12:27:58.110253+0000","last_became_active":"2023-11-08T12:27:54.111143+0000","last_became_peered":"2023-11-08T12:27:54.111143+0000","last_unstale":"2023-11-08T12:27:58.110253+0000","last_undegraded":"2023-11-08T12:27:58.110253+0000","last_fullsized":"2023-11-08T12:27:58.110253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126839+0000","last_change":"2023-11-08T12:27:54.098992+0000","last_active":"2023-11-08T12:27:58.126839+0000","last_peered":"2023-11-08T12:27:58.126839+0000","last_clean":"2023-11-08T12:27:58.126839+0000","last_became_active":"2023-11-08T12:27:54.096650+0000","last_became_peered":"2023-11-08T12:27:54.096650+0000","last_unstale":"2023-11-08T12:27:58.126839+0000","last_undegraded":"2023-11-08T12:27:58.126839+0000","last_fullsized":"2023-11-08T12:27:58.126839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:18.972524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126259+0000","last_change":"2023-11-08T12:27:54.102716+0000","last_active":"2023-11-08T12:27:58.126259+0000","last_peered":"2023-11-08T12:27:58.126259+0000","last_clean":"2023-11-08T12:27:58.126259+0000","last_became_active":"2023-11-08T12:27:54.102078+0000","last_became_peered":"2023-11-08T12:27:54.102078+0000","last_unstale":"2023-11-08T12:27:58.126259+0000","last_undegraded":"2023-11-08T12:27:58.126259+0000","last_fullsized":"2023-11-08T12:27:58.126259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124250+0000","last_change":"2023-11-08T12:27:54.114137+0000","last_active":"2023-11-08T12:27:58.124250+0000","last_peered":"2023-11-08T12:27:58.124250+0000","last_clean":"2023-11-08T12:27:58.124250+0000","last_became_active":"2023-11-08T12:27:54.111468+0000","last_became_peered":"2023-11-08T12:27:54.111468+0000","last_unstale":"2023-11-08T12:27:58.124250+0000","last_undegraded":"2023-11-08T12:27:58.124250+0000","last_fullsized":"2023-11-08T12:27:58.124250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110810+0000","last_change":"2023-11-08T12:27:54.111270+0000","last_active":"2023-11-08T12:27:58.110810+0000","last_peered":"2023-11-08T12:27:58.110810+0000","last_clean":"2023-11-08T12:27:58.110810+0000","last_became_active":"2023-11-08T12:27:54.110978+0000","last_became_peered":"2023-11-08T12:27:54.110978+0000","last_unstale":"2023-11-08T12:27:58.110810+0000","last_undegraded":"2023-11-08T12:27:58.110810+0000","last_fullsized":"2023-11-08T12:27:58.110810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121952+0000","last_change":"2023-11-08T12:27:54.110870+0000","last_active":"2023-11-08T12:27:58.121952+0000","last_peered":"2023-11-08T12:27:58.121952+0000","last_clean":"2023-11-08T12:27:58.121952+0000","last_became_active":"2023-11-08T12:27:54.110578+0000","last_became_peered":"2023-11-08T12:27:54.110578+0000","last_unstale":"2023-11-08T12:27:58.121952+0000","last_undegraded":"2023-11-08T12:27:58.121952+0000","last_fullsized":"2023-11-08T12:27:58.121952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121410+0000","last_change":"2023-11-08T12:27:54.110928+0000","last_active":"2023-11-08T12:27:58.121410+0000","last_peered":"2023-11-08T12:27:58.121410+0000","last_clean":"2023-11-08T12:27:58.121410+0000","last_became_active":"2023-11-08T12:27:54.110627+0000","last_became_peered":"2023-11-08T12:27:54.110627+0000","last_unstale":"2023-11-08T12:27:58.121410+0000","last_undegraded":"2023-11-08T12:27:58.121410+0000","last_fullsized":"2023-11-08T12:27:58.121410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127487+0000","last_change":"2023-11-08T12:27:54.099305+0000","last_active":"2023-11-08T12:27:58.127487+0000","last_peered":"2023-11-08T12:27:58.127487+0000","last_clean":"2023-11-08T12:27:58.127487+0000","last_became_active":"2023-11-08T12:27:54.096530+0000","last_became_peered":"2023-11-08T12:27:54.096530+0000","last_unstale":"2023-11-08T12:27:58.127487+0000","last_undegraded":"2023-11-08T12:27:58.127487+0000","last_fullsized":"2023-11-08T12:27:58.127487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:03:24.809478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112660+0000","last_change":"2023-11-08T12:27:54.091908+0000","last_active":"2023-11-08T12:27:58.112660+0000","last_peered":"2023-11-08T12:27:58.112660+0000","last_clean":"2023-11-08T12:27:58.112660+0000","last_became_active":"2023-11-08T12:27:54.091565+0000","last_became_peered":"2023-11-08T12:27:54.091565+0000","last_unstale":"2023-11-08T12:27:58.112660+0000","last_undegraded":"2023-11-08T12:27:58.112660+0000","last_fullsized":"2023-11-08T12:27:58.112660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:48.409713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127626+0000","last_change":"2023-11-08T12:27:54.102006+0000","last_active":"2023-11-08T12:27:58.127626+0000","last_peered":"2023-11-08T12:27:58.127626+0000","last_clean":"2023-11-08T12:27:58.127626+0000","last_became_active":"2023-11-08T12:27:54.101747+0000","last_became_peered":"2023-11-08T12:27:54.101747+0000","last_unstale":"2023-11-08T12:27:58.127626+0000","last_undegraded":"2023-11-08T12:27:58.127626+0000","last_fullsized":"2023-11-08T12:27:58.127626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130643+0000","last_change":"2023-11-08T12:27:54.107313+0000","last_active":"2023-11-08T12:27:58.130643+0000","last_peered":"2023-11-08T12:27:58.130643+0000","last_clean":"2023-11-08T12:27:58.130643+0000","last_became_active":"2023-11-08T12:27:54.106868+0000","last_became_peered":"2023-11-08T12:27:54.106868+0000","last_unstale":"2023-11-08T12:27:58.130643+0000","last_undegraded":"2023-11-08T12:27:58.130643+0000","last_fullsized":"2023-11-08T12:27:58.130643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126067+0000","last_change":"2023-11-08T12:27:54.104910+0000","last_active":"2023-11-08T12:27:58.126067+0000","last_peered":"2023-11-08T12:27:58.126067+0000","last_clean":"2023-11-08T12:27:58.126067+0000","last_became_active":"2023-11-08T12:27:54.104571+0000","last_became_peered":"2023-11-08T12:27:54.104571+0000","last_unstale":"2023-11-08T12:27:58.126067+0000","last_undegraded":"2023-11-08T12:27:58.126067+0000","last_fullsized":"2023-11-08T12:27:58.126067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127618+0000","last_change":"2023-11-08T12:27:54.117605+0000","last_active":"2023-11-08T12:27:58.127618+0000","last_peered":"2023-11-08T12:27:58.127618+0000","last_clean":"2023-11-08T12:27:58.127618+0000","last_became_active":"2023-11-08T12:27:54.115128+0000","last_became_peered":"2023-11-08T12:27:54.115128+0000","last_unstale":"2023-11-08T12:27:58.127618+0000","last_undegraded":"2023-11-08T12:27:58.127618+0000","last_fullsized":"2023-11-08T12:27:58.127618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109727+0000","last_change":"2023-11-08T12:27:54.078100+0000","last_active":"2023-11-08T12:27:58.109727+0000","last_peered":"2023-11-08T12:27:58.109727+0000","last_clean":"2023-11-08T12:27:58.109727+0000","last_became_active":"2023-11-08T12:27:54.077806+0000","last_became_peered":"2023-11-08T12:27:54.077806+0000","last_unstale":"2023-11-08T12:27:58.109727+0000","last_undegraded":"2023-11-08T12:27:58.109727+0000","last_fullsized":"2023-11-08T12:27:58.109727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.115584+0000","last_change":"2023-11-08T12:27:54.079682+0000","last_active":"2023-11-08T12:27:58.115584+0000","last_peered":"2023-11-08T12:27:58.115584+0000","last_clean":"2023-11-08T12:27:58.115584+0000","last_became_active":"2023-11-08T12:27:54.079412+0000","last_became_peered":"2023-11-08T12:27:54.079412+0000","last_unstale":"2023-11-08T12:27:58.115584+0000","last_undegraded":"2023-11-08T12:27:58.115584+0000","last_fullsized":"2023-11-08T12:27:58.115584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:03:48.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112090+0000","last_change":"2023-11-08T12:27:54.094245+0000","last_active":"2023-11-08T12:27:58.112090+0000","last_peered":"2023-11-08T12:27:58.112090+0000","last_clean":"2023-11-08T12:27:58.112090+0000","last_became_active":"2023-11-08T12:27:54.093989+0000","last_became_peered":"2023-11-08T12:27:54.093989+0000","last_unstale":"2023-11-08T12:27:58.112090+0000","last_undegraded":"2023-11-08T12:27:58.112090+0000","last_fullsized":"2023-11-08T12:27:58.112090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:45.542969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126703+0000","last_change":"2023-11-08T12:27:54.093474+0000","last_active":"2023-11-08T12:27:58.126703+0000","last_peered":"2023-11-08T12:27:58.126703+0000","last_clean":"2023-11-08T12:27:58.126703+0000","last_became_active":"2023-11-08T12:27:54.093141+0000","last_became_peered":"2023-11-08T12:27:54.093141+0000","last_unstale":"2023-11-08T12:27:58.126703+0000","last_undegraded":"2023-11-08T12:27:58.126703+0000","last_fullsized":"2023-11-08T12:27:58.126703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.174800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110510+0000","last_change":"2023-11-08T12:27:54.109186+0000","last_active":"2023-11-08T12:27:58.110510+0000","last_peered":"2023-11-08T12:27:58.110510+0000","last_clean":"2023-11-08T12:27:58.110510+0000","last_became_active":"2023-11-08T12:27:54.108861+0000","last_became_peered":"2023-11-08T12:27:54.108861+0000","last_unstale":"2023-11-08T12:27:58.110510+0000","last_undegraded":"2023-11-08T12:27:58.110510+0000","last_fullsized":"2023-11-08T12:27:58.110510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130596+0000","last_change":"2023-11-08T12:27:54.107459+0000","last_active":"2023-11-08T12:27:58.130596+0000","last_peered":"2023-11-08T12:27:58.130596+0000","last_clean":"2023-11-08T12:27:58.130596+0000","last_became_active":"2023-11-08T12:27:54.107098+0000","last_became_peered":"2023-11-08T12:27:54.107098+0000","last_unstale":"2023-11-08T12:27:58.130596+0000","last_undegraded":"2023-11-08T12:27:58.130596+0000","last_fullsized":"2023-11-08T12:27:58.130596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109785+0000","last_change":"2023-11-08T12:27:54.094309+0000","last_active":"2023-11-08T12:27:58.109785+0000","last_peered":"2023-11-08T12:27:58.109785+0000","last_clean":"2023-11-08T12:27:58.109785+0000","last_became_active":"2023-11-08T12:27:54.094019+0000","last_became_peered":"2023-11-08T12:27:54.094019+0000","last_unstale":"2023-11-08T12:27:58.109785+0000","last_undegraded":"2023-11-08T12:27:58.109785+0000","last_fullsized":"2023-11-08T12:27:58.109785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127510+0000","last_change":"2023-11-08T12:27:54.115331+0000","last_active":"2023-11-08T12:27:58.127510+0000","last_peered":"2023-11-08T12:27:58.127510+0000","last_clean":"2023-11-08T12:27:58.127510+0000","last_became_active":"2023-11-08T12:27:54.114822+0000","last_became_peered":"2023-11-08T12:27:54.114822+0000","last_unstale":"2023-11-08T12:27:58.127510+0000","last_undegraded":"2023-11-08T12:27:58.127510+0000","last_fullsized":"2023-11-08T12:27:58.127510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127152+0000","last_change":"2023-11-08T12:27:54.110256+0000","last_active":"2023-11-08T12:27:58.127152+0000","last_peered":"2023-11-08T12:27:58.127152+0000","last_clean":"2023-11-08T12:27:58.127152+0000","last_became_active":"2023-11-08T12:27:54.109960+0000","last_became_peered":"2023-11-08T12:27:54.109960+0000","last_unstale":"2023-11-08T12:27:58.127152+0000","last_undegraded":"2023-11-08T12:27:58.127152+0000","last_fullsized":"2023-11-08T12:27:58.127152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:50.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129321+0000","last_change":"2023-11-08T12:27:54.113205+0000","last_active":"2023-11-08T12:27:58.129321+0000","last_peered":"2023-11-08T12:27:58.129321+0000","last_clean":"2023-11-08T12:27:58.129321+0000","last_became_active":"2023-11-08T12:27:54.100836+0000","last_became_peered":"2023-11-08T12:27:54.100836+0000","last_unstale":"2023-11-08T12:27:58.129321+0000","last_undegraded":"2023-11-08T12:27:58.129321+0000","last_fullsized":"2023-11-08T12:27:58.129321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134239+0000","last_change":"2023-11-08T12:27:54.113012+0000","last_active":"2023-11-08T12:27:58.134239+0000","last_peered":"2023-11-08T12:27:58.134239+0000","last_clean":"2023-11-08T12:27:58.134239+0000","last_became_active":"2023-11-08T12:27:54.112671+0000","last_became_peered":"2023-11-08T12:27:54.112671+0000","last_unstale":"2023-11-08T12:27:58.134239+0000","last_undegraded":"2023-11-08T12:27:58.134239+0000","last_fullsized":"2023-11-08T12:27:58.134239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:36.178901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126621+0000","last_change":"2023-11-08T12:27:54.106855+0000","last_active":"2023-11-08T12:27:58.126621+0000","last_peered":"2023-11-08T12:27:58.126621+0000","last_clean":"2023-11-08T12:27:58.126621+0000","last_became_active":"2023-11-08T12:27:54.106572+0000","last_became_peered":"2023-11-08T12:27:54.106572+0000","last_unstale":"2023-11-08T12:27:58.126621+0000","last_undegraded":"2023-11-08T12:27:58.126621+0000","last_fullsized":"2023-11-08T12:27:58.126621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:20.409594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110499+0000","last_change":"2023-11-08T12:27:54.088006+0000","last_active":"2023-11-08T12:27:58.110499+0000","last_peered":"2023-11-08T12:27:58.110499+0000","last_clean":"2023-11-08T12:27:58.110499+0000","last_became_active":"2023-11-08T12:27:54.087733+0000","last_became_peered":"2023-11-08T12:27:54.087733+0000","last_unstale":"2023-11-08T12:27:58.110499+0000","last_undegraded":"2023-11-08T12:27:58.110499+0000","last_fullsized":"2023-11-08T12:27:58.110499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110178+0000","last_change":"2023-11-08T12:27:54.088141+0000","last_active":"2023-11-08T12:27:58.110178+0000","last_peered":"2023-11-08T12:27:58.110178+0000","last_clean":"2023-11-08T12:27:58.110178+0000","last_became_active":"2023-11-08T12:27:54.087785+0000","last_became_peered":"2023-11-08T12:27:54.087785+0000","last_unstale":"2023-11-08T12:27:58.110178+0000","last_undegraded":"2023-11-08T12:27:58.110178+0000","last_fullsized":"2023-11-08T12:27:58.110178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:16:17.839606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476746,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]},{"osd":4,"up_from":16,"seq":68719476746,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9296,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362544,"statfs":{"total":96636764160,"available":96627245056,"internally_reserved":0,"allocated":925696,"data_stored":719012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:28:21.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:28:21.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.325+0000 7f31c89b7700 1 Processor -- start 2023-11-08T12:28:21.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c89b7700 1 -- start start 2023-11-08T12:28:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c89b7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c40b43a0 0x7f31c415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c89b7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31c40b1640 0x7f31c4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c89b7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c415a550 con 0x7f31c40c9040 2023-11-08T12:28:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c89b7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c406b0a0 con 0x7f31c40b1640 2023-11-08T12:28:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c89b7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c40caac0 con 0x7f31c40b43a0 2023-11-08T12:28:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c40b43a0 0x7f31c415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31c40b1640 0x7f31c4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c40b43a0 0x7f31c415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46472/0 (socket says 172.21.15.112:46472) 2023-11-08T12:28:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.329+0000 7f31c2d9d700 1 -- 172.21.15.112:0/2115923389 learned_addr learned my addr 172.21.15.112:0/2115923389 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c1d9b700 1 -- 172.21.15.112:0/2115923389 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028741151 0 0) 0x7f31bc001490 con 0x7f31c40c9040 2023-11-08T12:28:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c1d9b700 1 -- 172.21.15.112:0/2115923389 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ac0035d0 con 0x7f31c40c9040 2023-11-08T12:28:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c2d9d700 1 -- 172.21.15.112:0/2115923389 >> v2:172.21.15.112:3300/0 conn(0x7f31c40b1640 msgr2=0x7f31c4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c2d9d700 1 --2- 172.21.15.112:0/2115923389 >> v2:172.21.15.112:3300/0 conn(0x7f31c40b1640 0x7f31c4070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c2d9d700 1 -- 172.21.15.112:0/2115923389 >> v1:172.21.15.112:6789/0 conn(0x7f31c40c9040 legacy=0x7f31c4069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c2d9d700 1 -- 172.21.15.112:0/2115923389 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40cada0 con 0x7f31c40b43a0 2023-11-08T12:28:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c259c700 1 --2- 172.21.15.112:0/2115923389 >> v2:172.21.15.112:3300/0 conn(0x7f31c40b1640 0x7f31c4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c2d9d700 1 --2- 172.21.15.112:0/2115923389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b43a0 0x7f31c415e5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31c406fe80 tx=0x7f31b4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d603f4abe360c77 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c1d9b700 1 -- 172.21.15.112:0/2115923389 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4011830 con 0x7f31c40b43a0 2023-11-08T12:28:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c1d9b700 1 -- 172.21.15.112:0/2115923389 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4011990 con 0x7f31c40b43a0 2023-11-08T12:28:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c1d9b700 1 -- 172.21.15.112:0/2115923389 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4011d20 con 0x7f31c40b43a0 2023-11-08T12:28:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 -- 172.21.15.112:0/2115923389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b43a0 msgr2=0x7f31c415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 --2- 172.21.15.112:0/2115923389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b43a0 0x7f31c415e5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31c406fe80 tx=0x7f31b4009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 -- 172.21.15.112:0/2115923389 shutdown_connections 2023-11-08T12:28:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 --2- 172.21.15.112:0/2115923389 >> v2:172.21.15.112:3300/0 conn(0x7f31c40b1640 0x7f31c4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 --2- 172.21.15.112:0/2115923389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b43a0 0x7f31c415e5d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 -- 172.21.15.112:0/2115923389 >> 172.21.15.112:0/2115923389 conn(0x7f31c40b0f80 msgr2=0x7f31c40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 -- 172.21.15.112:0/2115923389 shutdown_connections 2023-11-08T12:28:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.333+0000 7f31c89b7700 1 -- 172.21.15.112:0/2115923389 wait complete. 2023-11-08T12:28:21.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 Processor -- start 2023-11-08T12:28:21.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 -- start start 2023-11-08T12:28:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b1640 0x7f31c40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c40b43a0 0x7f31c41492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31c40c9040 0x7f31c41f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40ce180 con 0x7f31c40b43a0 2023-11-08T12:28:21.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c415aab0 con 0x7f31c40b1640 2023-11-08T12:28:21.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c89b7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c415ceb0 con 0x7f31c40c9040 2023-11-08T12:28:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c40b43a0 0x7f31c41492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c40b43a0 0x7f31c41492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34816/0 (socket says 172.21.15.112:34816) 2023-11-08T12:28:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.337+0000 7f31c259c700 1 -- 172.21.15.112:0/1232958374 learned_addr learned my addr 172.21.15.112:0/1232958374 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c2d9d700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b1640 0x7f31c40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c359e700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31c40c9040 0x7f31c41f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c2d9d700 1 -- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31c40c9040 msgr2=0x7f31c41f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c2d9d700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31c40c9040 0x7f31c41f4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c2d9d700 1 -- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c40b43a0 msgr2=0x7f31c41492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c2d9d700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c40b43a0 0x7f31c41492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c2d9d700 1 -- 172.21.15.112:0/1232958374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b80094b0 con 0x7f31c40b1640 2023-11-08T12:28:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c259c700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c40b43a0 0x7f31c41492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c2d9d700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b1640 0x7f31c40c8220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31b4016000 tx=0x7f31b4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31ab7fe700 1 -- 172.21.15.112:0/1232958374 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4004450 con 0x7f31c40b1640 2023-11-08T12:28:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31ab7fe700 1 -- 172.21.15.112:0/1232958374 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b40045b0 con 0x7f31c40b1640 2023-11-08T12:28:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31ab7fe700 1 -- 172.21.15.112:0/1232958374 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4003900 con 0x7f31c40b1640 2023-11-08T12:28:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b4009570 con 0x7f31c40b1640 2023-11-08T12:28:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c406b5d0 con 0x7f31c40b1640 2023-11-08T12:28:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.341+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c406b2f0 con 0x7f31c40b1640 2023-11-08T12:28:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.345+0000 7f31ab7fe700 1 -- 172.21.15.112:0/1232958374 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f31b400f050 con 0x7f31c40b1640 2023-11-08T12:28:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.345+0000 7f31ab7fe700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f31b0064ee0 0x7f31b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.345+0000 7f31ab7fe700 1 -- 172.21.15.112:0/1232958374 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f31b4021030 con 0x7f31c40b1640 2023-11-08T12:28:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.345+0000 7f31c259c700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f31b0064ee0 0x7f31b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.349+0000 7f31c259c700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f31b0064ee0 0x7f31b0067390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31c40b0250 tx=0x7f31b8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.353+0000 7f31ab7fe700 1 -- 172.21.15.112:0/1232958374 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f31b4051b40 con 0x7f31c40b1640 2023-11-08T12:28:21.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.521+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31c415eb10 con 0x7f31b0064ee0 2023-11-08T12:28:21.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.541+0000 7f31ab7fe700 1 -- 172.21.15.112:0/1232958374 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367069 (secure 0 0 0) 0x7f31c415eb10 con 0x7f31b0064ee0 2023-11-08T12:28:21.548 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:21.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f31b0064ee0 msgr2=0x7f31b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f31b0064ee0 0x7f31b0067390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31c40b0250 tx=0x7f31b8009240 comp rx=0 tx=0).stop 2023-11-08T12:28:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b1640 msgr2=0x7f31c40c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b1640 0x7f31c40c8220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31b4016000 tx=0x7f31b4004770 comp rx=0 tx=0).stop 2023-11-08T12:28:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 shutdown_connections 2023-11-08T12:28:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f31b0064ee0 0x7f31b0067390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31c40c9040 0x7f31c41f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31c40b43a0 0x7f31c41492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 --2- 172.21.15.112:0/1232958374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40b1640 0x7f31c40c8220 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 >> 172.21.15.112:0/1232958374 conn(0x7f31c40b0f80 msgr2=0x7f31c406a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 shutdown_connections 2023-11-08T12:28:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.545+0000 7f31c89b7700 1 -- 172.21.15.112:0/1232958374 wait complete. 2023-11-08T12:28:21.554 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:28:21.572 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-11-08T12:28:20.715622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67592,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907128,"statfs":{"total":773094113280,"available":773024899072,"internally_reserved":0,"allocated":3678208,"data_stored":2187254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005234"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734482+0000","last_change":"2023-11-08T12:27:58.143715+0000","last_active":"2023-11-08T12:27:58.734482+0000","last_peered":"2023-11-08T12:27:58.734482+0000","last_clean":"2023-11-08T12:27:58.734482+0000","last_became_active":"2023-11-08T12:27:58.143212+0000","last_became_peered":"2023-11-08T12:27:58.143212+0000","last_unstale":"2023-11-08T12:27:58.734482+0000","last_undegraded":"2023-11-08T12:27:58.734482+0000","last_fullsized":"2023-11-08T12:27:58.734482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:00:05.519929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130697+0000","last_change":"2023-11-08T12:27:53.619554+0000","last_active":"2023-11-08T12:27:58.130697+0000","last_peered":"2023-11-08T12:27:58.130697+0000","last_clean":"2023-11-08T12:27:58.130697+0000","last_became_active":"2023-11-08T12:27:53.618719+0000","last_became_peered":"2023-11-08T12:27:53.618719+0000","last_unstale":"2023-11-08T12:27:58.130697+0000","last_undegraded":"2023-11-08T12:27:58.130697+0000","last_fullsized":"2023-11-08T12:27:58.130697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126104+0000","last_change":"2023-11-08T12:27:54.093845+0000","last_active":"2023-11-08T12:27:58.126104+0000","last_peered":"2023-11-08T12:27:58.126104+0000","last_clean":"2023-11-08T12:27:58.126104+0000","last_became_active":"2023-11-08T12:27:54.093578+0000","last_became_peered":"2023-11-08T12:27:54.093578+0000","last_unstale":"2023-11-08T12:27:58.126104+0000","last_undegraded":"2023-11-08T12:27:58.126104+0000","last_fullsized":"2023-11-08T12:27:58.126104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625901+0000","last_change":"2023-11-08T12:27:58.137408+0000","last_active":"2023-11-08T12:27:58.625901+0000","last_peered":"2023-11-08T12:27:58.625901+0000","last_clean":"2023-11-08T12:27:58.625901+0000","last_became_active":"2023-11-08T12:27:58.136515+0000","last_became_peered":"2023-11-08T12:27:58.136515+0000","last_unstale":"2023-11-08T12:27:58.625901+0000","last_undegraded":"2023-11-08T12:27:58.625901+0000","last_fullsized":"2023-11-08T12:27:58.625901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:02:41.434275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.116564+0000","last_change":"2023-11-08T12:27:53.619875+0000","last_active":"2023-11-08T12:27:58.116564+0000","last_peered":"2023-11-08T12:27:58.116564+0000","last_clean":"2023-11-08T12:27:58.116564+0000","last_became_active":"2023-11-08T12:27:53.619543+0000","last_became_peered":"2023-11-08T12:27:53.619543+0000","last_unstale":"2023-11-08T12:27:58.116564+0000","last_undegraded":"2023-11-08T12:27:58.116564+0000","last_fullsized":"2023-11-08T12:27:58.116564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111227+0000","last_change":"2023-11-08T12:27:54.083208+0000","last_active":"2023-11-08T12:27:58.111227+0000","last_peered":"2023-11-08T12:27:58.111227+0000","last_clean":"2023-11-08T12:27:58.111227+0000","last_became_active":"2023-11-08T12:27:54.082680+0000","last_became_peered":"2023-11-08T12:27:54.082680+0000","last_unstale":"2023-11-08T12:27:58.111227+0000","last_undegraded":"2023-11-08T12:27:58.111227+0000","last_fullsized":"2023-11-08T12:27:58.111227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574345+0000","last_change":"2023-11-08T12:27:58.142185+0000","last_active":"2023-11-08T12:27:58.574345+0000","last_peered":"2023-11-08T12:27:58.574345+0000","last_clean":"2023-11-08T12:27:58.574345+0000","last_became_active":"2023-11-08T12:27:58.141842+0000","last_became_peered":"2023-11-08T12:27:58.141842+0000","last_unstale":"2023-11-08T12:27:58.574345+0000","last_undegraded":"2023-11-08T12:27:58.574345+0000","last_fullsized":"2023-11-08T12:27:58.574345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:02:41.632614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110470+0000","last_change":"2023-11-08T12:27:53.624797+0000","last_active":"2023-11-08T12:27:58.110470+0000","last_peered":"2023-11-08T12:27:58.110470+0000","last_clean":"2023-11-08T12:27:58.110470+0000","last_became_active":"2023-11-08T12:27:53.624543+0000","last_became_peered":"2023-11-08T12:27:53.624543+0000","last_unstale":"2023-11-08T12:27:58.110470+0000","last_undegraded":"2023-11-08T12:27:58.110470+0000","last_fullsized":"2023-11-08T12:27:58.110470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:30.363156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127249+0000","last_change":"2023-11-08T12:27:54.100828+0000","last_active":"2023-11-08T12:27:58.127249+0000","last_peered":"2023-11-08T12:27:58.127249+0000","last_clean":"2023-11-08T12:27:58.127249+0000","last_became_active":"2023-11-08T12:27:54.100558+0000","last_became_peered":"2023-11-08T12:27:54.100558+0000","last_unstale":"2023-11-08T12:27:58.127249+0000","last_undegraded":"2023-11-08T12:27:58.127249+0000","last_fullsized":"2023-11-08T12:27:58.127249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879088+0000","last_change":"2023-11-08T12:27:58.154104+0000","last_active":"2023-11-08T12:27:58.879088+0000","last_peered":"2023-11-08T12:27:58.879088+0000","last_clean":"2023-11-08T12:27:58.879088+0000","last_became_active":"2023-11-08T12:27:58.153162+0000","last_became_peered":"2023-11-08T12:27:58.153162+0000","last_unstale":"2023-11-08T12:27:58.879088+0000","last_undegraded":"2023-11-08T12:27:58.879088+0000","last_fullsized":"2023-11-08T12:27:58.879088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109644+0000","last_change":"2023-11-08T12:27:53.622313+0000","last_active":"2023-11-08T12:27:58.109644+0000","last_peered":"2023-11-08T12:27:58.109644+0000","last_clean":"2023-11-08T12:27:58.109644+0000","last_became_active":"2023-11-08T12:27:53.621963+0000","last_became_peered":"2023-11-08T12:27:53.621963+0000","last_unstale":"2023-11-08T12:27:58.109644+0000","last_undegraded":"2023-11-08T12:27:58.109644+0000","last_fullsized":"2023-11-08T12:27:58.109644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:58.001489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127020+0000","last_change":"2023-11-08T12:27:54.096898+0000","last_active":"2023-11-08T12:27:58.127020+0000","last_peered":"2023-11-08T12:27:58.127020+0000","last_clean":"2023-11-08T12:27:58.127020+0000","last_became_active":"2023-11-08T12:27:54.096604+0000","last_became_peered":"2023-11-08T12:27:54.096604+0000","last_unstale":"2023-11-08T12:27:58.127020+0000","last_undegraded":"2023-11-08T12:27:58.127020+0000","last_fullsized":"2023-11-08T12:27:58.127020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735720+0000","last_change":"2023-11-08T12:27:58.144552+0000","last_active":"2023-11-08T12:27:58.735720+0000","last_peered":"2023-11-08T12:27:58.735720+0000","last_clean":"2023-11-08T12:27:58.735720+0000","last_became_active":"2023-11-08T12:27:58.144149+0000","last_became_peered":"2023-11-08T12:27:58.144149+0000","last_unstale":"2023-11-08T12:27:58.735720+0000","last_undegraded":"2023-11-08T12:27:58.735720+0000","last_fullsized":"2023-11-08T12:27:58.735720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.131880+0000","last_change":"2023-11-08T12:27:53.626681+0000","last_active":"2023-11-08T12:27:58.131880+0000","last_peered":"2023-11-08T12:27:58.131880+0000","last_clean":"2023-11-08T12:27:58.131880+0000","last_became_active":"2023-11-08T12:27:53.625885+0000","last_became_peered":"2023-11-08T12:27:53.625885+0000","last_unstale":"2023-11-08T12:27:58.131880+0000","last_undegraded":"2023-11-08T12:27:58.131880+0000","last_fullsized":"2023-11-08T12:27:58.131880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112234+0000","last_change":"2023-11-08T12:27:54.089379+0000","last_active":"2023-11-08T12:27:58.112234+0000","last_peered":"2023-11-08T12:27:58.112234+0000","last_clean":"2023-11-08T12:27:58.112234+0000","last_became_active":"2023-11-08T12:27:54.089095+0000","last_became_peered":"2023-11-08T12:27:54.089095+0000","last_unstale":"2023-11-08T12:27:58.112234+0000","last_undegraded":"2023-11-08T12:27:58.112234+0000","last_fullsized":"2023-11-08T12:27:58.112234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:02.028291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.626502+0000","last_change":"2023-11-08T12:27:58.143308+0000","last_active":"2023-11-08T12:27:58.626502+0000","last_peered":"2023-11-08T12:27:58.626502+0000","last_clean":"2023-11-08T12:27:58.626502+0000","last_became_active":"2023-11-08T12:27:58.142966+0000","last_became_peered":"2023-11-08T12:27:58.142966+0000","last_unstale":"2023-11-08T12:27:58.626502+0000","last_undegraded":"2023-11-08T12:27:58.626502+0000","last_fullsized":"2023-11-08T12:27:58.626502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:55.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127396+0000","last_change":"2023-11-08T12:27:53.627388+0000","last_active":"2023-11-08T12:27:58.127396+0000","last_peered":"2023-11-08T12:27:58.127396+0000","last_clean":"2023-11-08T12:27:58.127396+0000","last_became_active":"2023-11-08T12:27:53.625097+0000","last_became_peered":"2023-11-08T12:27:53.625097+0000","last_unstale":"2023-11-08T12:27:58.127396+0000","last_undegraded":"2023-11-08T12:27:58.127396+0000","last_fullsized":"2023-11-08T12:27:58.127396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:48.205657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112661+0000","last_change":"2023-11-08T12:27:54.091732+0000","last_active":"2023-11-08T12:27:58.112661+0000","last_peered":"2023-11-08T12:27:58.112661+0000","last_clean":"2023-11-08T12:27:58.112661+0000","last_became_active":"2023-11-08T12:27:54.090672+0000","last_became_peered":"2023-11-08T12:27:54.090672+0000","last_unstale":"2023-11-08T12:27:58.112661+0000","last_undegraded":"2023-11-08T12:27:58.112661+0000","last_fullsized":"2023-11-08T12:27:58.112661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.068573+0000","last_change":"2023-11-08T12:27:58.149046+0000","last_active":"2023-11-08T12:27:59.068573+0000","last_peered":"2023-11-08T12:27:59.068573+0000","last_clean":"2023-11-08T12:27:59.068573+0000","last_became_active":"2023-11-08T12:27:58.148283+0000","last_became_peered":"2023-11-08T12:27:58.148283+0000","last_unstale":"2023-11-08T12:27:59.068573+0000","last_undegraded":"2023-11-08T12:27:59.068573+0000","last_fullsized":"2023-11-08T12:27:59.068573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:06.214828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123874+0000","last_change":"2023-11-08T12:27:53.618474+0000","last_active":"2023-11-08T12:27:58.123874+0000","last_peered":"2023-11-08T12:27:58.123874+0000","last_clean":"2023-11-08T12:27:58.123874+0000","last_became_active":"2023-11-08T12:27:53.617981+0000","last_became_peered":"2023-11-08T12:27:53.617981+0000","last_unstale":"2023-11-08T12:27:58.123874+0000","last_undegraded":"2023-11-08T12:27:58.123874+0000","last_fullsized":"2023-11-08T12:27:58.123874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128422+0000","last_change":"2023-11-08T12:27:54.116480+0000","last_active":"2023-11-08T12:27:58.128422+0000","last_peered":"2023-11-08T12:27:58.128422+0000","last_clean":"2023-11-08T12:27:58.128422+0000","last_became_active":"2023-11-08T12:27:54.116211+0000","last_became_peered":"2023-11-08T12:27:54.116211+0000","last_unstale":"2023-11-08T12:27:58.128422+0000","last_undegraded":"2023-11-08T12:27:58.128422+0000","last_fullsized":"2023-11-08T12:27:58.128422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727992+0000","last_change":"2023-11-08T12:27:58.145667+0000","last_active":"2023-11-08T12:27:58.727992+0000","last_peered":"2023-11-08T12:27:58.727992+0000","last_clean":"2023-11-08T12:27:58.727992+0000","last_became_active":"2023-11-08T12:27:58.145298+0000","last_became_peered":"2023-11-08T12:27:58.145298+0000","last_unstale":"2023-11-08T12:27:58.727992+0000","last_undegraded":"2023-11-08T12:27:58.727992+0000","last_fullsized":"2023-11-08T12:27:58.727992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112268+0000","last_change":"2023-11-08T12:27:53.612017+0000","last_active":"2023-11-08T12:27:58.112268+0000","last_peered":"2023-11-08T12:27:58.112268+0000","last_clean":"2023-11-08T12:27:58.112268+0000","last_became_active":"2023-11-08T12:27:53.611179+0000","last_became_peered":"2023-11-08T12:27:53.611179+0000","last_unstale":"2023-11-08T12:27:58.112268+0000","last_undegraded":"2023-11-08T12:27:58.112268+0000","last_fullsized":"2023-11-08T12:27:58.112268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135571+0000","last_change":"2023-11-08T12:27:54.089485+0000","last_active":"2023-11-08T12:27:58.135571+0000","last_peered":"2023-11-08T12:27:58.135571+0000","last_clean":"2023-11-08T12:27:58.135571+0000","last_became_active":"2023-11-08T12:27:54.089151+0000","last_became_peered":"2023-11-08T12:27:54.089151+0000","last_unstale":"2023-11-08T12:27:58.135571+0000","last_undegraded":"2023-11-08T12:27:58.135571+0000","last_fullsized":"2023-11-08T12:27:58.135571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:14.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111497+0000","last_change":"2023-11-08T12:27:54.084403+0000","last_active":"2023-11-08T12:27:58.111497+0000","last_peered":"2023-11-08T12:27:58.111497+0000","last_clean":"2023-11-08T12:27:58.111497+0000","last_became_active":"2023-11-08T12:27:54.084144+0000","last_became_peered":"2023-11-08T12:27:54.084144+0000","last_unstale":"2023-11-08T12:27:58.111497+0000","last_undegraded":"2023-11-08T12:27:58.111497+0000","last_fullsized":"2023-11-08T12:27:58.111497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130737+0000","last_change":"2023-11-08T12:27:53.621364+0000","last_active":"2023-11-08T12:27:58.130737+0000","last_peered":"2023-11-08T12:27:58.130737+0000","last_clean":"2023-11-08T12:27:58.130737+0000","last_became_active":"2023-11-08T12:27:53.619170+0000","last_became_peered":"2023-11-08T12:27:53.619170+0000","last_unstale":"2023-11-08T12:27:58.130737+0000","last_undegraded":"2023-11-08T12:27:58.130737+0000","last_fullsized":"2023-11-08T12:27:58.130737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067445+0000","last_change":"2023-11-08T12:27:58.143148+0000","last_active":"2023-11-08T12:27:59.067445+0000","last_peered":"2023-11-08T12:27:59.067445+0000","last_clean":"2023-11-08T12:27:59.067445+0000","last_became_active":"2023-11-08T12:27:58.142740+0000","last_became_peered":"2023-11-08T12:27:58.142740+0000","last_unstale":"2023-11-08T12:27:59.067445+0000","last_undegraded":"2023-11-08T12:27:59.067445+0000","last_fullsized":"2023-11-08T12:27:59.067445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:35.390792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111098+0000","last_change":"2023-11-08T12:27:54.117016+0000","last_active":"2023-11-08T12:27:58.111098+0000","last_peered":"2023-11-08T12:27:58.111098+0000","last_clean":"2023-11-08T12:27:58.111098+0000","last_became_active":"2023-11-08T12:27:54.116727+0000","last_became_peered":"2023-11-08T12:27:54.116727+0000","last_unstale":"2023-11-08T12:27:58.111098+0000","last_undegraded":"2023-11-08T12:27:58.111098+0000","last_fullsized":"2023-11-08T12:27:58.111098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110642+0000","last_change":"2023-11-08T12:27:53.615988+0000","last_active":"2023-11-08T12:27:58.110642+0000","last_peered":"2023-11-08T12:27:58.110642+0000","last_clean":"2023-11-08T12:27:58.110642+0000","last_became_active":"2023-11-08T12:27:53.615438+0000","last_became_peered":"2023-11-08T12:27:53.615438+0000","last_unstale":"2023-11-08T12:27:58.110642+0000","last_undegraded":"2023-11-08T12:27:58.110642+0000","last_fullsized":"2023-11-08T12:27:58.110642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:35.164663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878583+0000","last_change":"2023-11-08T12:27:58.153999+0000","last_active":"2023-11-08T12:27:58.878583+0000","last_peered":"2023-11-08T12:27:58.878583+0000","last_clean":"2023-11-08T12:27:58.878583+0000","last_became_active":"2023-11-08T12:27:58.152623+0000","last_became_peered":"2023-11-08T12:27:58.152623+0000","last_unstale":"2023-11-08T12:27:58.878583+0000","last_undegraded":"2023-11-08T12:27:58.878583+0000","last_fullsized":"2023-11-08T12:27:58.878583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122939+0000","last_change":"2023-11-08T12:27:53.621214+0000","last_active":"2023-11-08T12:27:58.122939+0000","last_peered":"2023-11-08T12:27:58.122939+0000","last_clean":"2023-11-08T12:27:58.122939+0000","last_became_active":"2023-11-08T12:27:53.620914+0000","last_became_peered":"2023-11-08T12:27:53.620914+0000","last_unstale":"2023-11-08T12:27:58.122939+0000","last_undegraded":"2023-11-08T12:27:58.122939+0000","last_fullsized":"2023-11-08T12:27:58.122939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:07.559515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127137+0000","last_change":"2023-11-08T12:27:54.093415+0000","last_active":"2023-11-08T12:27:58.127137+0000","last_peered":"2023-11-08T12:27:58.127137+0000","last_clean":"2023-11-08T12:27:58.127137+0000","last_became_active":"2023-11-08T12:27:54.092409+0000","last_became_peered":"2023-11-08T12:27:54.092409+0000","last_unstale":"2023-11-08T12:27:58.127137+0000","last_undegraded":"2023-11-08T12:27:58.127137+0000","last_fullsized":"2023-11-08T12:27:58.127137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572683+0000","last_change":"2023-11-08T12:27:58.143576+0000","last_active":"2023-11-08T12:27:58.572683+0000","last_peered":"2023-11-08T12:27:58.572683+0000","last_clean":"2023-11-08T12:27:58.572683+0000","last_became_active":"2023-11-08T12:27:58.143166+0000","last_became_peered":"2023-11-08T12:27:58.143166+0000","last_unstale":"2023-11-08T12:27:58.572683+0000","last_undegraded":"2023-11-08T12:27:58.572683+0000","last_fullsized":"2023-11-08T12:27:58.572683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:28:10.838649+0000","last_change":"2023-11-08T12:27:53.627035+0000","last_active":"2023-11-08T12:28:10.838649+0000","last_peered":"2023-11-08T12:28:10.838649+0000","last_clean":"2023-11-08T12:28:10.838649+0000","last_became_active":"2023-11-08T12:27:53.625128+0000","last_became_peered":"2023-11-08T12:27:53.625128+0000","last_unstale":"2023-11-08T12:28:10.838649+0000","last_undegraded":"2023-11-08T12:28:10.838649+0000","last_fullsized":"2023-11-08T12:28:10.838649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127106+0000","last_change":"2023-11-08T12:27:54.095419+0000","last_active":"2023-11-08T12:27:58.127106+0000","last_peered":"2023-11-08T12:27:58.127106+0000","last_clean":"2023-11-08T12:27:58.127106+0000","last_became_active":"2023-11-08T12:27:54.095149+0000","last_became_peered":"2023-11-08T12:27:54.095149+0000","last_unstale":"2023-11-08T12:27:58.127106+0000","last_undegraded":"2023-11-08T12:27:58.127106+0000","last_fullsized":"2023-11-08T12:27:58.127106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734672+0000","last_change":"2023-11-08T12:27:58.153991+0000","last_active":"2023-11-08T12:27:58.734672+0000","last_peered":"2023-11-08T12:27:58.734672+0000","last_clean":"2023-11-08T12:27:58.734672+0000","last_became_active":"2023-11-08T12:27:58.153570+0000","last_became_peered":"2023-11-08T12:27:58.153570+0000","last_unstale":"2023-11-08T12:27:58.734672+0000","last_undegraded":"2023-11-08T12:27:58.734672+0000","last_fullsized":"2023-11-08T12:27:58.734672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:18:44.567768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126320+0000","last_change":"2023-11-08T12:27:54.097273+0000","last_active":"2023-11-08T12:27:58.126320+0000","last_peered":"2023-11-08T12:27:58.126320+0000","last_clean":"2023-11-08T12:27:58.126320+0000","last_became_active":"2023-11-08T12:27:54.097022+0000","last_became_peered":"2023-11-08T12:27:54.097022+0000","last_unstale":"2023-11-08T12:27:58.126320+0000","last_undegraded":"2023-11-08T12:27:58.126320+0000","last_fullsized":"2023-11-08T12:27:58.126320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135667+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:27:58.135667+0000","last_peered":"2023-11-08T12:27:58.135667+0000","last_clean":"2023-11-08T12:27:58.135667+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:27:58.135667+0000","last_undegraded":"2023-11-08T12:27:58.135667+0000","last_fullsized":"2023-11-08T12:27:58.135667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.728537+0000","last_change":"2023-11-08T12:27:53.620399+0000","last_active":"2023-11-08T12:27:58.728537+0000","last_peered":"2023-11-08T12:27:58.728537+0000","last_clean":"2023-11-08T12:27:58.728537+0000","last_became_active":"2023-11-08T12:27:53.619858+0000","last_became_peered":"2023-11-08T12:27:53.619858+0000","last_unstale":"2023-11-08T12:27:58.728537+0000","last_undegraded":"2023-11-08T12:27:58.728537+0000","last_fullsized":"2023-11-08T12:27:58.728537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572203+0000","last_change":"2023-11-08T12:27:58.138249+0000","last_active":"2023-11-08T12:27:58.572203+0000","last_peered":"2023-11-08T12:27:58.572203+0000","last_clean":"2023-11-08T12:27:58.572203+0000","last_became_active":"2023-11-08T12:27:58.136905+0000","last_became_peered":"2023-11-08T12:27:58.136905+0000","last_unstale":"2023-11-08T12:27:58.572203+0000","last_undegraded":"2023-11-08T12:27:58.572203+0000","last_fullsized":"2023-11-08T12:27:58.572203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111643+0000","last_change":"2023-11-08T12:27:54.113672+0000","last_active":"2023-11-08T12:27:58.111643+0000","last_peered":"2023-11-08T12:27:58.111643+0000","last_clean":"2023-11-08T12:27:58.111643+0000","last_became_active":"2023-11-08T12:27:54.113329+0000","last_became_peered":"2023-11-08T12:27:54.113329+0000","last_unstale":"2023-11-08T12:27:58.111643+0000","last_undegraded":"2023-11-08T12:27:58.111643+0000","last_fullsized":"2023-11-08T12:27:58.111643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126943+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:27:58.126943+0000","last_peered":"2023-11-08T12:27:58.126943+0000","last_clean":"2023-11-08T12:27:58.126943+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:27:58.126943+0000","last_undegraded":"2023-11-08T12:27:58.126943+0000","last_fullsized":"2023-11-08T12:27:58.126943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.118099+0000","last_change":"2023-11-08T12:27:53.617273+0000","last_active":"2023-11-08T12:27:58.118099+0000","last_peered":"2023-11-08T12:27:58.118099+0000","last_clean":"2023-11-08T12:27:58.118099+0000","last_became_active":"2023-11-08T12:27:53.616974+0000","last_became_peered":"2023-11-08T12:27:53.616974+0000","last_unstale":"2023-11-08T12:27:58.118099+0000","last_undegraded":"2023-11-08T12:27:58.118099+0000","last_fullsized":"2023-11-08T12:27:58.118099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625634+0000","last_change":"2023-11-08T12:27:58.149407+0000","last_active":"2023-11-08T12:27:58.625634+0000","last_peered":"2023-11-08T12:27:58.625634+0000","last_clean":"2023-11-08T12:27:58.625634+0000","last_became_active":"2023-11-08T12:27:58.148897+0000","last_became_peered":"2023-11-08T12:27:58.148897+0000","last_unstale":"2023-11-08T12:27:58.625634+0000","last_undegraded":"2023-11-08T12:27:58.625634+0000","last_fullsized":"2023-11-08T12:27:58.625634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:49.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129170+0000","last_change":"2023-11-08T12:27:54.116232+0000","last_active":"2023-11-08T12:27:58.129170+0000","last_peered":"2023-11-08T12:27:58.129170+0000","last_clean":"2023-11-08T12:27:58.129170+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129170+0000","last_undegraded":"2023-11-08T12:27:58.129170+0000","last_fullsized":"2023-11-08T12:27:58.129170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123167+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:27:58.123167+0000","last_peered":"2023-11-08T12:27:58.123167+0000","last_clean":"2023-11-08T12:27:58.123167+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:27:58.123167+0000","last_undegraded":"2023-11-08T12:27:58.123167+0000","last_fullsized":"2023-11-08T12:27:58.123167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126485+0000","last_change":"2023-11-08T12:27:53.615162+0000","last_active":"2023-11-08T12:27:58.126485+0000","last_peered":"2023-11-08T12:27:58.126485+0000","last_clean":"2023-11-08T12:27:58.126485+0000","last_became_active":"2023-11-08T12:27:53.613969+0000","last_became_peered":"2023-11-08T12:27:53.613969+0000","last_unstale":"2023-11-08T12:27:58.126485+0000","last_undegraded":"2023-11-08T12:27:58.126485+0000","last_fullsized":"2023-11-08T12:27:58.126485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067771+0000","last_change":"2023-11-08T12:27:58.135959+0000","last_active":"2023-11-08T12:27:59.067771+0000","last_peered":"2023-11-08T12:27:59.067771+0000","last_clean":"2023-11-08T12:27:59.067771+0000","last_became_active":"2023-11-08T12:27:58.135005+0000","last_became_peered":"2023-11-08T12:27:58.135005+0000","last_unstale":"2023-11-08T12:27:59.067771+0000","last_undegraded":"2023-11-08T12:27:59.067771+0000","last_fullsized":"2023-11-08T12:27:59.067771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:40.554359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127218+0000","last_change":"2023-11-08T12:27:54.101570+0000","last_active":"2023-11-08T12:27:58.127218+0000","last_peered":"2023-11-08T12:27:58.127218+0000","last_clean":"2023-11-08T12:27:58.127218+0000","last_became_active":"2023-11-08T12:27:54.101436+0000","last_became_peered":"2023-11-08T12:27:54.101436+0000","last_unstale":"2023-11-08T12:27:58.127218+0000","last_undegraded":"2023-11-08T12:27:58.127218+0000","last_fullsized":"2023-11-08T12:27:58.127218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127048+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:27:58.127048+0000","last_peered":"2023-11-08T12:27:58.127048+0000","last_clean":"2023-11-08T12:27:58.127048+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:27:58.127048+0000","last_undegraded":"2023-11-08T12:27:58.127048+0000","last_fullsized":"2023-11-08T12:27:58.127048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110574+0000","last_change":"2023-11-08T12:27:53.610684+0000","last_active":"2023-11-08T12:27:58.110574+0000","last_peered":"2023-11-08T12:27:58.110574+0000","last_clean":"2023-11-08T12:27:58.110574+0000","last_became_active":"2023-11-08T12:27:53.610294+0000","last_became_peered":"2023-11-08T12:27:53.610294+0000","last_unstale":"2023-11-08T12:27:58.110574+0000","last_undegraded":"2023-11-08T12:27:58.110574+0000","last_fullsized":"2023-11-08T12:27:58.110574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727740+0000","last_change":"2023-11-08T12:27:58.142126+0000","last_active":"2023-11-08T12:27:58.727740+0000","last_peered":"2023-11-08T12:27:58.727740+0000","last_clean":"2023-11-08T12:27:58.727740+0000","last_became_active":"2023-11-08T12:27:58.139937+0000","last_became_peered":"2023-11-08T12:27:58.139937+0000","last_unstale":"2023-11-08T12:27:58.727740+0000","last_undegraded":"2023-11-08T12:27:58.727740+0000","last_fullsized":"2023-11-08T12:27:58.727740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:25:36.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126398+0000","last_change":"2023-11-08T12:27:54.098374+0000","last_active":"2023-11-08T12:27:58.126398+0000","last_peered":"2023-11-08T12:27:58.126398+0000","last_clean":"2023-11-08T12:27:58.126398+0000","last_became_active":"2023-11-08T12:27:54.095259+0000","last_became_peered":"2023-11-08T12:27:54.095259+0000","last_unstale":"2023-11-08T12:27:58.126398+0000","last_undegraded":"2023-11-08T12:27:58.126398+0000","last_fullsized":"2023-11-08T12:27:58.126398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127272+0000","last_change":"2023-11-08T12:27:53.624589+0000","last_active":"2023-11-08T12:27:58.127272+0000","last_peered":"2023-11-08T12:27:58.127272+0000","last_clean":"2023-11-08T12:27:58.127272+0000","last_became_active":"2023-11-08T12:27:53.624171+0000","last_became_peered":"2023-11-08T12:27:53.624171+0000","last_unstale":"2023-11-08T12:27:58.127272+0000","last_undegraded":"2023-11-08T12:27:58.127272+0000","last_fullsized":"2023-11-08T12:27:58.127272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109600+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:27:58.109600+0000","last_peered":"2023-11-08T12:27:58.109600+0000","last_clean":"2023-11-08T12:27:58.109600+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:27:58.109600+0000","last_undegraded":"2023-11-08T12:27:58.109600+0000","last_fullsized":"2023-11-08T12:27:58.109600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727835+0000","last_change":"2023-11-08T12:27:58.142674+0000","last_active":"2023-11-08T12:27:58.727835+0000","last_peered":"2023-11-08T12:27:58.727835+0000","last_clean":"2023-11-08T12:27:58.727835+0000","last_became_active":"2023-11-08T12:27:58.142302+0000","last_became_peered":"2023-11-08T12:27:58.142302+0000","last_unstale":"2023-11-08T12:27:58.727835+0000","last_undegraded":"2023-11-08T12:27:58.727835+0000","last_fullsized":"2023-11-08T12:27:58.727835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127069+0000","last_change":"2023-11-08T12:27:54.102964+0000","last_active":"2023-11-08T12:27:58.127069+0000","last_peered":"2023-11-08T12:27:58.127069+0000","last_clean":"2023-11-08T12:27:58.127069+0000","last_became_active":"2023-11-08T12:27:54.102407+0000","last_became_peered":"2023-11-08T12:27:54.102407+0000","last_unstale":"2023-11-08T12:27:58.127069+0000","last_undegraded":"2023-11-08T12:27:58.127069+0000","last_fullsized":"2023-11-08T12:27:58.127069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:05.031348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130328+0000","last_change":"2023-11-08T12:27:53.616006+0000","last_active":"2023-11-08T12:27:58.130328+0000","last_peered":"2023-11-08T12:27:58.130328+0000","last_clean":"2023-11-08T12:27:58.130328+0000","last_became_active":"2023-11-08T12:27:53.615753+0000","last_became_peered":"2023-11-08T12:27:53.615753+0000","last_unstale":"2023-11-08T12:27:58.130328+0000","last_undegraded":"2023-11-08T12:27:58.130328+0000","last_fullsized":"2023-11-08T12:27:58.130328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112019+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:27:58.112019+0000","last_peered":"2023-11-08T12:27:58.112019+0000","last_clean":"2023-11-08T12:27:58.112019+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:27:58.112019+0000","last_undegraded":"2023-11-08T12:27:58.112019+0000","last_fullsized":"2023-11-08T12:27:58.112019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575827+0000","last_change":"2023-11-08T12:27:58.150621+0000","last_active":"2023-11-08T12:27:58.575827+0000","last_peered":"2023-11-08T12:27:58.575827+0000","last_clean":"2023-11-08T12:27:58.575827+0000","last_became_active":"2023-11-08T12:27:58.150173+0000","last_became_peered":"2023-11-08T12:27:58.150173+0000","last_unstale":"2023-11-08T12:27:58.575827+0000","last_undegraded":"2023-11-08T12:27:58.575827+0000","last_fullsized":"2023-11-08T12:27:58.575827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:48.495503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128502+0000","last_change":"2023-11-08T12:27:54.105866+0000","last_active":"2023-11-08T12:27:58.128502+0000","last_peered":"2023-11-08T12:27:58.128502+0000","last_clean":"2023-11-08T12:27:58.128502+0000","last_became_active":"2023-11-08T12:27:54.105572+0000","last_became_peered":"2023-11-08T12:27:54.105572+0000","last_unstale":"2023-11-08T12:27:58.128502+0000","last_undegraded":"2023-11-08T12:27:58.128502+0000","last_fullsized":"2023-11-08T12:27:58.128502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.120729+0000","last_change":"2023-11-08T12:27:53.626369+0000","last_active":"2023-11-08T12:27:58.120729+0000","last_peered":"2023-11-08T12:27:58.120729+0000","last_clean":"2023-11-08T12:27:58.120729+0000","last_became_active":"2023-11-08T12:27:53.625999+0000","last_became_peered":"2023-11-08T12:27:53.625999+0000","last_unstale":"2023-11-08T12:27:58.120729+0000","last_undegraded":"2023-11-08T12:27:58.120729+0000","last_fullsized":"2023-11-08T12:27:58.120729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124321+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:27:58.124321+0000","last_peered":"2023-11-08T12:27:58.124321+0000","last_clean":"2023-11-08T12:27:58.124321+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:27:58.124321+0000","last_undegraded":"2023-11-08T12:27:58.124321+0000","last_fullsized":"2023-11-08T12:27:58.124321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574864+0000","last_change":"2023-11-08T12:27:58.143351+0000","last_active":"2023-11-08T12:27:58.574864+0000","last_peered":"2023-11-08T12:27:58.574864+0000","last_clean":"2023-11-08T12:27:58.574864+0000","last_became_active":"2023-11-08T12:27:58.142889+0000","last_became_peered":"2023-11-08T12:27:58.142889+0000","last_unstale":"2023-11-08T12:27:58.574864+0000","last_undegraded":"2023-11-08T12:27:58.574864+0000","last_fullsized":"2023-11-08T12:27:58.574864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134390+0000","last_change":"2023-11-08T12:27:54.094331+0000","last_active":"2023-11-08T12:27:58.134390+0000","last_peered":"2023-11-08T12:27:58.134390+0000","last_clean":"2023-11-08T12:27:58.134390+0000","last_became_active":"2023-11-08T12:27:54.093211+0000","last_became_peered":"2023-11-08T12:27:54.093211+0000","last_unstale":"2023-11-08T12:27:58.134390+0000","last_undegraded":"2023-11-08T12:27:58.134390+0000","last_fullsized":"2023-11-08T12:27:58.134390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112852+0000","last_change":"2023-11-08T12:27:53.602187+0000","last_active":"2023-11-08T12:27:58.112852+0000","last_peered":"2023-11-08T12:27:58.112852+0000","last_clean":"2023-11-08T12:27:58.112852+0000","last_became_active":"2023-11-08T12:27:53.601789+0000","last_became_peered":"2023-11-08T12:27:53.601789+0000","last_unstale":"2023-11-08T12:27:58.112852+0000","last_undegraded":"2023-11-08T12:27:58.112852+0000","last_fullsized":"2023-11-08T12:27:58.112852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109985+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:27:58.109985+0000","last_peered":"2023-11-08T12:27:58.109985+0000","last_clean":"2023-11-08T12:27:58.109985+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:27:58.109985+0000","last_undegraded":"2023-11-08T12:27:58.109985+0000","last_fullsized":"2023-11-08T12:27:58.109985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124400+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:27:58.124400+0000","last_peered":"2023-11-08T12:27:58.124400+0000","last_clean":"2023-11-08T12:27:58.124400+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:27:58.124400+0000","last_undegraded":"2023-11-08T12:27:58.124400+0000","last_fullsized":"2023-11-08T12:27:58.124400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879351+0000","last_change":"2023-11-08T12:27:58.142022+0000","last_active":"2023-11-08T12:27:58.879351+0000","last_peered":"2023-11-08T12:27:58.879351+0000","last_clean":"2023-11-08T12:27:58.879351+0000","last_became_active":"2023-11-08T12:27:58.141645+0000","last_became_peered":"2023-11-08T12:27:58.141645+0000","last_unstale":"2023-11-08T12:27:58.879351+0000","last_undegraded":"2023-11-08T12:27:58.879351+0000","last_fullsized":"2023-11-08T12:27:58.879351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126920+0000","last_change":"2023-11-08T12:27:54.098077+0000","last_active":"2023-11-08T12:27:58.126920+0000","last_peered":"2023-11-08T12:27:58.126920+0000","last_clean":"2023-11-08T12:27:58.126920+0000","last_became_active":"2023-11-08T12:27:54.097691+0000","last_became_peered":"2023-11-08T12:27:54.097691+0000","last_unstale":"2023-11-08T12:27:58.126920+0000","last_undegraded":"2023-11-08T12:27:58.126920+0000","last_fullsized":"2023-11-08T12:27:58.126920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112388+0000","last_change":"2023-11-08T12:27:53.618293+0000","last_active":"2023-11-08T12:27:58.112388+0000","last_peered":"2023-11-08T12:27:58.112388+0000","last_clean":"2023-11-08T12:27:58.112388+0000","last_became_active":"2023-11-08T12:27:53.618041+0000","last_became_peered":"2023-11-08T12:27:53.618041+0000","last_unstale":"2023-11-08T12:27:58.112388+0000","last_undegraded":"2023-11-08T12:27:58.112388+0000","last_fullsized":"2023-11-08T12:27:58.112388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.627085+0000","last_change":"2023-11-08T12:27:58.147482+0000","last_active":"2023-11-08T12:27:58.627085+0000","last_peered":"2023-11-08T12:27:58.627085+0000","last_clean":"2023-11-08T12:27:58.627085+0000","last_became_active":"2023-11-08T12:27:58.142932+0000","last_became_peered":"2023-11-08T12:27:58.142932+0000","last_unstale":"2023-11-08T12:27:58.627085+0000","last_undegraded":"2023-11-08T12:27:58.627085+0000","last_fullsized":"2023-11-08T12:27:58.627085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:44:57.061749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127731+0000","last_change":"2023-11-08T12:27:54.096854+0000","last_active":"2023-11-08T12:27:58.127731+0000","last_peered":"2023-11-08T12:27:58.127731+0000","last_clean":"2023-11-08T12:27:58.127731+0000","last_became_active":"2023-11-08T12:27:54.095714+0000","last_became_peered":"2023-11-08T12:27:54.095714+0000","last_unstale":"2023-11-08T12:27:58.127731+0000","last_undegraded":"2023-11-08T12:27:58.127731+0000","last_fullsized":"2023-11-08T12:27:58.127731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:27.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126342+0000","last_change":"2023-11-08T12:27:53.615271+0000","last_active":"2023-11-08T12:27:58.126342+0000","last_peered":"2023-11-08T12:27:58.126342+0000","last_clean":"2023-11-08T12:27:58.126342+0000","last_became_active":"2023-11-08T12:27:53.614914+0000","last_became_peered":"2023-11-08T12:27:53.614914+0000","last_unstale":"2023-11-08T12:27:58.126342+0000","last_undegraded":"2023-11-08T12:27:58.126342+0000","last_fullsized":"2023-11-08T12:27:58.126342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574743+0000","last_change":"2023-11-08T12:27:58.137274+0000","last_active":"2023-11-08T12:27:58.574743+0000","last_peered":"2023-11-08T12:27:58.574743+0000","last_clean":"2023-11-08T12:27:58.574743+0000","last_became_active":"2023-11-08T12:27:58.136837+0000","last_became_peered":"2023-11-08T12:27:58.136837+0000","last_unstale":"2023-11-08T12:27:58.574743+0000","last_undegraded":"2023-11-08T12:27:58.574743+0000","last_fullsized":"2023-11-08T12:27:58.574743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126782+0000","last_change":"2023-11-08T12:27:54.099673+0000","last_active":"2023-11-08T12:27:58.126782+0000","last_peered":"2023-11-08T12:27:58.126782+0000","last_clean":"2023-11-08T12:27:58.126782+0000","last_became_active":"2023-11-08T12:27:54.096740+0000","last_became_peered":"2023-11-08T12:27:54.096740+0000","last_unstale":"2023-11-08T12:27:58.126782+0000","last_undegraded":"2023-11-08T12:27:58.126782+0000","last_fullsized":"2023-11-08T12:27:58.126782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134615+0000","last_change":"2023-11-08T12:27:53.628166+0000","last_active":"2023-11-08T12:27:58.134615+0000","last_peered":"2023-11-08T12:27:58.134615+0000","last_clean":"2023-11-08T12:27:58.134615+0000","last_became_active":"2023-11-08T12:27:53.627825+0000","last_became_peered":"2023-11-08T12:27:53.627825+0000","last_unstale":"2023-11-08T12:27:58.134615+0000","last_undegraded":"2023-11-08T12:27:58.134615+0000","last_fullsized":"2023-11-08T12:27:58.134615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735076+0000","last_change":"2023-11-08T12:27:58.140971+0000","last_active":"2023-11-08T12:27:58.735076+0000","last_peered":"2023-11-08T12:27:58.735076+0000","last_clean":"2023-11-08T12:27:58.735076+0000","last_became_active":"2023-11-08T12:27:58.140628+0000","last_became_peered":"2023-11-08T12:27:58.140628+0000","last_unstale":"2023-11-08T12:27:58.735076+0000","last_undegraded":"2023-11-08T12:27:58.735076+0000","last_fullsized":"2023-11-08T12:27:58.735076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127582+0000","last_change":"2023-11-08T12:27:54.099418+0000","last_active":"2023-11-08T12:27:58.127582+0000","last_peered":"2023-11-08T12:27:58.127582+0000","last_clean":"2023-11-08T12:27:58.127582+0000","last_became_active":"2023-11-08T12:27:54.098046+0000","last_became_peered":"2023-11-08T12:27:54.098046+0000","last_unstale":"2023-11-08T12:27:58.127582+0000","last_undegraded":"2023-11-08T12:27:58.127582+0000","last_fullsized":"2023-11-08T12:27:58.127582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112929+0000","last_change":"2023-11-08T12:27:53.623957+0000","last_active":"2023-11-08T12:27:58.112929+0000","last_peered":"2023-11-08T12:27:58.112929+0000","last_clean":"2023-11-08T12:27:58.112929+0000","last_became_active":"2023-11-08T12:27:53.623625+0000","last_became_peered":"2023-11-08T12:27:53.623625+0000","last_unstale":"2023-11-08T12:27:58.112929+0000","last_undegraded":"2023-11-08T12:27:58.112929+0000","last_fullsized":"2023-11-08T12:27:58.112929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575667+0000","last_change":"2023-11-08T12:27:58.144841+0000","last_active":"2023-11-08T12:27:58.575667+0000","last_peered":"2023-11-08T12:27:58.575667+0000","last_clean":"2023-11-08T12:27:58.575667+0000","last_became_active":"2023-11-08T12:27:58.144375+0000","last_became_peered":"2023-11-08T12:27:58.144375+0000","last_unstale":"2023-11-08T12:27:58.575667+0000","last_undegraded":"2023-11-08T12:27:58.575667+0000","last_fullsized":"2023-11-08T12:27:58.575667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:58:16.447050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129079+0000","last_change":"2023-11-08T12:27:54.116845+0000","last_active":"2023-11-08T12:27:58.129079+0000","last_peered":"2023-11-08T12:27:58.129079+0000","last_clean":"2023-11-08T12:27:58.129079+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129079+0000","last_undegraded":"2023-11-08T12:27:58.129079+0000","last_fullsized":"2023-11-08T12:27:58.129079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109551+0000","last_change":"2023-11-08T12:27:53.610197+0000","last_active":"2023-11-08T12:27:58.109551+0000","last_peered":"2023-11-08T12:27:58.109551+0000","last_clean":"2023-11-08T12:27:58.109551+0000","last_became_active":"2023-11-08T12:27:53.609789+0000","last_became_peered":"2023-11-08T12:27:53.609789+0000","last_unstale":"2023-11-08T12:27:58.109551+0000","last_undegraded":"2023-11-08T12:27:58.109551+0000","last_fullsized":"2023-11-08T12:27:58.109551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575442+0000","last_change":"2023-11-08T12:27:58.138875+0000","last_active":"2023-11-08T12:27:58.575442+0000","last_peered":"2023-11-08T12:27:58.575442+0000","last_clean":"2023-11-08T12:27:58.575442+0000","last_became_active":"2023-11-08T12:27:58.138194+0000","last_became_peered":"2023-11-08T12:27:58.138194+0000","last_unstale":"2023-11-08T12:27:58.575442+0000","last_undegraded":"2023-11-08T12:27:58.575442+0000","last_fullsized":"2023-11-08T12:27:58.575442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.510559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134393+0000","last_change":"2023-11-08T12:27:54.091331+0000","last_active":"2023-11-08T12:27:58.134393+0000","last_peered":"2023-11-08T12:27:58.134393+0000","last_clean":"2023-11-08T12:27:58.134393+0000","last_became_active":"2023-11-08T12:27:54.090934+0000","last_became_peered":"2023-11-08T12:27:54.090934+0000","last_unstale":"2023-11-08T12:27:58.134393+0000","last_undegraded":"2023-11-08T12:27:58.134393+0000","last_fullsized":"2023-11-08T12:27:58.134393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:31.377393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123027+0000","last_change":"2023-11-08T12:27:53.619884+0000","last_active":"2023-11-08T12:27:58.123027+0000","last_peered":"2023-11-08T12:27:58.123027+0000","last_clean":"2023-11-08T12:27:58.123027+0000","last_became_active":"2023-11-08T12:27:53.619224+0000","last_became_peered":"2023-11-08T12:27:53.619224+0000","last_unstale":"2023-11-08T12:27:58.123027+0000","last_undegraded":"2023-11-08T12:27:58.123027+0000","last_fullsized":"2023-11-08T12:27:58.123027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:13.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575454+0000","last_change":"2023-11-08T12:27:58.146347+0000","last_active":"2023-11-08T12:27:58.575454+0000","last_peered":"2023-11-08T12:27:58.575454+0000","last_clean":"2023-11-08T12:27:58.575454+0000","last_became_active":"2023-11-08T12:27:58.141366+0000","last_became_peered":"2023-11-08T12:27:58.141366+0000","last_unstale":"2023-11-08T12:27:58.575454+0000","last_undegraded":"2023-11-08T12:27:58.575454+0000","last_fullsized":"2023-11-08T12:27:58.575454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:21:31.033260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126220+0000","last_change":"2023-11-08T12:27:54.096017+0000","last_active":"2023-11-08T12:27:58.126220+0000","last_peered":"2023-11-08T12:27:58.126220+0000","last_clean":"2023-11-08T12:27:58.126220+0000","last_became_active":"2023-11-08T12:27:54.095626+0000","last_became_peered":"2023-11-08T12:27:54.095626+0000","last_unstale":"2023-11-08T12:27:58.126220+0000","last_undegraded":"2023-11-08T12:27:58.126220+0000","last_fullsized":"2023-11-08T12:27:58.126220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:39.760166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122741+0000","last_change":"2023-11-08T12:27:53.629941+0000","last_active":"2023-11-08T12:27:58.122741+0000","last_peered":"2023-11-08T12:27:58.122741+0000","last_clean":"2023-11-08T12:27:58.122741+0000","last_became_active":"2023-11-08T12:27:53.629616+0000","last_became_peered":"2023-11-08T12:27:53.629616+0000","last_unstale":"2023-11-08T12:27:58.122741+0000","last_undegraded":"2023-11-08T12:27:58.122741+0000","last_fullsized":"2023-11-08T12:27:58.122741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:41:54.461363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575103+0000","last_change":"2023-11-08T12:27:58.134296+0000","last_active":"2023-11-08T12:27:58.575103+0000","last_peered":"2023-11-08T12:27:58.575103+0000","last_clean":"2023-11-08T12:27:58.575103+0000","last_became_active":"2023-11-08T12:27:58.133923+0000","last_became_peered":"2023-11-08T12:27:58.133923+0000","last_unstale":"2023-11-08T12:27:58.575103+0000","last_undegraded":"2023-11-08T12:27:58.575103+0000","last_fullsized":"2023-11-08T12:27:58.575103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:19:06.502167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109786+0000","last_change":"2023-11-08T12:27:54.114859+0000","last_active":"2023-11-08T12:27:58.109786+0000","last_peered":"2023-11-08T12:27:58.109786+0000","last_clean":"2023-11-08T12:27:58.109786+0000","last_became_active":"2023-11-08T12:27:54.114573+0000","last_became_peered":"2023-11-08T12:27:54.114573+0000","last_unstale":"2023-11-08T12:27:58.109786+0000","last_undegraded":"2023-11-08T12:27:58.109786+0000","last_fullsized":"2023-11-08T12:27:58.109786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121705+0000","last_change":"2023-11-08T12:27:53.632041+0000","last_active":"2023-11-08T12:27:58.121705+0000","last_peered":"2023-11-08T12:27:58.121705+0000","last_clean":"2023-11-08T12:27:58.121705+0000","last_became_active":"2023-11-08T12:27:53.631715+0000","last_became_peered":"2023-11-08T12:27:53.631715+0000","last_unstale":"2023-11-08T12:27:58.121705+0000","last_undegraded":"2023-11-08T12:27:58.121705+0000","last_fullsized":"2023-11-08T12:27:58.121705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:13.451343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878943+0000","last_change":"2023-11-08T12:27:58.153252+0000","last_active":"2023-11-08T12:27:58.878943+0000","last_peered":"2023-11-08T12:27:58.878943+0000","last_clean":"2023-11-08T12:27:58.878943+0000","last_became_active":"2023-11-08T12:27:58.152715+0000","last_became_peered":"2023-11-08T12:27:58.152715+0000","last_unstale":"2023-11-08T12:27:58.878943+0000","last_undegraded":"2023-11-08T12:27:58.878943+0000","last_fullsized":"2023-11-08T12:27:58.878943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574571+0000","last_change":"2023-11-08T12:27:58.134922+0000","last_active":"2023-11-08T12:27:58.574571+0000","last_peered":"2023-11-08T12:27:58.574571+0000","last_clean":"2023-11-08T12:27:58.574571+0000","last_became_active":"2023-11-08T12:27:58.134553+0000","last_became_peered":"2023-11-08T12:27:58.134553+0000","last_unstale":"2023-11-08T12:27:58.574571+0000","last_undegraded":"2023-11-08T12:27:58.574571+0000","last_fullsized":"2023-11-08T12:27:58.574571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130484+0000","last_change":"2023-11-08T12:27:53.613363+0000","last_active":"2023-11-08T12:27:58.130484+0000","last_peered":"2023-11-08T12:27:58.130484+0000","last_clean":"2023-11-08T12:27:58.130484+0000","last_became_active":"2023-11-08T12:27:53.613054+0000","last_became_peered":"2023-11-08T12:27:53.613054+0000","last_unstale":"2023-11-08T12:27:58.130484+0000","last_undegraded":"2023-11-08T12:27:58.130484+0000","last_fullsized":"2023-11-08T12:27:58.130484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.117992+0000","last_change":"2023-11-08T12:27:54.113407+0000","last_active":"2023-11-08T12:27:58.117992+0000","last_peered":"2023-11-08T12:27:58.117992+0000","last_clean":"2023-11-08T12:27:58.117992+0000","last_became_active":"2023-11-08T12:27:54.113143+0000","last_became_peered":"2023-11-08T12:27:54.113143+0000","last_unstale":"2023-11-08T12:27:58.117992+0000","last_undegraded":"2023-11-08T12:27:58.117992+0000","last_fullsized":"2023-11-08T12:27:58.117992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574644+0000","last_change":"2023-11-08T12:27:58.152343+0000","last_active":"2023-11-08T12:27:58.574644+0000","last_peered":"2023-11-08T12:27:58.574644+0000","last_clean":"2023-11-08T12:27:58.574644+0000","last_became_active":"2023-11-08T12:27:58.150007+0000","last_became_peered":"2023-11-08T12:27:58.150007+0000","last_unstale":"2023-11-08T12:27:58.574644+0000","last_undegraded":"2023-11-08T12:27:58.574644+0000","last_fullsized":"2023-11-08T12:27:58.574644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127705+0000","last_change":"2023-11-08T12:27:53.629979+0000","last_active":"2023-11-08T12:27:58.127705+0000","last_peered":"2023-11-08T12:27:58.127705+0000","last_clean":"2023-11-08T12:27:58.127705+0000","last_became_active":"2023-11-08T12:27:53.629610+0000","last_became_peered":"2023-11-08T12:27:53.629610+0000","last_unstale":"2023-11-08T12:27:58.127705+0000","last_undegraded":"2023-11-08T12:27:58.127705+0000","last_fullsized":"2023-11-08T12:27:58.127705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:10:20.186679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128585+0000","last_change":"2023-11-08T12:27:54.105236+0000","last_active":"2023-11-08T12:27:58.128585+0000","last_peered":"2023-11-08T12:27:58.128585+0000","last_clean":"2023-11-08T12:27:58.128585+0000","last_became_active":"2023-11-08T12:27:54.101882+0000","last_became_peered":"2023-11-08T12:27:54.101882+0000","last_unstale":"2023-11-08T12:27:58.128585+0000","last_undegraded":"2023-11-08T12:27:58.128585+0000","last_fullsized":"2023-11-08T12:27:58.128585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122039+0000","last_change":"2023-11-08T12:27:53.623671+0000","last_active":"2023-11-08T12:27:58.122039+0000","last_peered":"2023-11-08T12:27:58.122039+0000","last_clean":"2023-11-08T12:27:58.122039+0000","last_became_active":"2023-11-08T12:27:53.623278+0000","last_became_peered":"2023-11-08T12:27:53.623278+0000","last_unstale":"2023-11-08T12:27:58.122039+0000","last_undegraded":"2023-11-08T12:27:58.122039+0000","last_fullsized":"2023-11-08T12:27:58.122039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110357+0000","last_change":"2023-11-08T12:27:54.112710+0000","last_active":"2023-11-08T12:27:58.110357+0000","last_peered":"2023-11-08T12:27:58.110357+0000","last_clean":"2023-11-08T12:27:58.110357+0000","last_became_active":"2023-11-08T12:27:54.111530+0000","last_became_peered":"2023-11-08T12:27:54.111530+0000","last_unstale":"2023-11-08T12:27:58.110357+0000","last_undegraded":"2023-11-08T12:27:58.110357+0000","last_fullsized":"2023-11-08T12:27:58.110357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.573865+0000","last_change":"2023-11-08T12:27:58.147598+0000","last_active":"2023-11-08T12:27:58.573865+0000","last_peered":"2023-11-08T12:27:58.573865+0000","last_clean":"2023-11-08T12:27:58.573865+0000","last_became_active":"2023-11-08T12:27:58.142637+0000","last_became_peered":"2023-11-08T12:27:58.142637+0000","last_unstale":"2023-11-08T12:27:58.573865+0000","last_undegraded":"2023-11-08T12:27:58.573865+0000","last_fullsized":"2023-11-08T12:27:58.573865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:15.627959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121493+0000","last_change":"2023-11-08T12:27:53.629943+0000","last_active":"2023-11-08T12:27:58.121493+0000","last_peered":"2023-11-08T12:27:58.121493+0000","last_clean":"2023-11-08T12:27:58.121493+0000","last_became_active":"2023-11-08T12:27:53.629644+0000","last_became_peered":"2023-11-08T12:27:53.629644+0000","last_unstale":"2023-11-08T12:27:58.121493+0000","last_undegraded":"2023-11-08T12:27:58.121493+0000","last_fullsized":"2023-11-08T12:27:58.121493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.958287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112153+0000","last_change":"2023-11-08T12:27:54.087612+0000","last_active":"2023-11-08T12:27:58.112153+0000","last_peered":"2023-11-08T12:27:58.112153+0000","last_clean":"2023-11-08T12:27:58.112153+0000","last_became_active":"2023-11-08T12:27:54.087329+0000","last_became_peered":"2023-11-08T12:27:54.087329+0000","last_unstale":"2023-11-08T12:27:58.112153+0000","last_undegraded":"2023-11-08T12:27:58.112153+0000","last_fullsized":"2023-11-08T12:27:58.112153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574522+0000","last_change":"2023-11-08T12:27:58.143756+0000","last_active":"2023-11-08T12:27:58.574522+0000","last_peered":"2023-11-08T12:27:58.574522+0000","last_clean":"2023-11-08T12:27:58.574522+0000","last_became_active":"2023-11-08T12:27:58.142849+0000","last_became_peered":"2023-11-08T12:27:58.142849+0000","last_unstale":"2023-11-08T12:27:58.574522+0000","last_undegraded":"2023-11-08T12:27:58.574522+0000","last_fullsized":"2023-11-08T12:27:58.574522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130357+0000","last_change":"2023-11-08T12:27:54.090219+0000","last_active":"2023-11-08T12:27:58.130357+0000","last_peered":"2023-11-08T12:27:58.130357+0000","last_clean":"2023-11-08T12:27:58.130357+0000","last_became_active":"2023-11-08T12:27:54.089953+0000","last_became_peered":"2023-11-08T12:27:54.089953+0000","last_unstale":"2023-11-08T12:27:58.130357+0000","last_undegraded":"2023-11-08T12:27:58.130357+0000","last_fullsized":"2023-11-08T12:27:58.130357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:59.015726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110954+0000","last_change":"2023-11-08T12:27:54.089673+0000","last_active":"2023-11-08T12:27:58.110954+0000","last_peered":"2023-11-08T12:27:58.110954+0000","last_clean":"2023-11-08T12:27:58.110954+0000","last_became_active":"2023-11-08T12:27:54.088838+0000","last_became_peered":"2023-11-08T12:27:54.088838+0000","last_unstale":"2023-11-08T12:27:58.110954+0000","last_undegraded":"2023-11-08T12:27:58.110954+0000","last_fullsized":"2023-11-08T12:27:58.110954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127306+0000","last_change":"2023-11-08T12:27:54.101563+0000","last_active":"2023-11-08T12:27:58.127306+0000","last_peered":"2023-11-08T12:27:58.127306+0000","last_clean":"2023-11-08T12:27:58.127306+0000","last_became_active":"2023-11-08T12:27:54.101287+0000","last_became_peered":"2023-11-08T12:27:54.101287+0000","last_unstale":"2023-11-08T12:27:58.127306+0000","last_undegraded":"2023-11-08T12:27:58.127306+0000","last_fullsized":"2023-11-08T12:27:58.127306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112764+0000","last_change":"2023-11-08T12:27:54.112891+0000","last_active":"2023-11-08T12:27:58.112764+0000","last_peered":"2023-11-08T12:27:58.112764+0000","last_clean":"2023-11-08T12:27:58.112764+0000","last_became_active":"2023-11-08T12:27:54.112236+0000","last_became_peered":"2023-11-08T12:27:54.112236+0000","last_unstale":"2023-11-08T12:27:58.112764+0000","last_undegraded":"2023-11-08T12:27:58.112764+0000","last_fullsized":"2023-11-08T12:27:58.112764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127544+0000","last_change":"2023-11-08T12:27:54.112391+0000","last_active":"2023-11-08T12:27:58.127544+0000","last_peered":"2023-11-08T12:27:58.127544+0000","last_clean":"2023-11-08T12:27:58.127544+0000","last_became_active":"2023-11-08T12:27:54.112033+0000","last_became_peered":"2023-11-08T12:27:54.112033+0000","last_unstale":"2023-11-08T12:27:58.127544+0000","last_undegraded":"2023-11-08T12:27:58.127544+0000","last_fullsized":"2023-11-08T12:27:58.127544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110253+0000","last_change":"2023-11-08T12:27:54.111812+0000","last_active":"2023-11-08T12:27:58.110253+0000","last_peered":"2023-11-08T12:27:58.110253+0000","last_clean":"2023-11-08T12:27:58.110253+0000","last_became_active":"2023-11-08T12:27:54.111143+0000","last_became_peered":"2023-11-08T12:27:54.111143+0000","last_unstale":"2023-11-08T12:27:58.110253+0000","last_undegraded":"2023-11-08T12:27:58.110253+0000","last_fullsized":"2023-11-08T12:27:58.110253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126839+0000","last_change":"2023-11-08T12:27:54.098992+0000","last_active":"2023-11-08T12:27:58.126839+0000","last_peered":"2023-11-08T12:27:58.126839+0000","last_clean":"2023-11-08T12:27:58.126839+0000","last_became_active":"2023-11-08T12:27:54.096650+0000","last_became_peered":"2023-11-08T12:27:54.096650+0000","last_unstale":"2023-11-08T12:27:58.126839+0000","last_undegraded":"2023-11-08T12:27:58.126839+0000","last_fullsized":"2023-11-08T12:27:58.126839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:18.972524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126259+0000","last_change":"2023-11-08T12:27:54.102716+0000","last_active":"2023-11-08T12:27:58.126259+0000","last_peered":"2023-11-08T12:27:58.126259+0000","last_clean":"2023-11-08T12:27:58.126259+0000","last_became_active":"2023-11-08T12:27:54.102078+0000","last_became_peered":"2023-11-08T12:27:54.102078+0000","last_unstale":"2023-11-08T12:27:58.126259+0000","last_undegraded":"2023-11-08T12:27:58.126259+0000","last_fullsized":"2023-11-08T12:27:58.126259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124250+0000","last_change":"2023-11-08T12:27:54.114137+0000","last_active":"2023-11-08T12:27:58.124250+0000","last_peered":"2023-11-08T12:27:58.124250+0000","last_clean":"2023-11-08T12:27:58.124250+0000","last_became_active":"2023-11-08T12:27:54.111468+0000","last_became_peered":"2023-11-08T12:27:54.111468+0000","last_unstale":"2023-11-08T12:27:58.124250+0000","last_undegraded":"2023-11-08T12:27:58.124250+0000","last_fullsized":"2023-11-08T12:27:58.124250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110810+0000","last_change":"2023-11-08T12:27:54.111270+0000","last_active":"2023-11-08T12:27:58.110810+0000","last_peered":"2023-11-08T12:27:58.110810+0000","last_clean":"2023-11-08T12:27:58.110810+0000","last_became_active":"2023-11-08T12:27:54.110978+0000","last_became_peered":"2023-11-08T12:27:54.110978+0000","last_unstale":"2023-11-08T12:27:58.110810+0000","last_undegraded":"2023-11-08T12:27:58.110810+0000","last_fullsized":"2023-11-08T12:27:58.110810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121952+0000","last_change":"2023-11-08T12:27:54.110870+0000","last_active":"2023-11-08T12:27:58.121952+0000","last_peered":"2023-11-08T12:27:58.121952+0000","last_clean":"2023-11-08T12:27:58.121952+0000","last_became_active":"2023-11-08T12:27:54.110578+0000","last_became_peered":"2023-11-08T12:27:54.110578+0000","last_unstale":"2023-11-08T12:27:58.121952+0000","last_undegraded":"2023-11-08T12:27:58.121952+0000","last_fullsized":"2023-11-08T12:27:58.121952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121410+0000","last_change":"2023-11-08T12:27:54.110928+0000","last_active":"2023-11-08T12:27:58.121410+0000","last_peered":"2023-11-08T12:27:58.121410+0000","last_clean":"2023-11-08T12:27:58.121410+0000","last_became_active":"2023-11-08T12:27:54.110627+0000","last_became_peered":"2023-11-08T12:27:54.110627+0000","last_unstale":"2023-11-08T12:27:58.121410+0000","last_undegraded":"2023-11-08T12:27:58.121410+0000","last_fullsized":"2023-11-08T12:27:58.121410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127487+0000","last_change":"2023-11-08T12:27:54.099305+0000","last_active":"2023-11-08T12:27:58.127487+0000","last_peered":"2023-11-08T12:27:58.127487+0000","last_clean":"2023-11-08T12:27:58.127487+0000","last_became_active":"2023-11-08T12:27:54.096530+0000","last_became_peered":"2023-11-08T12:27:54.096530+0000","last_unstale":"2023-11-08T12:27:58.127487+0000","last_undegraded":"2023-11-08T12:27:58.127487+0000","last_fullsized":"2023-11-08T12:27:58.127487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:03:24.809478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112660+0000","last_change":"2023-11-08T12:27:54.091908+0000","last_active":"2023-11-08T12:27:58.112660+0000","last_peered":"2023-11-08T12:27:58.112660+0000","last_clean":"2023-11-08T12:27:58.112660+0000","last_became_active":"2023-11-08T12:27:54.091565+0000","last_became_peered":"2023-11-08T12:27:54.091565+0000","last_unstale":"2023-11-08T12:27:58.112660+0000","last_undegraded":"2023-11-08T12:27:58.112660+0000","last_fullsized":"2023-11-08T12:27:58.112660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:48.409713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127626+0000","last_change":"2023-11-08T12:27:54.102006+0000","last_active":"2023-11-08T12:27:58.127626+0000","last_peered":"2023-11-08T12:27:58.127626+0000","last_clean":"2023-11-08T12:27:58.127626+0000","last_became_active":"2023-11-08T12:27:54.101747+0000","last_became_peered":"2023-11-08T12:27:54.101747+0000","last_unstale":"2023-11-08T12:27:58.127626+0000","last_undegraded":"2023-11-08T12:27:58.127626+0000","last_fullsized":"2023-11-08T12:27:58.127626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130643+0000","last_change":"2023-11-08T12:27:54.107313+0000","last_active":"2023-11-08T12:27:58.130643+0000","last_peered":"2023-11-08T12:27:58.130643+0000","last_clean":"2023-11-08T12:27:58.130643+0000","last_became_active":"2023-11-08T12:27:54.106868+0000","last_became_peered":"2023-11-08T12:27:54.106868+0000","last_unstale":"2023-11-08T12:27:58.130643+0000","last_undegraded":"2023-11-08T12:27:58.130643+0000","last_fullsized":"2023-11-08T12:27:58.130643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126067+0000","last_change":"2023-11-08T12:27:54.104910+0000","last_active":"2023-11-08T12:27:58.126067+0000","last_peered":"2023-11-08T12:27:58.126067+0000","last_clean":"2023-11-08T12:27:58.126067+0000","last_became_active":"2023-11-08T12:27:54.104571+0000","last_became_peered":"2023-11-08T12:27:54.104571+0000","last_unstale":"2023-11-08T12:27:58.126067+0000","last_undegraded":"2023-11-08T12:27:58.126067+0000","last_fullsized":"2023-11-08T12:27:58.126067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127618+0000","last_change":"2023-11-08T12:27:54.117605+0000","last_active":"2023-11-08T12:27:58.127618+0000","last_peered":"2023-11-08T12:27:58.127618+0000","last_clean":"2023-11-08T12:27:58.127618+0000","last_became_active":"2023-11-08T12:27:54.115128+0000","last_became_peered":"2023-11-08T12:27:54.115128+0000","last_unstale":"2023-11-08T12:27:58.127618+0000","last_undegraded":"2023-11-08T12:27:58.127618+0000","last_fullsized":"2023-11-08T12:27:58.127618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109727+0000","last_change":"2023-11-08T12:27:54.078100+0000","last_active":"2023-11-08T12:27:58.109727+0000","last_peered":"2023-11-08T12:27:58.109727+0000","last_clean":"2023-11-08T12:27:58.109727+0000","last_became_active":"2023-11-08T12:27:54.077806+0000","last_became_peered":"2023-11-08T12:27:54.077806+0000","last_unstale":"2023-11-08T12:27:58.109727+0000","last_undegraded":"2023-11-08T12:27:58.109727+0000","last_fullsized":"2023-11-08T12:27:58.109727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.115584+0000","last_change":"2023-11-08T12:27:54.079682+0000","last_active":"2023-11-08T12:27:58.115584+0000","last_peered":"2023-11-08T12:27:58.115584+0000","last_clean":"2023-11-08T12:27:58.115584+0000","last_became_active":"2023-11-08T12:27:54.079412+0000","last_became_peered":"2023-11-08T12:27:54.079412+0000","last_unstale":"2023-11-08T12:27:58.115584+0000","last_undegraded":"2023-11-08T12:27:58.115584+0000","last_fullsized":"2023-11-08T12:27:58.115584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:03:48.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112090+0000","last_change":"2023-11-08T12:27:54.094245+0000","last_active":"2023-11-08T12:27:58.112090+0000","last_peered":"2023-11-08T12:27:58.112090+0000","last_clean":"2023-11-08T12:27:58.112090+0000","last_became_active":"2023-11-08T12:27:54.093989+0000","last_became_peered":"2023-11-08T12:27:54.093989+0000","last_unstale":"2023-11-08T12:27:58.112090+0000","last_undegraded":"2023-11-08T12:27:58.112090+0000","last_fullsized":"2023-11-08T12:27:58.112090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:45.542969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126703+0000","last_change":"2023-11-08T12:27:54.093474+0000","last_active":"2023-11-08T12:27:58.126703+0000","last_peered":"2023-11-08T12:27:58.126703+0000","last_clean":"2023-11-08T12:27:58.126703+0000","last_became_active":"2023-11-08T12:27:54.093141+0000","last_became_peered":"2023-11-08T12:27:54.093141+0000","last_unstale":"2023-11-08T12:27:58.126703+0000","last_undegraded":"2023-11-08T12:27:58.126703+0000","last_fullsized":"2023-11-08T12:27:58.126703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.174800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110510+0000","last_change":"2023-11-08T12:27:54.109186+0000","last_active":"2023-11-08T12:27:58.110510+0000","last_peered":"2023-11-08T12:27:58.110510+0000","last_clean":"2023-11-08T12:27:58.110510+0000","last_became_active":"2023-11-08T12:27:54.108861+0000","last_became_peered":"2023-11-08T12:27:54.108861+0000","last_unstale":"2023-11-08T12:27:58.110510+0000","last_undegraded":"2023-11-08T12:27:58.110510+0000","last_fullsized":"2023-11-08T12:27:58.110510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130596+0000","last_change":"2023-11-08T12:27:54.107459+0000","last_active":"2023-11-08T12:27:58.130596+0000","last_peered":"2023-11-08T12:27:58.130596+0000","last_clean":"2023-11-08T12:27:58.130596+0000","last_became_active":"2023-11-08T12:27:54.107098+0000","last_became_peered":"2023-11-08T12:27:54.107098+0000","last_unstale":"2023-11-08T12:27:58.130596+0000","last_undegraded":"2023-11-08T12:27:58.130596+0000","last_fullsized":"2023-11-08T12:27:58.130596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109785+0000","last_change":"2023-11-08T12:27:54.094309+0000","last_active":"2023-11-08T12:27:58.109785+0000","last_peered":"2023-11-08T12:27:58.109785+0000","last_clean":"2023-11-08T12:27:58.109785+0000","last_became_active":"2023-11-08T12:27:54.094019+0000","last_became_peered":"2023-11-08T12:27:54.094019+0000","last_unstale":"2023-11-08T12:27:58.109785+0000","last_undegraded":"2023-11-08T12:27:58.109785+0000","last_fullsized":"2023-11-08T12:27:58.109785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127510+0000","last_change":"2023-11-08T12:27:54.115331+0000","last_active":"2023-11-08T12:27:58.127510+0000","last_peered":"2023-11-08T12:27:58.127510+0000","last_clean":"2023-11-08T12:27:58.127510+0000","last_became_active":"2023-11-08T12:27:54.114822+0000","last_became_peered":"2023-11-08T12:27:54.114822+0000","last_unstale":"2023-11-08T12:27:58.127510+0000","last_undegraded":"2023-11-08T12:27:58.127510+0000","last_fullsized":"2023-11-08T12:27:58.127510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127152+0000","last_change":"2023-11-08T12:27:54.110256+0000","last_active":"2023-11-08T12:27:58.127152+0000","last_peered":"2023-11-08T12:27:58.127152+0000","last_clean":"2023-11-08T12:27:58.127152+0000","last_became_active":"2023-11-08T12:27:54.109960+0000","last_became_peered":"2023-11-08T12:27:54.109960+0000","last_unstale":"2023-11-08T12:27:58.127152+0000","last_undegraded":"2023-11-08T12:27:58.127152+0000","last_fullsized":"2023-11-08T12:27:58.127152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:50.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129321+0000","last_change":"2023-11-08T12:27:54.113205+0000","last_active":"2023-11-08T12:27:58.129321+0000","last_peered":"2023-11-08T12:27:58.129321+0000","last_clean":"2023-11-08T12:27:58.129321+0000","last_became_active":"2023-11-08T12:27:54.100836+0000","last_became_peered":"2023-11-08T12:27:54.100836+0000","last_unstale":"2023-11-08T12:27:58.129321+0000","last_undegraded":"2023-11-08T12:27:58.129321+0000","last_fullsized":"2023-11-08T12:27:58.129321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134239+0000","last_change":"2023-11-08T12:27:54.113012+0000","last_active":"2023-11-08T12:27:58.134239+0000","last_peered":"2023-11-08T12:27:58.134239+0000","last_clean":"2023-11-08T12:27:58.134239+0000","last_became_active":"2023-11-08T12:27:54.112671+0000","last_became_peered":"2023-11-08T12:27:54.112671+0000","last_unstale":"2023-11-08T12:27:58.134239+0000","last_undegraded":"2023-11-08T12:27:58.134239+0000","last_fullsized":"2023-11-08T12:27:58.134239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:36.178901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126621+0000","last_change":"2023-11-08T12:27:54.106855+0000","last_active":"2023-11-08T12:27:58.126621+0000","last_peered":"2023-11-08T12:27:58.126621+0000","last_clean":"2023-11-08T12:27:58.126621+0000","last_became_active":"2023-11-08T12:27:54.106572+0000","last_became_peered":"2023-11-08T12:27:54.106572+0000","last_unstale":"2023-11-08T12:27:58.126621+0000","last_undegraded":"2023-11-08T12:27:58.126621+0000","last_fullsized":"2023-11-08T12:27:58.126621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:20.409594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110499+0000","last_change":"2023-11-08T12:27:54.088006+0000","last_active":"2023-11-08T12:27:58.110499+0000","last_peered":"2023-11-08T12:27:58.110499+0000","last_clean":"2023-11-08T12:27:58.110499+0000","last_became_active":"2023-11-08T12:27:54.087733+0000","last_became_peered":"2023-11-08T12:27:54.087733+0000","last_unstale":"2023-11-08T12:27:58.110499+0000","last_undegraded":"2023-11-08T12:27:58.110499+0000","last_fullsized":"2023-11-08T12:27:58.110499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110178+0000","last_change":"2023-11-08T12:27:54.088141+0000","last_active":"2023-11-08T12:27:58.110178+0000","last_peered":"2023-11-08T12:27:58.110178+0000","last_clean":"2023-11-08T12:27:58.110178+0000","last_became_active":"2023-11-08T12:27:54.087785+0000","last_became_peered":"2023-11-08T12:27:54.087785+0000","last_unstale":"2023-11-08T12:27:58.110178+0000","last_undegraded":"2023-11-08T12:27:58.110178+0000","last_fullsized":"2023-11-08T12:27:58.110178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:16:17.839606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476746,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]},{"osd":4,"up_from":16,"seq":68719476746,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9296,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362544,"statfs":{"total":96636764160,"available":96627245056,"internally_reserved":0,"allocated":925696,"data_stored":719012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:28:21.580 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T12:28:21.581 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-08T12:28:21.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-08T12:28:21.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-08T12:28:21.582 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-08T12:28:21.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.789+0000 7ff29d90d700 1 Processor -- start 2023-11-08T12:28:21.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.789+0000 7ff29d90d700 1 -- start start 2023-11-08T12:28:21.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff29d90d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2980cba00 0x7ff29815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff29d90d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29815d790 con 0x7ff2980b2240 2023-11-08T12:28:21.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff29d90d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29815d1d0 con 0x7ff29815c750 2023-11-08T12:28:21.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff29d90d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29815d4b0 con 0x7ff2980cba00 2023-11-08T12:28:21.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff297fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff2980b2240 0x7ff2980cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35982/0 (socket says 172.21.15.112:35982) 2023-11-08T12:28:21.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff297fff700 1 -- 172.21.15.112:0/2712922998 learned_addr learned my addr 172.21.15.112:0/2712922998 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:21.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff296ffd700 1 --2- 172.21.15.112:0/2712922998 >> v2:172.21.15.112:3300/0 conn(0x7ff2980cba00 0x7ff29815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff295ffb700 1 -- 172.21.15.112:0/2712922998 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490568438 0 0) 0x7ff29815d790 con 0x7ff2980b2240 2023-11-08T12:28:21.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff295ffb700 1 -- 172.21.15.112:0/2712922998 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2800035d0 con 0x7ff2980b2240 2023-11-08T12:28:21.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff296ffd700 1 -- 172.21.15.112:0/2712922998 >> v1:172.21.15.133:6789/0 conn(0x7ff29815c750 legacy=0x7ff2980b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff296ffd700 1 -- 172.21.15.112:0/2712922998 >> v1:172.21.15.112:6789/0 conn(0x7ff2980b2240 legacy=0x7ff2980cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff296ffd700 1 -- 172.21.15.112:0/2712922998 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980cebc0 con 0x7ff2980cba00 2023-11-08T12:28:21.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff296ffd700 1 --2- 172.21.15.112:0/2712922998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2980cba00 0x7ff29815d960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff288009850 tx=0x7ff288009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c046ce6dd2ead0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:21.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff295ffb700 1 -- 172.21.15.112:0/2712922998 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288011830 con 0x7ff2980cba00 2023-11-08T12:28:21.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff295ffb700 1 -- 172.21.15.112:0/2712922998 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288011990 con 0x7ff2980cba00 2023-11-08T12:28:21.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.793+0000 7ff295ffb700 1 -- 172.21.15.112:0/2712922998 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288011d00 con 0x7ff2980cba00 2023-11-08T12:28:21.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 -- 172.21.15.112:0/2712922998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2980cba00 msgr2=0x7ff29815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2712922998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2980cba00 0x7ff29815d960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff288009850 tx=0x7ff288009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:21.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 -- 172.21.15.112:0/2712922998 shutdown_connections 2023-11-08T12:28:21.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2712922998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2980cba00 0x7ff29815d960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 -- 172.21.15.112:0/2712922998 >> 172.21.15.112:0/2712922998 conn(0x7ff2980ccb30 msgr2=0x7ff2980ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:21.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 -- 172.21.15.112:0/2712922998 shutdown_connections 2023-11-08T12:28:21.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 -- 172.21.15.112:0/2712922998 wait complete. 2023-11-08T12:28:21.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.797+0000 7ff29d90d700 1 Processor -- start 2023-11-08T12:28:21.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 -- start start 2023-11-08T12:28:21.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980b2240 0x7ff298154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2980cba00 0x7ff2980c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff29815c750 0x7ff2981f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c4c60 con 0x7ff29815c750 2023-11-08T12:28:21.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c4050 con 0x7ff2980b2240 2023-11-08T12:28:21.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c4330 con 0x7ff2980cba00 2023-11-08T12:28:21.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff29815c750 0x7ff2981f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff29815c750 0x7ff2981f1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34844/0 (socket says 172.21.15.112:34844) 2023-11-08T12:28:21.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 -- 172.21.15.112:0/2916493620 learned_addr learned my addr 172.21.15.112:0/2916493620 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:21.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff296ffd700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980b2240 0x7ff298154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff2967fc700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2980cba00 0x7ff2980c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 -- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2980cba00 msgr2=0x7ff2980c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2980cba00 0x7ff2980c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 -- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980b2240 msgr2=0x7ff298154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:21.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980b2240 0x7ff298154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:21.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 -- 172.21.15.112:0/2916493620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880094b0 con 0x7ff29815c750 2023-11-08T12:28:21.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff296ffd700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980b2240 0x7ff298154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:21.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff2967fc700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2980cba00 0x7ff2980c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:21.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff297fff700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff29815c750 0x7ff2981f1600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff29000cae0 tx=0x7ff29000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:21.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff27ffff700 1 -- 172.21.15.112:0/2916493620 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000a820 con 0x7ff29815c750 2023-11-08T12:28:21.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff27ffff700 1 -- 172.21.15.112:0/2916493620 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000a980 con 0x7ff29815c750 2023-11-08T12:28:21.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2980caa60 con 0x7ff29815c750 2023-11-08T12:28:21.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff27ffff700 1 -- 172.21.15.112:0/2916493620 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000ad30 con 0x7ff29815c750 2023-11-08T12:28:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.801+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2980ceea0 con 0x7ff29815c750 2023-11-08T12:28:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.805+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2980cabf0 con 0x7ff29815c750 2023-11-08T12:28:21.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.805+0000 7ff27ffff700 1 -- 172.21.15.112:0/2916493620 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff290019030 con 0x7ff29815c750 2023-11-08T12:28:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.805+0000 7ff27ffff700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff284064ee0 0x7ff284067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.805+0000 7ff27ffff700 1 -- 172.21.15.112:0/2916493620 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff290081bf0 con 0x7ff29815c750 2023-11-08T12:28:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.805+0000 7ff296ffd700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff284064ee0 0x7ff284067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:21.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.809+0000 7ff296ffd700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff284064ee0 0x7ff284067390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff288000c00 tx=0x7ff288008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:21.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:21.813+0000 7ff27ffff700 1 -- 172.21.15.112:0/2916493620 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff29004f950 con 0x7ff29815c750 2023-11-08T12:28:22.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.021+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff2980726c0 con 0x7ff29815c750 2023-11-08T12:28:22.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.029+0000 7ff27ffff700 1 -- 172.21.15.112:0/2916493620 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161637 (secure 0 0 0) 0x7ff290052f70 con 0x7ff29815c750 2023-11-08T12:28:22.033 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff284064ee0 msgr2=0x7ff284067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff284064ee0 0x7ff284067390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff288000c00 tx=0x7ff288008030 comp rx=0 tx=0).stop 2023-11-08T12:28:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff29815c750 msgr2=0x7ff2981f1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff29815c750 0x7ff2981f1600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff29000cae0 tx=0x7ff29000cbc0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 shutdown_connections 2023-11-08T12:28:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff284064ee0 0x7ff284067390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff29815c750 0x7ff2981f1600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2980cba00 0x7ff2980c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 --2- 172.21.15.112:0/2916493620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980b2240 0x7ff298154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.033+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 >> 172.21.15.112:0/2916493620 conn(0x7ff2980ccb30 msgr2=0x7ff29815eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.037+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 shutdown_connections 2023-11-08T12:28:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.037+0000 7ff29d90d700 1 -- 172.21.15.112:0/2916493620 wait complete. 2023-11-08T12:28:22.060 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":35428},{"type":"v1","addr":"172.21.15.112:6833","nonce":35428}]},"active_addr":"172.21.15.112:6833/35428","active_change":"2023-11-08T12:27:34.686720+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3444018274}]},{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1335909098}]},{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3849617833}]},{"addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":4250375547}]}]} 2023-11-08T12:28:22.064 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-08T12:28:22.064 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-08T12:28:22.065 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:22.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.241+0000 7f445506f700 1 Processor -- start 2023-11-08T12:28:22.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.241+0000 7f445506f700 1 -- start start 2023-11-08T12:28:22.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445506f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f445015c1a0 0x7f445006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445506f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4450070790 0x7f445006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445506f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44500adf90 con 0x7f44500cdeb0 2023-11-08T12:28:22.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445506f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4450069bf0 con 0x7f445015c1a0 2023-11-08T12:28:22.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445506f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44500ce370 con 0x7f4450070790 2023-11-08T12:28:22.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f44477fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f44500cdeb0 0x7f4450070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35984/0 (socket says 172.21.15.112:35984) 2023-11-08T12:28:22.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f44477fe700 1 -- 172.21.15.112:0/1353308564 learned_addr learned my addr 172.21.15.112:0/1353308564 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:22.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445486e700 1 --2- 172.21.15.112:0/1353308564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4450070790 0x7f445006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f444ffff700 1 --2- 172.21.15.112:0/1353308564 >> v2:172.21.15.133:3300/0 conn(0x7f445015c1a0 0x7f445006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445486e700 1 -- 172.21.15.112:0/1353308564 >> v2:172.21.15.133:3300/0 conn(0x7f445015c1a0 msgr2=0x7f445006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:22.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445486e700 1 --2- 172.21.15.112:0/1353308564 >> v2:172.21.15.133:3300/0 conn(0x7f445015c1a0 0x7f445006c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f444f7fe700 1 -- 172.21.15.112:0/1353308564 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825121772 0 0) 0x7f44500adf90 con 0x7f44500cdeb0 2023-11-08T12:28:22.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445486e700 1 -- 172.21.15.112:0/1353308564 >> v1:172.21.15.112:6789/0 conn(0x7f44500cdeb0 legacy=0x7f4450070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445486e700 1 -- 172.21.15.112:0/1353308564 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500cc4a0 con 0x7f4450070790 2023-11-08T12:28:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f445486e700 1 --2- 172.21.15.112:0/1353308564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4450070790 0x7f445006a010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4448009850 tx=0x7f4448009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73b390df550bfe08 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f444f7fe700 1 -- 172.21.15.112:0/1353308564 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448011830 con 0x7f4450070790 2023-11-08T12:28:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f444f7fe700 1 -- 172.21.15.112:0/1353308564 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4448011990 con 0x7f4450070790 2023-11-08T12:28:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.245+0000 7f444f7fe700 1 -- 172.21.15.112:0/1353308564 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448011d40 con 0x7f4450070790 2023-11-08T12:28:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 -- 172.21.15.112:0/1353308564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4450070790 msgr2=0x7f445006a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 --2- 172.21.15.112:0/1353308564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4450070790 0x7f445006a010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4448009850 tx=0x7f4448009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 -- 172.21.15.112:0/1353308564 shutdown_connections 2023-11-08T12:28:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 --2- 172.21.15.112:0/1353308564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4450070790 0x7f445006a010 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 --2- 172.21.15.112:0/1353308564 >> v2:172.21.15.133:3300/0 conn(0x7f445015c1a0 0x7f445006c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 -- 172.21.15.112:0/1353308564 >> 172.21.15.112:0/1353308564 conn(0x7f44500b0f80 msgr2=0x7f44500ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:22.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 -- 172.21.15.112:0/1353308564 shutdown_connections 2023-11-08T12:28:22.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 -- 172.21.15.112:0/1353308564 wait complete. 2023-11-08T12:28:22.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 Processor -- start 2023-11-08T12:28:22.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.249+0000 7f445506f700 1 -- start start 2023-11-08T12:28:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445506f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4450070790 0x7f445015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445506f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44500cdeb0 0x7f4450152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445506f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f445015c1a0 0x7f445015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445506f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445015b900 con 0x7f445015c1a0 2023-11-08T12:28:22.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445506f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445015f290 con 0x7f4450070790 2023-11-08T12:28:22.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445506f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445015f570 con 0x7f44500cdeb0 2023-11-08T12:28:22.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f445015c1a0 0x7f445015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f444ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4450070790 0x7f445015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f445015c1a0 0x7f445015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34848/0 (socket says 172.21.15.112:34848) 2023-11-08T12:28:22.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 -- 172.21.15.112:0/518145919 learned_addr learned my addr 172.21.15.112:0/518145919 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:22.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f44477fe700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44500cdeb0 0x7f4450152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 -- 172.21.15.112:0/518145919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44500cdeb0 msgr2=0x7f4450152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44500cdeb0 0x7f4450152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 -- 172.21.15.112:0/518145919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4450070790 msgr2=0x7f445015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4450070790 0x7f445015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 -- 172.21.15.112:0/518145919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44480094b0 con 0x7f445015c1a0 2023-11-08T12:28:22.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445486e700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f445015c1a0 0x7f445015cb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f44480090b0 tx=0x7f4448004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:22.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f444d7fa700 1 -- 172.21.15.112:0/518145919 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444801a990 con 0x7f445015c1a0 2023-11-08T12:28:22.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f444d7fa700 1 -- 172.21.15.112:0/518145919 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444801f070 con 0x7f445015c1a0 2023-11-08T12:28:22.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445006cdf0 con 0x7f445015c1a0 2023-11-08T12:28:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.253+0000 7f444d7fa700 1 -- 172.21.15.112:0/518145919 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444801ad30 con 0x7f445015c1a0 2023-11-08T12:28:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.257+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44500cc780 con 0x7f445015c1a0 2023-11-08T12:28:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.257+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445015c570 con 0x7f445015c1a0 2023-11-08T12:28:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.257+0000 7f444d7fa700 1 -- 172.21.15.112:0/518145919 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f444800f050 con 0x7f445015c1a0 2023-11-08T12:28:22.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.261+0000 7f444d7fa700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4430064ee0 0x7f4430067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.261+0000 7f444d7fa700 1 -- 172.21.15.112:0/518145919 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44480831c0 con 0x7f445015c1a0 2023-11-08T12:28:22.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.261+0000 7f444ffff700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4430064ee0 0x7f4430067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.261+0000 7f444ffff700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4430064ee0 0x7f4430067390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4440011340 tx=0x7f444000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:22.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.265+0000 7f444d7fa700 1 -- 172.21.15.112:0/518145919 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4448051070 con 0x7f445015c1a0 2023-11-08T12:28:22.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.437+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44500abaa0 con 0x7f445015c1a0 2023-11-08T12:28:22.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.441+0000 7f444d7fa700 1 -- 172.21.15.112:0/518145919 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7f44500abaa0 con 0x7f445015c1a0 2023-11-08T12:28:22.445 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:22.445 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:22.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4430064ee0 msgr2=0x7f4430067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4430064ee0 0x7f4430067390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4440011340 tx=0x7f444000b040 comp rx=0 tx=0).stop 2023-11-08T12:28:22.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f445015c1a0 msgr2=0x7f445015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f445015c1a0 0x7f445015cb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f44480090b0 tx=0x7f4448004770 comp rx=0 tx=0).stop 2023-11-08T12:28:22.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 shutdown_connections 2023-11-08T12:28:22.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4430064ee0 0x7f4430067390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f445015c1a0 0x7f445015cb80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44500cdeb0 0x7f4450152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 --2- 172.21.15.112:0/518145919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4450070790 0x7f445015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 >> 172.21.15.112:0/518145919 conn(0x7f44500b0f80 msgr2=0x7f4450069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:22.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 shutdown_connections 2023-11-08T12:28:22.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.445+0000 7f445506f700 1 -- 172.21.15.112:0/518145919 wait complete. 2023-11-08T12:28:22.469 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-08T12:28:22.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:22.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.641+0000 7f57a5570700 1 Processor -- start 2023-11-08T12:28:22.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.641+0000 7f57a5570700 1 -- start start 2023-11-08T12:28:22.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f57a5570700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57a00cdfb0 0x7f57a006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f57a5570700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 0x7f57a006a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f57a5570700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a0164080 con 0x7f57a0163cb0 2023-11-08T12:28:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f57a5570700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a00cc290 con 0x7f57a00cdfb0 2023-11-08T12:28:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f57a5570700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a006d770 con 0x7f57a006d2f0 2023-11-08T12:28:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579effd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f57a0163cb0 0x7f57a0164cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35990/0 (socket says 172.21.15.112:35990) 2023-11-08T12:28:22.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579effd700 1 -- 172.21.15.112:0/4102269740 learned_addr learned my addr 172.21.15.112:0/4102269740 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:22.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f5797fff700 1 --2- 172.21.15.112:0/4102269740 >> v2:172.21.15.133:3300/0 conn(0x7f57a00cdfb0 0x7f57a006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579f7fe700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 0x7f57a006a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149246098 0 0) 0x7f57a0164080 con 0x7f57a0163cb0 2023-11-08T12:28:22.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f578c0035d0 con 0x7f57a0163cb0 2023-11-08T12:28:22.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2665457402 0 0) 0x7f578c0035d0 con 0x7f57a0163cb0 2023-11-08T12:28:22.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 msgr2=0x7f57a006a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:22.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579e7fc700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 0x7f57a006a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.645+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 >> v2:172.21.15.133:3300/0 conn(0x7f57a00cdfb0 msgr2=0x7f57a006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:22.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 --2- 172.21.15.112:0/4102269740 >> v2:172.21.15.133:3300/0 conn(0x7f57a00cdfb0 0x7f57a006cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0069bf0 con 0x7f57a0163cb0 2023-11-08T12:28:22.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f5790001670 con 0x7f57a0163cb0 2023-11-08T12:28:22.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 >> v1:172.21.15.112:6789/0 conn(0x7f57a0163cb0 legacy=0x7f57a0164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f578c003a20 0x7f578c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 0x7f578c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578c004db0 0x7f578c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00cc290 con 0x7f578c003a20 2023-11-08T12:28:22.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a006d770 con 0x7f578c004db0 2023-11-08T12:28:22.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c00ba30 con 0x7f57a006d2f0 2023-11-08T12:28:22.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579effd700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f578c003a20 0x7f578c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f5797fff700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 0x7f578c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579f7fe700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578c004db0 0x7f578c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579effd700 1 -- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 msgr2=0x7f578c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:22.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579effd700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a006d2f0 0x7f578c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579effd700 1 -- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578c004db0 msgr2=0x7f578c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:22.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579effd700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578c004db0 0x7f578c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579effd700 1 -- 172.21.15.112:0/4102269740 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0035d0 con 0x7f578c003a20 2023-11-08T12:28:22.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579effd700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f578c003a20 0x7f578c003e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f579000c320 tx=0x7f578c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0f24dc303f46ca server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:22.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579000ce60 con 0x7f578c003a20 2023-11-08T12:28:22.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5790005980 con 0x7f578c003a20 2023-11-08T12:28:22.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579e7fc700 1 -- 172.21.15.112:0/4102269740 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790005d10 con 0x7f578c003a20 2023-11-08T12:28:22.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f57a5570700 1 -- 172.21.15.112:0/4102269740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f578c003a20 msgr2=0x7f578c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f57a5570700 1 --2- 172.21.15.112:0/4102269740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f578c003a20 0x7f578c003e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f579000c320 tx=0x7f578c0058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f579f7fe700 1 -- 172.21.15.112:0/4102269740 reap_dead start 2023-11-08T12:28:22.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f57a5570700 1 -- 172.21.15.112:0/4102269740 shutdown_connections 2023-11-08T12:28:22.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f57a5570700 1 -- 172.21.15.112:0/4102269740 >> 172.21.15.112:0/4102269740 conn(0x7f57a00cf350 msgr2=0x7f57a00b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:22.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f57a5570700 1 -- 172.21.15.112:0/4102269740 shutdown_connections 2023-11-08T12:28:22.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.649+0000 7f57a5570700 1 -- 172.21.15.112:0/4102269740 wait complete. 2023-11-08T12:28:22.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.653+0000 7f57a5570700 1 Processor -- start 2023-11-08T12:28:22.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.653+0000 7f57a5570700 1 -- start start 2023-11-08T12:28:22.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a0157830 0x7f57a00c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57a00b1eb0 0x7f57a00af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a00af800 0x7f57a01f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00afca0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c3690 con 0x7f57a0157830 2023-11-08T12:28:22.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c3970 con 0x7f57a00af800 2023-11-08T12:28:22.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57a00b1eb0 0x7f57a00af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57a00b1eb0 0x7f57a00af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34862/0 (socket says 172.21.15.112:34862) 2023-11-08T12:28:22.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 -- 172.21.15.112:0/2093929493 learned_addr learned my addr 172.21.15.112:0/2093929493 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:22.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f579effd700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a0157830 0x7f57a00c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 -- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a00af800 msgr2=0x7f57a01f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a00af800 0x7f57a01f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 -- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a0157830 msgr2=0x7f57a00c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a0157830 0x7f57a00c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 -- 172.21.15.112:0/2093929493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00cc780 con 0x7f57a00b1eb0 2023-11-08T12:28:22.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f579effd700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a0157830 0x7f57a00c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:22.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f5797fff700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57a00b1eb0 0x7f57a00af2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57880108d0 tx=0x7f5788010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:22.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57977fe700 1 -- 172.21.15.112:0/2093929493 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788010ed0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57977fe700 1 -- 172.21.15.112:0/2093929493 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578800e8d0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a00cc4a0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57977fe700 1 -- 172.21.15.112:0/2093929493 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800eca0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.657+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a0069e40 con 0x7f57a00b1eb0 2023-11-08T12:28:22.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.661+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a00b2af0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.661+0000 7f57977fe700 1 -- 172.21.15.112:0/2093929493 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f578801c030 con 0x7f57a00b1eb0 2023-11-08T12:28:22.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.661+0000 7f57977fe700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5780064ee0 0x7f5780067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:22.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.661+0000 7f57977fe700 1 -- 172.21.15.112:0/2093929493 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f57880822b0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.661+0000 7f579effd700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5780064ee0 0x7f5780067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:22.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.665+0000 7f579effd700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5780064ee0 0x7f5780067390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f57a01653c0 tx=0x7f579000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:22.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.665+0000 7f57977fe700 1 -- 172.21.15.112:0/2093929493 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f57a00b2af0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.837+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57a00b2af0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57977fe700 1 -- 172.21.15.112:0/2093929493 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7f57a00b2af0 con 0x7f57a00b1eb0 2023-11-08T12:28:22.843 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:22.844 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:22.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5780064ee0 msgr2=0x7f5780067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5780064ee0 0x7f5780067390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f57a01653c0 tx=0x7f579000a000 comp rx=0 tx=0).stop 2023-11-08T12:28:22.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57a00b1eb0 msgr2=0x7f57a00af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:22.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57a00b1eb0 0x7f57a00af2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f57880108d0 tx=0x7f5788010c90 comp rx=0 tx=0).stop 2023-11-08T12:28:22.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 shutdown_connections 2023-11-08T12:28:22.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5780064ee0 0x7f5780067390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57a00af800 0x7f57a01f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f57a00b1eb0 0x7f57a00af2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 --2- 172.21.15.112:0/2093929493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a0157830 0x7f57a00c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:22.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.841+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 >> 172.21.15.112:0/2093929493 conn(0x7f57a00cf350 msgr2=0x7f57a00c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:22.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.845+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 shutdown_connections 2023-11-08T12:28:22.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:22.845+0000 7f57a5570700 1 -- 172.21.15.112:0/2093929493 wait complete. 2023-11-08T12:28:22.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-08T12:28:22.868 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-08T12:28:22.868 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-08T12:28:22.869 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-08T12:28:22.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-08T12:28:22.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-08T12:28:22.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-08T12:28:22.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-08T12:28:23.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d3fff700 1 Processor -- start 2023-11-08T12:28:23.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d3fff700 1 -- start start 2023-11-08T12:28:23.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41d40ada60 0x7f41d406cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41d40c1bf0 0x7f41d40cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d3fff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d4160fc0 con 0x7f41d406d2a0 2023-11-08T12:28:23.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d3fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d40ade30 con 0x7f41d40c1bf0 2023-11-08T12:28:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d3fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d406da10 con 0x7f41d40ada60 2023-11-08T12:28:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41d37fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41d40c1bf0 0x7f41d40cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41ca7fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f41d406d2a0 0x7f41d40c14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36004/0 (socket says 172.21.15.112:36004) 2023-11-08T12:28:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.101+0000 7f41ca7fc700 1 -- 172.21.15.112:0/3507630892 learned_addr learned my addr 172.21.15.112:0/3507630892 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.105+0000 7f41d37fe700 1 -- 172.21.15.112:0/3507630892 >> v2:172.21.15.133:3300/0 conn(0x7f41d40ada60 msgr2=0x7f41d406cd60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:28:23.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.105+0000 7f41d37fe700 1 --2- 172.21.15.112:0/3507630892 >> v2:172.21.15.133:3300/0 conn(0x7f41d40ada60 0x7f41d406cd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.105+0000 7f41d37fe700 1 -- 172.21.15.112:0/3507630892 >> v1:172.21.15.112:6789/0 conn(0x7f41d406d2a0 legacy=0x7f41d40c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.105+0000 7f41d37fe700 1 -- 172.21.15.112:0/3507630892 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d406d730 con 0x7f41d40c1bf0 2023-11-08T12:28:23.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.105+0000 7f41d37fe700 1 --2- 172.21.15.112:0/3507630892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40c1bf0 0x7f41d40cc0e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41d406ed80 tx=0x7f41cc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d713568e10e51c26 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d27fc700 1 -- 172.21.15.112:0/3507630892 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc011830 con 0x7f41d40c1bf0 2023-11-08T12:28:23.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d27fc700 1 -- 172.21.15.112:0/3507630892 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc011990 con 0x7f41d40c1bf0 2023-11-08T12:28:23.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d27fc700 1 -- 172.21.15.112:0/3507630892 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc011d40 con 0x7f41d40c1bf0 2023-11-08T12:28:23.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7fe6fb416700 1 Processor -- start 2023-11-08T12:28:23.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 -- 172.21.15.112:0/3507630892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40c1bf0 msgr2=0x7f41d40cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 --2- 172.21.15.112:0/3507630892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40c1bf0 0x7f41d40cc0e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41d406ed80 tx=0x7f41cc009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:23.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 -- 172.21.15.112:0/3507630892 shutdown_connections 2023-11-08T12:28:23.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 --2- 172.21.15.112:0/3507630892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40c1bf0 0x7f41d40cc0e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 --2- 172.21.15.112:0/3507630892 >> v2:172.21.15.133:3300/0 conn(0x7f41d40ada60 0x7f41d406cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 -- 172.21.15.112:0/3507630892 >> 172.21.15.112:0/3507630892 conn(0x7f41d40b2080 msgr2=0x7f41d4071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 -- 172.21.15.112:0/3507630892 shutdown_connections 2023-11-08T12:28:23.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7fb0da274700 1 Processor -- start 2023-11-08T12:28:23.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7fe6fb416700 1 -- start start 2023-11-08T12:28:23.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7fb0da274700 1 -- start start 2023-11-08T12:28:23.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f0588dfc700 1 Processor -- start 2023-11-08T12:28:23.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0da274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d41534a0 0x7fb0d415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.109+0000 7f41d3fff700 1 -- 172.21.15.112:0/3507630892 wait complete. 2023-11-08T12:28:23.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0da274700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0d40b6200 0x7fb0d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0da274700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d415d080 con 0x7fb0d4160920 2023-11-08T12:28:23.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0da274700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d4153870 con 0x7fb0d40b6200 2023-11-08T12:28:23.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0da274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40b53c0 con 0x7fb0d41534a0 2023-11-08T12:28:23.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f136086f700 1 Processor -- start 2023-11-08T12:28:23.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6fb416700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6f41534a0 0x7fe6f415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6fb416700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6f4160920 0x7fe6f40b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0d40b6200 0x7fb0d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6fb416700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0d40b6200 0x7fb0d4070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46540/0 (socket says 172.21.15.112:46540) 2023-11-08T12:28:23.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 -- 172.21.15.112:0/1419340200 learned_addr learned my addr 172.21.15.112:0/1419340200 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6fb416700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f415d080 con 0x7fe6f41534a0 2023-11-08T12:28:23.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6fb416700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f4153870 con 0x7fe6f4160920 2023-11-08T12:28:23.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f41d3fff700 1 Processor -- start 2023-11-08T12:28:23.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6fb416700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40b6430 con 0x7fe6f40b6030 2023-11-08T12:28:23.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d3fff700 1 --2- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d41534a0 0x7fb0d415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0588dfc700 1 -- start start 2023-11-08T12:28:23.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6f4160920 0x7fe6f40b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f99b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f41d3fff700 1 -- start start 2023-11-08T12:28:23.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0588dfc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0584163cb0 0x7f0584164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0588dfc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 0x7f058406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0588dfc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0584164080 con 0x7f058406d2f0 2023-11-08T12:28:23.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0588dfc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05840cc290 con 0x7f0584163cb0 2023-11-08T12:28:23.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0588dfc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058406d770 con 0x7f05840cdfb0 2023-11-08T12:28:23.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 -- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d41534a0 msgr2=0x7fb0d415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 --2- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d41534a0 0x7fb0d415d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 -- 172.21.15.112:0/1419340200 >> v1:172.21.15.112:6789/0 conn(0x7fb0d4160920 legacy=0x7fb0d40b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 -- 172.21.15.112:0/1419340200 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40b56a0 con 0x7fb0d40b6200 2023-11-08T12:28:23.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6f4160920 0x7fe6f40b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46548/0 (socket says 172.21.15.112:46548) 2023-11-08T12:28:23.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 -- 172.21.15.112:0/908260934 learned_addr learned my addr 172.21.15.112:0/908260934 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f91b2700 1 --2- 172.21.15.112:0/908260934 >> v2:172.21.15.112:3300/0 conn(0x7fe6f41534a0 0x7fe6f415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f136086f700 1 -- start start 2023-11-08T12:28:23.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f136086f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 0x7f135c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f136086f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f135c069e00 0x7f135c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f136086f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c06c600 con 0x7f135c071aa0 2023-11-08T12:28:23.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f136086f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c06cef0 con 0x7f135c069e00 2023-11-08T12:28:23.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f136086f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c06a7c0 con 0x7f135c15c640 2023-11-08T12:28:23.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb84b68a700 1 Processor -- start 2023-11-08T12:28:23.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0582d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f058406d2f0 0x7f058406bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:57658/0 (socket says 172.21.15.112:57658) 2023-11-08T12:28:23.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0582d9d700 1 -- 172.21.15.112:0/134226959 learned_addr learned my addr 172.21.15.112:0/134226959 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:23.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb0d8811700 1 --2- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d40b6200 0x7fb0d4070630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009e50 tx=0x7fb0cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0a2011bb568caf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fb84b68a700 1 -- start start 2023-11-08T12:28:23.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f41d3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41d406d2a0 0x7f41d4158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40ada60 0x7f41d41625c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f058259c700 1 --2- 172.21.15.112:0/134226959 >> v2:172.21.15.112:3300/0 conn(0x7f0584163cb0 0x7f0584164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 -- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 msgr2=0x7fe6f4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f4070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 -- 172.21.15.112:0/908260934 >> v2:172.21.15.112:3300/0 conn(0x7fe6f41534a0 msgr2=0x7fe6f415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 --2- 172.21.15.112:0/908260934 >> v2:172.21.15.112:3300/0 conn(0x7fe6f41534a0 0x7fe6f415d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7fe6f89b1700 1 -- 172.21.15.112:0/908260934 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40b53c0 con 0x7fe6f4160920 2023-11-08T12:28:23.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d3fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41d40c1bf0 0x7f41d4163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d3fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4162b00 con 0x7f41d40ada60 2023-11-08T12:28:23.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4161520 con 0x7f41d406d2a0 2023-11-08T12:28:23.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d3fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4161800 con 0x7f41d40c1bf0 2023-11-08T12:28:23.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fe6f91b2700 1 --2- 172.21.15.112:0/908260934 >> v2:172.21.15.112:3300/0 conn(0x7fe6f41534a0 0x7fe6f415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:23.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41d40c1bf0 0x7f41d4163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41d406d2a0 0x7f41d4158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41d40c1bf0 0x7f41d4163bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54176/0 (socket says 172.21.15.112:54176) 2023-11-08T12:28:23.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 -- 172.21.15.112:0/2102930360 learned_addr learned my addr 172.21.15.112:0/2102930360 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073933392 0 0) 0x7f0584164080 con 0x7f058406d2f0 2023-11-08T12:28:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f056c0035d0 con 0x7f058406d2f0 2023-11-08T12:28:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb0d37fe700 1 -- 172.21.15.112:0/1419340200 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00e070 con 0x7fb0d40b6200 2023-11-08T12:28:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb0d37fe700 1 -- 172.21.15.112:0/1419340200 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc003a40 con 0x7fb0d40b6200 2023-11-08T12:28:23.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb0d37fe700 1 -- 172.21.15.112:0/1419340200 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc003df0 con 0x7fb0d40b6200 2023-11-08T12:28:23.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fe6f89b1700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4160920 0x7fe6f40b5af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4072450 tx=0x7fe6f0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fda72b4bdd7e3e4a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f135affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f135c071aa0 0x7f135c06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:57670/0 (socket says 172.21.15.112:57670) 2023-11-08T12:28:23.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f135affd700 1 -- 172.21.15.112:0/3410030874 learned_addr learned my addr 172.21.15.112:0/3410030874 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:23.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135b7fe700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 0x7f135c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135bfff700 1 --2- 172.21.15.112:0/3410030874 >> v2:172.21.15.112:3300/0 conn(0x7f135c069e00 0x7f135c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413966344 0 0) 0x7f135c06c600 con 0x7f135c071aa0 2023-11-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13480035d0 con 0x7f135c071aa0 2023-11-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41ca7fc700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40ada60 0x7f41d41625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb84b68a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8440cc290 0x7fb844070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb84b68a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440ac550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb84b68a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84406bb00 con 0x7fb84415c1f0 2023-11-08T12:28:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.113+0000 7f0581d9b700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 0x7f058406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb84b68a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84406acc0 con 0x7fb8440cc290 2023-11-08T12:28:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb84b68a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440ccaa0 con 0x7fb844070670 2023-11-08T12:28:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429729006 0 0) 0x7f056c0035d0 con 0x7f058406d2f0 2023-11-08T12:28:23.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 msgr2=0x7f058406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 0x7f058406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 >> v2:172.21.15.112:3300/0 conn(0x7f0584163cb0 msgr2=0x7f0584164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 --2- 172.21.15.112:0/134226959 >> v2:172.21.15.112:3300/0 conn(0x7f0584163cb0 0x7f0584164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584069bf0 con 0x7f058406d2f0 2023-11-08T12:28:23.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f057c0019f0 con 0x7f058406d2f0 2023-11-08T12:28:23.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 >> v1:172.21.15.133:6789/0 conn(0x7f058406d2f0 legacy=0x7f058406bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 0x7f056c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 -- 172.21.15.112:0/2102930360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41d406d2a0 msgr2=0x7f41d4158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41d406d2a0 0x7f41d4158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 -- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40ada60 msgr2=0x7f41d41625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41d40ada60 0x7f41d41625c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f056c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f056c004db0 0x7f056c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05840cc290 con 0x7f056c004db0 2023-11-08T12:28:23.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058406d770 con 0x7f056c003fa0 2023-11-08T12:28:23.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c00bb10 con 0x7f05840cdfb0 2023-11-08T12:28:23.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 -- 172.21.15.112:0/2102930360 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0094b0 con 0x7f41d40c1bf0 2023-11-08T12:28:23.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb0da274700 1 -- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d40b6200 msgr2=0x7fb0d4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb0da274700 1 --2- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d40b6200 0x7fb0d4070630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009e50 tx=0x7fb0cc00b330 comp rx=0 tx=0).stop 2023-11-08T12:28:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb848c25700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8440cc290 0x7fb844070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb848c25700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8440cc290 0x7fb844070130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46560/0 (socket says 172.21.15.112:46560) 2023-11-08T12:28:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb848c25700 1 -- 172.21.15.112:0/4002152840 learned_addr learned my addr 172.21.15.112:0/4002152840 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2116590998 0 0) 0x7f13480035d0 con 0x7f135c071aa0 2023-11-08T12:28:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 msgr2=0x7f135c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 0x7f135c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 >> v2:172.21.15.112:3300/0 conn(0x7f135c069e00 msgr2=0x7f135c06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 --2- 172.21.15.112:0/3410030874 >> v2:172.21.15.112:3300/0 conn(0x7f135c069e00 0x7f135c06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f91b5a9f700 1 Processor -- start 2023-11-08T12:28:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f0582d9d700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f056c004db0 0x7f056c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f91b5a9f700 1 -- start start 2023-11-08T12:28:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0722f0 con 0x7f135c071aa0 2023-11-08T12:28:23.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f1344001670 con 0x7f135c071aa0 2023-11-08T12:28:23.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 >> v1:172.21.15.133:6789/0 conn(0x7f135c071aa0 legacy=0x7f135c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 0x7f1348003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fe6ebfff700 1 -- 172.21.15.112:0/908260934 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0011830 con 0x7fe6f4160920 2023-11-08T12:28:23.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1348003fe0 0x7f1348004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1348004db0 0x7f1348005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c06cef0 con 0x7f1348004db0 2023-11-08T12:28:23.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c06a7c0 con 0x7f1348003fe0 2023-11-08T12:28:23.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134800ba30 con 0x7f135c15c640 2023-11-08T12:28:23.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f0581d9b700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f056c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb849c27700 1 --2- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fe6ebfff700 1 -- 172.21.15.112:0/908260934 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f0011990 con 0x7fe6f4160920 2023-11-08T12:28:23.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fe6ebfff700 1 -- 172.21.15.112:0/908260934 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0011830 con 0x7fe6f4160920 2023-11-08T12:28:23.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41d37fe700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41d40c1bf0 0x7f41d4163bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009f30 tx=0x7f41cc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f058259c700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 0x7f056c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135bfff700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1348004db0 0x7f1348005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb848c25700 1 -- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 msgr2=0x7fb8440ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135b7fe700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 0x7f1348003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f135affd700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1348003fe0 0x7f1348004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb848c25700 1 --2- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440ac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0038c0 con 0x7f41d40c1bf0 2023-11-08T12:28:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc003a40 con 0x7f41d40c1bf0 2023-11-08T12:28:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb848c25700 1 -- 172.21.15.112:0/4002152840 >> v1:172.21.15.133:6789/0 conn(0x7fb84415c1f0 legacy=0x7fb84406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7fb848c25700 1 -- 172.21.15.112:0/4002152840 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844070ad0 con 0x7fb8440cc290 2023-11-08T12:28:23.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 -- 172.21.15.112:0/1419340200 shutdown_connections 2023-11-08T12:28:23.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 --2- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d40b6200 0x7fb0d4070630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 --2- 172.21.15.112:0/1419340200 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d41534a0 0x7fb0d415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 -- 172.21.15.112:0/1419340200 >> 172.21.15.112:0/1419340200 conn(0x7fb0d406bfc0 msgr2=0x7fb0d406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 -- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4160920 msgr2=0x7fe6f40b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4160920 0x7fe6f40b5af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4072450 tx=0x7fe6f0009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 -- 172.21.15.112:0/1419340200 shutdown_connections 2023-11-08T12:28:23.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135b7fe700 1 -- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1348003fe0 msgr2=0x7f1348004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135b7fe700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1348003fe0 0x7f1348004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135b7fe700 1 -- 172.21.15.112:0/3410030874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1348004db0 msgr2=0x7f1348005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135b7fe700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1348004db0 0x7f1348005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135b7fe700 1 -- 172.21.15.112:0/3410030874 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c06c600 con 0x7f135c15c640 2023-11-08T12:28:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f0581d9b700 1 -- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 msgr2=0x7f056c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f0581d9b700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840cdfb0 0x7f056c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f0581d9b700 1 -- 172.21.15.112:0/134226959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f056c004db0 msgr2=0x7f056c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f0581d9b700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f056c004db0 0x7f056c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.117+0000 7f0581d9b700 1 -- 172.21.15.112:0/134226959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0035d0 con 0x7f056c003fa0 2023-11-08T12:28:23.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 -- 172.21.15.112:0/1419340200 wait complete. 2023-11-08T12:28:23.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 -- 172.21.15.112:0/908260934 shutdown_connections 2023-11-08T12:28:23.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f4070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f4160920 0x7fe6f40b5af0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 --2- 172.21.15.112:0/908260934 >> v2:172.21.15.112:3300/0 conn(0x7fe6f41534a0 0x7fe6f415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 -- 172.21.15.112:0/908260934 >> 172.21.15.112:0/908260934 conn(0x7fe6f406bfc0 msgr2=0x7fe6f406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0581d9b700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f056c004870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0578009b40 tx=0x7f056c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80cdf2b09ebac82f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb848c25700 1 --2- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8440cc290 0x7fb844070130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb840009910 tx=0x7fb840009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55fabc3428caa378 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91b5a9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b006d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc003df0 con 0x7f41d40c1bf0 2023-11-08T12:28:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d406c280 con 0x7f41d40c1bf0 2023-11-08T12:28:23.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d406bfa0 con 0x7f41d40c1bf0 2023-11-08T12:28:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91b5a9f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f91b006c350 0x7f91b00ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800e6c0 con 0x7f056c003fa0 2023-11-08T12:28:23.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057800e820 con 0x7f056c003fa0 2023-11-08T12:28:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f058159a700 1 -- 172.21.15.112:0/134226959 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800eb90 con 0x7f056c003fa0 2023-11-08T12:28:23.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41d406c560 con 0x7f41d40c1bf0 2023-11-08T12:28:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91affff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f91b006c350 0x7f91b00ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fd211564700 1 Processor -- start 2023-11-08T12:28:23.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb83bfff700 1 -- 172.21.15.112:0/4002152840 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011830 con 0x7fb8440cc290 2023-11-08T12:28:23.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb83bfff700 1 -- 172.21.15.112:0/4002152840 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840011990 con 0x7fb8440cc290 2023-11-08T12:28:23.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb83bfff700 1 -- 172.21.15.112:0/4002152840 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011d40 con 0x7fb8440cc290 2023-11-08T12:28:23.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135b7fe700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 0x7f1348003a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f134c009b70 tx=0x7f13480058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb1ca8cf40aece32 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 -- 172.21.15.112:0/908260934 shutdown_connections 2023-11-08T12:28:23.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91b4a9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91b4a9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b006d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54200/0 (socket says 172.21.15.112:54200) 2023-11-08T12:28:23.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91b4a9d700 1 -- 172.21.15.112:0/755165106 learned_addr learned my addr 172.21.15.112:0/755165106 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fe6fb416700 1 -- 172.21.15.112:0/908260934 wait complete. 2023-11-08T12:28:23.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b006d000 con 0x7f91b00cae20 2023-11-08T12:28:23.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0588dfc700 1 -- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 msgr2=0x7f056c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0588dfc700 1 --2- 172.21.15.112:0/134226959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f056c004870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0578009b40 tx=0x7f056c0058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fd211564700 1 -- start start 2023-11-08T12:28:23.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0582d9d700 1 -- 172.21.15.112:0/134226959 reap_dead start 2023-11-08T12:28:23.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00e6c0 con 0x7f135c15c640 2023-11-08T12:28:23.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c00e820 con 0x7f135c15c640 2023-11-08T12:28:23.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f135a7fc700 1 -- 172.21.15.112:0/3410030874 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00eb90 con 0x7f135c15c640 2023-11-08T12:28:23.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb84b68a700 1 -- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8440cc290 msgr2=0x7fb844070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb84b68a700 1 --2- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8440cc290 0x7fb844070130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb840009910 tx=0x7fb840009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:23.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 Processor -- start 2023-11-08T12:28:23.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0588dfc700 1 -- 172.21.15.112:0/134226959 shutdown_connections 2023-11-08T12:28:23.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0588dfc700 1 -- 172.21.15.112:0/134226959 >> 172.21.15.112:0/134226959 conn(0x7f05840cf350 msgr2=0x7f05840b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb0da274700 1 -- start start 2023-11-08T12:28:23.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b00adae0 con 0x7f91b006c350 2023-11-08T12:28:23.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd211564700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c160710 0x7fd20c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd211564700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd20c0cc860 0x7fd20c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd211564700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0ad6c0 con 0x7fd20c0705c0 2023-11-08T12:28:23.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f136086f700 1 -- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 msgr2=0x7f1348003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f136086f700 1 --2- 172.21.15.112:0/3410030874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c15c640 0x7f1348003a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f134c009b70 tx=0x7f13480058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b015cdd0 con 0x7f91b015b6b0 2023-11-08T12:28:23.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f41cc02b020 con 0x7f41d40c1bf0 2023-11-08T12:28:23.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb84b68a700 1 -- 172.21.15.112:0/4002152840 shutdown_connections 2023-11-08T12:28:23.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb84b68a700 1 --2- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb84b68a700 1 --2- 172.21.15.112:0/4002152840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8440cc290 0x7fb844070130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7fb84b68a700 1 -- 172.21.15.112:0/4002152840 >> 172.21.15.112:0/4002152840 conn(0x7fb8440ce6c0 msgr2=0x7fb8440cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb84b68a700 1 -- 172.21.15.112:0/4002152840 shutdown_connections 2023-11-08T12:28:23.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f135bfff700 1 -- 172.21.15.112:0/3410030874 reap_dead start 2023-11-08T12:28:23.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd211564700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c070a60 con 0x7fd20c0cc860 2023-11-08T12:28:23.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd211564700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c06b1c0 con 0x7fd20c160710 2023-11-08T12:28:23.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f91af7fe700 1 -- 172.21.15.112:0/755165106 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212249705 0 0) 0x7f91b006d000 con 0x7f91b00cae20 2023-11-08T12:28:23.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c160710 0x7fd20c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f136086f700 1 -- 172.21.15.112:0/3410030874 shutdown_connections 2023-11-08T12:28:23.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f136086f700 1 -- 172.21.15.112:0/3410030874 >> 172.21.15.112:0/3410030874 conn(0x7f135c0b6520 msgr2=0x7f135c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0da274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d40b6200 0x7fb0d40c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0da274700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d41534a0 0x7fb0d41476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0da274700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d4160920 0x7fb0d415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0da274700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4157820 con 0x7fb0d4160920 2023-11-08T12:28:23.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0da274700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d41572a0 con 0x7fb0d41534a0 2023-11-08T12:28:23.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0da274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4157540 con 0x7fb0d40b6200 2023-11-08T12:28:23.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f91af7fe700 1 -- 172.21.15.112:0/755165106 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a00035d0 con 0x7f91b00cae20 2023-11-08T12:28:23.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c160710 0x7fd20c0cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54202/0 (socket says 172.21.15.112:54202) 2023-11-08T12:28:23.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 -- 172.21.15.112:0/4150516473 learned_addr learned my addr 172.21.15.112:0/4150516473 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb84b68a700 1 -- 172.21.15.112:0/4002152840 wait complete. 2023-11-08T12:28:23.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd203fff700 1 --2- 172.21.15.112:0/4150516473 >> v2:172.21.15.133:3300/0 conn(0x7fd20c0cc860 0x7fd20c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d41534a0 0x7fb0d41476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0d3fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d40b6200 0x7fb0d40c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d41534a0 0x7fb0d41476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46596/0 (socket says 172.21.15.112:46596) 2023-11-08T12:28:23.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41cbfff700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f41b4064f10 0x7f41b40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0588dfc700 1 -- 172.21.15.112:0/134226959 shutdown_connections 2023-11-08T12:28:23.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.121+0000 7f0588dfc700 1 -- 172.21.15.112:0/134226959 wait complete. 2023-11-08T12:28:23.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fe6fb416700 1 Processor -- start 2023-11-08T12:28:23.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 -- 172.21.15.112:0/3370066877 learned_addr learned my addr 172.21.15.112:0/3370066877 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0d8811700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d4160920 0x7fb0d415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f0588dfc700 1 Processor -- start 2023-11-08T12:28:23.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 -- 172.21.15.112:0/4150516473 >> v2:172.21.15.133:3300/0 conn(0x7fd20c0cc860 msgr2=0x7fd20c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 --2- 172.21.15.112:0/4150516473 >> v2:172.21.15.133:3300/0 conn(0x7fd20c0cc860 0x7fd20c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 -- 172.21.15.112:0/4150516473 >> v1:172.21.15.112:6789/0 conn(0x7fd20c0705c0 legacy=0x7fd20c069bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:28:23.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 -- 172.21.15.112:0/3370066877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d40b6200 msgr2=0x7fb0d40c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0d40b6200 0x7fb0d40c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 -- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d4160920 msgr2=0x7fb0d415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0d4160920 0x7fb0d415b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 -- 172.21.15.112:0/3370066877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009b30 con 0x7fb0d41534a0 2023-11-08T12:28:23.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f136086f700 1 -- 172.21.15.112:0/3410030874 shutdown_connections 2023-11-08T12:28:23.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f136086f700 1 -- 172.21.15.112:0/3410030874 wait complete. 2023-11-08T12:28:23.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f41cc083d90 con 0x7f41d40c1bf0 2023-11-08T12:28:23.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f91b4a9d700 1 -- 172.21.15.112:0/755165106 >> v2:172.21.15.112:3300/0 conn(0x7f91b006c350 msgr2=0x7f91b00ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f91b4a9d700 1 --2- 172.21.15.112:0/755165106 >> v2:172.21.15.112:3300/0 conn(0x7f91b006c350 0x7f91b00ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fe6fb416700 1 -- start start 2023-11-08T12:28:23.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 -- 172.21.15.112:0/4150516473 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0adc60 con 0x7fd20c160710 2023-11-08T12:28:23.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f91b4a9d700 1 -- 172.21.15.112:0/755165106 >> v1:172.21.15.112:6789/0 conn(0x7f91b00cae20 legacy=0x7f91b00cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41cbfff700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f41b406eb60 0x7f41b4070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20bfff700 1 --2- 172.21.15.112:0/4150516473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c160710 0x7fd20c0cc320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009910 tx=0x7fd1fc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48b784f56e1760a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 --> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41b4071660 con 0x7f41b406eb60 2023-11-08T12:28:23.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41cc084140 con 0x7f41d40c1bf0 2023-11-08T12:28:23.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41d2ffd700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f41b4064f10 0x7f41b40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0cbfff700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d41534a0 0x7fb0d41476f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c500 tx=0x7fb0bc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f0588dfc700 1 -- start start 2023-11-08T12:28:23.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20b7fe700 1 -- 172.21.15.112:0/4150516473 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc004230 con 0x7fd20c160710 2023-11-08T12:28:23.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f91b4a9d700 1 -- 172.21.15.112:0/755165106 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b015c810 con 0x7f91b015b6b0 2023-11-08T12:28:23.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20b7fe700 1 -- 172.21.15.112:0/4150516473 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc004390 con 0x7fd20c160710 2023-11-08T12:28:23.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fd20b7fe700 1 -- 172.21.15.112:0/4150516473 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0036c0 con 0x7fd20c160710 2023-11-08T12:28:23.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0054e0 con 0x7fb0d41534a0 2023-11-08T12:28:23.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0036a0 con 0x7fb0d41534a0 2023-11-08T12:28:23.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc003a50 con 0x7fb0d41534a0 2023-11-08T12:28:23.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7f41ca7fc700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f41b406eb60 0x7f41b4070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.125+0000 7fb84b68a700 1 Processor -- start 2023-11-08T12:28:23.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d415cd10 con 0x7fb0d41534a0 2023-11-08T12:28:23.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d415ca30 con 0x7fb0d41534a0 2023-11-08T12:28:23.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f41ca7fc700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f41b406eb60 0x7f41b4070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6fb416700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f40c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fd211564700 1 -- 172.21.15.112:0/4150516473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c160710 msgr2=0x7fd20c0cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f05840c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840c58a0 0x7f05840c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840c40f0 0x7f05840c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05840c8880 con 0x7f05840c58a0 2023-11-08T12:28:23.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05841f93b0 con 0x7f056c003fa0 2023-11-08T12:28:23.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05841f9690 con 0x7f05840c40f0 2023-11-08T12:28:23.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f91b4a9d700 1 --2- 172.21.15.112:0/755165106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b006d490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91a4007940 tx=0x7f91a4007c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7801057938d92a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f41d2ffd700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f41b4064f10 0x7f41b40673c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f41d40c4f40 tx=0x7f41c400d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fd211564700 1 --2- 172.21.15.112:0/4150516473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c160710 0x7fd20c0cc320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009910 tx=0x7fd1fc009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:23.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== osd.0 v2:172.21.15.112:6801/35551 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f41b4071660 con 0x7f41b406eb60 2023-11-08T12:28:23.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f05840c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f05840c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46598/0 (socket says 172.21.15.112:46598) 2023-11-08T12:28:23.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 -- 172.21.15.112:0/3966078443 learned_addr learned my addr 172.21.15.112:0/3966078443 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0582d9d700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840c40f0 0x7f05840c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 -- 172.21.15.112:0/3966078443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840c40f0 msgr2=0x7f05840c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05840c40f0 0x7f05840c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 -- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840c58a0 msgr2=0x7f05840c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840c58a0 0x7f05840c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 -- 172.21.15.112:0/3966078443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840cc4a0 con 0x7f056c003fa0 2023-11-08T12:28:23.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0d40b7f10 con 0x7fb0d41534a0 2023-11-08T12:28:23.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb84b68a700 1 -- start start 2023-11-08T12:28:23.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb84b68a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb84b68a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8440cc290 0x7fb84414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb84b68a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb84415c1f0 0x7fb84406c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb84b68a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440b3b40 con 0x7fb8440cc290 2023-11-08T12:28:23.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb84b68a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415c780 con 0x7fb84415c1f0 2023-11-08T12:28:23.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fb84b68a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415eb40 con 0x7fb844070670 2023-11-08T12:28:23.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6fb416700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f41534a0 0x7fe6f414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6fb416700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6f4160920 0x7fe6f408d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6fb416700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f408d980 con 0x7fe6f4160920 2023-11-08T12:28:23.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6fb416700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40c8b00 con 0x7fe6f41534a0 2023-11-08T12:28:23.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6fb416700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40c8de0 con 0x7fe6f40b6030 2023-11-08T12:28:23.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f40c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f40c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54220/0 (socket says 172.21.15.112:54220) 2023-11-08T12:28:23.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 -- 172.21.15.112:0/870623903 learned_addr learned my addr 172.21.15.112:0/870623903 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f91af7fe700 1 -- 172.21.15.112:0/755165106 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80019f0 con 0x7f91b015b6b0 2023-11-08T12:28:23.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f91af7fe700 1 -- 172.21.15.112:0/755165106 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4004030 con 0x7f91b015b6b0 2023-11-08T12:28:23.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f91af7fe700 1 -- 172.21.15.112:0/755165106 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40043c0 con 0x7f91b015b6b0 2023-11-08T12:28:23.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f89b1700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f41534a0 0x7fe6f414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f058259c700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f05840c8340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0574011900 tx=0x7f0574011cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f41534a0 msgr2=0x7fe6f414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6f41534a0 0x7fe6f414a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6f4160920 msgr2=0x7fe6f408d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6f4160920 0x7fe6f408d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0009570 con 0x7fe6f40b6030 2023-11-08T12:28:23.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400c070 con 0x7f056c003fa0 2023-11-08T12:28:23.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05841651f0 con 0x7f056c003fa0 2023-11-08T12:28:23.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400f8d0 con 0x7f056c003fa0 2023-11-08T12:28:23.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05840cc780 con 0x7f056c003fa0 2023-11-08T12:28:23.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400fc80 con 0x7f056c003fa0 2023-11-08T12:28:23.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7fe6f91b2700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f40c8470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e880 tx=0x7fe6e400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.129+0000 7f136086f700 1 Processor -- start 2023-11-08T12:28:23.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0568000fc0 con 0x7f056c003fa0 2023-11-08T12:28:23.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8440cc290 0x7fb84414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8440cc290 0x7fb84414c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34966/0 (socket says 172.21.15.112:34966) 2023-11-08T12:28:23.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 -- 172.21.15.112:0/4026856754 learned_addr learned my addr 172.21.15.112:0/4026856754 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb849426700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 -- 172.21.15.112:0/4150516473 shutdown_connections 2023-11-08T12:28:23.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 --2- 172.21.15.112:0/4150516473 >> v2:172.21.15.133:3300/0 conn(0x7fd20c0cc860 0x7fd20c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 --2- 172.21.15.112:0/4150516473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c160710 0x7fd20c0cc320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 -- 172.21.15.112:0/4150516473 >> 172.21.15.112:0/4150516473 conn(0x7fd20c0b0f80 msgr2=0x7fd20c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400c780 con 0x7fe6f40b6030 2023-11-08T12:28:23.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e400c8e0 con 0x7fe6f40b6030 2023-11-08T12:28:23.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400cc70 con 0x7fe6f40b6030 2023-11-08T12:28:23.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f415ca30 con 0x7fe6f40b6030 2023-11-08T12:28:23.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 -- 172.21.15.112:0/4150516473 shutdown_connections 2023-11-08T12:28:23.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f40b56a0 con 0x7fe6f40b6030 2023-11-08T12:28:23.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 -- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 msgr2=0x7fb8440b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb849c27700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb84415c1f0 0x7fb84406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 -- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb84415c1f0 msgr2=0x7fb84406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb84415c1f0 0x7fb84406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 -- 172.21.15.112:0/4026856754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009570 con 0x7fb8440cc290 2023-11-08T12:28:23.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb849426700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb844070670 0x7fb8440b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:23.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb849c27700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb84415c1f0 0x7fb84406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:23.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7f136086f700 1 -- start start 2023-11-08T12:28:23.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6f415cd10 con 0x7fe6f40b6030 2023-11-08T12:28:23.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 msgr2=0x7f91b006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7f91b5a9f700 1 --2- 172.21.15.112:0/755165106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b006d490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91a4007940 tx=0x7f91a4007c50 comp rx=0 tx=0).stop 2023-11-08T12:28:23.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb0bc019030 con 0x7fb0d41534a0 2023-11-08T12:28:23.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe6e4023070 con 0x7fe6f40b6030 2023-11-08T12:28:23.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 -- 172.21.15.112:0/4150516473 wait complete. 2023-11-08T12:28:23.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 Processor -- start 2023-11-08T12:28:23.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb848c25700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8440cc290 0x7fb84414c250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb840000c00 tx=0x7fb840004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fd211564700 1 -- start start 2023-11-08T12:28:23.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7fb0d17fa700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb0b4064fb0 0x7fb0b4067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6e9ffb700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe6d8064f30 0x7fe6d80673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe6e40820f0 con 0x7fe6f40b6030 2023-11-08T12:28:23.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f136086f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c15c640 0x7f135c0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f136086f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f135c0cf7a0 0x7f135c1f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f136086f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c1f19c0 0x7f135c0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6e9ffb700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7fe6d806eb80 0x7fe6d8070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6d8071680 con 0x7fe6d806eb80 2023-11-08T12:28:23.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6e40095c0 con 0x7fe6f40b6030 2023-11-08T12:28:23.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f136086f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0cadc0 con 0x7f135c15c640 2023-11-08T12:28:23.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f136086f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c15fe30 con 0x7f135c0cf7a0 2023-11-08T12:28:23.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f136086f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0cf250 con 0x7f135c1f19c0 2023-11-08T12:28:23.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb0bc081660 con 0x7fb0d41534a0 2023-11-08T12:28:23.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb0d3fff700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb0b4064fb0 0x7fb0b4067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb0d17fa700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7fb0b406ec80 0x7fb0b40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 --> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0b4071780 con 0x7fb0b406ec80 2023-11-08T12:28:23.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0bc083c80 con 0x7fb0d41534a0 2023-11-08T12:28:23.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.133+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0574025070 con 0x7f056c003fa0 2023-11-08T12:28:23.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840004510 con 0x7fb8440cc290 2023-11-08T12:28:23.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400036c0 con 0x7fb8440cc290 2023-11-08T12:28:23.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840003a70 con 0x7fb8440cc290 2023-11-08T12:28:23.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6f99b3700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7fe6d806eb80 0x7fe6d8070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c1f19c0 0x7f135c0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c1f19c0 0x7f135c0cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54236/0 (socket says 172.21.15.112:54236) 2023-11-08T12:28:23.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 -- 172.21.15.112:0/4197350208 learned_addr learned my addr 172.21.15.112:0/4197350208 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd211564700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c0705c0 0x7fd20c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd211564700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cc860 0x7fd20c163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd211564700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd20c160710 0x7fd20c1644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd211564700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1f5ea0 con 0x7fd20c160710 2023-11-08T12:28:23.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd211564700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15fbd0 con 0x7fd20c0cc860 2023-11-08T12:28:23.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd211564700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0b23a0 con 0x7fd20c0705c0 2023-11-08T12:28:23.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135affd700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f135c0cf7a0 0x7f135c1f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd203fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cc860 0x7fd20c163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd203fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cc860 0x7fd20c163fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46640/0 (socket says 172.21.15.112:46640) 2023-11-08T12:28:23.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd203fff700 1 -- 172.21.15.112:0/2496238609 learned_addr learned my addr 172.21.15.112:0/2496238609 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd20bfff700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c0705c0 0x7fd20c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd210d63700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd20c160710 0x7fd20c1644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f0572ffd700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0564064ee0 0x7f0564067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135b7fe700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c15c640 0x7f135c0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 -- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f135c0cf7a0 msgr2=0x7f135c1f1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f135c0cf7a0 0x7f135c1f1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 -- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c15c640 msgr2=0x7f135c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f135c15c640 0x7f135c0cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 -- 172.21.15.112:0/4197350208 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c15ca10 con 0x7f135c1f19c0 2023-11-08T12:28:23.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0574082c00 con 0x7f056c003fa0 2023-11-08T12:28:23.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 shutdown_connections 2023-11-08T12:28:23.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f91b5a9f700 1 --2- 172.21.15.112:0/755165106 >> v2:172.21.15.112:3300/0 conn(0x7f91b006c350 0x7f91b00ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f91b5a9f700 1 --2- 172.21.15.112:0/755165106 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b006d490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 >> 172.21.15.112:0/755165106 conn(0x7f91b00ce510 msgr2=0x7f91b00ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 shutdown_connections 2023-11-08T12:28:23.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f91b5a9f700 1 -- 172.21.15.112:0/755165106 wait complete. 2023-11-08T12:28:23.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb0d8811700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7fb0b406ec80 0x7fb0b40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f0572ffd700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f056406ebb0 0x7f0564070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 --> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05640716b0 con 0x7f056406ebb0 2023-11-08T12:28:23.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0574082fb0 con 0x7f056c003fa0 2023-11-08T12:28:23.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6f89b1700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe6d8064f30 0x7fe6d80673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f0581d9b700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0564064ee0 0x7f0564067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fe6f99b3700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7fe6d806eb80 0x7fe6d8070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd20bfff700 1 -- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cc860 msgr2=0x7fd20c163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd20bfff700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cc860 0x7fd20c163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7f135bfff700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c1f19c0 0x7f135c0cb130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f135c071130 tx=0x7f13540114b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd20bfff700 1 -- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd20c160710 msgr2=0x7fd20c1644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fb84b68a700 1 -- 172.21.15.112:0/4026856754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8440aba70 con 0x7fb8440cc290 2023-11-08T12:28:23.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd20bfff700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd20c160710 0x7fd20c1644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd20bfff700 1 -- 172.21.15.112:0/2496238609 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc009570 con 0x7fd20c0705c0 2023-11-08T12:28:23.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f0582d9d700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f056406ebb0 0x7f0564070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400e070 con 0x7f135c1f19c0 2023-11-08T12:28:23.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354003c50 con 0x7f135c1f19c0 2023-11-08T12:28:23.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354003e40 con 0x7f135c1f19c0 2023-11-08T12:28:23.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd210d63700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd20c160710 0x7fd20c1644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:23.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.137+0000 7fd203fff700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cc860 0x7fd20c163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:23.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fd20bfff700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c0705c0 0x7fd20c15b640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc015000 tx=0x7fd1fc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fe6f89b1700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe6d8064f30 0x7fe6d80673e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000c00 tx=0x7fe6f0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fb0d3fff700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb0b4064fb0 0x7fb0b4067460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4071d70 tx=0x7fb0c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f0581d9b700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0564064ee0 0x7f0564067390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0584070d90 tx=0x7f0578013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f0582d9d700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f056406ebb0 0x7f0564070fe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fb0d8811700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7fb0b406ec80 0x7fb0b40710b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== osd.4 v2:172.21.15.133:6802/35801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe6d8071680 con 0x7fe6d806eb80 2023-11-08T12:28:23.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c06da20 con 0x7f135c1f19c0 2023-11-08T12:28:23.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c072010 con 0x7f135c1f19c0 2023-11-08T12:28:23.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f91b5a9f700 1 Processor -- start 2023-11-08T12:28:23.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f91b5a9f700 1 -- start start 2023-11-08T12:28:23.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0045c0 con 0x7fd20c0705c0 2023-11-08T12:28:23.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc011630 con 0x7fd20c0705c0 2023-11-08T12:28:23.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0119e0 con 0x7fd20c0705c0 2023-11-08T12:28:23.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c06b6b0 con 0x7fd20c0705c0 2023-11-08T12:28:23.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c06b3d0 con 0x7fd20c0705c0 2023-11-08T12:28:23.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fb84b68a700 1 -- 172.21.15.112:0/4026856754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8440cc7c0 con 0x7fb8440cc290 2023-11-08T12:28:23.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd20c0ad8f0 con 0x7fd20c0705c0 2023-11-08T12:28:23.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.141+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f135c073cb0 con 0x7f135c1f19c0 2023-11-08T12:28:23.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== osd.2 v2:172.21.15.112:6816/35550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb0b4071780 con 0x7fb0b406ec80 2023-11-08T12:28:23.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb820000fc0 con 0x7fb8440cc290 2023-11-08T12:28:23.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b5a9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b006c350 0x7f91b01f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== osd.1 v2:172.21.15.112:6800/35553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f05640716b0 con 0x7f056406ebb0 2023-11-08T12:28:23.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b5a9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b00cae20 0x7f91b00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b5a9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b00b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b5a9f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00c81d0 con 0x7f91b00cae20 2023-11-08T12:28:23.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b5a9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00adcd0 con 0x7f91b006c350 2023-11-08T12:28:23.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b5a9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00adf40 con 0x7f91b015b6b0 2023-11-08T12:28:23.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b4a9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b006c350 0x7f91b01f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd1fc017020 con 0x7fd20c0705c0 2023-11-08T12:28:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b4a9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b006c350 0x7f91b01f9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46648/0 (socket says 172.21.15.112:46648) 2023-11-08T12:28:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b4a9d700 1 -- 172.21.15.112:0/2067512344 learned_addr learned my addr 172.21.15.112:0/2067512344 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b529e700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b00b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fd2097fa700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd1ec064f30 0x7fd1ec0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91affff700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b00cae20 0x7f91b00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd1fc083390 con 0x7fd20c0705c0 2023-11-08T12:28:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fd2097fa700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7fd1ec06ea90 0x7fd1ec070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 --> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1ec071590 con 0x7fd1ec06ea90 2023-11-08T12:28:23.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1fc085a80 con 0x7fd20c0705c0 2023-11-08T12:28:23.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b529e700 1 -- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b006c350 msgr2=0x7f91b01f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b529e700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b006c350 0x7f91b01f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b529e700 1 -- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b00cae20 msgr2=0x7f91b00aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1354011a10 con 0x7f135c1f19c0 2023-11-08T12:28:23.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b529e700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b00cae20 0x7f91b00aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7f91b529e700 1 -- 172.21.15.112:0/2067512344 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4007550 con 0x7f91b015b6b0 2023-11-08T12:28:23.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91affff700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b00cae20 0x7f91b00aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:23.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fd210d63700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7fd1ec06ea90 0x7fd1ec070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91b529e700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b00b0350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91a800cac0 tx=0x7f91a800cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fd203fff700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd1ec064f30 0x7fd1ec0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800ce40 con 0x7f91b015b6b0 2023-11-08T12:28:23.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f1353fff700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f133c064ee0 0x7f133c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8003a20 con 0x7f91b015b6b0 2023-11-08T12:28:23.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b006c9b0 con 0x7f91b015b6b0 2023-11-08T12:28:23.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.145+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb84000f050 con 0x7fb8440cc290 2023-11-08T12:28:23.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fb839ffb700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb828064f30 0x7fb8280673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb840083d70 con 0x7fb8440cc290 2023-11-08T12:28:23.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fb839ffb700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7fb82806ec00 0x7fb828071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 --> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb828071700 con 0x7fb82806ec00 2023-11-08T12:28:23.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8400841d0 con 0x7fb8440cc290 2023-11-08T12:28:23.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fb849426700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb828064f30 0x7fb8280673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f13540835b0 con 0x7f135c1f19c0 2023-11-08T12:28:23.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8003dd0 con 0x7f91b015b6b0 2023-11-08T12:28:23.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b015caf0 con 0x7f91b015b6b0 2023-11-08T12:28:23.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91b006cc90 con 0x7f91b015b6b0 2023-11-08T12:28:23.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f1353fff700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f133c06ebb0 0x7f133c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f133c0716b0 con 0x7f133c06ebb0 2023-11-08T12:28:23.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1354083960 con 0x7f135c1f19c0 2023-11-08T12:28:23.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fd210d63700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7fd1ec06ea90 0x7fd1ec070ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f135b7fe700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f133c064ee0 0x7f133c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7fb849c27700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7fb82806ec00 0x7fb828071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.149+0000 7f135affd700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f133c06ebb0 0x7f133c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7fd203fff700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd1ec064f30 0x7fd1ec0673e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0ae6e0 tx=0x7fd1f4009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== osd.7 v2:172.21.15.133:6824/35803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd1ec071590 con 0x7fd1ec06ea90 2023-11-08T12:28:23.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7fb849426700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb828064f30 0x7fb8280673e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb834000f60 tx=0x7fb834009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f91a801a030 con 0x7f91b015b6b0 2023-11-08T12:28:23.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7fb849c27700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7fb82806ec00 0x7fb828071030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91ad7fa700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9194064fb0 0x7f9194067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f135affd700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f133c06ebb0 0x7f133c070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f91a8082040 con 0x7f91b015b6b0 2023-11-08T12:28:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91ad7fa700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f919406ec80 0x7f91940710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 --> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9194071780 con 0x7f919406ec80 2023-11-08T12:28:23.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91a80823f0 con 0x7f91b015b6b0 2023-11-08T12:28:23.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91b4a9d700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9194064fb0 0x7f9194067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.153+0000 7f91affff700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f919406ec80 0x7f91940710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.157+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== osd.3 v2:172.21.15.112:6824/35552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb828071700 con 0x7fb82806ec00 2023-11-08T12:28:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.157+0000 7f91affff700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f919406ec80 0x7f91940710b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.157+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f133c0716b0 con 0x7f133c06ebb0 2023-11-08T12:28:23.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.157+0000 7f91b4a9d700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9194064fb0 0x7f9194067460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91a4000c00 tx=0x7f91a4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.157+0000 7f135b7fe700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f133c064ee0 0x7f133c067390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f134c000c00 tx=0x7f134c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.161+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== osd.6 v2:172.21.15.133:6816/35802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9194071780 con 0x7f919406ec80 2023-11-08T12:28:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.165+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 --> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41d4073cb0 con 0x7f41b406eb60 2023-11-08T12:28:23.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.165+0000 7f41cbfff700 1 -- 172.21.15.112:0/2102930360 <== osd.0 v2:172.21.15.112:6801/35551 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41d4073cb0 con 0x7f41b406eb60 2023-11-08T12:28:23.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f41b406eb60 msgr2=0x7f41b4070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f41b406eb60 0x7f41b4070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f41b4064f10 msgr2=0x7f41b40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f41b4064f10 0x7f41b40673c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f41d40c4f40 tx=0x7f41c400d040 comp rx=0 tx=0).stop 2023-11-08T12:28:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41d40c1bf0 msgr2=0x7f41d4163bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 --2- 172.21.15.112:0/2102930360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41d40c1bf0 0x7f41d4163bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009f30 tx=0x7f41cc004770 comp rx=0 tx=0).stop 2023-11-08T12:28:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6f40c8f20 con 0x7fe6d806eb80 2023-11-08T12:28:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 --> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0d40726c0 con 0x7fb0b406ec80 2023-11-08T12:28:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d37fe700 1 -- 172.21.15.112:0/2102930360 reap_dead start 2023-11-08T12:28:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 shutdown_connections 2023-11-08T12:28:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 >> 172.21.15.112:0/2102930360 conn(0x7f41d40b2080 msgr2=0x7f41d4160210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 shutdown_connections 2023-11-08T12:28:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6e9ffb700 1 -- 172.21.15.112:0/870623903 <== osd.4 v2:172.21.15.133:6802/35801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6f40c8f20 con 0x7fe6d806eb80 2023-11-08T12:28:23.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f41d3fff700 1 -- 172.21.15.112:0/2102930360 wait complete. 2023-11-08T12:28:23.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7fe6d806eb80 msgr2=0x7fe6d8070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 --> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0568002d60 con 0x7f056406ebb0 2023-11-08T12:28:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7fe6d806eb80 0x7fe6d8070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe6d8064f30 msgr2=0x7fe6d80673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe6d8064f30 0x7fe6d80673e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000c00 tx=0x7fe6f0008030 comp rx=0 tx=0).stop 2023-11-08T12:28:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 msgr2=0x7fe6f40c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe6f40b6030 0x7fe6f40c8470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e880 tx=0x7fe6e400ec40 comp rx=0 tx=0).stop 2023-11-08T12:28:23.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fb0d17fa700 1 -- 172.21.15.112:0/3370066877 <== osd.2 v2:172.21.15.112:6816/35550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0d40726c0 con 0x7fb0b406ec80 2023-11-08T12:28:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6f99b3700 1 -- 172.21.15.112:0/870623903 reap_dead start 2023-11-08T12:28:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7fb0b406ec80 msgr2=0x7fb0b40710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fb0da274700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7fb0b406ec80 0x7fb0b40710b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 shutdown_connections 2023-11-08T12:28:23.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.173+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 >> 172.21.15.112:0/870623903 conn(0x7fe6f406bfc0 msgr2=0x7fe6f40d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 shutdown_connections 2023-11-08T12:28:23.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fe6fb416700 1 -- 172.21.15.112:0/870623903 wait complete. 2023-11-08T12:28:23.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 --> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd20c066d70 con 0x7fd1ec06ea90 2023-11-08T12:28:23.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb0b4064fb0 msgr2=0x7fb0b4067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb0b4064fb0 0x7fb0b4067460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4071d70 tx=0x7fb0c4008040 comp rx=0 tx=0).stop 2023-11-08T12:28:23.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d41534a0 msgr2=0x7fb0d41476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 --2- 172.21.15.112:0/3370066877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0d41534a0 0x7fb0d41476f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c500 tx=0x7fb0bc00c8c0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0d8811700 1 -- 172.21.15.112:0/3370066877 reap_dead start 2023-11-08T12:28:23.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 shutdown_connections 2023-11-08T12:28:23.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 >> 172.21.15.112:0/3370066877 conn(0x7fb0d406bfc0 msgr2=0x7fb0d4070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7f0572ffd700 1 -- 172.21.15.112:0/3966078443 <== osd.1 v2:172.21.15.112:6800/35553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0568002d60 con 0x7f056406ebb0 2023-11-08T12:28:23.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd2097fa700 1 -- 172.21.15.112:0/2496238609 <== osd.7 v2:172.21.15.133:6824/35803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd20c066d70 con 0x7fd1ec06ea90 2023-11-08T12:28:23.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 shutdown_connections 2023-11-08T12:28:23.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fb0da274700 1 -- 172.21.15.112:0/3370066877 wait complete. 2023-11-08T12:28:23.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7fd1ec06ea90 msgr2=0x7fd1ec070ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7fd1ec06ea90 0x7fd1ec070ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd1ec064f30 msgr2=0x7fd1ec0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd1ec064f30 0x7fd1ec0673e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0ae6e0 tx=0x7fd1f4009240 comp rx=0 tx=0).stop 2023-11-08T12:28:23.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c0705c0 msgr2=0x7fd20c15b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 --2- 172.21.15.112:0/2496238609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c0705c0 0x7fd20c15b640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc015000 tx=0x7fd1fc004770 comp rx=0 tx=0).stop 2023-11-08T12:28:23.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd210d63700 1 -- 172.21.15.112:0/2496238609 reap_dead start 2023-11-08T12:28:23.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 shutdown_connections 2023-11-08T12:28:23.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 >> 172.21.15.112:0/2496238609 conn(0x7fd20c0b0f80 msgr2=0x7fd20c0c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.177+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 shutdown_connections 2023-11-08T12:28:23.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7fd211564700 1 -- 172.21.15.112:0/2496238609 wait complete. 2023-11-08T12:28:23.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f056406ebb0 msgr2=0x7f0564070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f056406ebb0 0x7f0564070fe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0564064ee0 msgr2=0x7f0564067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0564064ee0 0x7f0564067390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0584070d90 tx=0x7f0578013000 comp rx=0 tx=0).stop 2023-11-08T12:28:23.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 msgr2=0x7f05840c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 --2- 172.21.15.112:0/3966078443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f056c003fa0 0x7f05840c8340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0574011900 tx=0x7f0574011cc0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0582d9d700 1 -- 172.21.15.112:0/3966078443 reap_dead start 2023-11-08T12:28:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 shutdown_connections 2023-11-08T12:28:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 >> 172.21.15.112:0/3966078443 conn(0x7f05840cf350 msgr2=0x7f05840ade60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f135c0cccd0 con 0x7f133c06ebb0 2023-11-08T12:28:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 shutdown_connections 2023-11-08T12:28:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.181+0000 7f0588dfc700 1 -- 172.21.15.112:0/3966078443 wait complete. 2023-11-08T12:28:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.185+0000 7f1353fff700 1 -- 172.21.15.112:0/4197350208 <== osd.5 v2:172.21.15.133:6800/35800 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f135c0cccd0 con 0x7f133c06ebb0 2023-11-08T12:28:23.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.185+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 --> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb820002d60 con 0x7fb82806ec00 2023-11-08T12:28:23.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.185+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f133c06ebb0 msgr2=0x7f133c070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.185+0000 7f136086f700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f133c06ebb0 0x7f133c070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb839ffb700 1 -- 172.21.15.112:0/4026856754 <== osd.3 v2:172.21.15.112:6824/35552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb820002d60 con 0x7fb82806ec00 2023-11-08T12:28:23.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f133c064ee0 msgr2=0x7f133c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7fb82806ec00 msgr2=0x7fb828071030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7fb82806ec00 0x7fb828071030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 --> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91b00ae080 con 0x7f919406ec80 2023-11-08T12:28:23.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f136086f700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f133c064ee0 0x7f133c067390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f134c000c00 tx=0x7f134c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb828064f30 msgr2=0x7fb8280673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb828064f30 0x7fb8280673e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb834000f60 tx=0x7fb834009040 comp rx=0 tx=0).stop 2023-11-08T12:28:23.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8440cc290 msgr2=0x7fb84414c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 --2- 172.21.15.112:0/4026856754 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8440cc290 0x7fb84414c250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb840000c00 tx=0x7fb840004770 comp rx=0 tx=0).stop 2023-11-08T12:28:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb849c27700 1 -- 172.21.15.112:0/4026856754 reap_dead start 2023-11-08T12:28:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 shutdown_connections 2023-11-08T12:28:23.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 >> 172.21.15.112:0/4026856754 conn(0x7fb8440ce6c0 msgr2=0x7fb8440cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c1f19c0 msgr2=0x7f135c0cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f136086f700 1 --2- 172.21.15.112:0/4197350208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f135c1f19c0 0x7f135c0cb130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f135c071130 tx=0x7f13540114b0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91ad7fa700 1 -- 172.21.15.112:0/2067512344 <== osd.6 v2:172.21.15.133:6816/35802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91b00ae080 con 0x7f919406ec80 2023-11-08T12:28:23.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f919406ec80 msgr2=0x7f91940710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b5a9f700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f919406ec80 0x7f91940710b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9194064fb0 msgr2=0x7f9194067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b5a9f700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9194064fb0 0x7f9194067460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91a4000c00 tx=0x7f91a4010000 comp rx=0 tx=0).stop 2023-11-08T12:28:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 msgr2=0x7f91b00b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b5a9f700 1 --2- 172.21.15.112:0/2067512344 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b015b6b0 0x7f91b00b0350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f91a800cac0 tx=0x7f91a800cdd0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.189+0000 7f91b529e700 1 -- 172.21.15.112:0/2067512344 reap_dead start 2023-11-08T12:28:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.193+0000 7f135bfff700 1 -- 172.21.15.112:0/4197350208 reap_dead start 2023-11-08T12:28:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.193+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 shutdown_connections 2023-11-08T12:28:23.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.193+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 >> 172.21.15.112:0/4197350208 conn(0x7f135c0b6520 msgr2=0x7f135c0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.193+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 shutdown_connections 2023-11-08T12:28:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.193+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 >> 172.21.15.112:0/2067512344 conn(0x7f91b00ce510 msgr2=0x7f91b00c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.193+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 shutdown_connections 2023-11-08T12:28:23.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.193+0000 7f91b5a9f700 1 -- 172.21.15.112:0/2067512344 wait complete. 2023-11-08T12:28:23.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.197+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 shutdown_connections 2023-11-08T12:28:23.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.197+0000 7fb8277fe700 1 -- 172.21.15.112:0/4026856754 wait complete. 2023-11-08T12:28:23.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.197+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 shutdown_connections 2023-11-08T12:28:23.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.197+0000 7f136086f700 1 -- 172.21.15.112:0/4197350208 wait complete. 2023-11-08T12:28:23.356 INFO:teuthology.orchestra.run.smithi112.stdout:68719476748 2023-11-08T12:28:23.357 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-08T12:28:23.358 INFO:teuthology.orchestra.run.smithi112.stdout:64424509452 2023-11-08T12:28:23.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-08T12:28:23.360 INFO:teuthology.orchestra.run.smithi112.stdout:60129542155 2023-11-08T12:28:23.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-08T12:28:23.361 INFO:teuthology.orchestra.run.smithi112.stdout:64424509452 2023-11-08T12:28:23.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-08T12:28:23.363 INFO:teuthology.orchestra.run.smithi112.stdout:64424509451 2023-11-08T12:28:23.363 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-08T12:28:23.364 INFO:teuthology.orchestra.run.smithi112.stdout:64424509453 2023-11-08T12:28:23.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-08T12:28:23.366 INFO:teuthology.orchestra.run.smithi112.stdout:68719476748 2023-11-08T12:28:23.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-08T12:28:23.367 INFO:teuthology.orchestra.run.smithi112.stdout:64424509450 2023-11-08T12:28:23.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-08T12:28:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.629+0000 7f94b4a2f700 1 Processor -- start 2023-11-08T12:28:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.629+0000 7f94b4a2f700 1 -- start start 2023-11-08T12:28:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.629+0000 7fabc566f700 1 Processor -- start 2023-11-08T12:28:23.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94b4a2f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94a80514c0 0x7f94a80e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94b4a2f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94a8038980 0x7f94a8038de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94b4a2f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a8039320 con 0x7f94a8036320 2023-11-08T12:28:23.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94b4a2f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a803a460 con 0x7f94a80514c0 2023-11-08T12:28:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94b4a2f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80e5260 con 0x7f94a8038980 2023-11-08T12:28:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.629+0000 7fabc566f700 1 -- start start 2023-11-08T12:28:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabc566f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabb80df6c0 0x7fabb80e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabc566f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fabb8038c50 0x7fabb8037880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabc566f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80e40a0 con 0x7fabb8055600 2023-11-08T12:28:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabc566f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb8050450 con 0x7fabb8038c50 2023-11-08T12:28:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabc566f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb8050a10 con 0x7fabb80df6c0 2023-11-08T12:28:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94affff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94a8038980 0x7f94a8038de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94af7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f94a8036320 0x7f94a8039d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:57696/0 (socket says 172.21.15.112:57696) 2023-11-08T12:28:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94af7fe700 1 -- 172.21.15.112:0/24286931 learned_addr learned my addr 172.21.15.112:0/24286931 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:23.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabb80df6c0 0x7fabb80e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabb80df6c0 0x7fabb80e3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46656/0 (socket says 172.21.15.112:46656) 2023-11-08T12:28:23.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbffff700 1 -- 172.21.15.112:0/1816157287 learned_addr learned my addr 172.21.15.112:0/1816157287 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbf7fe700 1 --2- 172.21.15.112:0/1816157287 >> v2:172.21.15.112:3300/0 conn(0x7fabb8038c50 0x7fabb8037880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94aeffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94a80514c0 0x7f94a80e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f3d362fa700 1 Processor -- start 2023-11-08T12:28:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbf7fe700 1 -- 172.21.15.112:0/1816157287 >> v2:172.21.15.133:3300/0 conn(0x7fabb80df6c0 msgr2=0x7fabb80e3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94ae7fc700 1 -- 172.21.15.112:0/24286931 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810756037 0 0) 0x7f94a8039320 con 0x7f94a8036320 2023-11-08T12:28:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f94ae7fc700 1 -- 172.21.15.112:0/24286931 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a00035d0 con 0x7f94a8036320 2023-11-08T12:28:23.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbf7fe700 1 --2- 172.21.15.112:0/1816157287 >> v2:172.21.15.133:3300/0 conn(0x7fabb80df6c0 0x7fabb80e3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbf7fe700 1 -- 172.21.15.112:0/1816157287 >> v1:172.21.15.133:6789/0 conn(0x7fabb8055600 legacy=0x7fabb8053c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7fabbf7fe700 1 -- 172.21.15.112:0/1816157287 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8051fb0 con 0x7fabb8038c50 2023-11-08T12:28:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.633+0000 7f3d362fa700 1 -- start start 2023-11-08T12:28:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94affff700 1 -- 172.21.15.112:0/24286931 >> v2:172.21.15.112:3300/0 conn(0x7f94a80514c0 msgr2=0x7f94a80e4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94affff700 1 --2- 172.21.15.112:0/24286931 >> v2:172.21.15.112:3300/0 conn(0x7f94a80514c0 0x7f94a80e4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94affff700 1 -- 172.21.15.112:0/24286931 >> v1:172.21.15.133:6789/0 conn(0x7f94a8036320 legacy=0x7f94a8039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94affff700 1 -- 172.21.15.112:0/24286931 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8053500 con 0x7f94a8038980 2023-11-08T12:28:23.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabbf7fe700 1 --2- 172.21.15.112:0/1816157287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb8038c50 0x7fabb8037880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fabb80534f0 tx=0x7fabac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d7795793623871 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d362fa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d3006cb00 0x7f3d30070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d362fa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3006a450 con 0x7f3d300cee60 2023-11-08T12:28:23.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94affff700 1 --2- 172.21.15.112:0/24286931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a8038980 0x7f94a8038de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f94b0066a20 tx=0x7f94b004e8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24f0d214e91de09d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabbeffd700 1 -- 172.21.15.112:0/1816157287 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011830 con 0x7fabb8038c50 2023-11-08T12:28:23.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabbeffd700 1 -- 172.21.15.112:0/1816157287 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac011990 con 0x7fabb8038c50 2023-11-08T12:28:23.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabbeffd700 1 -- 172.21.15.112:0/1816157287 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011d20 con 0x7fabb8038c50 2023-11-08T12:28:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d362fa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d300ccc20 con 0x7f3d300705c0 2023-11-08T12:28:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3d300cee60 0x7f3d300cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36042/0 (socket says 172.21.15.112:36042) 2023-11-08T12:28:23.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2ffff700 1 -- 172.21.15.112:0/1165954163 learned_addr learned my addr 172.21.15.112:0/1165954163 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d362fa700 1 -- 172.21.15.112:0/1165954163 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d30158760 con 0x7f3d3006cb00 2023-11-08T12:28:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94ae7fc700 1 -- 172.21.15.112:0/24286931 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0072c00 con 0x7f94a8038980 2023-11-08T12:28:23.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94ae7fc700 1 -- 172.21.15.112:0/24286931 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0072d80 con 0x7f94a8038980 2023-11-08T12:28:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94ae7fc700 1 -- 172.21.15.112:0/24286931 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0066d80 con 0x7f94a8038980 2023-11-08T12:28:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94b4a2f700 1 -- 172.21.15.112:0/24286931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a8038980 msgr2=0x7f94a8038de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/24286931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a8038980 0x7f94a8038de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f94b0066a20 tx=0x7f94b004e8b0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 -- 172.21.15.112:0/1816157287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb8038c50 msgr2=0x7fabb8037880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 --2- 172.21.15.112:0/1816157287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb8038c50 0x7fabb8037880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fabb80534f0 tx=0x7fabac009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:23.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 -- 172.21.15.112:0/1816157287 shutdown_connections 2023-11-08T12:28:23.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 --2- 172.21.15.112:0/1816157287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb8038c50 0x7fabb8037880 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 --2- 172.21.15.112:0/1816157287 >> v2:172.21.15.133:3300/0 conn(0x7fabb80df6c0 0x7fabb80e3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 -- 172.21.15.112:0/1816157287 >> 172.21.15.112:0/1816157287 conn(0x7fabb8052880 msgr2=0x7fabb8052c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fa08e1d2700 1 Processor -- start 2023-11-08T12:28:23.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fa08e1d2700 1 -- start start 2023-11-08T12:28:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380430657 0 0) 0x7f3d3006a450 con 0x7f3d300cee60 2023-11-08T12:28:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d180035d0 con 0x7f3d300cee60 2023-11-08T12:28:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247469636 0 0) 0x7f3d300ccc20 con 0x7f3d300705c0 2023-11-08T12:28:23.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d3006a450 con 0x7f3d300705c0 2023-11-08T12:28:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2f7fe700 1 --2- 172.21.15.112:0/1165954163 >> v2:172.21.15.133:3300/0 conn(0x7f3d3006cb00 0x7f3d30070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f6ebab4f700 1 Processor -- start 2023-11-08T12:28:23.653 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f6ebab4f700 1 -- start start 2023-11-08T12:28:23.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 -- 172.21.15.112:0/1816157287 shutdown_connections 2023-11-08T12:28:23.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1380105611 0 0) 0x7f3d180035d0 con 0x7f3d300cee60 2023-11-08T12:28:23.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7fabc566f700 1 -- 172.21.15.112:0/1816157287 wait complete. 2023-11-08T12:28:23.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 >> v2:172.21.15.133:3300/0 conn(0x7f3d3006cb00 msgr2=0x7f3d30070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 --2- 172.21.15.112:0/1165954163 >> v2:172.21.15.133:3300/0 conn(0x7f3d3006cb00 0x7f3d30070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.637+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 >> v1:172.21.15.133:6789/0 conn(0x7f3d300705c0 legacy=0x7f3d3006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d30069e00 con 0x7f3d300cee60 2023-11-08T12:28:23.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f3d20001670 con 0x7f3d300cee60 2023-11-08T12:28:23.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 >> v1:172.21.15.112:6789/0 conn(0x7f3d300cee60 legacy=0x7f3d300cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d18004cb0 0x7f3d180050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18003810 0x7f3d18003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d18004230 0x7f3d1800fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f94b4a2f700 1 -- 172.21.15.112:0/24286931 shutdown_connections 2023-11-08T12:28:23.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/24286931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a8038980 0x7f94a8038de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/24286931 >> v2:172.21.15.112:3300/0 conn(0x7f94a80514c0 0x7f94a80e4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f94b4a2f700 1 -- 172.21.15.112:0/24286931 >> 172.21.15.112:0/24286931 conn(0x7f94a8057b90 msgr2=0x7f94a8053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180105b0 con 0x7f3d18004230 2023-11-08T12:28:23.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18010720 con 0x7f3d18004cb0 2023-11-08T12:28:23.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180108e0 con 0x7f3d18003810 2023-11-08T12:28:23.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f94b4a2f700 1 -- 172.21.15.112:0/24286931 shutdown_connections 2023-11-08T12:28:23.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f94b4a2f700 1 -- 172.21.15.112:0/24286931 wait complete. 2023-11-08T12:28:23.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d18004230 0x7f3d1800fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2ffff700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d18004cb0 0x7f3d180050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6ebab4f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6eb41605b0 0x7f6eb40cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6ebab4f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb406b0d0 con 0x7f6eb4156790 2023-11-08T12:28:23.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6ebab4f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb406b560 con 0x7f6eb4156b60 2023-11-08T12:28:23.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6ebab4f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40cc990 con 0x7f6eb41605b0 2023-11-08T12:28:23.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6eb90ec700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6eb41605b0 0x7f6eb40cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6eb90ec700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6eb41605b0 0x7f6eb40cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35024/0 (socket says 172.21.15.112:35024) 2023-11-08T12:28:23.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6eb90ec700 1 -- 172.21.15.112:0/3216114409 learned_addr learned my addr 172.21.15.112:0/3216114409 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa08e1d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa088070130 0x7fa088070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa08e1d2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0880cc700 0x7fa08815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa08e1d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08815bca0 con 0x7fa0880cc290 2023-11-08T12:28:23.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa08e1d2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08806a5c0 con 0x7fa0880cc700 2023-11-08T12:28:23.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa08e1d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa088070a40 con 0x7fa088070130 2023-11-08T12:28:23.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fabc566f700 1 Processor -- start 2023-11-08T12:28:23.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0880cc700 0x7fa08815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0880cc700 0x7fa08815c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35032/0 (socket says 172.21.15.112:35032) 2023-11-08T12:28:23.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 -- 172.21.15.112:0/2508507138 learned_addr learned my addr 172.21.15.112:0/2508507138 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 -- 172.21.15.112:0/1165954163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18003810 msgr2=0x7f3d18003c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-08T12:28:23.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18003810 0x7f3d18003c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 -- 172.21.15.112:0/1165954163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d18004cb0 msgr2=0x7f3d180050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d18004cb0 0x7f3d180050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 -- 172.21.15.112:0/1165954163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180035d0 con 0x7f3d18004230 2023-11-08T12:28:23.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 -- 172.21.15.112:0/1165954163 reap_dead start 2023-11-08T12:28:23.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fabc566f700 1 -- start start 2023-11-08T12:28:23.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d34897700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d18004230 0x7f3d1800fe40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c240 tx=0x7f3d180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c9478421caf4f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6eb90ec700 1 -- 172.21.15.112:0/3216114409 >> v1:172.21.15.133:6789/0 conn(0x7f6eb4156b60 legacy=0x7f6eb4164220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T12:28:23.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 -- 172.21.15.112:0/2508507138 >> v2:172.21.15.133:3300/0 conn(0x7fa088070130 msgr2=0x7fa088070500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T12:28:23.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 --2- 172.21.15.112:0/2508507138 >> v2:172.21.15.133:3300/0 conn(0x7fa088070130 0x7fa088070500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 -- 172.21.15.112:0/2508507138 >> v1:172.21.15.133:6789/0 conn(0x7fa0880cc290 legacy=0x7fa08815beb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T12:28:23.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 -- 172.21.15.112:0/2508507138 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088069c90 con 0x7fa0880cc700 2023-11-08T12:28:23.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6eb90ec700 1 -- 172.21.15.112:0/3216114409 >> v1:172.21.15.112:6789/0 conn(0x7f6eb4156790 legacy=0x7f6eb415fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f6eb90ec700 1 -- 172.21.15.112:0/3216114409 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb406a7a0 con 0x7f6eb41605b0 2023-11-08T12:28:23.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28001e70 con 0x7f3d18004230 2023-11-08T12:28:23.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7fa087fff700 1 --2- 172.21.15.112:0/2508507138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc700 0x7fa08815c5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa088071830 tx=0x7fa070009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9e945ae9c434a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.641+0000 7f94b4a2f700 1 Processor -- start 2023-11-08T12:28:23.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc566f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fabb8055600 0x7fabb804bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc566f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabb80df6c0 0x7fabb804c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc566f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb80d7260 0x7fabb80dad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc566f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb80db240 con 0x7fabb80d7260 2023-11-08T12:28:23.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc566f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb804ac10 con 0x7fabb80df6c0 2023-11-08T12:28:23.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc566f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb804aef0 con 0x7fabb8055600 2023-11-08T12:28:23.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800ce00 con 0x7f3d18004230 2023-11-08T12:28:23.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f158b091700 1 Processor -- start 2023-11-08T12:28:23.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabbf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabb80df6c0 0x7fabb804c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabbf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabb80df6c0 0x7fabb804c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46702/0 (socket says 172.21.15.112:46702) 2023-11-08T12:28:23.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabbf7fe700 1 -- 172.21.15.112:0/1431110171 learned_addr learned my addr 172.21.15.112:0/1431110171 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabbffff700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fabb8055600 0x7fabb804bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d2effd700 1 -- 172.21.15.112:0/1165954163 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28003c60 con 0x7f3d18004230 2023-11-08T12:28:23.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94b4a2f700 1 -- start start 2023-11-08T12:28:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc4e6e700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb80d7260 0x7fabb80dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa0867fc700 1 -- 172.21.15.112:0/2508507138 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070004230 con 0x7fa0880cc700 2023-11-08T12:28:23.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa0867fc700 1 -- 172.21.15.112:0/2508507138 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070004390 con 0x7fa0880cc700 2023-11-08T12:28:23.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa0867fc700 1 -- 172.21.15.112:0/2508507138 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000f740 con 0x7fa0880cc700 2023-11-08T12:28:23.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f32bf97f700 1 Processor -- start 2023-11-08T12:28:23.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d362fa700 1 -- 172.21.15.112:0/1165954163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d18004230 msgr2=0x7f3d1800fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d362fa700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d18004230 0x7f3d1800fe40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c240 tx=0x7f3d180058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d362fa700 1 -- 172.21.15.112:0/1165954163 shutdown_connections 2023-11-08T12:28:23.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d362fa700 1 --2- 172.21.15.112:0/1165954163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d18004230 0x7f3d1800fe40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d362fa700 1 -- 172.21.15.112:0/1165954163 >> 172.21.15.112:0/1165954163 conn(0x7f3d300b0f90 msgr2=0x7f3d300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94b4a2f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94a8036320 0x7f94a80e36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94b4a2f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94a8038980 0x7f94a80dc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94b4a2f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a80514c0 0x7f94a8036910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94b4a2f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80e3be0 con 0x7f94a8038980 2023-11-08T12:28:23.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94b4a2f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a804df40 con 0x7f94a80514c0 2023-11-08T12:28:23.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94b4a2f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a804e190 con 0x7f94a8036320 2023-11-08T12:28:23.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc4e6e700 1 -- 172.21.15.112:0/1431110171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fabb8055600 msgr2=0x7fabb804bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 -- 172.21.15.112:0/2508507138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc700 msgr2=0x7fa08815c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 --2- 172.21.15.112:0/2508507138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc700 0x7fa08815c5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa088071830 tx=0x7fa070009f90 comp rx=0 tx=0).stop 2023-11-08T12:28:23.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f158b091700 1 -- start start 2023-11-08T12:28:23.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc4e6e700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fabb8055600 0x7fabb804bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc4e6e700 1 -- 172.21.15.112:0/1431110171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabb80df6c0 msgr2=0x7fabb804c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc4e6e700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabb80df6c0 0x7fabb804c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94a8036320 0x7f94a80e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94a8036320 0x7f94a80e36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54276/0 (socket says 172.21.15.112:54276) 2023-11-08T12:28:23.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 -- 172.21.15.112:0/1695978668 learned_addr learned my addr 172.21.15.112:0/1695978668 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc4e6e700 1 -- 172.21.15.112:0/1431110171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac0094b0 con 0x7fabb80d7260 2023-11-08T12:28:23.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d362fa700 1 -- 172.21.15.112:0/1165954163 shutdown_connections 2023-11-08T12:28:23.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f32bf97f700 1 -- start start 2023-11-08T12:28:23.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94affff700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a80514c0 0x7f94a8036910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 -- 172.21.15.112:0/2508507138 shutdown_connections 2023-11-08T12:28:23.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 --2- 172.21.15.112:0/2508507138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc700 0x7fa08815c5c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 --2- 172.21.15.112:0/2508507138 >> v2:172.21.15.133:3300/0 conn(0x7fa088070130 0x7fa088070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 -- 172.21.15.112:0/2508507138 >> 172.21.15.112:0/2508507138 conn(0x7fa0880ce6c0 msgr2=0x7fa0880cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f6eb90ec700 1 --2- 172.21.15.112:0/3216114409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41605b0 0x7f6eb40cc290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009e50 tx=0x7f6eac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93230caf77a1dbb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f158b091700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15840ad780 0x7f15840b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f3d362fa700 1 -- 172.21.15.112:0/1165954163 wait complete. 2023-11-08T12:28:23.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f158b091700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f158406d3b0 0x7f15840c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 -- 172.21.15.112:0/2508507138 shutdown_connections 2023-11-08T12:28:23.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fa08e1d2700 1 -- 172.21.15.112:0/2508507138 wait complete. 2023-11-08T12:28:23.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f158b091700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f15840c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94aeffd700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94a8038980 0x7f94a80dc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f6eb37fe700 1 -- 172.21.15.112:0/3216114409 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00e070 con 0x7f6eb41605b0 2023-11-08T12:28:23.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f1583fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f158406d3b0 0x7f15840c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f1583fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f158406d3b0 0x7f15840c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46706/0 (socket says 172.21.15.112:46706) 2023-11-08T12:28:23.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f1588e2d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15840ad780 0x7f15840b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f158b091700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840cc390 con 0x7f15840ad780 2023-11-08T12:28:23.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f1588e2d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15840ad780 0x7f15840b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35050/0 (socket says 172.21.15.112:35050) 2023-11-08T12:28:23.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f1588e2d700 1 -- 172.21.15.112:0/3896928355 learned_addr learned my addr 172.21.15.112:0/3896928355 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7fabc4e6e700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb80d7260 0x7fabb80dad00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fabc004f8c0 tx=0x7fabc0061780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f158b091700 1 -- 172.21.15.112:0/3896928355 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840ccbf0 con 0x7f158406d3b0 2023-11-08T12:28:23.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 -- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a80514c0 msgr2=0x7f94a8036910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a80514c0 0x7f94a8036910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 -- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94a8038980 msgr2=0x7f94a80dc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f158b091700 1 -- 172.21.15.112:0/3896928355 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1584165140 con 0x7f158406d900 2023-11-08T12:28:23.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94a8038980 0x7f94a80dc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.645+0000 7f94af7fe700 1 -- 172.21.15.112:0/1695978668 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b004e720 con 0x7f94a8036320 2023-11-08T12:28:23.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6eb37fe700 1 -- 172.21.15.112:0/3216114409 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac003a40 con 0x7f6eb41605b0 2023-11-08T12:28:23.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6eb37fe700 1 -- 172.21.15.112:0/3216114409 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac003df0 con 0x7f6eb41605b0 2023-11-08T12:28:23.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bf97f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32b8163cb0 0x7f32b8164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f158962e700 1 --2- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f15840c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f94aeffd700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94a8038980 0x7f94a80dc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:23.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f94affff700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a80514c0 0x7f94a8036910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:23.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f1583fff700 1 -- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 msgr2=0x7f15840c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f1583fff700 1 --2- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f15840c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f1583fff700 1 -- 172.21.15.112:0/3896928355 >> v2:172.21.15.112:3300/0 conn(0x7f15840ad780 msgr2=0x7f15840b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f1583fff700 1 --2- 172.21.15.112:0/3896928355 >> v2:172.21.15.112:3300/0 conn(0x7f15840ad780 0x7f15840b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f1583fff700 1 -- 172.21.15.112:0/3896928355 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840cc5a0 con 0x7f158406d3b0 2023-11-08T12:28:23.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bf97f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32b806d4c0 0x7f32b806a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fd722392700 1 Processor -- start 2023-11-08T12:28:23.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fd722392700 1 -- start start 2023-11-08T12:28:23.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f1583fff700 1 --2- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f15840c1460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f158406fe70 tx=0x7f1570009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc4e07525c5023b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6ebab4f700 1 -- 172.21.15.112:0/3216114409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41605b0 msgr2=0x7f6eb40cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f3d362fa700 1 Processor -- start 2023-11-08T12:28:23.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bf97f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b8164080 con 0x7f32b80cdfb0 2023-11-08T12:28:23.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bf97f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80cc290 con 0x7f32b8163cb0 2023-11-08T12:28:23.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bf97f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b8069bf0 con 0x7f32b806d4c0 2023-11-08T12:28:23.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/3216114409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41605b0 0x7f6eb40cc290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009e50 tx=0x7f6eac00b330 comp rx=0 tx=0).stop 2023-11-08T12:28:23.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fabbcff9700 1 -- 172.21.15.112:0/1431110171 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0073070 con 0x7fabb80d7260 2023-11-08T12:28:23.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fabbcff9700 1 -- 172.21.15.112:0/1431110171 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc00731f0 con 0x7fabb80d7260 2023-11-08T12:28:23.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fabbcff9700 1 -- 172.21.15.112:0/1431110171 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00735a0 con 0x7fabb80d7260 2023-11-08T12:28:23.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bcf1a700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f32b80cdfb0 0x7f32b806cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36068/0 (socket says 172.21.15.112:36068) 2023-11-08T12:28:23.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb8052250 con 0x7fabb80d7260 2023-11-08T12:28:23.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bcf1a700 1 -- 172.21.15.112:0/3678928373 learned_addr learned my addr 172.21.15.112:0/3678928373 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:23.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb80dfa90 con 0x7fabb80d7260 2023-11-08T12:28:23.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bdf1c700 1 --2- 172.21.15.112:0/3678928373 >> v2:172.21.15.133:3300/0 conn(0x7f32b806d4c0 0x7f32b806a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f3d362fa700 1 -- start start 2023-11-08T12:28:23.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fa08e1d2700 1 Processor -- start 2023-11-08T12:28:23.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6ebab4f700 1 -- 172.21.15.112:0/3216114409 shutdown_connections 2023-11-08T12:28:23.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/3216114409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb41605b0 0x7f6eb40cc290 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6ebab4f700 1 -- 172.21.15.112:0/3216114409 >> 172.21.15.112:0/3216114409 conn(0x7f6eb40cf350 msgr2=0x7f6eb40b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f94af7fe700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94a8036320 0x7f94a80e36a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c550 tx=0x7f94a400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fa08e1d2700 1 -- start start 2023-11-08T12:28:23.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bd71b700 1 --2- 172.21.15.112:0/3678928373 >> v2:172.21.15.112:3300/0 conn(0x7f32b8163cb0 0x7f32b8164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb8052530 con 0x7fabb80d7260 2023-11-08T12:28:23.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bd71b700 1 -- 172.21.15.112:0/3678928373 >> v2:172.21.15.133:3300/0 conn(0x7f32b806d4c0 msgr2=0x7f32b806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bd71b700 1 --2- 172.21.15.112:0/3678928373 >> v2:172.21.15.133:3300/0 conn(0x7f32b806d4c0 0x7f32b806a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bd71b700 1 -- 172.21.15.112:0/3678928373 >> v1:172.21.15.112:6789/0 conn(0x7f32b80cdfb0 legacy=0x7f32b806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bd71b700 1 -- 172.21.15.112:0/3678928373 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b81651f0 con 0x7f32b8163cb0 2023-11-08T12:28:23.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f15837fe700 1 -- 172.21.15.112:0/3896928355 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570011830 con 0x7f158406d3b0 2023-11-08T12:28:23.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f15837fe700 1 -- 172.21.15.112:0/3896928355 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1570011990 con 0x7f158406d3b0 2023-11-08T12:28:23.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f15837fe700 1 -- 172.21.15.112:0/3896928355 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570011d20 con 0x7f158406d3b0 2023-11-08T12:28:23.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fd722392700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd71c163cb0 0x7fd71c164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fd722392700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c164080 con 0x7fd71c06d4c0 2023-11-08T12:28:23.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fd722392700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c069bf0 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7fd722392700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c0cc290 con 0x7fd71c163cb0 2023-11-08T12:28:23.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f3d362fa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18004230 0x7f3d3015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f3d362fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d300b2c00 0x7f3d300b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f32bd71b700 1 --2- 172.21.15.112:0/3678928373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b8163cb0 0x7f32b8164cb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f32b806d890 tx=0x7f32b4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe0e6a3cd0a005a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fabbcff9700 1 -- 172.21.15.112:0/1431110171 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fabc0092470 con 0x7fabb80d7260 2023-11-08T12:28:23.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d362fa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d3014f310 0x7f3d3014f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 -- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 msgr2=0x7f15840c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 --2- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f15840c1460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f158406fe70 tx=0x7f1570009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:23.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.649+0000 7f6ebab4f700 1 -- 172.21.15.112:0/3216114409 shutdown_connections 2023-11-08T12:28:23.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f6ebab4f700 1 -- 172.21.15.112:0/3216114409 wait complete. 2023-11-08T12:28:23.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd71c163cb0 0x7fd71c164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd71c163cb0 0x7fd71c164cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35066/0 (socket says 172.21.15.112:35066) 2023-11-08T12:28:23.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71bfff700 1 -- 172.21.15.112:0/1368619719 learned_addr learned my addr 172.21.15.112:0/1368619719 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71b7fe700 1 --1- 172.21.15.112:0/1368619719 >> v1:172.21.15.133:6789/0 conn(0x7fd71c0cdfb0 0x7fd71c06cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:57716/0 (socket says 172.21.15.112:57716) 2023-11-08T12:28:23.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa08e1d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa088070130 0x7fa0880c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f949bfff700 1 -- 172.21.15.112:0/1695978668 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4004ca0 con 0x7f94a8036320 2023-11-08T12:28:23.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f949bfff700 1 -- 172.21.15.112:0/1695978668 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4004e00 con 0x7f94a8036320 2023-11-08T12:28:23.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f949bfff700 1 -- 172.21.15.112:0/1695978668 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4007310 con 0x7f94a8036320 2023-11-08T12:28:23.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18004230 0x7f3d3015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18004230 0x7f3d3015c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54296/0 (socket says 172.21.15.112:54296) 2023-11-08T12:28:23.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a8054b70 con 0x7f94a8036320 2023-11-08T12:28:23.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a8051950 con 0x7f94a8036320 2023-11-08T12:28:23.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa08e1d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc290 0x7fa088152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d300b2c00 0x7f3d300b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d300b2c00 0x7f3d300b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35078/0 (socket says 172.21.15.112:35078) 2023-11-08T12:28:23.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2ffff700 1 -- 172.21.15.112:0/3193404072 learned_addr learned my addr 172.21.15.112:0/3193404072 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3014fcc0 con 0x7f3d300b2c00 2023-11-08T12:28:23.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa0877fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa088070130 0x7fa0880c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa08e1d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0880cc700 0x7fa0880bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa0877fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa088070130 0x7fa0880c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:46726/0 (socket says 172.21.15.112:46726) 2023-11-08T12:28:23.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71affd700 1 -- 172.21.15.112:0/1368619719 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191763751 0 0) 0x7fd71c069bf0 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71affd700 1 -- 172.21.15.112:0/1368619719 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7080035d0 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71bfff700 1 -- 172.21.15.112:0/1368619719 >> v1:172.21.15.133:6789/0 conn(0x7fd71c0cdfb0 legacy=0x7fd71c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71bfff700 1 -- 172.21.15.112:0/1368619719 >> v1:172.21.15.112:6789/0 conn(0x7fd71c06d4c0 legacy=0x7fd71c06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:23.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71bfff700 1 -- 172.21.15.112:0/1368619719 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c1651f0 con 0x7fd71c163cb0 2023-11-08T12:28:23.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa0877fe700 1 -- 172.21.15.112:0/460870164 learned_addr learned my addr 172.21.15.112:0/460870164 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30151a20 con 0x7f3d3014f310 2023-11-08T12:28:23.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa08e1d2700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880b35a0 con 0x7fa0880cc290 2023-11-08T12:28:23.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30151180 con 0x7f3d18004230 2023-11-08T12:28:23.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa08e1d2700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088152540 con 0x7fa088070130 2023-11-08T12:28:23.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa08e1d2700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa088152770 con 0x7fa0880cc700 2023-11-08T12:28:23.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d34897700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d3014f310 0x7f3d3014f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa087fff700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0880cc700 0x7fa0880bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32affff700 1 -- 172.21.15.112:0/3678928373 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4004230 con 0x7f32b8163cb0 2023-11-08T12:28:23.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 -- 172.21.15.112:0/3896928355 shutdown_connections 2023-11-08T12:28:23.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 --2- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f15840c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 --2- 172.21.15.112:0/3896928355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f15840c1460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 --2- 172.21.15.112:0/3896928355 >> v2:172.21.15.112:3300/0 conn(0x7f15840ad780 0x7f15840b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 -- 172.21.15.112:0/3896928355 >> 172.21.15.112:0/3896928355 conn(0x7f15840ce490 msgr2=0x7f15840ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9490005310 con 0x7f94a8036320 2023-11-08T12:28:23.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32affff700 1 -- 172.21.15.112:0/3678928373 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4004390 con 0x7f32b8163cb0 2023-11-08T12:28:23.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32affff700 1 -- 172.21.15.112:0/3678928373 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40036c0 con 0x7f32b8163cb0 2023-11-08T12:28:23.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d34897700 1 -- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18004230 msgr2=0x7f3d3015c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d34897700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18004230 0x7f3d3015c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d34897700 1 -- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d300b2c00 msgr2=0x7f3d300b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d34897700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d300b2c00 0x7f3d300b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d34897700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300c8da0 con 0x7f3d3014f310 2023-11-08T12:28:23.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa087fff700 1 -- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa088070130 msgr2=0x7fa0880c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa087fff700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa088070130 0x7fa0880c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa087fff700 1 -- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc290 msgr2=0x7fa088152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa087fff700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc290 0x7fa088152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa087fff700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070009e00 con 0x7fa0880cc700 2023-11-08T12:28:23.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32bf97f700 1 -- 172.21.15.112:0/3678928373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b8163cb0 msgr2=0x7f32b8164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3678928373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b8163cb0 0x7f32b8164cb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f32b806d890 tx=0x7f32b4009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:23.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fa087fff700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0880cc700 0x7fa0880bfe50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa070017000 tx=0x7fa070004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d34897700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d3014f310 0x7f3d3014f780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d3006fd00 tx=0x7f3d28001580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f6ebab4f700 1 Processor -- start 2023-11-08T12:28:23.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 -- 172.21.15.112:0/3896928355 shutdown_connections 2023-11-08T12:28:23.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fabbcff9700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faba4064f60 0x7faba4067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f6ebab4f700 1 -- start start 2023-11-08T12:28:23.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f158b091700 1 -- 172.21.15.112:0/3896928355 wait complete. 2023-11-08T12:28:23.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fabbcff9700 1 -- 172.21.15.112:0/1431110171 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabc0072040 con 0x7fabb80d7260 2023-11-08T12:28:23.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2cff9700 1 -- 172.21.15.112:0/3193404072 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28005070 con 0x7f3d3014f310 2023-11-08T12:28:23.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7fd71bfff700 1 --2- 172.21.15.112:0/1368619719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c163cb0 0x7fd71c164cb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009e50 tx=0x7fd70c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435df3248c9541c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32bf97f700 1 -- 172.21.15.112:0/3678928373 shutdown_connections 2023-11-08T12:28:23.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3678928373 >> v2:172.21.15.133:3300/0 conn(0x7f32b806d4c0 0x7f32b806a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3678928373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b8163cb0 0x7f32b8164cb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f32bf97f700 1 -- 172.21.15.112:0/3678928373 >> 172.21.15.112:0/3678928373 conn(0x7f32b80cf350 msgr2=0x7f32b80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3006a0e0 con 0x7f3d3014f310 2023-11-08T12:28:23.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d300c8f30 con 0x7f3d3014f310 2023-11-08T12:28:23.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2cff9700 1 -- 172.21.15.112:0/3193404072 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d280051d0 con 0x7f3d3014f310 2023-11-08T12:28:23.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.653+0000 7f3d2cff9700 1 -- 172.21.15.112:0/3193404072 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28005580 con 0x7f3d3014f310 2023-11-08T12:28:23.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f949bfff700 1 -- 172.21.15.112:0/1695978668 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f94a401a020 con 0x7f94a8036320 2023-11-08T12:28:23.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7fabbffff700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faba4064f60 0x7faba4067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6ebab4f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6eb4156790 0x7f6eb4155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6ebab4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb4156b60 0x7f6eb40c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6ebab4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6eb41605b0 0x7f6eb40c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6ebab4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41f1840 con 0x7f6eb4156b60 2023-11-08T12:28:23.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6ebab4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40ae0f0 con 0x7f6eb41605b0 2023-11-08T12:28:23.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6ebab4f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4156330 con 0x7f6eb4156790 2023-11-08T12:28:23.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6eb4156790 0x7f6eb4155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d30073cb0 con 0x7f3d3014f310 2023-11-08T12:28:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6eb4156790 0x7f6eb4155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54314/0 (socket says 172.21.15.112:54314) 2023-11-08T12:28:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 -- 172.21.15.112:0/2017124134 learned_addr learned my addr 172.21.15.112:0/2017124134 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb90ec700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6eb41605b0 0x7f6eb40c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb3fff700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb4156b60 0x7f6eb40c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7fabbffff700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faba4064f60 0x7faba4067410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006d70 tx=0x7fabb40092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f32bf97f700 1 -- 172.21.15.112:0/3678928373 shutdown_connections 2023-11-08T12:28:23.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 -- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6eb41605b0 msgr2=0x7f6eb40c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6eb41605b0 0x7f6eb40c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 -- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb4156b60 msgr2=0x7f6eb40c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb4156b60 0x7f6eb40c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f6eb88eb700 1 -- 172.21.15.112:0/2017124134 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009b30 con 0x7f6eb4156790 2023-11-08T12:28:23.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f158b091700 1 Processor -- start 2023-11-08T12:28:23.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f949bfff700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9494064fb0 0x7f9494067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f949bfff700 1 -- 172.21.15.112:0/1695978668 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94a4082010 con 0x7f94a8036320 2023-11-08T12:28:23.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f94aeffd700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9494064fb0 0x7f9494067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f3d2cff9700 1 -- 172.21.15.112:0/3193404072 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3d28010050 con 0x7f3d3014f310 2023-11-08T12:28:23.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f3d2cff9700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d1c064f10 0x7f3d1c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f158b091700 1 -- start start 2023-11-08T12:28:23.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f158b091700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f158415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f158b091700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f158415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f158b091700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15840ad780 0x7f15840ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f158b091700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840c9b70 con 0x7f15840ad780 2023-11-08T12:28:23.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f6eb88eb700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6eb4156790 0x7f6eb4155df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000c4e0 tx=0x7f6ea000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f158b091700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158415dfc0 con 0x7f158406d3b0 2023-11-08T12:28:23.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f158b091700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15840c9de0 con 0x7f158406d900 2023-11-08T12:28:23.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f94aeffd700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9494064fb0 0x7f9494067460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94a80374b0 tx=0x7f949c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f3d2cff9700 1 -- 172.21.15.112:0/3193404072 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3d28083f40 con 0x7f3d3014f310 2023-11-08T12:28:23.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f3d2ffff700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d1c064f10 0x7f3d1c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1588e2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f158415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f158415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.657+0000 7f32bf97f700 1 -- 172.21.15.112:0/3678928373 wait complete. 2023-11-08T12:28:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f158415da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:54324/0 (socket says 172.21.15.112:54324) 2023-11-08T12:28:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 -- 172.21.15.112:0/2064802454 learned_addr learned my addr 172.21.15.112:0/2064802454 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 Processor -- start 2023-11-08T12:28:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 -- start start 2023-11-08T12:28:23.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f3d2ffff700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d1c064f10 0x7f3d1c0673c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d20001050 tx=0x7f3d20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 -- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 msgr2=0x7f158415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f158415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 -- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15840ad780 msgr2=0x7f15840ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15840ad780 0x7f15840ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 -- 172.21.15.112:0/2064802454 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700094b0 con 0x7f158406d900 2023-11-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1588e2d700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f158415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f1583fff700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f158415da80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f15700090b0 tx=0x7f1570004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b806d4c0 0x7f32b81fe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b80cdfb0 0x7f32b80b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b8163cb0 0x7f32b80ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b1620 con 0x7f32b80cdfb0 2023-11-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b1900 con 0x7f32b8163cb0 2023-11-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bf97f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b1be0 con 0x7f32b806d4c0 2023-11-08T12:28:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b80cdfb0 0x7f32b80b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b80cdfb0 0x7f32b80b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35104/0 (socket says 172.21.15.112:35104) 2023-11-08T12:28:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 -- 172.21.15.112:0/3561211952 learned_addr learned my addr 172.21.15.112:0/3561211952 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bdf1c700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b8163cb0 0x7f32b80ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bd71b700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b806d4c0 0x7f32b81fe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 -- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b806d4c0 msgr2=0x7f32b81fe1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b806d4c0 0x7f32b81fe1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 -- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b8163cb0 msgr2=0x7f32b80ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b8163cb0 0x7f32b80ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 -- 172.21.15.112:0/3561211952 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40094b0 con 0x7f32b80cdfb0 2023-11-08T12:28:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bd71b700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b806d4c0 0x7f32b81fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32bcf1a700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b80cdfb0 0x7f32b80b2b60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c550 tx=0x7f32a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7fd71affd700 1 -- 172.21.15.112:0/1368619719 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00e070 con 0x7fd71c163cb0 2023-11-08T12:28:23.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32adffb700 1 -- 172.21.15.112:0/3561211952 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8005d90 con 0x7f32b80cdfb0 2023-11-08T12:28:23.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fabbcff9700 1 -- 172.21.15.112:0/1431110171 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fabc0100080 con 0x7fabb80d7260 2023-11-08T12:28:23.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.661+0000 7f32adffb700 1 -- 172.21.15.112:0/3561211952 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a80070d0 con 0x7f32b80cdfb0 2023-11-08T12:28:23.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f32adffb700 1 -- 172.21.15.112:0/3561211952 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8007480 con 0x7f32b80cdfb0 2023-11-08T12:28:23.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b80cc780 con 0x7f32b80cdfb0 2023-11-08T12:28:23.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b80cc4a0 con 0x7f32b80cdfb0 2023-11-08T12:28:23.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f949bfff700 1 -- 172.21.15.112:0/1695978668 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f94a404fdf0 con 0x7f94a8036320 2023-11-08T12:28:23.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fa077fff700 1 -- 172.21.15.112:0/460870164 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070003c30 con 0x7fa0880cc700 2023-11-08T12:28:23.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fa077fff700 1 -- 172.21.15.112:0/460870164 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070003d90 con 0x7fa0880cc700 2023-11-08T12:28:23.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fa077fff700 1 -- 172.21.15.112:0/460870164 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07001f620 con 0x7fa0880cc700 2023-11-08T12:28:23.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fa08e1d2700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08806a250 con 0x7fa0880cc700 2023-11-08T12:28:23.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fa08e1d2700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa088069f70 con 0x7fa0880cc700 2023-11-08T12:28:23.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f6eb17fa700 1 -- 172.21.15.112:0/2017124134 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00052d0 con 0x7f6eb4156790 2023-11-08T12:28:23.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f6eb17fa700 1 -- 172.21.15.112:0/2017124134 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea0005430 con 0x7f6eb4156790 2023-11-08T12:28:23.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f6eb17fa700 1 -- 172.21.15.112:0/2017124134 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00055a0 con 0x7f6eb4156790 2023-11-08T12:28:23.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb406ad60 con 0x7f6eb4156790 2023-11-08T12:28:23.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb406aa80 con 0x7f6eb4156790 2023-11-08T12:28:23.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fd71affd700 1 -- 172.21.15.112:0/1368619719 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c003a40 con 0x7fd71c163cb0 2023-11-08T12:28:23.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f15817fa700 1 -- 172.21.15.112:0/2064802454 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570004590 con 0x7f158406d900 2023-11-08T12:28:23.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f15817fa700 1 -- 172.21.15.112:0/2064802454 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157001e070 con 0x7f158406d900 2023-11-08T12:28:23.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f15817fa700 1 -- 172.21.15.112:0/2064802454 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570003900 con 0x7f158406d900 2023-11-08T12:28:23.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fd722392700 1 -- 172.21.15.112:0/1368619719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c163cb0 msgr2=0x7fd71c164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fd722392700 1 --2- 172.21.15.112:0/1368619719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c163cb0 0x7fd71c164cb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009e50 tx=0x7fd70c00b330 comp rx=0 tx=0).stop 2023-11-08T12:28:23.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b8069e40 con 0x7f32b80cdfb0 2023-11-08T12:28:23.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7f158b091700 1 -- 172.21.15.112:0/2064802454 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584164df0 con 0x7f158406d900 2023-11-08T12:28:23.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08814f720 con 0x7fa0880cc700 2023-11-08T12:28:23.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.665+0000 7fa077fff700 1 -- 172.21.15.112:0/460870164 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa07000e050 con 0x7fa0880cc700 2023-11-08T12:28:23.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f3d2cff9700 1 -- 172.21.15.112:0/3193404072 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3d28051d80 con 0x7f3d3014f310 2023-11-08T12:28:23.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f158b091700 1 -- 172.21.15.112:0/2064802454 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15840cc880 con 0x7f158406d900 2023-11-08T12:28:23.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7fa077fff700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa068064fb0 0x7fa068067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f32adffb700 1 -- 172.21.15.112:0/3561211952 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f32a8019030 con 0x7f32b80cdfb0 2023-11-08T12:28:23.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f32adffb700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f329c064f10 0x7f329c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f32adffb700 1 -- 172.21.15.112:0/3561211952 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32a80816d0 con 0x7f32b80cdfb0 2023-11-08T12:28:23.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7fa077fff700 1 -- 172.21.15.112:0/460870164 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa070013070 con 0x7fa0880cc700 2023-11-08T12:28:23.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f32bd71b700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f329c064f10 0x7f329c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c005310 con 0x7f158406d900 2023-11-08T12:28:23.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7fa0877fe700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa068064fb0 0x7fa068067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f6eb17fa700 1 -- 172.21.15.112:0/2017124134 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6ea0019030 con 0x7f6eb4156790 2023-11-08T12:28:23.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40cdfc0 con 0x7f6eb4156790 2023-11-08T12:28:23.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f15817fa700 1 -- 172.21.15.112:0/2064802454 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f157000f050 con 0x7f158406d900 2023-11-08T12:28:23.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f6eb17fa700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e98064f30 0x7f6e980673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.669+0000 7f6eb17fa700 1 -- 172.21.15.112:0/2017124134 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ea0081370 con 0x7f6eb4156790 2023-11-08T12:28:23.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7fa0877fe700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa068064fb0 0x7fa068067460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0880bfd20 tx=0x7fa08000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7f6eb3fff700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e98064f30 0x7f6e980673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7f15817fa700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1568064f30 0x7f15680673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7f15817fa700 1 -- 172.21.15.112:0/2064802454 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f15700827d0 con 0x7f158406d900 2023-11-08T12:28:23.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7fa077fff700 1 -- 172.21.15.112:0/460870164 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa070051b70 con 0x7fa0880cc700 2023-11-08T12:28:23.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7f6eb3fff700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e98064f30 0x7f6e980673e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40c4d40 tx=0x7f6ea8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7f1588e2d700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1568064f30 0x7f15680673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7f1588e2d700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1568064f30 0x7f15680673e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1578009c40 tx=0x7f1578008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7f32bd71b700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f329c064f10 0x7f329c0673c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009280 tx=0x7f32b4013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7fd722392700 1 -- 172.21.15.112:0/1368619719 shutdown_connections 2023-11-08T12:28:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7fd722392700 1 --2- 172.21.15.112:0/1368619719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c163cb0 0x7fd71c164cb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7fd722392700 1 -- 172.21.15.112:0/1368619719 >> 172.21.15.112:0/1368619719 conn(0x7fd71c0cf350 msgr2=0x7fd71c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7fd722392700 1 -- 172.21.15.112:0/1368619719 shutdown_connections 2023-11-08T12:28:23.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.673+0000 7fd722392700 1 -- 172.21.15.112:0/1368619719 wait complete. 2023-11-08T12:28:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.677+0000 7f6eb17fa700 1 -- 172.21.15.112:0/2017124134 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6ea004f2c0 con 0x7f6eb4156790 2023-11-08T12:28:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.677+0000 7fd722392700 1 Processor -- start 2023-11-08T12:28:23.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.677+0000 7f32adffb700 1 -- 172.21.15.112:0/3561211952 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f32a804f490 con 0x7f32b80cdfb0 2023-11-08T12:28:23.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.677+0000 7fd722392700 1 -- start start 2023-11-08T12:28:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.677+0000 7fd722392700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c06d4c0 0x7fd71c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.677+0000 7fd71bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c06d4c0 0x7fd71c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.677+0000 7fd71bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c06d4c0 0x7fd71c150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35106/0 (socket says 172.21.15.112:35106) 2023-11-08T12:28:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71bfff700 1 -- 172.21.15.112:0/4111575737 learned_addr learned my addr 172.21.15.112:0/4111575737 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:23.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd722392700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd71c0cdfb0 0x7fd71c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd722392700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71c163cb0 0x7fd71c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd722392700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c1537b0 con 0x7fd71c06d4c0 2023-11-08T12:28:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd722392700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c150e30 con 0x7fd71c163cb0 2023-11-08T12:28:23.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd722392700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c151110 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71b7fe700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd71c0cdfb0 0x7fd71c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7f15817fa700 1 -- 172.21.15.112:0/2064802454 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1570050700 con 0x7f158406d900 2023-11-08T12:28:23.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71b7fe700 1 -- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71c163cb0 msgr2=0x7fd71c14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71b7fe700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71c163cb0 0x7fd71c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71b7fe700 1 -- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c06d4c0 msgr2=0x7fd71c150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71b7fe700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c06d4c0 0x7fd71c150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71b7fe700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c009b30 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd71b7fe700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd71c0cdfb0 0x7fd71c153270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c500 tx=0x7fd70400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd718ff9700 1 -- 172.21.15.112:0/4111575737 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704005cd0 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd718ff9700 1 -- 172.21.15.112:0/4111575737 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704005e30 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd718ff9700 1 -- 172.21.15.112:0/4111575737 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704007310 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.681+0000 7fd722392700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c0cc780 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.685+0000 7fd722392700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c0cc4a0 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.689+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c069e40 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.689+0000 7fd718ff9700 1 -- 172.21.15.112:0/4111575737 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd704019030 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.693+0000 7fd718ff9700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd6fc064fb0 0x7fd6fc067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:23.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.693+0000 7fd718ff9700 1 -- 172.21.15.112:0/4111575737 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd704081630 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.693+0000 7fd71bfff700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd6fc064fb0 0x7fd6fc067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.693+0000 7fd71bfff700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd6fc064fb0 0x7fd6fc067460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009440 tx=0x7fd70c009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:23.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.701+0000 7fd718ff9700 1 -- 172.21.15.112:0/4111575737 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd70404f4a0 con 0x7fd71c0cdfb0 2023-11-08T12:28:23.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.981+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9490005890 con 0x7f94a8036320 2023-11-08T12:28:23.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.981+0000 7f949bfff700 1 -- 172.21.15.112:0/1695978668 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94a4053410 con 0x7f94a8036320 2023-11-08T12:28:23.986 INFO:teuthology.orchestra.run.smithi112.stdout:64424509451 2023-11-08T12:28:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.985+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9494064fb0 msgr2=0x7f9494067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.985+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9494064fb0 0x7f9494067460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94a80374b0 tx=0x7f949c008040 comp rx=0 tx=0).stop 2023-11-08T12:28:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.985+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94a8036320 msgr2=0x7f94a80e36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.985+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94a8036320 0x7f94a80e36a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c550 tx=0x7f94a400c910 comp rx=0 tx=0).stop 2023-11-08T12:28:23.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 shutdown_connections 2023-11-08T12:28:23.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9494064fb0 0x7f9494067460 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94a80514c0 0x7f94a8036910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94a8038980 0x7f94a80dc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f94b4a2f700 1 --2- 172.21.15.112:0/1695978668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94a8036320 0x7f94a80e36a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 >> 172.21.15.112:0/1695978668 conn(0x7f94a8057b90 msgr2=0x7f94a8053910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:23.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f32b80726c0 con 0x7f32b80cdfb0 2023-11-08T12:28:23.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa08815bca0 con 0x7fa0880cc700 2023-11-08T12:28:23.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.989+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 shutdown_connections 2023-11-08T12:28:23.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.993+0000 7f94b4a2f700 1 -- 172.21.15.112:0/1695978668 wait complete. 2023-11-08T12:28:23.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.993+0000 7fa077fff700 1 -- 172.21.15.112:0/460870164 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa08815bca0 con 0x7fa0880cc700 2023-11-08T12:28:23.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.993+0000 7f32adffb700 1 -- 172.21.15.112:0/3561211952 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32a8017090 con 0x7f32b80cdfb0 2023-11-08T12:28:23.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.993+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fabb8005530 con 0x7fabb80d7260 2023-11-08T12:28:23.996 INFO:teuthology.orchestra.run.smithi112.stdout:60129542154 2023-11-08T12:28:23.996 INFO:teuthology.orchestra.run.smithi112.stdout:64424509450 2023-11-08T12:28:23.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.993+0000 7fabbcff9700 1 -- 172.21.15.112:0/1431110171 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabc00c9890 con 0x7fabb80d7260 2023-11-08T12:28:23.998 INFO:teuthology.orchestra.run.smithi112.stdout:68719476747 2023-11-08T12:28:23.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3d300c9bd0 con 0x7f3d3014f310 2023-11-08T12:28:23.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa068064fb0 msgr2=0x7fa068067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa068064fb0 0x7fa068067460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0880bfd20 tx=0x7fa08000b040 comp rx=0 tx=0).stop 2023-11-08T12:28:23.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0880cc700 msgr2=0x7fa0880bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:23.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0880cc700 0x7fa0880bfe50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa070017000 tx=0x7fa070004770 comp rx=0 tx=0).stop 2023-11-08T12:28:24.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f329c064f10 msgr2=0x7f329c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f329c064f10 0x7f329c0673c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009280 tx=0x7f32b4013040 comp rx=0 tx=0).stop 2023-11-08T12:28:24.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b80cdfb0 msgr2=0x7f32b80b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b80cdfb0 0x7f32b80b2b60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c550 tx=0x7f32a800c910 comp rx=0 tx=0).stop 2023-11-08T12:28:24.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f3d2cff9700 1 -- 172.21.15.112:0/3193404072 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d280553a0 con 0x7f3d3014f310 2023-11-08T12:28:24.001 INFO:teuthology.orchestra.run.smithi112.stdout:64424509451 2023-11-08T12:28:24.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 shutdown_connections 2023-11-08T12:28:24.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa068064fb0 0x7fa068067460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0880cc700 0x7fa0880bfe50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0880cc290 0x7fa088152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 --2- 172.21.15.112:0/460870164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa088070130 0x7fa0880c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 >> 172.21.15.112:0/460870164 conn(0x7fa0880ce6c0 msgr2=0x7fa08815b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:24.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 shutdown_connections 2023-11-08T12:28:24.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faba4064f60 msgr2=0x7faba4067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faba4064f60 0x7faba4067410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006d70 tx=0x7fabb40092e0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 shutdown_connections 2023-11-08T12:28:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f329c064f10 0x7f329c0673c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b8163cb0 0x7f32b80ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b80cdfb0 0x7f32b80b2b60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 --2- 172.21.15.112:0/3561211952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b806d4c0 0x7f32b81fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 >> 172.21.15.112:0/3561211952 conn(0x7f32b80cf350 msgr2=0x7f32b80ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:24.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fa075ffb700 1 -- 172.21.15.112:0/460870164 wait complete. 2023-11-08T12:28:24.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb80d7260 msgr2=0x7fabb80dad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb80d7260 0x7fabb80dad00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fabc004f8c0 tx=0x7fabc0061780 comp rx=0 tx=0).stop 2023-11-08T12:28:24.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 shutdown_connections 2023-11-08T12:28:24.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faba4064f60 0x7faba4067410 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006d70 tx=0x7fabb40092e0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb80d7260 0x7fabb80dad00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabb80df6c0 0x7fabb804c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 --2- 172.21.15.112:0/1431110171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fabb8055600 0x7fabb804bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 >> 172.21.15.112:0/1431110171 conn(0x7fabb8052880 msgr2=0x7fabb8007c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:24.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 shutdown_connections 2023-11-08T12:28:24.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:23.997+0000 7f32bf97f700 1 -- 172.21.15.112:0/3561211952 wait complete. 2023-11-08T12:28:24.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 shutdown_connections 2023-11-08T12:28:24.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7fabc566f700 1 -- 172.21.15.112:0/1431110171 wait complete. 2023-11-08T12:28:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6eb40726c0 con 0x7f6eb4156790 2023-11-08T12:28:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d1c064f10 msgr2=0x7f3d1c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7f3d362fa700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d1c064f10 0x7f3d1c0673c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d20001050 tx=0x7f3d20009040 comp rx=0 tx=0).stop 2023-11-08T12:28:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d3014f310 msgr2=0x7f3d3014f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7f3d362fa700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d3014f310 0x7f3d3014f780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d3006fd00 tx=0x7f3d28001580 comp rx=0 tx=0).stop 2023-11-08T12:28:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.001+0000 7f6eb17fa700 1 -- 172.21.15.112:0/2017124134 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ea00528e0 con 0x7f6eb4156790 2023-11-08T12:28:24.011 INFO:teuthology.orchestra.run.smithi112.stdout:68719476747 2023-11-08T12:28:24.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f155c0055c0 con 0x7f158406d900 2023-11-08T12:28:24.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 shutdown_connections 2023-11-08T12:28:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f3d362fa700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d1c064f10 0x7f3d1c0673c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f3d362fa700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d3014f310 0x7f3d3014f780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f3d362fa700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d300b2c00 0x7f3d300b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f3d362fa700 1 --2- 172.21.15.112:0/3193404072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d18004230 0x7f3d3015c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 >> 172.21.15.112:0/3193404072 conn(0x7f3d300b0f90 msgr2=0x7f3d300c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.005+0000 7f15817fa700 1 -- 172.21.15.112:0/2064802454 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1570020020 con 0x7f158406d900 2023-11-08T12:28:24.014 INFO:teuthology.orchestra.run.smithi112.stdout:64424509452 2023-11-08T12:28:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1568064f30 msgr2=0x7f15680673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1568064f30 0x7f15680673e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1578009c40 tx=0x7f1578008040 comp rx=0 tx=0).stop 2023-11-08T12:28:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 msgr2=0x7f158415da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f158415da80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f15700090b0 tx=0x7f1570004770 comp rx=0 tx=0).stop 2023-11-08T12:28:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 shutdown_connections 2023-11-08T12:28:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1568064f30 0x7f15680673e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15840ad780 0x7f15840ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f158406d900 0x7f158415da80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 --2- 172.21.15.112:0/2064802454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f158406d3b0 0x7f158415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 >> 172.21.15.112:0/2064802454 conn(0x7f15840ce490 msgr2=0x7f15840ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e98064f30 msgr2=0x7f6e980673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e98064f30 0x7f6e980673e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40c4d40 tx=0x7f6ea8009190 comp rx=0 tx=0).stop 2023-11-08T12:28:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6eb4156790 msgr2=0x7f6eb4155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6eb4156790 0x7f6eb4155df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000c4e0 tx=0x7f6ea000c7f0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 shutdown_connections 2023-11-08T12:28:24.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f156effd700 1 -- 172.21.15.112:0/2064802454 wait complete. 2023-11-08T12:28:24.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 shutdown_connections 2023-11-08T12:28:24.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f3d362fa700 1 -- 172.21.15.112:0/3193404072 wait complete. 2023-11-08T12:28:24.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 shutdown_connections 2023-11-08T12:28:24.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e98064f30 0x7f6e980673e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6eb41605b0 0x7f6eb40c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6eb4156b60 0x7f6eb40c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 --2- 172.21.15.112:0/2017124134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6eb4156790 0x7f6eb4155df0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 >> 172.21.15.112:0/2017124134 conn(0x7f6eb40cf350 msgr2=0x7f6eb406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:24.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 shutdown_connections 2023-11-08T12:28:24.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.009+0000 7f6ebab4f700 1 -- 172.21.15.112:0/2017124134 wait complete. 2023-11-08T12:28:24.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.0 2023-11-08T12:28:24.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.2 2023-11-08T12:28:24.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.025+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd71c151250 con 0x7fd71c0cdfb0 2023-11-08T12:28:24.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.025+0000 7fd718ff9700 1 -- 172.21.15.112:0/4111575737 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd71c151250 con 0x7fd71c0cdfb0 2023-11-08T12:28:24.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2023-11-08T12:28:24.029 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2023-11-08T12:28:24.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd6fc064fb0 msgr2=0x7fd6fc067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd6fc064fb0 0x7fd6fc067460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009440 tx=0x7fd70c009000 comp rx=0 tx=0).stop 2023-11-08T12:28:24.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd71c0cdfb0 msgr2=0x7fd71c153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:24.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd71c0cdfb0 0x7fd71c153270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c500 tx=0x7fd70400c810 comp rx=0 tx=0).stop 2023-11-08T12:28:24.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 shutdown_connections 2023-11-08T12:28:24.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd6fc064fb0 0x7fd6fc067460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd71c163cb0 0x7fd71c14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd71c0cdfb0 0x7fd71c153270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 --2- 172.21.15.112:0/4111575737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd71c06d4c0 0x7fd71c150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:24.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 >> 172.21.15.112:0/4111575737 conn(0x7fd71c0cf350 msgr2=0x7fd71c162330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:24.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 shutdown_connections 2023-11-08T12:28:24.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476747 for osd.4 2023-11-08T12:28:24.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:24.029+0000 7fd7127fc700 1 -- 172.21.15.112:0/4111575737 wait complete. 2023-11-08T12:28:24.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.3 2023-11-08T12:28:24.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2023-11-08T12:28:24.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476747 for osd.6 2023-11-08T12:28:24.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2023-11-08T12:28:25.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-08T12:28:25.028 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-08T12:28:25.030 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-08T12:28:25.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-08T12:28:25.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-08T12:28:25.038 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-08T12:28:25.040 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-08T12:28:25.050 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-08T12:28:25.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.245+0000 7f23d0586700 1 Processor -- start 2023-11-08T12:28:25.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.245+0000 7f23d0586700 1 -- start start 2023-11-08T12:28:25.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.245+0000 7f23d0586700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80d2090 0x7f23c80c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.245+0000 7f23d0586700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23c80c57d0 0x7f23c8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.245+0000 7f23d0586700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c806c600 con 0x7f23c806a340 2023-11-08T12:28:25.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.245+0000 7f23d0586700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80d2460 con 0x7f23c80c57d0 2023-11-08T12:28:25.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.245+0000 7f23d0586700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80d3900 con 0x7f23c80d2090 2023-11-08T12:28:25.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23ce322700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80d2090 0x7f23c80c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cdb21700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23c80c57d0 0x7f23c8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23ceb23700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f23c806a340 0x7f23c80b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:34434/0 (socket says 172.21.15.112:34434) 2023-11-08T12:28:25.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23ce322700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80d2090 0x7f23c80c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51610/0 (socket says 172.21.15.112:51610) 2023-11-08T12:28:25.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23ceb23700 1 -- 172.21.15.112:0/2356902373 learned_addr learned my addr 172.21.15.112:0/2356902373 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:25.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cdb21700 1 -- 172.21.15.112:0/2356902373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80d2090 msgr2=0x7f23c80c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:25.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cdb21700 1 --2- 172.21.15.112:0/2356902373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80d2090 0x7f23c80c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cdb21700 1 -- 172.21.15.112:0/2356902373 >> v1:172.21.15.133:6789/0 conn(0x7f23c806a340 legacy=0x7f23c80b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cdb21700 1 -- 172.21.15.112:0/2356902373 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8071d40 con 0x7f23c80c57d0 2023-11-08T12:28:25.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cdb21700 1 --2- 172.21.15.112:0/2356902373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c8069e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009850 tx=0x7f23c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3df4f57842a1f9c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cd320700 1 -- 172.21.15.112:0/2356902373 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4011830 con 0x7f23c80c57d0 2023-11-08T12:28:25.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cd320700 1 -- 172.21.15.112:0/2356902373 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4011990 con 0x7f23c80c57d0 2023-11-08T12:28:25.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23cd320700 1 -- 172.21.15.112:0/2356902373 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4011d20 con 0x7f23c80c57d0 2023-11-08T12:28:25.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23d0586700 1 -- 172.21.15.112:0/2356902373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 msgr2=0x7f23c8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.249+0000 7f23d0586700 1 --2- 172.21.15.112:0/2356902373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c8069e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009850 tx=0x7f23c4009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:25.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.253+0000 7f23d0586700 1 -- 172.21.15.112:0/2356902373 shutdown_connections 2023-11-08T12:28:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.253+0000 7f23d0586700 1 --2- 172.21.15.112:0/2356902373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c8069e00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.253+0000 7f23d0586700 1 --2- 172.21.15.112:0/2356902373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80d2090 0x7f23c80c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.253+0000 7f23d0586700 1 -- 172.21.15.112:0/2356902373 >> 172.21.15.112:0/2356902373 conn(0x7f23c80b6520 msgr2=0x7f23c8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.253+0000 7f23d0586700 1 -- 172.21.15.112:0/2356902373 shutdown_connections 2023-11-08T12:28:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.253+0000 7f23d0586700 1 -- 172.21.15.112:0/2356902373 wait complete. 2023-11-08T12:28:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 Processor -- start 2023-11-08T12:28:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 Processor -- start 2023-11-08T12:28:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 -- start start 2023-11-08T12:28:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c806a340 0x7f23c80cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c80cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80d2090 0x7f23c80b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80c9c00 con 0x7f23c80d2090 2023-11-08T12:28:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80c9ee0 con 0x7f23c80c57d0 2023-11-08T12:28:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23d0586700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80ca1c0 con 0x7f23c806a340 2023-11-08T12:28:25.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 -- start start 2023-11-08T12:28:25.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9f80383e0 0x7ff9f8006d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23ceb23700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80d2090 0x7f23c80b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23ceb23700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80d2090 0x7f23c80b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56522/0 (socket says 172.21.15.112:56522) 2023-11-08T12:28:25.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23ceb23700 1 -- 172.21.15.112:0/1810797355 learned_addr learned my addr 172.21.15.112:0/1810797355 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f803b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff9f80e6530 0x7ff9f80e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f803c050 con 0x7ff9f80e6530 2023-11-08T12:28:25.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80079e0 con 0x7ff9f80383e0 2023-11-08T12:28:25.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fffff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f803b610 con 0x7ff9f803ac80 2023-11-08T12:28:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23cdb21700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c80cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23ce322700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c806a340 0x7f23c80cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23cdb21700 1 -- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c806a340 msgr2=0x7f23c80cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23cdb21700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c806a340 0x7f23c80cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23cdb21700 1 -- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80d2090 msgr2=0x7f23c80b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23cdb21700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80d2090 0x7f23c80b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23cdb21700 1 -- 172.21.15.112:0/1810797355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40094b0 con 0x7f23c80c57d0 2023-11-08T12:28:25.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23ceb23700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80d2090 0x7f23c80b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:25.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fe7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f803b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fe7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f803b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51616/0 (socket says 172.21.15.112:51616) 2023-11-08T12:28:25.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9fe7fc700 1 -- 172.21.15.112:0/164045839 learned_addr learned my addr 172.21.15.112:0/164045839 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7f23cdb21700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c80cc700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23c4016000 tx=0x7f23c4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.257+0000 7ff9ff7fe700 1 --2- 172.21.15.112:0/164045839 >> v2:172.21.15.112:3300/0 conn(0x7ff9f80e6530 0x7ff9f80e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f23beffd700 1 -- 172.21.15.112:0/1810797355 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4004550 con 0x7f23c80c57d0 2023-11-08T12:28:25.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f23d0586700 1 -- 172.21.15.112:0/1810797355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c80d3340 con 0x7f23c80c57d0 2023-11-08T12:28:25.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f23d0586700 1 -- 172.21.15.112:0/1810797355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c8072020 con 0x7f23c80c57d0 2023-11-08T12:28:25.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f23beffd700 1 -- 172.21.15.112:0/1810797355 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c401e070 con 0x7f23c80c57d0 2023-11-08T12:28:25.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f23beffd700 1 -- 172.21.15.112:0/1810797355 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4004550 con 0x7f23c80c57d0 2023-11-08T12:28:25.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fe7fc700 1 -- 172.21.15.112:0/164045839 >> v2:172.21.15.133:3300/0 conn(0x7ff9f80383e0 msgr2=0x7ff9f8006d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T12:28:25.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fe7fc700 1 --2- 172.21.15.112:0/164045839 >> v2:172.21.15.133:3300/0 conn(0x7ff9f80383e0 0x7ff9f8006d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fe7fc700 1 -- 172.21.15.112:0/164045839 >> v2:172.21.15.112:3300/0 conn(0x7ff9f80e6530 msgr2=0x7ff9f80e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:25.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fe7fc700 1 --2- 172.21.15.112:0/164045839 >> v2:172.21.15.112:3300/0 conn(0x7ff9f80e6530 0x7ff9f80e69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fe7fc700 1 -- 172.21.15.112:0/164045839 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8053850 con 0x7ff9f803ac80 2023-11-08T12:28:25.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fe7fc700 1 --2- 172.21.15.112:0/164045839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f803b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8056d80 tx=0x7ff9f4009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a9c614c172cbae server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f5df8e8e700 1 Processor -- start 2023-11-08T12:28:25.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f5df8e8e700 1 -- start start 2023-11-08T12:28:25.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fdffb700 1 -- 172.21.15.112:0/164045839 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4011830 con 0x7ff9f803ac80 2023-11-08T12:28:25.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c80d3620 con 0x7f23c80c57d0 2023-11-08T12:28:25.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fdffb700 1 -- 172.21.15.112:0/164045839 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4011990 con 0x7ff9f803ac80 2023-11-08T12:28:25.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fdffb700 1 -- 172.21.15.112:0/164045839 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4011d20 con 0x7ff9f803ac80 2023-11-08T12:28:25.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f74db2d1700 1 Processor -- start 2023-11-08T12:28:25.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7f74db2d1700 1 -- start start 2023-11-08T12:28:25.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7fc5280b5700 1 Processor -- start 2023-11-08T12:28:25.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fffff700 1 -- 172.21.15.112:0/164045839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 msgr2=0x7ff9f803b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.261+0000 7ff9fffff700 1 --2- 172.21.15.112:0/164045839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f803b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8056d80 tx=0x7ff9f4009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc5280b5700 1 -- start start 2023-11-08T12:28:25.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df8e8e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5df4070790 0x7f5df40c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7ff9fffff700 1 -- 172.21.15.112:0/164045839 shutdown_connections 2023-11-08T12:28:25.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df8e8e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40caa70 0x7f5df406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7ff9fffff700 1 --2- 172.21.15.112:0/164045839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f803b0d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7ff9fffff700 1 --2- 172.21.15.112:0/164045839 >> v2:172.21.15.112:3300/0 conn(0x7ff9f80e6530 0x7ff9f80e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7ff9fffff700 1 --2- 172.21.15.112:0/164045839 >> v2:172.21.15.133:3300/0 conn(0x7ff9f80383e0 0x7ff9f8006d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7ff9fffff700 1 -- 172.21.15.112:0/164045839 >> 172.21.15.112:0/164045839 conn(0x7ff9f8055c80 msgr2=0x7ff9f8056050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7ff9fffff700 1 -- 172.21.15.112:0/164045839 shutdown_connections 2023-11-08T12:28:25.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7ff9fffff700 1 -- 172.21.15.112:0/164045839 wait complete. 2023-11-08T12:28:25.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df8e8e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df40b1640 con 0x7f5df40b3fa0 2023-11-08T12:28:25.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df8e8e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df415dcd0 con 0x7f5df4070790 2023-11-08T12:28:25.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df8e8e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df415e850 con 0x7f5df40caa70 2023-11-08T12:28:25.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74db2d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74d40ce570 0x7f74d406ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74db2d1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d4160bc0 con 0x7f74d415c680 2023-11-08T12:28:25.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74db2d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d40cd4f0 con 0x7f74d40ce100 2023-11-08T12:28:25.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74db2d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d40b6700 con 0x7f74d40ce570 2023-11-08T12:28:25.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5df40b3fa0 0x7f5df4070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:34450/0 (socket says 172.21.15.112:34450) 2023-11-08T12:28:25.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df259c700 1 -- 172.21.15.112:0/2273066258 learned_addr learned my addr 172.21.15.112:0/2273066258 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:25.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f23beffd700 1 -- 172.21.15.112:0/1810797355 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23c400f050 con 0x7f23c80c57d0 2023-11-08T12:28:25.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74d906d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f74d415c680 0x7f74d40b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34254/0 (socket says 172.21.15.112:34254) 2023-11-08T12:28:25.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74d906d700 1 -- 172.21.15.112:0/1605786214 learned_addr learned my addr 172.21.15.112:0/1605786214 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:25.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74d986e700 1 --2- 172.21.15.112:0/1605786214 >> v2:172.21.15.133:3300/0 conn(0x7f74d40ce570 0x7f74d406ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc5280b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc52015c640 0x7fc5200d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df2d9d700 1 --2- 172.21.15.112:0/2273066258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40caa70 0x7f5df406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f84f0d70700 1 Processor -- start 2023-11-08T12:28:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc5280b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc52006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df1d9b700 1 --2- 172.21.15.112:0/2273066258 >> v2:172.21.15.133:3300/0 conn(0x7f5df4070790 0x7f5df40c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f84f0d70700 1 -- start start 2023-11-08T12:28:25.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f74d986e700 1 -- 172.21.15.112:0/1605786214 >> v1:172.21.15.133:6789/0 conn(0x7f74d40ce100 legacy=0x7f74d406a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df2d9d700 1 -- 172.21.15.112:0/2273066258 >> v2:172.21.15.133:3300/0 conn(0x7f5df4070790 msgr2=0x7f5df40c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:25.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f23beffd700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23ac064f40 0x7f23ac0673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df2d9d700 1 --2- 172.21.15.112:0/2273066258 >> v2:172.21.15.133:3300/0 conn(0x7f5df4070790 0x7f5df40c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc5280b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52006c600 con 0x7fc520071aa0 2023-11-08T12:28:25.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc5280b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52006cef0 con 0x7fc52015c640 2023-11-08T12:28:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df2d9d700 1 -- 172.21.15.112:0/2273066258 >> v1:172.21.15.133:6789/0 conn(0x7f5df40b3fa0 legacy=0x7f5df4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc5280b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52006a7c0 con 0x7fc520069e00 2023-11-08T12:28:25.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f5df2d9d700 1 -- 172.21.15.112:0/2273066258 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40c9480 con 0x7f5df40caa70 2023-11-08T12:28:25.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc526652700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc52006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc526652700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc52006a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51628/0 (socket says 172.21.15.112:51628) 2023-11-08T12:28:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc526652700 1 -- 172.21.15.112:0/1845806092 learned_addr learned my addr 172.21.15.112:0/1845806092 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7fc525e51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc52015c640 0x7fc5200d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 Processor -- start 2023-11-08T12:28:25.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f74d3fff700 1 -- 172.21.15.112:0/1605786214 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921989194 0 0) 0x7f74d4160bc0 con 0x7f74d415c680 2023-11-08T12:28:25.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f74d986e700 1 -- 172.21.15.112:0/1605786214 >> v1:172.21.15.112:6789/0 conn(0x7f74d415c680 legacy=0x7f74d40b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f74d986e700 1 -- 172.21.15.112:0/1605786214 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d40b5670 con 0x7f74d40ce570 2023-11-08T12:28:25.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.265+0000 7f23beffd700 1 -- 172.21.15.112:0/1810797355 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23c4006ce0 con 0x7f23c80c57d0 2023-11-08T12:28:25.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f23ce322700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23ac064f40 0x7f23ac0673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 -- start start 2023-11-08T12:28:25.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f74d986e700 1 --2- 172.21.15.112:0/1605786214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce570 0x7f74d406ae30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488282d1beac5608 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84f0d70700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84ec160710 0x7f84ec0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84f0d70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc525e51700 1 -- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 msgr2=0x7fc52006a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:25.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84f0d70700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0ad6c0 con 0x7f84ec0705c0 2023-11-08T12:28:25.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84f0d70700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec070a60 con 0x7f84ec160710 2023-11-08T12:28:25.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84f0d70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec06b1c0 con 0x7f84ec0cc860 2023-11-08T12:28:25.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc525e51700 1 --2- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc52006a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc525e51700 1 -- 172.21.15.112:0/1845806092 >> v1:172.21.15.133:6789/0 conn(0x7fc520071aa0 legacy=0x7fc52006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc525e51700 1 -- 172.21.15.112:0/1845806092 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200722f0 con 0x7fc52015c640 2023-11-08T12:28:25.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc526652700 1 --2- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc52006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:25.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ead9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f84ec0705c0 0x7f84ec069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:34490/0 (socket says 172.21.15.112:34490) 2023-11-08T12:28:25.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ead9d700 1 -- 172.21.15.112:0/3269811951 learned_addr learned my addr 172.21.15.112:0/3269811951 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:25.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f23ce322700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23ac064f40 0x7f23ac0673f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009b50 tx=0x7f23b8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84e9d9b700 1 --2- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ea59c700 1 --2- 172.21.15.112:0/3269811951 >> v2:172.21.15.133:3300/0 conn(0x7f84ec160710 0x7f84ec0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9f80383e0 0x7ff9f80d8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7fc525e51700 1 --2- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200d31e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc510009850 tx=0x7fc510009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc8b46284565411 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f5df2d9d700 1 --2- 172.21.15.112:0/2273066258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40caa70 0x7f5df406bed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009850 tx=0x7f5de4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dfe64ae390f7ae5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f8039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9f80e6530 0x7ff9f803cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8039020 con 0x7ff9f80e6530 2023-11-08T12:28:25.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80398c0 con 0x7ff9f80383e0 2023-11-08T12:28:25.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fffff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f816e310 con 0x7ff9f803ac80 2023-11-08T12:28:25.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ea59c700 1 -- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 msgr2=0x7f84ec070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:25.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ea59c700 1 --2- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ea59c700 1 -- 172.21.15.112:0/3269811951 >> v1:172.21.15.133:6789/0 conn(0x7f84ec0705c0 legacy=0x7f84ec069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ea59c700 1 -- 172.21.15.112:0/3269811951 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0adc60 con 0x7f84ec160710 2023-11-08T12:28:25.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9f80e6530 0x7ff9f803cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9f80e6530 0x7ff9f803cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56530/0 (socket says 172.21.15.112:56530) 2023-11-08T12:28:25.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 -- 172.21.15.112:0/2741787349 learned_addr learned my addr 172.21.15.112:0/2741787349 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9fe7fc700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f8039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f5df159a700 1 -- 172.21.15.112:0/2273066258 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4011830 con 0x7f5df40caa70 2023-11-08T12:28:25.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9feffd700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9f80383e0 0x7ff9f80d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f5df159a700 1 -- 172.21.15.112:0/2273066258 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de4011990 con 0x7f5df40caa70 2023-11-08T12:28:25.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f5df159a700 1 -- 172.21.15.112:0/2273066258 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4011d40 con 0x7f5df40caa70 2023-11-08T12:28:25.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7f84ea59c700 1 --2- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 0x7f84ec0cc320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009850 tx=0x7f84e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22f987afccc5c3b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 -- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 msgr2=0x7ff9f8039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f8039d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 -- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9f80383e0 msgr2=0x7ff9f80d8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9f80383e0 0x7ff9f80d8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.269+0000 7ff9ff7fe700 1 -- 172.21.15.112:0/2741787349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f4009570 con 0x7ff9f80e6530 2023-11-08T12:28:25.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 -- 172.21.15.112:0/2273066258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40caa70 msgr2=0x7f5df406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/2273066258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40caa70 0x7f5df406bed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009850 tx=0x7f5de4009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:25.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7ff9ff7fe700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9f80e6530 0x7ff9f803cd20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000e7f0 tx=0x7ff9f000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 -- 172.21.15.112:0/2273066258 shutdown_connections 2023-11-08T12:28:25.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/2273066258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40caa70 0x7f5df406bed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/2273066258 >> v2:172.21.15.133:3300/0 conn(0x7f5df4070790 0x7f5df40c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 -- 172.21.15.112:0/2273066258 >> 172.21.15.112:0/2273066258 conn(0x7f5df40b0f90 msgr2=0x7f5df40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7ff9e77fe700 1 -- 172.21.15.112:0/2741787349 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00095c0 con 0x7ff9f80e6530 2023-11-08T12:28:25.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8054060 con 0x7ff9f80e6530 2023-11-08T12:28:25.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 -- 172.21.15.112:0/2273066258 shutdown_connections 2023-11-08T12:28:25.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f8007700 con 0x7ff9f80e6530 2023-11-08T12:28:25.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7ff9e77fe700 1 -- 172.21.15.112:0/2741787349 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0013680 con 0x7ff9f80e6530 2023-11-08T12:28:25.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7ff9e77fe700 1 -- 172.21.15.112:0/2741787349 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0013a10 con 0x7ff9f80e6530 2023-11-08T12:28:25.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 -- 172.21.15.112:0/2273066258 wait complete. 2023-11-08T12:28:25.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f209225a700 1 Processor -- start 2023-11-08T12:28:25.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f209225a700 1 -- start start 2023-11-08T12:28:25.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7fc524e4f700 1 -- 172.21.15.112:0/1845806092 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510011830 con 0x7fc52015c640 2023-11-08T12:28:25.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74d3fff700 1 -- 172.21.15.112:0/1605786214 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400e070 con 0x7f74d40ce570 2023-11-08T12:28:25.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f23beffd700 1 -- 172.21.15.112:0/1810797355 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23c4051750 con 0x7f23c80c57d0 2023-11-08T12:28:25.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f84e959a700 1 -- 172.21.15.112:0/3269811951 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0011830 con 0x7f84ec160710 2023-11-08T12:28:25.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7fc524e4f700 1 -- 172.21.15.112:0/1845806092 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc510011990 con 0x7fc52015c640 2023-11-08T12:28:25.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7fc524e4f700 1 -- 172.21.15.112:0/1845806092 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510011d20 con 0x7fc52015c640 2023-11-08T12:28:25.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74d3fff700 1 -- 172.21.15.112:0/1605786214 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400bbd0 con 0x7f74d40ce570 2023-11-08T12:28:25.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74d3fff700 1 -- 172.21.15.112:0/1605786214 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4012430 con 0x7f74d40ce570 2023-11-08T12:28:25.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f8007270 con 0x7ff9f80e6530 2023-11-08T12:28:25.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f84e959a700 1 -- 172.21.15.112:0/3269811951 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0011990 con 0x7f84ec160710 2023-11-08T12:28:25.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f84e959a700 1 -- 172.21.15.112:0/3269811951 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0011d40 con 0x7f84ec160710 2023-11-08T12:28:25.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f84f0d70700 1 -- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 msgr2=0x7f84ec0cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f84f0d70700 1 --2- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 0x7f84ec0cc320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009850 tx=0x7f84e0009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:25.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74db2d1700 1 -- 172.21.15.112:0/1605786214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce570 msgr2=0x7f74d406ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f209225a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2084038430 0x7f2084006c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74db2d1700 1 --2- 172.21.15.112:0/1605786214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce570 0x7f74d406ae30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:25.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f5df8e8e700 1 Processor -- start 2023-11-08T12:28:25.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74db2d1700 1 -- 172.21.15.112:0/1605786214 shutdown_connections 2023-11-08T12:28:25.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74db2d1700 1 --2- 172.21.15.112:0/1605786214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce570 0x7f74d406ae30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f74db2d1700 1 -- 172.21.15.112:0/1605786214 >> 172.21.15.112:0/1605786214 conn(0x7f74d40d2c00 msgr2=0x7f74d40d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f209225a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f208403ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f209225a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840077c0 con 0x7f208403b080 2023-11-08T12:28:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.273+0000 7f209225a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2084038800 con 0x7f2084038430 2023-11-08T12:28:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f209225a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208403b500 con 0x7f2084055690 2023-11-08T12:28:25.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091258700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2084038430 0x7f2084006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091a59700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f208403b080 0x7f20840e63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34256/0 (socket says 172.21.15.112:34256) 2023-11-08T12:28:25.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091a59700 1 -- 172.21.15.112:0/3986364409 learned_addr learned my addr 172.21.15.112:0/3986364409 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:25.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091258700 1 -- 172.21.15.112:0/3986364409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 msgr2=0x7f208403ab40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-08T12:28:25.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091258700 1 --2- 172.21.15.112:0/3986364409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f208403ab40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091258700 1 -- 172.21.15.112:0/3986364409 >> v1:172.21.15.112:6789/0 conn(0x7f208403b080 legacy=0x7f20840e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091258700 1 -- 172.21.15.112:0/3986364409 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2084007160 con 0x7f2084038430 2023-11-08T12:28:25.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df8e8e700 1 -- start start 2023-11-08T12:28:25.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 -- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 msgr2=0x7fc5200d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 --2- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200d31e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc510009850 tx=0x7fc510009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:25.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f2091258700 1 --2- 172.21.15.112:0/3986364409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084038430 0x7f2084006c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2088009850 tx=0x7f2088009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad532adba90c202 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7ff9e77fe700 1 -- 172.21.15.112:0/2741787349 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff9f0019030 con 0x7ff9f80e6530 2023-11-08T12:28:25.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df8e8e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5df4070790 0x7f5df40c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df8e8e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40b3fa0 0x7f5df40c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f74db2d1700 1 -- 172.21.15.112:0/1605786214 shutdown_connections 2023-11-08T12:28:25.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f84f0d70700 1 -- 172.21.15.112:0/3269811951 shutdown_connections 2023-11-08T12:28:25.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f84f0d70700 1 --2- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f84f0d70700 1 --2- 172.21.15.112:0/3269811951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 0x7f84ec0cc320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f84f0d70700 1 -- 172.21.15.112:0/3269811951 >> 172.21.15.112:0/3269811951 conn(0x7f84ec0b0f80 msgr2=0x7f84ec0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f84f0d70700 1 -- 172.21.15.112:0/3269811951 shutdown_connections 2023-11-08T12:28:25.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 -- 172.21.15.112:0/1845806092 shutdown_connections 2023-11-08T12:28:25.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 --2- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc52006a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 --2- 172.21.15.112:0/1845806092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200d31e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 -- 172.21.15.112:0/1845806092 >> 172.21.15.112:0/1845806092 conn(0x7fc5200b6520 msgr2=0x7fc520071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 -- 172.21.15.112:0/1845806092 shutdown_connections 2023-11-08T12:28:25.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7fc5280b5700 1 -- 172.21.15.112:0/1845806092 wait complete. 2023-11-08T12:28:25.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f84f0d70700 1 -- 172.21.15.112:0/3269811951 wait complete. 2023-11-08T12:28:25.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df8e8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5df40caa70 0x7f5df4146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df8e8e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40c50d0 con 0x7f5df4070790 2023-11-08T12:28:25.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df8e8e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40c54f0 con 0x7f5df40caa70 2023-11-08T12:28:25.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df8e8e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40c4450 con 0x7f5df40b3fa0 2023-11-08T12:28:25.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5df4070790 0x7f5df40c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5df4070790 0x7f5df40c3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56550/0 (socket says 172.21.15.112:56550) 2023-11-08T12:28:25.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 -- 172.21.15.112:0/3630740517 learned_addr learned my addr 172.21.15.112:0/3630740517 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7ff9e77fe700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff9ec064f10 0x7ff9ec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7ff9e77fe700 1 -- 172.21.15.112:0/2741787349 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff9f0081f40 con 0x7ff9f80e6530 2023-11-08T12:28:25.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7ff9feffd700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff9ec064f10 0x7ff9ec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 -- 172.21.15.112:0/3630740517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40b3fa0 msgr2=0x7f5df40c7080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-08T12:28:25.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40b3fa0 0x7f5df40c7080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 -- 172.21.15.112:0/3630740517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5df40caa70 msgr2=0x7f5df4146b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-08T12:28:25.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5df40caa70 0x7f5df4146b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f5df259c700 1 -- 172.21.15.112:0/3630740517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40094b0 con 0x7f5df4070790 2023-11-08T12:28:25.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f5df259c700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5df4070790 0x7f5df40c3b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00cb10 tx=0x7f5dec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.277+0000 7f74db2d1700 1 -- 172.21.15.112:0/1605786214 wait complete. 2023-11-08T12:28:25.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 Processor -- start 2023-11-08T12:28:25.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 -- start start 2023-11-08T12:28:25.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 Processor -- start 2023-11-08T12:28:25.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7ff9feffd700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff9ec064f10 0x7ff9ec0673c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa00063ca0 tx=0x7ffa000668f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 -- start start 2023-11-08T12:28:25.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce100 0x7f74d41f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74d40ce570 0x7f74d415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74d415c680 0x7f74d40cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d415b340 con 0x7f74d415c680 2023-11-08T12:28:25.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d415a6c0 con 0x7f74d40ce100 2023-11-08T12:28:25.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74db2d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d415a9a0 con 0x7f74d40ce570 2023-11-08T12:28:25.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f84f0d70700 1 Processor -- start 2023-11-08T12:28:25.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f84f0d70700 1 -- start start 2023-11-08T12:28:25.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc520092bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc520071aa0 0x7fc520155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c8530 con 0x7fc520071aa0 2023-11-08T12:28:25.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520093130 con 0x7fc52015c640 2023-11-08T12:28:25.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc5280b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c7eb0 con 0x7fc520069e00 2023-11-08T12:28:25.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d886c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74d40ce570 0x7f74d415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d986e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74d415c680 0x7f74d40cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d886c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74d40ce570 0x7f74d415b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51666/0 (socket says 172.21.15.112:51666) 2023-11-08T12:28:25.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d886c700 1 -- 172.21.15.112:0/2827323984 learned_addr learned my addr 172.21.15.112:0/2827323984 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d986e700 1 -- 172.21.15.112:0/2827323984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74d40ce570 msgr2=0x7f74d415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d986e700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74d40ce570 0x7f74d415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d986e700 1 -- 172.21.15.112:0/2827323984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce100 msgr2=0x7f74d41f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d986e700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce100 0x7f74d41f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f2083fff700 1 -- 172.21.15.112:0/3986364409 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011830 con 0x7f2084038430 2023-11-08T12:28:25.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f74d986e700 1 -- 172.21.15.112:0/2827323984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4009a70 con 0x7f74d415c680 2023-11-08T12:28:25.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc526652700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc526652700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:40276/0 (socket says 172.21.15.112:40276) 2023-11-08T12:28:25.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7fc526652700 1 -- 172.21.15.112:0/3266613219 learned_addr learned my addr 172.21.15.112:0/3266613219 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f5de2ffd700 1 -- 172.21.15.112:0/3630740517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00a820 con 0x7f5df4070790 2023-11-08T12:28:25.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df415e200 con 0x7f5df4070790 2023-11-08T12:28:25.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f5de2ffd700 1 -- 172.21.15.112:0/3630740517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00a980 con 0x7f5df4070790 2023-11-08T12:28:25.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f5de2ffd700 1 -- 172.21.15.112:0/3630740517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00ad10 con 0x7f5df4070790 2023-11-08T12:28:25.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f2083fff700 1 -- 172.21.15.112:0/3986364409 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088011990 con 0x7f2084038430 2023-11-08T12:28:25.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.281+0000 7f2083fff700 1 -- 172.21.15.112:0/3986364409 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011d20 con 0x7f2084038430 2023-11-08T12:28:25.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f74d986e700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74d415c680 0x7f74d40cbce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74c4016000 tx=0x7f74c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df415df20 con 0x7f5df4070790 2023-11-08T12:28:25.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7ff9e77fe700 1 -- 172.21.15.112:0/2741787349 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff9f004fd00 con 0x7ff9f80e6530 2023-11-08T12:28:25.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc525e51700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc520092bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc525650700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc520071aa0 0x7fc520155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84f0d70700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec0705c0 0x7f84ec150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84f0d70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84f0d70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 0x7f84ec15da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84f0d70700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec1506b0 con 0x7f84ec0705c0 2023-11-08T12:28:25.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84f0d70700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0b1c90 con 0x7f84ec160710 2023-11-08T12:28:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84f0d70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0b19b0 con 0x7f84ec0cc860 2023-11-08T12:28:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec0b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51672/0 (socket says 172.21.15.112:51672) 2023-11-08T12:28:25.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 -- 172.21.15.112:0/1707167487 learned_addr learned my addr 172.21.15.112:0/1707167487 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 -- 172.21.15.112:0/3986364409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084038430 msgr2=0x7f2084006c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 --2- 172.21.15.112:0/3986364409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084038430 0x7f2084006c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2088009850 tx=0x7f2088009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:25.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 -- 172.21.15.112:0/3986364409 shutdown_connections 2023-11-08T12:28:25.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 --2- 172.21.15.112:0/3986364409 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f208403ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 --2- 172.21.15.112:0/3986364409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2084038430 0x7f2084006c20 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2088009850 tx=0x7f2088009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:25.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 -- 172.21.15.112:0/3986364409 >> 172.21.15.112:0/3986364409 conn(0x7f2084055b40 msgr2=0x7f2084055f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84ea59c700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec0705c0 0x7f84ec150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc526652700 1 -- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 msgr2=0x7fc520092bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc526652700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc520092bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc526652700 1 -- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc520071aa0 msgr2=0x7fc520155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc526652700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc520071aa0 0x7fc520155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc526652700 1 -- 172.21.15.112:0/3266613219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5100094b0 con 0x7fc52015c640 2023-11-08T12:28:25.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f74d1ffb700 1 -- 172.21.15.112:0/2827323984 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4004830 con 0x7f74d415c680 2023-11-08T12:28:25.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 -- 172.21.15.112:0/3986364409 shutdown_connections 2023-11-08T12:28:25.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84ead9d700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 0x7f84ec15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 -- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 msgr2=0x7f84ec15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 0x7f84ec15da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 -- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec0705c0 msgr2=0x7f84ec150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec0705c0 0x7f84ec150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f209225a700 1 -- 172.21.15.112:0/3986364409 wait complete. 2023-11-08T12:28:25.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 -- 172.21.15.112:0/1707167487 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e00094b0 con 0x7f84ec0cc860 2023-11-08T12:28:25.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7fc526652700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200c8950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc518007ac0 tx=0x7fc518007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84e9d9b700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec0b3f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84e400efc0 tx=0x7f84e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84daffd700 1 -- 172.21.15.112:0/1707167487 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400cdc0 con 0x7f84ec0cc860 2023-11-08T12:28:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84daffd700 1 -- 172.21.15.112:0/1707167487 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e400f040 con 0x7f84ec0cc860 2023-11-08T12:28:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec06b6b0 con 0x7f84ec0cc860 2023-11-08T12:28:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f84daffd700 1 -- 172.21.15.112:0/1707167487 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40146a0 con 0x7f84ec0cc860 2023-11-08T12:28:25.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.285+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d4160570 con 0x7f74d415c680 2023-11-08T12:28:25.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec06b3d0 con 0x7f84ec0cc860 2023-11-08T12:28:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d4160290 con 0x7f74d415c680 2023-11-08T12:28:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 Processor -- start 2023-11-08T12:28:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 -- start start 2023-11-08T12:28:25.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d4160850 con 0x7f74d415c680 2023-11-08T12:28:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208403b080 0x7f20840deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f20840df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20840e26f0 0x7f20840d3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840d4220 con 0x7f208403b080 2023-11-08T12:28:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840df820 con 0x7f20840e26f0 2023-11-08T12:28:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f209225a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20840e59e0 con 0x7f2084055690 2023-11-08T12:28:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f20840df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2091a59700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20840e26f0 0x7f20840d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f20840df2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51692/0 (socket says 172.21.15.112:51692) 2023-11-08T12:28:25.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 -- 172.21.15.112:0/724989772 learned_addr learned my addr 172.21.15.112:0/724989772 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 -- 172.21.15.112:0/724989772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20840e26f0 msgr2=0x7f20840d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20840e26f0 0x7f20840d3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 -- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208403b080 msgr2=0x7f20840deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208403b080 0x7f20840deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 -- 172.21.15.112:0/724989772 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880094b0 con 0x7f2084055690 2023-11-08T12:28:25.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f2090a57700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f20840df2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f207c00b4a0 tx=0x7f207c00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7fc5167fc700 1 -- 172.21.15.112:0/3266613219 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518003c40 con 0x7fc52015c640 2023-11-08T12:28:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7fc5167fc700 1 -- 172.21.15.112:0/3266613219 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800f040 con 0x7fc52015c640 2023-11-08T12:28:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7fc5167fc700 1 -- 172.21.15.112:0/3266613219 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800d950 con 0x7fc52015c640 2023-11-08T12:28:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f74d1ffb700 1 -- 172.21.15.112:0/2827323984 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c4020070 con 0x7f74d415c680 2023-11-08T12:28:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f74d1ffb700 1 -- 172.21.15.112:0/2827323984 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4004990 con 0x7f74d415c680 2023-11-08T12:28:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52015ca10 con 0x7fc52015c640 2023-11-08T12:28:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52006da20 con 0x7fc52015c640 2023-11-08T12:28:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df415e4e0 con 0x7f5df4070790 2023-11-08T12:28:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f5de2ffd700 1 -- 172.21.15.112:0/3630740517 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5dec019030 con 0x7f5df4070790 2023-11-08T12:28:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.289+0000 7f5de2ffd700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5dd4064ee0 0x7f5dd4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f5de2ffd700 1 -- 172.21.15.112:0/3630740517 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5dec081b60 con 0x7f5df4070790 2023-11-08T12:28:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f5df1d9b700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5dd4064ee0 0x7f5dd4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f5df1d9b700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5dd4064ee0 0x7f5dd4067390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5df4071940 tx=0x7f5de8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f2081ffb700 1 -- 172.21.15.112:0/724989772 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c011830 con 0x7f2084055690 2023-11-08T12:28:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f2081ffb700 1 -- 172.21.15.112:0/724989772 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c011990 con 0x7f2084055690 2023-11-08T12:28:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f2081ffb700 1 -- 172.21.15.112:0/724989772 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c011d40 con 0x7f2084055690 2023-11-08T12:28:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f84daffd700 1 -- 172.21.15.112:0/1707167487 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f84e4014800 con 0x7f84ec0cc860 2023-11-08T12:28:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec0ad8f0 con 0x7f84ec0cc860 2023-11-08T12:28:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f84daffd700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f84cc064ee0 0x7f84cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2084053b20 con 0x7f2084055690 2023-11-08T12:28:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.293+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2084053840 con 0x7f2084055690 2023-11-08T12:28:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7f84daffd700 1 -- 172.21.15.112:0/1707167487 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f84e405bea0 con 0x7f84ec0cc860 2023-11-08T12:28:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520072010 con 0x7fc52015c640 2023-11-08T12:28:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7fc5167fc700 1 -- 172.21.15.112:0/3266613219 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc518013070 con 0x7fc52015c640 2023-11-08T12:28:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2084007450 con 0x7f2084055690 2023-11-08T12:28:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7fc5167fc700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc504064f30 0x7fc5040673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7fc5167fc700 1 -- 172.21.15.112:0/3266613219 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc518081d20 con 0x7fc52015c640 2023-11-08T12:28:25.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7f84ea59c700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f84cc064ee0 0x7f84cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7f2081ffb700 1 -- 172.21.15.112:0/724989772 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f207c021070 con 0x7f2084055690 2023-11-08T12:28:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.297+0000 7f84ea59c700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f84cc064ee0 0x7f84cc067390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84e00090b0 tx=0x7f84e0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7fc525e51700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc504064f30 0x7fc5040673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f5de2ffd700 1 -- 172.21.15.112:0/3630740517 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5dec04f920 con 0x7f5df4070790 2023-11-08T12:28:25.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f2081ffb700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2070064fb0 0x7f2070067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f2081ffb700 1 -- 172.21.15.112:0/724989772 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f207c0827b0 con 0x7f2084055690 2023-11-08T12:28:25.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f74d1ffb700 1 -- 172.21.15.112:0/2827323984 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f74c4027680 con 0x7f74d415c680 2023-11-08T12:28:25.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7fc525e51700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc504064f30 0x7fc5040673e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc510000c00 tx=0x7fc510008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f2091258700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2070064fb0 0x7f2070067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f74d1ffb700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f74c0064ee0 0x7f74c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f74d906d700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f74c0064ee0 0x7f74c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f2091258700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2070064fb0 0x7f2070067460 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2084011f70 tx=0x7f2088010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.301+0000 7f74d1ffb700 1 -- 172.21.15.112:0/2827323984 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74c4022070 con 0x7f74d415c680 2023-11-08T12:28:25.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.305+0000 7f74d906d700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f74c0064ee0 0x7f74c0067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000c00 tx=0x7f74cc0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.305+0000 7f84daffd700 1 -- 172.21.15.112:0/1707167487 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f84e4087060 con 0x7f84ec0cc860 2023-11-08T12:28:25.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.305+0000 7f74d1ffb700 1 -- 172.21.15.112:0/2827323984 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f74c4052c10 con 0x7f74d415c680 2023-11-08T12:28:25.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.309+0000 7fc5167fc700 1 -- 172.21.15.112:0/3266613219 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc51804c400 con 0x7fc52015c640 2023-11-08T12:28:25.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.309+0000 7f2081ffb700 1 -- 172.21.15.112:0/724989772 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f207c0505f0 con 0x7f2084055690 2023-11-08T12:28:25.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.325+0000 7f246088c700 1 Processor -- start 2023-11-08T12:28:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.325+0000 7f246088c700 1 -- start start 2023-11-08T12:28:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.329+0000 7f246088c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2454036e80 0x7f245403a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.329+0000 7f246088c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540060c0 con 0x7f245403a640 2023-11-08T12:28:25.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.329+0000 7f246088c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540ded00 con 0x7f2454054800 2023-11-08T12:28:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.329+0000 7f246088c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540070b0 con 0x7f2454036e80 2023-11-08T12:28:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.329+0000 7f245b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2454054800 0x7f2454036770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:34498/0 (socket says 172.21.15.112:34498) 2023-11-08T12:28:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.329+0000 7f245b7fe700 1 -- 172.21.15.112:0/558913208 learned_addr learned my addr 172.21.15.112:0/558913208 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.329+0000 7f245affd700 1 --2- 172.21.15.112:0/558913208 >> v2:172.21.15.133:3300/0 conn(0x7f2454036e80 0x7f245403a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f245affd700 1 -- 172.21.15.112:0/558913208 >> v1:172.21.15.133:6789/0 conn(0x7f2454054800 legacy=0x7f2454036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f245affd700 1 -- 172.21.15.112:0/558913208 >> v1:172.21.15.112:6789/0 conn(0x7f245403a640 legacy=0x7f24540528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f245affd700 1 -- 172.21.15.112:0/558913208 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245403aac0 con 0x7f2454036e80 2023-11-08T12:28:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f245affd700 1 --2- 172.21.15.112:0/558913208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 0x7f245403a100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2450009850 tx=0x7f2450009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed989424c1ed45e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f245a7fc700 1 -- 172.21.15.112:0/558913208 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450011830 con 0x7f2454036e80 2023-11-08T12:28:25.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f245a7fc700 1 -- 172.21.15.112:0/558913208 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450011990 con 0x7f2454036e80 2023-11-08T12:28:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f245a7fc700 1 -- 172.21.15.112:0/558913208 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450011d20 con 0x7f2454036e80 2023-11-08T12:28:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f246088c700 1 -- 172.21.15.112:0/558913208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 msgr2=0x7f245403a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f246088c700 1 --2- 172.21.15.112:0/558913208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 0x7f245403a100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2450009850 tx=0x7f2450009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f246088c700 1 -- 172.21.15.112:0/558913208 shutdown_connections 2023-11-08T12:28:25.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f246088c700 1 --2- 172.21.15.112:0/558913208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 0x7f245403a100 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f246088c700 1 -- 172.21.15.112:0/558913208 >> 172.21.15.112:0/558913208 conn(0x7f2454051770 msgr2=0x7f2454051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f246088c700 1 -- 172.21.15.112:0/558913208 shutdown_connections 2023-11-08T12:28:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.333+0000 7f246088c700 1 -- 172.21.15.112:0/558913208 wait complete. 2023-11-08T12:28:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.337+0000 7f246088c700 1 Processor -- start 2023-11-08T12:28:25.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f246088c700 1 -- start start 2023-11-08T12:28:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f246088c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 0x7f2454184cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f246088c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f245403a640 0x7f2454049e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f246088c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2454054800 0x7f2454038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f246088c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454049990 con 0x7f2454054800 2023-11-08T12:28:25.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f246088c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540e1b80 con 0x7f2454036e80 2023-11-08T12:28:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f246088c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2454185230 con 0x7f245403a640 2023-11-08T12:28:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2454054800 0x7f2454038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2454054800 0x7f2454038ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56602/0 (socket says 172.21.15.112:56602) 2023-11-08T12:28:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 -- 172.21.15.112:0/1251402496 learned_addr learned my addr 172.21.15.112:0/1251402496 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245b7fe700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 0x7f2454184cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245affd700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f245403a640 0x7f2454049e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 -- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f245403a640 msgr2=0x7f2454049e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f245403a640 0x7f2454049e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 -- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 msgr2=0x7f2454184cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 0x7f2454184cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 -- 172.21.15.112:0/1251402496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500094b0 con 0x7f2454054800 2023-11-08T12:28:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.345+0000 7f245bfff700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2454054800 0x7f2454038ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f245c065690 tx=0x7f245c072ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.349+0000 7f2447fff700 1 -- 172.21.15.112:0/1251402496 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c073070 con 0x7f2454054800 2023-11-08T12:28:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.349+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24540065d0 con 0x7f2454054800 2023-11-08T12:28:25.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.349+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24540062f0 con 0x7f2454054800 2023-11-08T12:28:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.349+0000 7f2447fff700 1 -- 172.21.15.112:0/1251402496 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c0731d0 con 0x7f2454054800 2023-11-08T12:28:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.349+0000 7f2447fff700 1 -- 172.21.15.112:0/1251402496 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c073580 con 0x7f2454054800 2023-11-08T12:28:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.349+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c005310 con 0x7f2454054800 2023-11-08T12:28:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.357+0000 7f2447fff700 1 -- 172.21.15.112:0/1251402496 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f245c09b3f0 con 0x7f2454054800 2023-11-08T12:28:25.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.357+0000 7f2447fff700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2440064f40 0x7f24400673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.357+0000 7f2447fff700 1 -- 172.21.15.112:0/1251402496 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f245c072040 con 0x7f2454054800 2023-11-08T12:28:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.361+0000 7f245b7fe700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2440064f40 0x7f24400673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.361+0000 7f245b7fe700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2440064f40 0x7f24400673f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2448000f60 tx=0x7f2448007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.365+0000 7f2447fff700 1 -- 172.21.15.112:0/1251402496 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f245c0ca7b0 con 0x7f2454054800 2023-11-08T12:28:25.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.569+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9f8039a30 con 0x7ff9f80e6530 2023-11-08T12:28:25.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.569+0000 7ff9e77fe700 1 -- 172.21.15.112:0/2741787349 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9f0017020 con 0x7ff9f80e6530 2023-11-08T12:28:25.573 INFO:teuthology.orchestra.run.smithi112.stdout:60129542155 2023-11-08T12:28:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff9ec064f10 msgr2=0x7ff9ec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff9ec064f10 0x7ff9ec0673c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa00063ca0 tx=0x7ffa000668f0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9f80e6530 msgr2=0x7ff9f803cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9f80e6530 0x7ff9f803cd20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000e7f0 tx=0x7ff9f000eb00 comp rx=0 tx=0).stop 2023-11-08T12:28:25.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 shutdown_connections 2023-11-08T12:28:25.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff9ec064f10 0x7ff9ec0673c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9f80e6530 0x7ff9f803cd20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9f803ac80 0x7ff9f8039d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 --2- 172.21.15.112:0/2741787349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9f80383e0 0x7ff9f80d8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 >> 172.21.15.112:0/2741787349 conn(0x7ff9f8055c80 msgr2=0x7ff9f80387b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.573+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 shutdown_connections 2023-11-08T12:28:25.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.577+0000 7ff9fffff700 1 -- 172.21.15.112:0/2741787349 wait complete. 2023-11-08T12:28:25.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.593+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23c80ca300 con 0x7f23c80c57d0 2023-11-08T12:28:25.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.593+0000 7f23beffd700 1 -- 172.21.15.112:0/1810797355 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23c4020090 con 0x7f23c80c57d0 2023-11-08T12:28:25.601 INFO:teuthology.orchestra.run.smithi112.stdout:64424509452 2023-11-08T12:28:25.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23ac064f40 msgr2=0x7f23ac0673f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23ac064f40 0x7f23ac0673f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009b50 tx=0x7f23b8009240 comp rx=0 tx=0).stop 2023-11-08T12:28:25.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 msgr2=0x7f23c80cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c80cc700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23c4016000 tx=0x7f23c4004770 comp rx=0 tx=0).stop 2023-11-08T12:28:25.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 shutdown_connections 2023-11-08T12:28:25.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23ac064f40 0x7f23ac0673f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80d2090 0x7f23c80b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80c57d0 0x7f23c80cc700 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 --2- 172.21.15.112:0/1810797355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c806a340 0x7f23c80cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 >> 172.21.15.112:0/1810797355 conn(0x7f23c80b6520 msgr2=0x7f23c80afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2023-11-08T12:28:25.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 shutdown_connections 2023-11-08T12:28:25.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.601+0000 7f23bcff9700 1 -- 172.21.15.112:0/1810797355 wait complete. 2023-11-08T12:28:25.607 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.617+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2084005840 con 0x7f2084055690 2023-11-08T12:28:25.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.621+0000 7f2081ffb700 1 -- 172.21.15.112:0/724989772 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f207c053c10 con 0x7f2084055690 2023-11-08T12:28:25.622 INFO:teuthology.orchestra.run.smithi112.stdout:68719476748 2023-11-08T12:28:25.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2070064fb0 msgr2=0x7f2070067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2070064fb0 0x7f2070067460 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2084011f70 tx=0x7f2088010000 comp rx=0 tx=0).stop 2023-11-08T12:28:25.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 msgr2=0x7f20840df2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f20840df2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f207c00b4a0 tx=0x7f207c00b860 comp rx=0 tx=0).stop 2023-11-08T12:28:25.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 shutdown_connections 2023-11-08T12:28:25.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2070064fb0 0x7f2070067460 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20840e26f0 0x7f20840d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2084055690 0x7f20840df2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 --2- 172.21.15.112:0/724989772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208403b080 0x7f20840deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 >> 172.21.15.112:0/724989772 conn(0x7f2084055b40 msgr2=0x7f2084056c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 shutdown_connections 2023-11-08T12:28:25.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f209225a700 1 -- 172.21.15.112:0/724989772 wait complete. 2023-11-08T12:28:25.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5200c8670 con 0x7fc52015c640 2023-11-08T12:28:25.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f84ec073cb0 con 0x7f84ec0cc860 2023-11-08T12:28:25.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.0 2023-11-08T12:28:25.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7f84daffd700 1 -- 172.21.15.112:0/1707167487 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84e4050150 con 0x7f84ec0cc860 2023-11-08T12:28:25.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.625+0000 7fc5167fc700 1 -- 172.21.15.112:0/3266613219 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5200c8670 con 0x7fc52015c640 2023-11-08T12:28:25.633 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.634 INFO:teuthology.orchestra.run.smithi112.stdout:64424509451 2023-11-08T12:28:25.634 INFO:teuthology.orchestra.run.smithi112.stdout:64424509453 2023-11-08T12:28:25.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f74d40726c0 con 0x7f74d415c680 2023-11-08T12:28:25.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc504064f30 msgr2=0x7fc5040673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc504064f30 0x7fc5040673e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc510000c00 tx=0x7fc510008030 comp rx=0 tx=0).stop 2023-11-08T12:28:25.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f74d1ffb700 1 -- 172.21.15.112:0/2827323984 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74c40263e0 con 0x7f74d415c680 2023-11-08T12:28:25.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 msgr2=0x7fc5200c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200c8950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc518007ac0 tx=0x7fc518007e80 comp rx=0 tx=0).stop 2023-11-08T12:28:25.637 INFO:teuthology.orchestra.run.smithi112.stdout:64424509452 2023-11-08T12:28:25.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 shutdown_connections 2023-11-08T12:28:25.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc504064f30 0x7fc5040673e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52015c640 0x7fc5200c8950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc520071aa0 0x7fc520155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 --2- 172.21.15.112:0/3266613219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc520069e00 0x7fc520092bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 >> 172.21.15.112:0/3266613219 conn(0x7fc5200b6520 msgr2=0x7fc5200b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5df40c5210 con 0x7f5df4070790 2023-11-08T12:28:25.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 shutdown_connections 2023-11-08T12:28:25.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7fc5280b5700 1 -- 172.21.15.112:0/3266613219 wait complete. 2023-11-08T12:28:25.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f84cc064ee0 msgr2=0x7f84cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f84cc064ee0 0x7f84cc067390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84e00090b0 tx=0x7f84e0008030 comp rx=0 tx=0).stop 2023-11-08T12:28:25.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 msgr2=0x7f84ec0b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec0b3f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84e400efc0 tx=0x7f84e400c3a0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f5de2ffd700 1 -- 172.21.15.112:0/3630740517 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5df40c5210 con 0x7f5df4070790 2023-11-08T12:28:25.643 INFO:teuthology.orchestra.run.smithi112.stdout:68719476748 2023-11-08T12:28:25.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 shutdown_connections 2023-11-08T12:28:25.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f84cc064ee0 0x7f84cc067390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84ec160710 0x7f84ec15da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84ec0cc860 0x7f84ec0b3f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 --2- 172.21.15.112:0/1707167487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec0705c0 0x7f84ec150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.629+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 >> 172.21.15.112:0/1707167487 conn(0x7f84ec0b0f80 msgr2=0x7f84ec06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 shutdown_connections 2023-11-08T12:28:25.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f84f0d70700 1 -- 172.21.15.112:0/1707167487 wait complete. 2023-11-08T12:28:25.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f74c0064ee0 msgr2=0x7f74c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f74c0064ee0 0x7f74c0067390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000c00 tx=0x7f74cc0079b0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74d415c680 msgr2=0x7f74d40cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74d415c680 0x7f74d40cbce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74c4016000 tx=0x7f74c4004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 shutdown_connections 2023-11-08T12:28:25.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f74c0064ee0 0x7f74c0067390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74d415c680 0x7f74d40cbce0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74d40ce570 0x7f74d415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 --2- 172.21.15.112:0/2827323984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74d40ce100 0x7f74d41f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 >> 172.21.15.112:0/2827323984 conn(0x7f74d40d2c00 msgr2=0x7f74d40b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 shutdown_connections 2023-11-08T12:28:25.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f74db2d1700 1 -- 172.21.15.112:0/2827323984 wait complete. 2023-11-08T12:28:25.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5dd4064ee0 msgr2=0x7f5dd4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5dd4064ee0 0x7f5dd4067390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5df4071940 tx=0x7f5de8009240 comp rx=0 tx=0).stop 2023-11-08T12:28:25.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5df4070790 msgr2=0x7f5df40c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5df4070790 0x7f5df40c3b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00cb10 tx=0x7f5dec00cbf0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 shutdown_connections 2023-11-08T12:28:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5dd4064ee0 0x7f5dd4067390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5df40caa70 0x7f5df4146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5df40b3fa0 0x7f5df40c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 --2- 172.21.15.112:0/3630740517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5df4070790 0x7f5df40c3b20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 >> 172.21.15.112:0/3630740517 conn(0x7f5df40b0f90 msgr2=0x7f5df40af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 shutdown_connections 2023-11-08T12:28:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.633+0000 7f5df8e8e700 1 -- 172.21.15.112:0/3630740517 wait complete. 2023-11-08T12:28:25.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.6 2023-11-08T12:28:25.652 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.3 2023-11-08T12:28:25.654 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2023-11-08T12:28:25.661 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.4 2023-11-08T12:28:25.664 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.7 2023-11-08T12:28:25.665 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.677+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f243c005890 con 0x7f2454054800 2023-11-08T12:28:25.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.677+0000 7f2447fff700 1 -- 172.21.15.112:0/1251402496 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f245c0ca950 con 0x7f2454054800 2023-11-08T12:28:25.681 INFO:teuthology.orchestra.run.smithi112.stdout:64424509450 2023-11-08T12:28:25.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2440064f40 msgr2=0x7f24400673f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2440064f40 0x7f24400673f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2448000f60 tx=0x7f2448007f30 comp rx=0 tx=0).stop 2023-11-08T12:28:25.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2454054800 msgr2=0x7f2454038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2454054800 0x7f2454038ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f245c065690 tx=0x7f245c072ce0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 shutdown_connections 2023-11-08T12:28:25.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2440064f40 0x7f24400673f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2454054800 0x7f2454038ca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f245403a640 0x7f2454049e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 --2- 172.21.15.112:0/1251402496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454036e80 0x7f2454184cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 >> 172.21.15.112:0/1251402496 conn(0x7f2454051770 msgr2=0x7f24540dc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 shutdown_connections 2023-11-08T12:28:25.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.681+0000 7f246088c700 1 -- 172.21.15.112:0/1251402496 wait complete. 2023-11-08T12:28:25.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2023-11-08T12:28:25.702 DEBUG:teuthology.parallel:result is None 2023-11-08T12:28:25.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-08T12:28:25.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:28:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.917+0000 7f8155de8700 1 Processor -- start 2023-11-08T12:28:25.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.917+0000 7f8155de8700 1 -- start start 2023-11-08T12:28:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8150158840 0x7f81500ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f815015c3b0 0x7f8150070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815006b090 con 0x7f81500c8da0 2023-11-08T12:28:25.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8150069bf0 con 0x7f8150158840 2023-11-08T12:28:25.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815015c890 con 0x7f815015c3b0 2023-11-08T12:28:25.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8150158840 0x7f81500ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8150158840 0x7f81500ad9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56616/0 (socket says 172.21.15.112:56616) 2023-11-08T12:28:25.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 -- 172.21.15.112:0/3063800075 learned_addr learned my addr 172.21.15.112:0/3063800075 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f814ffff700 1 --2- 172.21.15.112:0/3063800075 >> v2:172.21.15.133:3300/0 conn(0x7f815015c3b0 0x7f8150070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 -- 172.21.15.112:0/3063800075 >> v2:172.21.15.133:3300/0 conn(0x7f815015c3b0 msgr2=0x7f8150070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:25.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 --2- 172.21.15.112:0/3063800075 >> v2:172.21.15.133:3300/0 conn(0x7f815015c3b0 0x7f8150070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 -- 172.21.15.112:0/3063800075 >> v1:172.21.15.133:6789/0 conn(0x7f81500c8da0 legacy=0x7f815006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 -- 172.21.15.112:0/3063800075 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815015cb70 con 0x7f8150158840 2023-11-08T12:28:25.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8154de6700 1 --2- 172.21.15.112:0/3063800075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8150158840 0x7f81500ad9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f81500cf7b0 tx=0x7f814400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429e6f5cd4c9d12b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f814f7fe700 1 -- 172.21.15.112:0/3063800075 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400dc10 con 0x7f8150158840 2023-11-08T12:28:25.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f814f7fe700 1 -- 172.21.15.112:0/3063800075 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814400dd70 con 0x7f8150158840 2023-11-08T12:28:25.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f814f7fe700 1 -- 172.21.15.112:0/3063800075 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144004250 con 0x7f8150158840 2023-11-08T12:28:25.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- 172.21.15.112:0/3063800075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8150158840 msgr2=0x7f81500ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 --2- 172.21.15.112:0/3063800075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8150158840 0x7f81500ad9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f81500cf7b0 tx=0x7f814400bea0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- 172.21.15.112:0/3063800075 shutdown_connections 2023-11-08T12:28:25.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 --2- 172.21.15.112:0/3063800075 >> v2:172.21.15.133:3300/0 conn(0x7f815015c3b0 0x7f8150070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 --2- 172.21.15.112:0/3063800075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8150158840 0x7f81500ad9f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- 172.21.15.112:0/3063800075 >> 172.21.15.112:0/3063800075 conn(0x7f81500b0f80 msgr2=0x7f81500ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:25.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- 172.21.15.112:0/3063800075 shutdown_connections 2023-11-08T12:28:25.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.921+0000 7f8155de8700 1 -- 172.21.15.112:0/3063800075 wait complete. 2023-11-08T12:28:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.925+0000 7f8155de8700 1 Processor -- start 2023-11-08T12:28:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.925+0000 7f8155de8700 1 -- start start 2023-11-08T12:28:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81500c8da0 0x7f81500b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8150158840 0x7f8150145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f815015c3b0 0x7f81500c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815015aec0 con 0x7f815015c3b0 2023-11-08T12:28:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8150159fd0 con 0x7f81500c8da0 2023-11-08T12:28:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815015a2b0 con 0x7f8150158840 2023-11-08T12:28:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f815015c3b0 0x7f81500c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f815015c3b0 0x7f81500c1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56620/0 (socket says 172.21.15.112:56620) 2023-11-08T12:28:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 -- 172.21.15.112:0/2696141554 learned_addr learned my addr 172.21.15.112:0/2696141554 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8154de6700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81500c8da0 0x7f81500b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f814ffff700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8150158840 0x7f8150145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 -- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8150158840 msgr2=0x7f8150145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8150158840 0x7f8150145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 -- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81500c8da0 msgr2=0x7f81500b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81500c8da0 0x7f81500b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 -- 172.21.15.112:0/2696141554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814400b820 con 0x7f815015c3b0 2023-11-08T12:28:25.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f81555e7700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f815015c3b0 0x7f81500c1e40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f814800cc50 tx=0x7f814800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f814d7fa700 1 -- 172.21.15.112:0/2696141554 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148003c20 con 0x7f815015c3b0 2023-11-08T12:28:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f814d7fa700 1 -- 172.21.15.112:0/2696141554 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148003d80 con 0x7f815015c3b0 2023-11-08T12:28:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815015d130 con 0x7f815015c3b0 2023-11-08T12:28:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f814d7fa700 1 -- 172.21.15.112:0/2696141554 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814800aab0 con 0x7f815015c3b0 2023-11-08T12:28:25.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.929+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815015ce50 con 0x7f815015c3b0 2023-11-08T12:28:25.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.933+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8150158c10 con 0x7f815015c3b0 2023-11-08T12:28:25.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.933+0000 7f814d7fa700 1 -- 172.21.15.112:0/2696141554 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8148010050 con 0x7f815015c3b0 2023-11-08T12:28:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.937+0000 7f814d7fa700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8134064ee0 0x7f8134067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.937+0000 7f814d7fa700 1 -- 172.21.15.112:0/2696141554 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8148081f50 con 0x7f815015c3b0 2023-11-08T12:28:25.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.937+0000 7f8154de6700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8134064ee0 0x7f8134067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:25.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.937+0000 7f8154de6700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8134064ee0 0x7f8134067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8144019040 tx=0x7f8144014000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:25.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:25.941+0000 7f814d7fa700 1 -- 172.21.15.112:0/2696141554 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f814804fd10 con 0x7f815015c3b0 2023-11-08T12:28:26.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.097+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f815006b090 con 0x7f8134064ee0 2023-11-08T12:28:26.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.109+0000 7f814d7fa700 1 -- 172.21.15.112:0/2696141554 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367166 (secure 0 0 0) 0x7f815006b090 con 0x7f8134064ee0 2023-11-08T12:28:26.119 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:26.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8134064ee0 msgr2=0x7f8134067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8134064ee0 0x7f8134067390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8144019040 tx=0x7f8144014000 comp rx=0 tx=0).stop 2023-11-08T12:28:26.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f815015c3b0 msgr2=0x7f81500c1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f815015c3b0 0x7f81500c1e40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f814800cc50 tx=0x7f814800cf60 comp rx=0 tx=0).stop 2023-11-08T12:28:26.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 shutdown_connections 2023-11-08T12:28:26.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8134064ee0 0x7f8134067390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f815015c3b0 0x7f81500c1e40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8150158840 0x7f8150145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 --2- 172.21.15.112:0/2696141554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81500c8da0 0x7f81500b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 >> 172.21.15.112:0/2696141554 conn(0x7f81500b0f80 msgr2=0x7f8150153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:26.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 shutdown_connections 2023-11-08T12:28:26.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.117+0000 7f8155de8700 1 -- 172.21.15.112:0/2696141554 wait complete. 2023-11-08T12:28:26.124 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:28:26.146 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-11-08T12:28:24.717630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67592,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907128,"statfs":{"total":773094113280,"available":773024899072,"internally_reserved":0,"allocated":3678208,"data_stored":2187254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005453"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734482+0000","last_change":"2023-11-08T12:27:58.143715+0000","last_active":"2023-11-08T12:27:58.734482+0000","last_peered":"2023-11-08T12:27:58.734482+0000","last_clean":"2023-11-08T12:27:58.734482+0000","last_became_active":"2023-11-08T12:27:58.143212+0000","last_became_peered":"2023-11-08T12:27:58.143212+0000","last_unstale":"2023-11-08T12:27:58.734482+0000","last_undegraded":"2023-11-08T12:27:58.734482+0000","last_fullsized":"2023-11-08T12:27:58.734482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:00:05.519929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130697+0000","last_change":"2023-11-08T12:27:53.619554+0000","last_active":"2023-11-08T12:27:58.130697+0000","last_peered":"2023-11-08T12:27:58.130697+0000","last_clean":"2023-11-08T12:27:58.130697+0000","last_became_active":"2023-11-08T12:27:53.618719+0000","last_became_peered":"2023-11-08T12:27:53.618719+0000","last_unstale":"2023-11-08T12:27:58.130697+0000","last_undegraded":"2023-11-08T12:27:58.130697+0000","last_fullsized":"2023-11-08T12:27:58.130697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126104+0000","last_change":"2023-11-08T12:27:54.093845+0000","last_active":"2023-11-08T12:27:58.126104+0000","last_peered":"2023-11-08T12:27:58.126104+0000","last_clean":"2023-11-08T12:27:58.126104+0000","last_became_active":"2023-11-08T12:27:54.093578+0000","last_became_peered":"2023-11-08T12:27:54.093578+0000","last_unstale":"2023-11-08T12:27:58.126104+0000","last_undegraded":"2023-11-08T12:27:58.126104+0000","last_fullsized":"2023-11-08T12:27:58.126104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625901+0000","last_change":"2023-11-08T12:27:58.137408+0000","last_active":"2023-11-08T12:27:58.625901+0000","last_peered":"2023-11-08T12:27:58.625901+0000","last_clean":"2023-11-08T12:27:58.625901+0000","last_became_active":"2023-11-08T12:27:58.136515+0000","last_became_peered":"2023-11-08T12:27:58.136515+0000","last_unstale":"2023-11-08T12:27:58.625901+0000","last_undegraded":"2023-11-08T12:27:58.625901+0000","last_fullsized":"2023-11-08T12:27:58.625901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:02:41.434275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.116564+0000","last_change":"2023-11-08T12:27:53.619875+0000","last_active":"2023-11-08T12:27:58.116564+0000","last_peered":"2023-11-08T12:27:58.116564+0000","last_clean":"2023-11-08T12:27:58.116564+0000","last_became_active":"2023-11-08T12:27:53.619543+0000","last_became_peered":"2023-11-08T12:27:53.619543+0000","last_unstale":"2023-11-08T12:27:58.116564+0000","last_undegraded":"2023-11-08T12:27:58.116564+0000","last_fullsized":"2023-11-08T12:27:58.116564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111227+0000","last_change":"2023-11-08T12:27:54.083208+0000","last_active":"2023-11-08T12:27:58.111227+0000","last_peered":"2023-11-08T12:27:58.111227+0000","last_clean":"2023-11-08T12:27:58.111227+0000","last_became_active":"2023-11-08T12:27:54.082680+0000","last_became_peered":"2023-11-08T12:27:54.082680+0000","last_unstale":"2023-11-08T12:27:58.111227+0000","last_undegraded":"2023-11-08T12:27:58.111227+0000","last_fullsized":"2023-11-08T12:27:58.111227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574345+0000","last_change":"2023-11-08T12:27:58.142185+0000","last_active":"2023-11-08T12:27:58.574345+0000","last_peered":"2023-11-08T12:27:58.574345+0000","last_clean":"2023-11-08T12:27:58.574345+0000","last_became_active":"2023-11-08T12:27:58.141842+0000","last_became_peered":"2023-11-08T12:27:58.141842+0000","last_unstale":"2023-11-08T12:27:58.574345+0000","last_undegraded":"2023-11-08T12:27:58.574345+0000","last_fullsized":"2023-11-08T12:27:58.574345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:02:41.632614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110470+0000","last_change":"2023-11-08T12:27:53.624797+0000","last_active":"2023-11-08T12:27:58.110470+0000","last_peered":"2023-11-08T12:27:58.110470+0000","last_clean":"2023-11-08T12:27:58.110470+0000","last_became_active":"2023-11-08T12:27:53.624543+0000","last_became_peered":"2023-11-08T12:27:53.624543+0000","last_unstale":"2023-11-08T12:27:58.110470+0000","last_undegraded":"2023-11-08T12:27:58.110470+0000","last_fullsized":"2023-11-08T12:27:58.110470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:30.363156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127249+0000","last_change":"2023-11-08T12:27:54.100828+0000","last_active":"2023-11-08T12:27:58.127249+0000","last_peered":"2023-11-08T12:27:58.127249+0000","last_clean":"2023-11-08T12:27:58.127249+0000","last_became_active":"2023-11-08T12:27:54.100558+0000","last_became_peered":"2023-11-08T12:27:54.100558+0000","last_unstale":"2023-11-08T12:27:58.127249+0000","last_undegraded":"2023-11-08T12:27:58.127249+0000","last_fullsized":"2023-11-08T12:27:58.127249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879088+0000","last_change":"2023-11-08T12:27:58.154104+0000","last_active":"2023-11-08T12:27:58.879088+0000","last_peered":"2023-11-08T12:27:58.879088+0000","last_clean":"2023-11-08T12:27:58.879088+0000","last_became_active":"2023-11-08T12:27:58.153162+0000","last_became_peered":"2023-11-08T12:27:58.153162+0000","last_unstale":"2023-11-08T12:27:58.879088+0000","last_undegraded":"2023-11-08T12:27:58.879088+0000","last_fullsized":"2023-11-08T12:27:58.879088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109644+0000","last_change":"2023-11-08T12:27:53.622313+0000","last_active":"2023-11-08T12:27:58.109644+0000","last_peered":"2023-11-08T12:27:58.109644+0000","last_clean":"2023-11-08T12:27:58.109644+0000","last_became_active":"2023-11-08T12:27:53.621963+0000","last_became_peered":"2023-11-08T12:27:53.621963+0000","last_unstale":"2023-11-08T12:27:58.109644+0000","last_undegraded":"2023-11-08T12:27:58.109644+0000","last_fullsized":"2023-11-08T12:27:58.109644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:58.001489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127020+0000","last_change":"2023-11-08T12:27:54.096898+0000","last_active":"2023-11-08T12:27:58.127020+0000","last_peered":"2023-11-08T12:27:58.127020+0000","last_clean":"2023-11-08T12:27:58.127020+0000","last_became_active":"2023-11-08T12:27:54.096604+0000","last_became_peered":"2023-11-08T12:27:54.096604+0000","last_unstale":"2023-11-08T12:27:58.127020+0000","last_undegraded":"2023-11-08T12:27:58.127020+0000","last_fullsized":"2023-11-08T12:27:58.127020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735720+0000","last_change":"2023-11-08T12:27:58.144552+0000","last_active":"2023-11-08T12:27:58.735720+0000","last_peered":"2023-11-08T12:27:58.735720+0000","last_clean":"2023-11-08T12:27:58.735720+0000","last_became_active":"2023-11-08T12:27:58.144149+0000","last_became_peered":"2023-11-08T12:27:58.144149+0000","last_unstale":"2023-11-08T12:27:58.735720+0000","last_undegraded":"2023-11-08T12:27:58.735720+0000","last_fullsized":"2023-11-08T12:27:58.735720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.131880+0000","last_change":"2023-11-08T12:27:53.626681+0000","last_active":"2023-11-08T12:27:58.131880+0000","last_peered":"2023-11-08T12:27:58.131880+0000","last_clean":"2023-11-08T12:27:58.131880+0000","last_became_active":"2023-11-08T12:27:53.625885+0000","last_became_peered":"2023-11-08T12:27:53.625885+0000","last_unstale":"2023-11-08T12:27:58.131880+0000","last_undegraded":"2023-11-08T12:27:58.131880+0000","last_fullsized":"2023-11-08T12:27:58.131880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112234+0000","last_change":"2023-11-08T12:27:54.089379+0000","last_active":"2023-11-08T12:27:58.112234+0000","last_peered":"2023-11-08T12:27:58.112234+0000","last_clean":"2023-11-08T12:27:58.112234+0000","last_became_active":"2023-11-08T12:27:54.089095+0000","last_became_peered":"2023-11-08T12:27:54.089095+0000","last_unstale":"2023-11-08T12:27:58.112234+0000","last_undegraded":"2023-11-08T12:27:58.112234+0000","last_fullsized":"2023-11-08T12:27:58.112234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:02.028291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.626502+0000","last_change":"2023-11-08T12:27:58.143308+0000","last_active":"2023-11-08T12:27:58.626502+0000","last_peered":"2023-11-08T12:27:58.626502+0000","last_clean":"2023-11-08T12:27:58.626502+0000","last_became_active":"2023-11-08T12:27:58.142966+0000","last_became_peered":"2023-11-08T12:27:58.142966+0000","last_unstale":"2023-11-08T12:27:58.626502+0000","last_undegraded":"2023-11-08T12:27:58.626502+0000","last_fullsized":"2023-11-08T12:27:58.626502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:55.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127396+0000","last_change":"2023-11-08T12:27:53.627388+0000","last_active":"2023-11-08T12:27:58.127396+0000","last_peered":"2023-11-08T12:27:58.127396+0000","last_clean":"2023-11-08T12:27:58.127396+0000","last_became_active":"2023-11-08T12:27:53.625097+0000","last_became_peered":"2023-11-08T12:27:53.625097+0000","last_unstale":"2023-11-08T12:27:58.127396+0000","last_undegraded":"2023-11-08T12:27:58.127396+0000","last_fullsized":"2023-11-08T12:27:58.127396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:48.205657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112661+0000","last_change":"2023-11-08T12:27:54.091732+0000","last_active":"2023-11-08T12:27:58.112661+0000","last_peered":"2023-11-08T12:27:58.112661+0000","last_clean":"2023-11-08T12:27:58.112661+0000","last_became_active":"2023-11-08T12:27:54.090672+0000","last_became_peered":"2023-11-08T12:27:54.090672+0000","last_unstale":"2023-11-08T12:27:58.112661+0000","last_undegraded":"2023-11-08T12:27:58.112661+0000","last_fullsized":"2023-11-08T12:27:58.112661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.068573+0000","last_change":"2023-11-08T12:27:58.149046+0000","last_active":"2023-11-08T12:27:59.068573+0000","last_peered":"2023-11-08T12:27:59.068573+0000","last_clean":"2023-11-08T12:27:59.068573+0000","last_became_active":"2023-11-08T12:27:58.148283+0000","last_became_peered":"2023-11-08T12:27:58.148283+0000","last_unstale":"2023-11-08T12:27:59.068573+0000","last_undegraded":"2023-11-08T12:27:59.068573+0000","last_fullsized":"2023-11-08T12:27:59.068573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:06.214828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123874+0000","last_change":"2023-11-08T12:27:53.618474+0000","last_active":"2023-11-08T12:27:58.123874+0000","last_peered":"2023-11-08T12:27:58.123874+0000","last_clean":"2023-11-08T12:27:58.123874+0000","last_became_active":"2023-11-08T12:27:53.617981+0000","last_became_peered":"2023-11-08T12:27:53.617981+0000","last_unstale":"2023-11-08T12:27:58.123874+0000","last_undegraded":"2023-11-08T12:27:58.123874+0000","last_fullsized":"2023-11-08T12:27:58.123874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128422+0000","last_change":"2023-11-08T12:27:54.116480+0000","last_active":"2023-11-08T12:27:58.128422+0000","last_peered":"2023-11-08T12:27:58.128422+0000","last_clean":"2023-11-08T12:27:58.128422+0000","last_became_active":"2023-11-08T12:27:54.116211+0000","last_became_peered":"2023-11-08T12:27:54.116211+0000","last_unstale":"2023-11-08T12:27:58.128422+0000","last_undegraded":"2023-11-08T12:27:58.128422+0000","last_fullsized":"2023-11-08T12:27:58.128422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727992+0000","last_change":"2023-11-08T12:27:58.145667+0000","last_active":"2023-11-08T12:27:58.727992+0000","last_peered":"2023-11-08T12:27:58.727992+0000","last_clean":"2023-11-08T12:27:58.727992+0000","last_became_active":"2023-11-08T12:27:58.145298+0000","last_became_peered":"2023-11-08T12:27:58.145298+0000","last_unstale":"2023-11-08T12:27:58.727992+0000","last_undegraded":"2023-11-08T12:27:58.727992+0000","last_fullsized":"2023-11-08T12:27:58.727992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112268+0000","last_change":"2023-11-08T12:27:53.612017+0000","last_active":"2023-11-08T12:27:58.112268+0000","last_peered":"2023-11-08T12:27:58.112268+0000","last_clean":"2023-11-08T12:27:58.112268+0000","last_became_active":"2023-11-08T12:27:53.611179+0000","last_became_peered":"2023-11-08T12:27:53.611179+0000","last_unstale":"2023-11-08T12:27:58.112268+0000","last_undegraded":"2023-11-08T12:27:58.112268+0000","last_fullsized":"2023-11-08T12:27:58.112268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135571+0000","last_change":"2023-11-08T12:27:54.089485+0000","last_active":"2023-11-08T12:27:58.135571+0000","last_peered":"2023-11-08T12:27:58.135571+0000","last_clean":"2023-11-08T12:27:58.135571+0000","last_became_active":"2023-11-08T12:27:54.089151+0000","last_became_peered":"2023-11-08T12:27:54.089151+0000","last_unstale":"2023-11-08T12:27:58.135571+0000","last_undegraded":"2023-11-08T12:27:58.135571+0000","last_fullsized":"2023-11-08T12:27:58.135571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:14.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111497+0000","last_change":"2023-11-08T12:27:54.084403+0000","last_active":"2023-11-08T12:27:58.111497+0000","last_peered":"2023-11-08T12:27:58.111497+0000","last_clean":"2023-11-08T12:27:58.111497+0000","last_became_active":"2023-11-08T12:27:54.084144+0000","last_became_peered":"2023-11-08T12:27:54.084144+0000","last_unstale":"2023-11-08T12:27:58.111497+0000","last_undegraded":"2023-11-08T12:27:58.111497+0000","last_fullsized":"2023-11-08T12:27:58.111497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130737+0000","last_change":"2023-11-08T12:27:53.621364+0000","last_active":"2023-11-08T12:27:58.130737+0000","last_peered":"2023-11-08T12:27:58.130737+0000","last_clean":"2023-11-08T12:27:58.130737+0000","last_became_active":"2023-11-08T12:27:53.619170+0000","last_became_peered":"2023-11-08T12:27:53.619170+0000","last_unstale":"2023-11-08T12:27:58.130737+0000","last_undegraded":"2023-11-08T12:27:58.130737+0000","last_fullsized":"2023-11-08T12:27:58.130737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067445+0000","last_change":"2023-11-08T12:27:58.143148+0000","last_active":"2023-11-08T12:27:59.067445+0000","last_peered":"2023-11-08T12:27:59.067445+0000","last_clean":"2023-11-08T12:27:59.067445+0000","last_became_active":"2023-11-08T12:27:58.142740+0000","last_became_peered":"2023-11-08T12:27:58.142740+0000","last_unstale":"2023-11-08T12:27:59.067445+0000","last_undegraded":"2023-11-08T12:27:59.067445+0000","last_fullsized":"2023-11-08T12:27:59.067445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:35.390792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111098+0000","last_change":"2023-11-08T12:27:54.117016+0000","last_active":"2023-11-08T12:27:58.111098+0000","last_peered":"2023-11-08T12:27:58.111098+0000","last_clean":"2023-11-08T12:27:58.111098+0000","last_became_active":"2023-11-08T12:27:54.116727+0000","last_became_peered":"2023-11-08T12:27:54.116727+0000","last_unstale":"2023-11-08T12:27:58.111098+0000","last_undegraded":"2023-11-08T12:27:58.111098+0000","last_fullsized":"2023-11-08T12:27:58.111098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110642+0000","last_change":"2023-11-08T12:27:53.615988+0000","last_active":"2023-11-08T12:27:58.110642+0000","last_peered":"2023-11-08T12:27:58.110642+0000","last_clean":"2023-11-08T12:27:58.110642+0000","last_became_active":"2023-11-08T12:27:53.615438+0000","last_became_peered":"2023-11-08T12:27:53.615438+0000","last_unstale":"2023-11-08T12:27:58.110642+0000","last_undegraded":"2023-11-08T12:27:58.110642+0000","last_fullsized":"2023-11-08T12:27:58.110642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:35.164663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878583+0000","last_change":"2023-11-08T12:27:58.153999+0000","last_active":"2023-11-08T12:27:58.878583+0000","last_peered":"2023-11-08T12:27:58.878583+0000","last_clean":"2023-11-08T12:27:58.878583+0000","last_became_active":"2023-11-08T12:27:58.152623+0000","last_became_peered":"2023-11-08T12:27:58.152623+0000","last_unstale":"2023-11-08T12:27:58.878583+0000","last_undegraded":"2023-11-08T12:27:58.878583+0000","last_fullsized":"2023-11-08T12:27:58.878583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122939+0000","last_change":"2023-11-08T12:27:53.621214+0000","last_active":"2023-11-08T12:27:58.122939+0000","last_peered":"2023-11-08T12:27:58.122939+0000","last_clean":"2023-11-08T12:27:58.122939+0000","last_became_active":"2023-11-08T12:27:53.620914+0000","last_became_peered":"2023-11-08T12:27:53.620914+0000","last_unstale":"2023-11-08T12:27:58.122939+0000","last_undegraded":"2023-11-08T12:27:58.122939+0000","last_fullsized":"2023-11-08T12:27:58.122939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:07.559515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127137+0000","last_change":"2023-11-08T12:27:54.093415+0000","last_active":"2023-11-08T12:27:58.127137+0000","last_peered":"2023-11-08T12:27:58.127137+0000","last_clean":"2023-11-08T12:27:58.127137+0000","last_became_active":"2023-11-08T12:27:54.092409+0000","last_became_peered":"2023-11-08T12:27:54.092409+0000","last_unstale":"2023-11-08T12:27:58.127137+0000","last_undegraded":"2023-11-08T12:27:58.127137+0000","last_fullsized":"2023-11-08T12:27:58.127137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572683+0000","last_change":"2023-11-08T12:27:58.143576+0000","last_active":"2023-11-08T12:27:58.572683+0000","last_peered":"2023-11-08T12:27:58.572683+0000","last_clean":"2023-11-08T12:27:58.572683+0000","last_became_active":"2023-11-08T12:27:58.143166+0000","last_became_peered":"2023-11-08T12:27:58.143166+0000","last_unstale":"2023-11-08T12:27:58.572683+0000","last_undegraded":"2023-11-08T12:27:58.572683+0000","last_fullsized":"2023-11-08T12:27:58.572683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:28:10.838649+0000","last_change":"2023-11-08T12:27:53.627035+0000","last_active":"2023-11-08T12:28:10.838649+0000","last_peered":"2023-11-08T12:28:10.838649+0000","last_clean":"2023-11-08T12:28:10.838649+0000","last_became_active":"2023-11-08T12:27:53.625128+0000","last_became_peered":"2023-11-08T12:27:53.625128+0000","last_unstale":"2023-11-08T12:28:10.838649+0000","last_undegraded":"2023-11-08T12:28:10.838649+0000","last_fullsized":"2023-11-08T12:28:10.838649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127106+0000","last_change":"2023-11-08T12:27:54.095419+0000","last_active":"2023-11-08T12:27:58.127106+0000","last_peered":"2023-11-08T12:27:58.127106+0000","last_clean":"2023-11-08T12:27:58.127106+0000","last_became_active":"2023-11-08T12:27:54.095149+0000","last_became_peered":"2023-11-08T12:27:54.095149+0000","last_unstale":"2023-11-08T12:27:58.127106+0000","last_undegraded":"2023-11-08T12:27:58.127106+0000","last_fullsized":"2023-11-08T12:27:58.127106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734672+0000","last_change":"2023-11-08T12:27:58.153991+0000","last_active":"2023-11-08T12:27:58.734672+0000","last_peered":"2023-11-08T12:27:58.734672+0000","last_clean":"2023-11-08T12:27:58.734672+0000","last_became_active":"2023-11-08T12:27:58.153570+0000","last_became_peered":"2023-11-08T12:27:58.153570+0000","last_unstale":"2023-11-08T12:27:58.734672+0000","last_undegraded":"2023-11-08T12:27:58.734672+0000","last_fullsized":"2023-11-08T12:27:58.734672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:18:44.567768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126320+0000","last_change":"2023-11-08T12:27:54.097273+0000","last_active":"2023-11-08T12:27:58.126320+0000","last_peered":"2023-11-08T12:27:58.126320+0000","last_clean":"2023-11-08T12:27:58.126320+0000","last_became_active":"2023-11-08T12:27:54.097022+0000","last_became_peered":"2023-11-08T12:27:54.097022+0000","last_unstale":"2023-11-08T12:27:58.126320+0000","last_undegraded":"2023-11-08T12:27:58.126320+0000","last_fullsized":"2023-11-08T12:27:58.126320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135667+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:27:58.135667+0000","last_peered":"2023-11-08T12:27:58.135667+0000","last_clean":"2023-11-08T12:27:58.135667+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:27:58.135667+0000","last_undegraded":"2023-11-08T12:27:58.135667+0000","last_fullsized":"2023-11-08T12:27:58.135667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.728537+0000","last_change":"2023-11-08T12:27:53.620399+0000","last_active":"2023-11-08T12:27:58.728537+0000","last_peered":"2023-11-08T12:27:58.728537+0000","last_clean":"2023-11-08T12:27:58.728537+0000","last_became_active":"2023-11-08T12:27:53.619858+0000","last_became_peered":"2023-11-08T12:27:53.619858+0000","last_unstale":"2023-11-08T12:27:58.728537+0000","last_undegraded":"2023-11-08T12:27:58.728537+0000","last_fullsized":"2023-11-08T12:27:58.728537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572203+0000","last_change":"2023-11-08T12:27:58.138249+0000","last_active":"2023-11-08T12:27:58.572203+0000","last_peered":"2023-11-08T12:27:58.572203+0000","last_clean":"2023-11-08T12:27:58.572203+0000","last_became_active":"2023-11-08T12:27:58.136905+0000","last_became_peered":"2023-11-08T12:27:58.136905+0000","last_unstale":"2023-11-08T12:27:58.572203+0000","last_undegraded":"2023-11-08T12:27:58.572203+0000","last_fullsized":"2023-11-08T12:27:58.572203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111643+0000","last_change":"2023-11-08T12:27:54.113672+0000","last_active":"2023-11-08T12:27:58.111643+0000","last_peered":"2023-11-08T12:27:58.111643+0000","last_clean":"2023-11-08T12:27:58.111643+0000","last_became_active":"2023-11-08T12:27:54.113329+0000","last_became_peered":"2023-11-08T12:27:54.113329+0000","last_unstale":"2023-11-08T12:27:58.111643+0000","last_undegraded":"2023-11-08T12:27:58.111643+0000","last_fullsized":"2023-11-08T12:27:58.111643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126943+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:27:58.126943+0000","last_peered":"2023-11-08T12:27:58.126943+0000","last_clean":"2023-11-08T12:27:58.126943+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:27:58.126943+0000","last_undegraded":"2023-11-08T12:27:58.126943+0000","last_fullsized":"2023-11-08T12:27:58.126943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.118099+0000","last_change":"2023-11-08T12:27:53.617273+0000","last_active":"2023-11-08T12:27:58.118099+0000","last_peered":"2023-11-08T12:27:58.118099+0000","last_clean":"2023-11-08T12:27:58.118099+0000","last_became_active":"2023-11-08T12:27:53.616974+0000","last_became_peered":"2023-11-08T12:27:53.616974+0000","last_unstale":"2023-11-08T12:27:58.118099+0000","last_undegraded":"2023-11-08T12:27:58.118099+0000","last_fullsized":"2023-11-08T12:27:58.118099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625634+0000","last_change":"2023-11-08T12:27:58.149407+0000","last_active":"2023-11-08T12:27:58.625634+0000","last_peered":"2023-11-08T12:27:58.625634+0000","last_clean":"2023-11-08T12:27:58.625634+0000","last_became_active":"2023-11-08T12:27:58.148897+0000","last_became_peered":"2023-11-08T12:27:58.148897+0000","last_unstale":"2023-11-08T12:27:58.625634+0000","last_undegraded":"2023-11-08T12:27:58.625634+0000","last_fullsized":"2023-11-08T12:27:58.625634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:49.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129170+0000","last_change":"2023-11-08T12:27:54.116232+0000","last_active":"2023-11-08T12:27:58.129170+0000","last_peered":"2023-11-08T12:27:58.129170+0000","last_clean":"2023-11-08T12:27:58.129170+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129170+0000","last_undegraded":"2023-11-08T12:27:58.129170+0000","last_fullsized":"2023-11-08T12:27:58.129170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123167+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:27:58.123167+0000","last_peered":"2023-11-08T12:27:58.123167+0000","last_clean":"2023-11-08T12:27:58.123167+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:27:58.123167+0000","last_undegraded":"2023-11-08T12:27:58.123167+0000","last_fullsized":"2023-11-08T12:27:58.123167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126485+0000","last_change":"2023-11-08T12:27:53.615162+0000","last_active":"2023-11-08T12:27:58.126485+0000","last_peered":"2023-11-08T12:27:58.126485+0000","last_clean":"2023-11-08T12:27:58.126485+0000","last_became_active":"2023-11-08T12:27:53.613969+0000","last_became_peered":"2023-11-08T12:27:53.613969+0000","last_unstale":"2023-11-08T12:27:58.126485+0000","last_undegraded":"2023-11-08T12:27:58.126485+0000","last_fullsized":"2023-11-08T12:27:58.126485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067771+0000","last_change":"2023-11-08T12:27:58.135959+0000","last_active":"2023-11-08T12:27:59.067771+0000","last_peered":"2023-11-08T12:27:59.067771+0000","last_clean":"2023-11-08T12:27:59.067771+0000","last_became_active":"2023-11-08T12:27:58.135005+0000","last_became_peered":"2023-11-08T12:27:58.135005+0000","last_unstale":"2023-11-08T12:27:59.067771+0000","last_undegraded":"2023-11-08T12:27:59.067771+0000","last_fullsized":"2023-11-08T12:27:59.067771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:40.554359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127218+0000","last_change":"2023-11-08T12:27:54.101570+0000","last_active":"2023-11-08T12:27:58.127218+0000","last_peered":"2023-11-08T12:27:58.127218+0000","last_clean":"2023-11-08T12:27:58.127218+0000","last_became_active":"2023-11-08T12:27:54.101436+0000","last_became_peered":"2023-11-08T12:27:54.101436+0000","last_unstale":"2023-11-08T12:27:58.127218+0000","last_undegraded":"2023-11-08T12:27:58.127218+0000","last_fullsized":"2023-11-08T12:27:58.127218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127048+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:27:58.127048+0000","last_peered":"2023-11-08T12:27:58.127048+0000","last_clean":"2023-11-08T12:27:58.127048+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:27:58.127048+0000","last_undegraded":"2023-11-08T12:27:58.127048+0000","last_fullsized":"2023-11-08T12:27:58.127048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110574+0000","last_change":"2023-11-08T12:27:53.610684+0000","last_active":"2023-11-08T12:27:58.110574+0000","last_peered":"2023-11-08T12:27:58.110574+0000","last_clean":"2023-11-08T12:27:58.110574+0000","last_became_active":"2023-11-08T12:27:53.610294+0000","last_became_peered":"2023-11-08T12:27:53.610294+0000","last_unstale":"2023-11-08T12:27:58.110574+0000","last_undegraded":"2023-11-08T12:27:58.110574+0000","last_fullsized":"2023-11-08T12:27:58.110574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727740+0000","last_change":"2023-11-08T12:27:58.142126+0000","last_active":"2023-11-08T12:27:58.727740+0000","last_peered":"2023-11-08T12:27:58.727740+0000","last_clean":"2023-11-08T12:27:58.727740+0000","last_became_active":"2023-11-08T12:27:58.139937+0000","last_became_peered":"2023-11-08T12:27:58.139937+0000","last_unstale":"2023-11-08T12:27:58.727740+0000","last_undegraded":"2023-11-08T12:27:58.727740+0000","last_fullsized":"2023-11-08T12:27:58.727740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:25:36.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126398+0000","last_change":"2023-11-08T12:27:54.098374+0000","last_active":"2023-11-08T12:27:58.126398+0000","last_peered":"2023-11-08T12:27:58.126398+0000","last_clean":"2023-11-08T12:27:58.126398+0000","last_became_active":"2023-11-08T12:27:54.095259+0000","last_became_peered":"2023-11-08T12:27:54.095259+0000","last_unstale":"2023-11-08T12:27:58.126398+0000","last_undegraded":"2023-11-08T12:27:58.126398+0000","last_fullsized":"2023-11-08T12:27:58.126398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127272+0000","last_change":"2023-11-08T12:27:53.624589+0000","last_active":"2023-11-08T12:27:58.127272+0000","last_peered":"2023-11-08T12:27:58.127272+0000","last_clean":"2023-11-08T12:27:58.127272+0000","last_became_active":"2023-11-08T12:27:53.624171+0000","last_became_peered":"2023-11-08T12:27:53.624171+0000","last_unstale":"2023-11-08T12:27:58.127272+0000","last_undegraded":"2023-11-08T12:27:58.127272+0000","last_fullsized":"2023-11-08T12:27:58.127272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109600+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:27:58.109600+0000","last_peered":"2023-11-08T12:27:58.109600+0000","last_clean":"2023-11-08T12:27:58.109600+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:27:58.109600+0000","last_undegraded":"2023-11-08T12:27:58.109600+0000","last_fullsized":"2023-11-08T12:27:58.109600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727835+0000","last_change":"2023-11-08T12:27:58.142674+0000","last_active":"2023-11-08T12:27:58.727835+0000","last_peered":"2023-11-08T12:27:58.727835+0000","last_clean":"2023-11-08T12:27:58.727835+0000","last_became_active":"2023-11-08T12:27:58.142302+0000","last_became_peered":"2023-11-08T12:27:58.142302+0000","last_unstale":"2023-11-08T12:27:58.727835+0000","last_undegraded":"2023-11-08T12:27:58.727835+0000","last_fullsized":"2023-11-08T12:27:58.727835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127069+0000","last_change":"2023-11-08T12:27:54.102964+0000","last_active":"2023-11-08T12:27:58.127069+0000","last_peered":"2023-11-08T12:27:58.127069+0000","last_clean":"2023-11-08T12:27:58.127069+0000","last_became_active":"2023-11-08T12:27:54.102407+0000","last_became_peered":"2023-11-08T12:27:54.102407+0000","last_unstale":"2023-11-08T12:27:58.127069+0000","last_undegraded":"2023-11-08T12:27:58.127069+0000","last_fullsized":"2023-11-08T12:27:58.127069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:05.031348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130328+0000","last_change":"2023-11-08T12:27:53.616006+0000","last_active":"2023-11-08T12:27:58.130328+0000","last_peered":"2023-11-08T12:27:58.130328+0000","last_clean":"2023-11-08T12:27:58.130328+0000","last_became_active":"2023-11-08T12:27:53.615753+0000","last_became_peered":"2023-11-08T12:27:53.615753+0000","last_unstale":"2023-11-08T12:27:58.130328+0000","last_undegraded":"2023-11-08T12:27:58.130328+0000","last_fullsized":"2023-11-08T12:27:58.130328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112019+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:27:58.112019+0000","last_peered":"2023-11-08T12:27:58.112019+0000","last_clean":"2023-11-08T12:27:58.112019+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:27:58.112019+0000","last_undegraded":"2023-11-08T12:27:58.112019+0000","last_fullsized":"2023-11-08T12:27:58.112019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575827+0000","last_change":"2023-11-08T12:27:58.150621+0000","last_active":"2023-11-08T12:27:58.575827+0000","last_peered":"2023-11-08T12:27:58.575827+0000","last_clean":"2023-11-08T12:27:58.575827+0000","last_became_active":"2023-11-08T12:27:58.150173+0000","last_became_peered":"2023-11-08T12:27:58.150173+0000","last_unstale":"2023-11-08T12:27:58.575827+0000","last_undegraded":"2023-11-08T12:27:58.575827+0000","last_fullsized":"2023-11-08T12:27:58.575827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:48.495503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128502+0000","last_change":"2023-11-08T12:27:54.105866+0000","last_active":"2023-11-08T12:27:58.128502+0000","last_peered":"2023-11-08T12:27:58.128502+0000","last_clean":"2023-11-08T12:27:58.128502+0000","last_became_active":"2023-11-08T12:27:54.105572+0000","last_became_peered":"2023-11-08T12:27:54.105572+0000","last_unstale":"2023-11-08T12:27:58.128502+0000","last_undegraded":"2023-11-08T12:27:58.128502+0000","last_fullsized":"2023-11-08T12:27:58.128502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.120729+0000","last_change":"2023-11-08T12:27:53.626369+0000","last_active":"2023-11-08T12:27:58.120729+0000","last_peered":"2023-11-08T12:27:58.120729+0000","last_clean":"2023-11-08T12:27:58.120729+0000","last_became_active":"2023-11-08T12:27:53.625999+0000","last_became_peered":"2023-11-08T12:27:53.625999+0000","last_unstale":"2023-11-08T12:27:58.120729+0000","last_undegraded":"2023-11-08T12:27:58.120729+0000","last_fullsized":"2023-11-08T12:27:58.120729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124321+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:27:58.124321+0000","last_peered":"2023-11-08T12:27:58.124321+0000","last_clean":"2023-11-08T12:27:58.124321+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:27:58.124321+0000","last_undegraded":"2023-11-08T12:27:58.124321+0000","last_fullsized":"2023-11-08T12:27:58.124321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574864+0000","last_change":"2023-11-08T12:27:58.143351+0000","last_active":"2023-11-08T12:27:58.574864+0000","last_peered":"2023-11-08T12:27:58.574864+0000","last_clean":"2023-11-08T12:27:58.574864+0000","last_became_active":"2023-11-08T12:27:58.142889+0000","last_became_peered":"2023-11-08T12:27:58.142889+0000","last_unstale":"2023-11-08T12:27:58.574864+0000","last_undegraded":"2023-11-08T12:27:58.574864+0000","last_fullsized":"2023-11-08T12:27:58.574864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134390+0000","last_change":"2023-11-08T12:27:54.094331+0000","last_active":"2023-11-08T12:27:58.134390+0000","last_peered":"2023-11-08T12:27:58.134390+0000","last_clean":"2023-11-08T12:27:58.134390+0000","last_became_active":"2023-11-08T12:27:54.093211+0000","last_became_peered":"2023-11-08T12:27:54.093211+0000","last_unstale":"2023-11-08T12:27:58.134390+0000","last_undegraded":"2023-11-08T12:27:58.134390+0000","last_fullsized":"2023-11-08T12:27:58.134390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112852+0000","last_change":"2023-11-08T12:27:53.602187+0000","last_active":"2023-11-08T12:27:58.112852+0000","last_peered":"2023-11-08T12:27:58.112852+0000","last_clean":"2023-11-08T12:27:58.112852+0000","last_became_active":"2023-11-08T12:27:53.601789+0000","last_became_peered":"2023-11-08T12:27:53.601789+0000","last_unstale":"2023-11-08T12:27:58.112852+0000","last_undegraded":"2023-11-08T12:27:58.112852+0000","last_fullsized":"2023-11-08T12:27:58.112852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109985+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:27:58.109985+0000","last_peered":"2023-11-08T12:27:58.109985+0000","last_clean":"2023-11-08T12:27:58.109985+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:27:58.109985+0000","last_undegraded":"2023-11-08T12:27:58.109985+0000","last_fullsized":"2023-11-08T12:27:58.109985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124400+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:27:58.124400+0000","last_peered":"2023-11-08T12:27:58.124400+0000","last_clean":"2023-11-08T12:27:58.124400+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:27:58.124400+0000","last_undegraded":"2023-11-08T12:27:58.124400+0000","last_fullsized":"2023-11-08T12:27:58.124400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879351+0000","last_change":"2023-11-08T12:27:58.142022+0000","last_active":"2023-11-08T12:27:58.879351+0000","last_peered":"2023-11-08T12:27:58.879351+0000","last_clean":"2023-11-08T12:27:58.879351+0000","last_became_active":"2023-11-08T12:27:58.141645+0000","last_became_peered":"2023-11-08T12:27:58.141645+0000","last_unstale":"2023-11-08T12:27:58.879351+0000","last_undegraded":"2023-11-08T12:27:58.879351+0000","last_fullsized":"2023-11-08T12:27:58.879351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126920+0000","last_change":"2023-11-08T12:27:54.098077+0000","last_active":"2023-11-08T12:27:58.126920+0000","last_peered":"2023-11-08T12:27:58.126920+0000","last_clean":"2023-11-08T12:27:58.126920+0000","last_became_active":"2023-11-08T12:27:54.097691+0000","last_became_peered":"2023-11-08T12:27:54.097691+0000","last_unstale":"2023-11-08T12:27:58.126920+0000","last_undegraded":"2023-11-08T12:27:58.126920+0000","last_fullsized":"2023-11-08T12:27:58.126920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112388+0000","last_change":"2023-11-08T12:27:53.618293+0000","last_active":"2023-11-08T12:27:58.112388+0000","last_peered":"2023-11-08T12:27:58.112388+0000","last_clean":"2023-11-08T12:27:58.112388+0000","last_became_active":"2023-11-08T12:27:53.618041+0000","last_became_peered":"2023-11-08T12:27:53.618041+0000","last_unstale":"2023-11-08T12:27:58.112388+0000","last_undegraded":"2023-11-08T12:27:58.112388+0000","last_fullsized":"2023-11-08T12:27:58.112388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.627085+0000","last_change":"2023-11-08T12:27:58.147482+0000","last_active":"2023-11-08T12:27:58.627085+0000","last_peered":"2023-11-08T12:27:58.627085+0000","last_clean":"2023-11-08T12:27:58.627085+0000","last_became_active":"2023-11-08T12:27:58.142932+0000","last_became_peered":"2023-11-08T12:27:58.142932+0000","last_unstale":"2023-11-08T12:27:58.627085+0000","last_undegraded":"2023-11-08T12:27:58.627085+0000","last_fullsized":"2023-11-08T12:27:58.627085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:44:57.061749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127731+0000","last_change":"2023-11-08T12:27:54.096854+0000","last_active":"2023-11-08T12:27:58.127731+0000","last_peered":"2023-11-08T12:27:58.127731+0000","last_clean":"2023-11-08T12:27:58.127731+0000","last_became_active":"2023-11-08T12:27:54.095714+0000","last_became_peered":"2023-11-08T12:27:54.095714+0000","last_unstale":"2023-11-08T12:27:58.127731+0000","last_undegraded":"2023-11-08T12:27:58.127731+0000","last_fullsized":"2023-11-08T12:27:58.127731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:27.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126342+0000","last_change":"2023-11-08T12:27:53.615271+0000","last_active":"2023-11-08T12:27:58.126342+0000","last_peered":"2023-11-08T12:27:58.126342+0000","last_clean":"2023-11-08T12:27:58.126342+0000","last_became_active":"2023-11-08T12:27:53.614914+0000","last_became_peered":"2023-11-08T12:27:53.614914+0000","last_unstale":"2023-11-08T12:27:58.126342+0000","last_undegraded":"2023-11-08T12:27:58.126342+0000","last_fullsized":"2023-11-08T12:27:58.126342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574743+0000","last_change":"2023-11-08T12:27:58.137274+0000","last_active":"2023-11-08T12:27:58.574743+0000","last_peered":"2023-11-08T12:27:58.574743+0000","last_clean":"2023-11-08T12:27:58.574743+0000","last_became_active":"2023-11-08T12:27:58.136837+0000","last_became_peered":"2023-11-08T12:27:58.136837+0000","last_unstale":"2023-11-08T12:27:58.574743+0000","last_undegraded":"2023-11-08T12:27:58.574743+0000","last_fullsized":"2023-11-08T12:27:58.574743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126782+0000","last_change":"2023-11-08T12:27:54.099673+0000","last_active":"2023-11-08T12:27:58.126782+0000","last_peered":"2023-11-08T12:27:58.126782+0000","last_clean":"2023-11-08T12:27:58.126782+0000","last_became_active":"2023-11-08T12:27:54.096740+0000","last_became_peered":"2023-11-08T12:27:54.096740+0000","last_unstale":"2023-11-08T12:27:58.126782+0000","last_undegraded":"2023-11-08T12:27:58.126782+0000","last_fullsized":"2023-11-08T12:27:58.126782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134615+0000","last_change":"2023-11-08T12:27:53.628166+0000","last_active":"2023-11-08T12:27:58.134615+0000","last_peered":"2023-11-08T12:27:58.134615+0000","last_clean":"2023-11-08T12:27:58.134615+0000","last_became_active":"2023-11-08T12:27:53.627825+0000","last_became_peered":"2023-11-08T12:27:53.627825+0000","last_unstale":"2023-11-08T12:27:58.134615+0000","last_undegraded":"2023-11-08T12:27:58.134615+0000","last_fullsized":"2023-11-08T12:27:58.134615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735076+0000","last_change":"2023-11-08T12:27:58.140971+0000","last_active":"2023-11-08T12:27:58.735076+0000","last_peered":"2023-11-08T12:27:58.735076+0000","last_clean":"2023-11-08T12:27:58.735076+0000","last_became_active":"2023-11-08T12:27:58.140628+0000","last_became_peered":"2023-11-08T12:27:58.140628+0000","last_unstale":"2023-11-08T12:27:58.735076+0000","last_undegraded":"2023-11-08T12:27:58.735076+0000","last_fullsized":"2023-11-08T12:27:58.735076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127582+0000","last_change":"2023-11-08T12:27:54.099418+0000","last_active":"2023-11-08T12:27:58.127582+0000","last_peered":"2023-11-08T12:27:58.127582+0000","last_clean":"2023-11-08T12:27:58.127582+0000","last_became_active":"2023-11-08T12:27:54.098046+0000","last_became_peered":"2023-11-08T12:27:54.098046+0000","last_unstale":"2023-11-08T12:27:58.127582+0000","last_undegraded":"2023-11-08T12:27:58.127582+0000","last_fullsized":"2023-11-08T12:27:58.127582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112929+0000","last_change":"2023-11-08T12:27:53.623957+0000","last_active":"2023-11-08T12:27:58.112929+0000","last_peered":"2023-11-08T12:27:58.112929+0000","last_clean":"2023-11-08T12:27:58.112929+0000","last_became_active":"2023-11-08T12:27:53.623625+0000","last_became_peered":"2023-11-08T12:27:53.623625+0000","last_unstale":"2023-11-08T12:27:58.112929+0000","last_undegraded":"2023-11-08T12:27:58.112929+0000","last_fullsized":"2023-11-08T12:27:58.112929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575667+0000","last_change":"2023-11-08T12:27:58.144841+0000","last_active":"2023-11-08T12:27:58.575667+0000","last_peered":"2023-11-08T12:27:58.575667+0000","last_clean":"2023-11-08T12:27:58.575667+0000","last_became_active":"2023-11-08T12:27:58.144375+0000","last_became_peered":"2023-11-08T12:27:58.144375+0000","last_unstale":"2023-11-08T12:27:58.575667+0000","last_undegraded":"2023-11-08T12:27:58.575667+0000","last_fullsized":"2023-11-08T12:27:58.575667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:58:16.447050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129079+0000","last_change":"2023-11-08T12:27:54.116845+0000","last_active":"2023-11-08T12:27:58.129079+0000","last_peered":"2023-11-08T12:27:58.129079+0000","last_clean":"2023-11-08T12:27:58.129079+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129079+0000","last_undegraded":"2023-11-08T12:27:58.129079+0000","last_fullsized":"2023-11-08T12:27:58.129079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109551+0000","last_change":"2023-11-08T12:27:53.610197+0000","last_active":"2023-11-08T12:27:58.109551+0000","last_peered":"2023-11-08T12:27:58.109551+0000","last_clean":"2023-11-08T12:27:58.109551+0000","last_became_active":"2023-11-08T12:27:53.609789+0000","last_became_peered":"2023-11-08T12:27:53.609789+0000","last_unstale":"2023-11-08T12:27:58.109551+0000","last_undegraded":"2023-11-08T12:27:58.109551+0000","last_fullsized":"2023-11-08T12:27:58.109551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575442+0000","last_change":"2023-11-08T12:27:58.138875+0000","last_active":"2023-11-08T12:27:58.575442+0000","last_peered":"2023-11-08T12:27:58.575442+0000","last_clean":"2023-11-08T12:27:58.575442+0000","last_became_active":"2023-11-08T12:27:58.138194+0000","last_became_peered":"2023-11-08T12:27:58.138194+0000","last_unstale":"2023-11-08T12:27:58.575442+0000","last_undegraded":"2023-11-08T12:27:58.575442+0000","last_fullsized":"2023-11-08T12:27:58.575442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.510559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134393+0000","last_change":"2023-11-08T12:27:54.091331+0000","last_active":"2023-11-08T12:27:58.134393+0000","last_peered":"2023-11-08T12:27:58.134393+0000","last_clean":"2023-11-08T12:27:58.134393+0000","last_became_active":"2023-11-08T12:27:54.090934+0000","last_became_peered":"2023-11-08T12:27:54.090934+0000","last_unstale":"2023-11-08T12:27:58.134393+0000","last_undegraded":"2023-11-08T12:27:58.134393+0000","last_fullsized":"2023-11-08T12:27:58.134393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:31.377393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123027+0000","last_change":"2023-11-08T12:27:53.619884+0000","last_active":"2023-11-08T12:27:58.123027+0000","last_peered":"2023-11-08T12:27:58.123027+0000","last_clean":"2023-11-08T12:27:58.123027+0000","last_became_active":"2023-11-08T12:27:53.619224+0000","last_became_peered":"2023-11-08T12:27:53.619224+0000","last_unstale":"2023-11-08T12:27:58.123027+0000","last_undegraded":"2023-11-08T12:27:58.123027+0000","last_fullsized":"2023-11-08T12:27:58.123027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:13.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575454+0000","last_change":"2023-11-08T12:27:58.146347+0000","last_active":"2023-11-08T12:27:58.575454+0000","last_peered":"2023-11-08T12:27:58.575454+0000","last_clean":"2023-11-08T12:27:58.575454+0000","last_became_active":"2023-11-08T12:27:58.141366+0000","last_became_peered":"2023-11-08T12:27:58.141366+0000","last_unstale":"2023-11-08T12:27:58.575454+0000","last_undegraded":"2023-11-08T12:27:58.575454+0000","last_fullsized":"2023-11-08T12:27:58.575454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:21:31.033260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126220+0000","last_change":"2023-11-08T12:27:54.096017+0000","last_active":"2023-11-08T12:27:58.126220+0000","last_peered":"2023-11-08T12:27:58.126220+0000","last_clean":"2023-11-08T12:27:58.126220+0000","last_became_active":"2023-11-08T12:27:54.095626+0000","last_became_peered":"2023-11-08T12:27:54.095626+0000","last_unstale":"2023-11-08T12:27:58.126220+0000","last_undegraded":"2023-11-08T12:27:58.126220+0000","last_fullsized":"2023-11-08T12:27:58.126220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:39.760166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122741+0000","last_change":"2023-11-08T12:27:53.629941+0000","last_active":"2023-11-08T12:27:58.122741+0000","last_peered":"2023-11-08T12:27:58.122741+0000","last_clean":"2023-11-08T12:27:58.122741+0000","last_became_active":"2023-11-08T12:27:53.629616+0000","last_became_peered":"2023-11-08T12:27:53.629616+0000","last_unstale":"2023-11-08T12:27:58.122741+0000","last_undegraded":"2023-11-08T12:27:58.122741+0000","last_fullsized":"2023-11-08T12:27:58.122741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:41:54.461363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575103+0000","last_change":"2023-11-08T12:27:58.134296+0000","last_active":"2023-11-08T12:27:58.575103+0000","last_peered":"2023-11-08T12:27:58.575103+0000","last_clean":"2023-11-08T12:27:58.575103+0000","last_became_active":"2023-11-08T12:27:58.133923+0000","last_became_peered":"2023-11-08T12:27:58.133923+0000","last_unstale":"2023-11-08T12:27:58.575103+0000","last_undegraded":"2023-11-08T12:27:58.575103+0000","last_fullsized":"2023-11-08T12:27:58.575103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:19:06.502167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109786+0000","last_change":"2023-11-08T12:27:54.114859+0000","last_active":"2023-11-08T12:27:58.109786+0000","last_peered":"2023-11-08T12:27:58.109786+0000","last_clean":"2023-11-08T12:27:58.109786+0000","last_became_active":"2023-11-08T12:27:54.114573+0000","last_became_peered":"2023-11-08T12:27:54.114573+0000","last_unstale":"2023-11-08T12:27:58.109786+0000","last_undegraded":"2023-11-08T12:27:58.109786+0000","last_fullsized":"2023-11-08T12:27:58.109786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121705+0000","last_change":"2023-11-08T12:27:53.632041+0000","last_active":"2023-11-08T12:27:58.121705+0000","last_peered":"2023-11-08T12:27:58.121705+0000","last_clean":"2023-11-08T12:27:58.121705+0000","last_became_active":"2023-11-08T12:27:53.631715+0000","last_became_peered":"2023-11-08T12:27:53.631715+0000","last_unstale":"2023-11-08T12:27:58.121705+0000","last_undegraded":"2023-11-08T12:27:58.121705+0000","last_fullsized":"2023-11-08T12:27:58.121705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:13.451343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878943+0000","last_change":"2023-11-08T12:27:58.153252+0000","last_active":"2023-11-08T12:27:58.878943+0000","last_peered":"2023-11-08T12:27:58.878943+0000","last_clean":"2023-11-08T12:27:58.878943+0000","last_became_active":"2023-11-08T12:27:58.152715+0000","last_became_peered":"2023-11-08T12:27:58.152715+0000","last_unstale":"2023-11-08T12:27:58.878943+0000","last_undegraded":"2023-11-08T12:27:58.878943+0000","last_fullsized":"2023-11-08T12:27:58.878943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574571+0000","last_change":"2023-11-08T12:27:58.134922+0000","last_active":"2023-11-08T12:27:58.574571+0000","last_peered":"2023-11-08T12:27:58.574571+0000","last_clean":"2023-11-08T12:27:58.574571+0000","last_became_active":"2023-11-08T12:27:58.134553+0000","last_became_peered":"2023-11-08T12:27:58.134553+0000","last_unstale":"2023-11-08T12:27:58.574571+0000","last_undegraded":"2023-11-08T12:27:58.574571+0000","last_fullsized":"2023-11-08T12:27:58.574571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130484+0000","last_change":"2023-11-08T12:27:53.613363+0000","last_active":"2023-11-08T12:27:58.130484+0000","last_peered":"2023-11-08T12:27:58.130484+0000","last_clean":"2023-11-08T12:27:58.130484+0000","last_became_active":"2023-11-08T12:27:53.613054+0000","last_became_peered":"2023-11-08T12:27:53.613054+0000","last_unstale":"2023-11-08T12:27:58.130484+0000","last_undegraded":"2023-11-08T12:27:58.130484+0000","last_fullsized":"2023-11-08T12:27:58.130484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.117992+0000","last_change":"2023-11-08T12:27:54.113407+0000","last_active":"2023-11-08T12:27:58.117992+0000","last_peered":"2023-11-08T12:27:58.117992+0000","last_clean":"2023-11-08T12:27:58.117992+0000","last_became_active":"2023-11-08T12:27:54.113143+0000","last_became_peered":"2023-11-08T12:27:54.113143+0000","last_unstale":"2023-11-08T12:27:58.117992+0000","last_undegraded":"2023-11-08T12:27:58.117992+0000","last_fullsized":"2023-11-08T12:27:58.117992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574644+0000","last_change":"2023-11-08T12:27:58.152343+0000","last_active":"2023-11-08T12:27:58.574644+0000","last_peered":"2023-11-08T12:27:58.574644+0000","last_clean":"2023-11-08T12:27:58.574644+0000","last_became_active":"2023-11-08T12:27:58.150007+0000","last_became_peered":"2023-11-08T12:27:58.150007+0000","last_unstale":"2023-11-08T12:27:58.574644+0000","last_undegraded":"2023-11-08T12:27:58.574644+0000","last_fullsized":"2023-11-08T12:27:58.574644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127705+0000","last_change":"2023-11-08T12:27:53.629979+0000","last_active":"2023-11-08T12:27:58.127705+0000","last_peered":"2023-11-08T12:27:58.127705+0000","last_clean":"2023-11-08T12:27:58.127705+0000","last_became_active":"2023-11-08T12:27:53.629610+0000","last_became_peered":"2023-11-08T12:27:53.629610+0000","last_unstale":"2023-11-08T12:27:58.127705+0000","last_undegraded":"2023-11-08T12:27:58.127705+0000","last_fullsized":"2023-11-08T12:27:58.127705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:10:20.186679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128585+0000","last_change":"2023-11-08T12:27:54.105236+0000","last_active":"2023-11-08T12:27:58.128585+0000","last_peered":"2023-11-08T12:27:58.128585+0000","last_clean":"2023-11-08T12:27:58.128585+0000","last_became_active":"2023-11-08T12:27:54.101882+0000","last_became_peered":"2023-11-08T12:27:54.101882+0000","last_unstale":"2023-11-08T12:27:58.128585+0000","last_undegraded":"2023-11-08T12:27:58.128585+0000","last_fullsized":"2023-11-08T12:27:58.128585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122039+0000","last_change":"2023-11-08T12:27:53.623671+0000","last_active":"2023-11-08T12:27:58.122039+0000","last_peered":"2023-11-08T12:27:58.122039+0000","last_clean":"2023-11-08T12:27:58.122039+0000","last_became_active":"2023-11-08T12:27:53.623278+0000","last_became_peered":"2023-11-08T12:27:53.623278+0000","last_unstale":"2023-11-08T12:27:58.122039+0000","last_undegraded":"2023-11-08T12:27:58.122039+0000","last_fullsized":"2023-11-08T12:27:58.122039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110357+0000","last_change":"2023-11-08T12:27:54.112710+0000","last_active":"2023-11-08T12:27:58.110357+0000","last_peered":"2023-11-08T12:27:58.110357+0000","last_clean":"2023-11-08T12:27:58.110357+0000","last_became_active":"2023-11-08T12:27:54.111530+0000","last_became_peered":"2023-11-08T12:27:54.111530+0000","last_unstale":"2023-11-08T12:27:58.110357+0000","last_undegraded":"2023-11-08T12:27:58.110357+0000","last_fullsized":"2023-11-08T12:27:58.110357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.573865+0000","last_change":"2023-11-08T12:27:58.147598+0000","last_active":"2023-11-08T12:27:58.573865+0000","last_peered":"2023-11-08T12:27:58.573865+0000","last_clean":"2023-11-08T12:27:58.573865+0000","last_became_active":"2023-11-08T12:27:58.142637+0000","last_became_peered":"2023-11-08T12:27:58.142637+0000","last_unstale":"2023-11-08T12:27:58.573865+0000","last_undegraded":"2023-11-08T12:27:58.573865+0000","last_fullsized":"2023-11-08T12:27:58.573865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:15.627959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121493+0000","last_change":"2023-11-08T12:27:53.629943+0000","last_active":"2023-11-08T12:27:58.121493+0000","last_peered":"2023-11-08T12:27:58.121493+0000","last_clean":"2023-11-08T12:27:58.121493+0000","last_became_active":"2023-11-08T12:27:53.629644+0000","last_became_peered":"2023-11-08T12:27:53.629644+0000","last_unstale":"2023-11-08T12:27:58.121493+0000","last_undegraded":"2023-11-08T12:27:58.121493+0000","last_fullsized":"2023-11-08T12:27:58.121493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.958287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112153+0000","last_change":"2023-11-08T12:27:54.087612+0000","last_active":"2023-11-08T12:27:58.112153+0000","last_peered":"2023-11-08T12:27:58.112153+0000","last_clean":"2023-11-08T12:27:58.112153+0000","last_became_active":"2023-11-08T12:27:54.087329+0000","last_became_peered":"2023-11-08T12:27:54.087329+0000","last_unstale":"2023-11-08T12:27:58.112153+0000","last_undegraded":"2023-11-08T12:27:58.112153+0000","last_fullsized":"2023-11-08T12:27:58.112153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574522+0000","last_change":"2023-11-08T12:27:58.143756+0000","last_active":"2023-11-08T12:27:58.574522+0000","last_peered":"2023-11-08T12:27:58.574522+0000","last_clean":"2023-11-08T12:27:58.574522+0000","last_became_active":"2023-11-08T12:27:58.142849+0000","last_became_peered":"2023-11-08T12:27:58.142849+0000","last_unstale":"2023-11-08T12:27:58.574522+0000","last_undegraded":"2023-11-08T12:27:58.574522+0000","last_fullsized":"2023-11-08T12:27:58.574522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130357+0000","last_change":"2023-11-08T12:27:54.090219+0000","last_active":"2023-11-08T12:27:58.130357+0000","last_peered":"2023-11-08T12:27:58.130357+0000","last_clean":"2023-11-08T12:27:58.130357+0000","last_became_active":"2023-11-08T12:27:54.089953+0000","last_became_peered":"2023-11-08T12:27:54.089953+0000","last_unstale":"2023-11-08T12:27:58.130357+0000","last_undegraded":"2023-11-08T12:27:58.130357+0000","last_fullsized":"2023-11-08T12:27:58.130357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:59.015726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110954+0000","last_change":"2023-11-08T12:27:54.089673+0000","last_active":"2023-11-08T12:27:58.110954+0000","last_peered":"2023-11-08T12:27:58.110954+0000","last_clean":"2023-11-08T12:27:58.110954+0000","last_became_active":"2023-11-08T12:27:54.088838+0000","last_became_peered":"2023-11-08T12:27:54.088838+0000","last_unstale":"2023-11-08T12:27:58.110954+0000","last_undegraded":"2023-11-08T12:27:58.110954+0000","last_fullsized":"2023-11-08T12:27:58.110954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127306+0000","last_change":"2023-11-08T12:27:54.101563+0000","last_active":"2023-11-08T12:27:58.127306+0000","last_peered":"2023-11-08T12:27:58.127306+0000","last_clean":"2023-11-08T12:27:58.127306+0000","last_became_active":"2023-11-08T12:27:54.101287+0000","last_became_peered":"2023-11-08T12:27:54.101287+0000","last_unstale":"2023-11-08T12:27:58.127306+0000","last_undegraded":"2023-11-08T12:27:58.127306+0000","last_fullsized":"2023-11-08T12:27:58.127306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112764+0000","last_change":"2023-11-08T12:27:54.112891+0000","last_active":"2023-11-08T12:27:58.112764+0000","last_peered":"2023-11-08T12:27:58.112764+0000","last_clean":"2023-11-08T12:27:58.112764+0000","last_became_active":"2023-11-08T12:27:54.112236+0000","last_became_peered":"2023-11-08T12:27:54.112236+0000","last_unstale":"2023-11-08T12:27:58.112764+0000","last_undegraded":"2023-11-08T12:27:58.112764+0000","last_fullsized":"2023-11-08T12:27:58.112764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127544+0000","last_change":"2023-11-08T12:27:54.112391+0000","last_active":"2023-11-08T12:27:58.127544+0000","last_peered":"2023-11-08T12:27:58.127544+0000","last_clean":"2023-11-08T12:27:58.127544+0000","last_became_active":"2023-11-08T12:27:54.112033+0000","last_became_peered":"2023-11-08T12:27:54.112033+0000","last_unstale":"2023-11-08T12:27:58.127544+0000","last_undegraded":"2023-11-08T12:27:58.127544+0000","last_fullsized":"2023-11-08T12:27:58.127544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110253+0000","last_change":"2023-11-08T12:27:54.111812+0000","last_active":"2023-11-08T12:27:58.110253+0000","last_peered":"2023-11-08T12:27:58.110253+0000","last_clean":"2023-11-08T12:27:58.110253+0000","last_became_active":"2023-11-08T12:27:54.111143+0000","last_became_peered":"2023-11-08T12:27:54.111143+0000","last_unstale":"2023-11-08T12:27:58.110253+0000","last_undegraded":"2023-11-08T12:27:58.110253+0000","last_fullsized":"2023-11-08T12:27:58.110253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126839+0000","last_change":"2023-11-08T12:27:54.098992+0000","last_active":"2023-11-08T12:27:58.126839+0000","last_peered":"2023-11-08T12:27:58.126839+0000","last_clean":"2023-11-08T12:27:58.126839+0000","last_became_active":"2023-11-08T12:27:54.096650+0000","last_became_peered":"2023-11-08T12:27:54.096650+0000","last_unstale":"2023-11-08T12:27:58.126839+0000","last_undegraded":"2023-11-08T12:27:58.126839+0000","last_fullsized":"2023-11-08T12:27:58.126839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:18.972524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126259+0000","last_change":"2023-11-08T12:27:54.102716+0000","last_active":"2023-11-08T12:27:58.126259+0000","last_peered":"2023-11-08T12:27:58.126259+0000","last_clean":"2023-11-08T12:27:58.126259+0000","last_became_active":"2023-11-08T12:27:54.102078+0000","last_became_peered":"2023-11-08T12:27:54.102078+0000","last_unstale":"2023-11-08T12:27:58.126259+0000","last_undegraded":"2023-11-08T12:27:58.126259+0000","last_fullsized":"2023-11-08T12:27:58.126259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124250+0000","last_change":"2023-11-08T12:27:54.114137+0000","last_active":"2023-11-08T12:27:58.124250+0000","last_peered":"2023-11-08T12:27:58.124250+0000","last_clean":"2023-11-08T12:27:58.124250+0000","last_became_active":"2023-11-08T12:27:54.111468+0000","last_became_peered":"2023-11-08T12:27:54.111468+0000","last_unstale":"2023-11-08T12:27:58.124250+0000","last_undegraded":"2023-11-08T12:27:58.124250+0000","last_fullsized":"2023-11-08T12:27:58.124250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110810+0000","last_change":"2023-11-08T12:27:54.111270+0000","last_active":"2023-11-08T12:27:58.110810+0000","last_peered":"2023-11-08T12:27:58.110810+0000","last_clean":"2023-11-08T12:27:58.110810+0000","last_became_active":"2023-11-08T12:27:54.110978+0000","last_became_peered":"2023-11-08T12:27:54.110978+0000","last_unstale":"2023-11-08T12:27:58.110810+0000","last_undegraded":"2023-11-08T12:27:58.110810+0000","last_fullsized":"2023-11-08T12:27:58.110810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121952+0000","last_change":"2023-11-08T12:27:54.110870+0000","last_active":"2023-11-08T12:27:58.121952+0000","last_peered":"2023-11-08T12:27:58.121952+0000","last_clean":"2023-11-08T12:27:58.121952+0000","last_became_active":"2023-11-08T12:27:54.110578+0000","last_became_peered":"2023-11-08T12:27:54.110578+0000","last_unstale":"2023-11-08T12:27:58.121952+0000","last_undegraded":"2023-11-08T12:27:58.121952+0000","last_fullsized":"2023-11-08T12:27:58.121952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121410+0000","last_change":"2023-11-08T12:27:54.110928+0000","last_active":"2023-11-08T12:27:58.121410+0000","last_peered":"2023-11-08T12:27:58.121410+0000","last_clean":"2023-11-08T12:27:58.121410+0000","last_became_active":"2023-11-08T12:27:54.110627+0000","last_became_peered":"2023-11-08T12:27:54.110627+0000","last_unstale":"2023-11-08T12:27:58.121410+0000","last_undegraded":"2023-11-08T12:27:58.121410+0000","last_fullsized":"2023-11-08T12:27:58.121410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127487+0000","last_change":"2023-11-08T12:27:54.099305+0000","last_active":"2023-11-08T12:27:58.127487+0000","last_peered":"2023-11-08T12:27:58.127487+0000","last_clean":"2023-11-08T12:27:58.127487+0000","last_became_active":"2023-11-08T12:27:54.096530+0000","last_became_peered":"2023-11-08T12:27:54.096530+0000","last_unstale":"2023-11-08T12:27:58.127487+0000","last_undegraded":"2023-11-08T12:27:58.127487+0000","last_fullsized":"2023-11-08T12:27:58.127487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:03:24.809478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112660+0000","last_change":"2023-11-08T12:27:54.091908+0000","last_active":"2023-11-08T12:27:58.112660+0000","last_peered":"2023-11-08T12:27:58.112660+0000","last_clean":"2023-11-08T12:27:58.112660+0000","last_became_active":"2023-11-08T12:27:54.091565+0000","last_became_peered":"2023-11-08T12:27:54.091565+0000","last_unstale":"2023-11-08T12:27:58.112660+0000","last_undegraded":"2023-11-08T12:27:58.112660+0000","last_fullsized":"2023-11-08T12:27:58.112660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:48.409713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127626+0000","last_change":"2023-11-08T12:27:54.102006+0000","last_active":"2023-11-08T12:27:58.127626+0000","last_peered":"2023-11-08T12:27:58.127626+0000","last_clean":"2023-11-08T12:27:58.127626+0000","last_became_active":"2023-11-08T12:27:54.101747+0000","last_became_peered":"2023-11-08T12:27:54.101747+0000","last_unstale":"2023-11-08T12:27:58.127626+0000","last_undegraded":"2023-11-08T12:27:58.127626+0000","last_fullsized":"2023-11-08T12:27:58.127626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130643+0000","last_change":"2023-11-08T12:27:54.107313+0000","last_active":"2023-11-08T12:27:58.130643+0000","last_peered":"2023-11-08T12:27:58.130643+0000","last_clean":"2023-11-08T12:27:58.130643+0000","last_became_active":"2023-11-08T12:27:54.106868+0000","last_became_peered":"2023-11-08T12:27:54.106868+0000","last_unstale":"2023-11-08T12:27:58.130643+0000","last_undegraded":"2023-11-08T12:27:58.130643+0000","last_fullsized":"2023-11-08T12:27:58.130643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126067+0000","last_change":"2023-11-08T12:27:54.104910+0000","last_active":"2023-11-08T12:27:58.126067+0000","last_peered":"2023-11-08T12:27:58.126067+0000","last_clean":"2023-11-08T12:27:58.126067+0000","last_became_active":"2023-11-08T12:27:54.104571+0000","last_became_peered":"2023-11-08T12:27:54.104571+0000","last_unstale":"2023-11-08T12:27:58.126067+0000","last_undegraded":"2023-11-08T12:27:58.126067+0000","last_fullsized":"2023-11-08T12:27:58.126067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127618+0000","last_change":"2023-11-08T12:27:54.117605+0000","last_active":"2023-11-08T12:27:58.127618+0000","last_peered":"2023-11-08T12:27:58.127618+0000","last_clean":"2023-11-08T12:27:58.127618+0000","last_became_active":"2023-11-08T12:27:54.115128+0000","last_became_peered":"2023-11-08T12:27:54.115128+0000","last_unstale":"2023-11-08T12:27:58.127618+0000","last_undegraded":"2023-11-08T12:27:58.127618+0000","last_fullsized":"2023-11-08T12:27:58.127618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109727+0000","last_change":"2023-11-08T12:27:54.078100+0000","last_active":"2023-11-08T12:27:58.109727+0000","last_peered":"2023-11-08T12:27:58.109727+0000","last_clean":"2023-11-08T12:27:58.109727+0000","last_became_active":"2023-11-08T12:27:54.077806+0000","last_became_peered":"2023-11-08T12:27:54.077806+0000","last_unstale":"2023-11-08T12:27:58.109727+0000","last_undegraded":"2023-11-08T12:27:58.109727+0000","last_fullsized":"2023-11-08T12:27:58.109727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.115584+0000","last_change":"2023-11-08T12:27:54.079682+0000","last_active":"2023-11-08T12:27:58.115584+0000","last_peered":"2023-11-08T12:27:58.115584+0000","last_clean":"2023-11-08T12:27:58.115584+0000","last_became_active":"2023-11-08T12:27:54.079412+0000","last_became_peered":"2023-11-08T12:27:54.079412+0000","last_unstale":"2023-11-08T12:27:58.115584+0000","last_undegraded":"2023-11-08T12:27:58.115584+0000","last_fullsized":"2023-11-08T12:27:58.115584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:03:48.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112090+0000","last_change":"2023-11-08T12:27:54.094245+0000","last_active":"2023-11-08T12:27:58.112090+0000","last_peered":"2023-11-08T12:27:58.112090+0000","last_clean":"2023-11-08T12:27:58.112090+0000","last_became_active":"2023-11-08T12:27:54.093989+0000","last_became_peered":"2023-11-08T12:27:54.093989+0000","last_unstale":"2023-11-08T12:27:58.112090+0000","last_undegraded":"2023-11-08T12:27:58.112090+0000","last_fullsized":"2023-11-08T12:27:58.112090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:45.542969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126703+0000","last_change":"2023-11-08T12:27:54.093474+0000","last_active":"2023-11-08T12:27:58.126703+0000","last_peered":"2023-11-08T12:27:58.126703+0000","last_clean":"2023-11-08T12:27:58.126703+0000","last_became_active":"2023-11-08T12:27:54.093141+0000","last_became_peered":"2023-11-08T12:27:54.093141+0000","last_unstale":"2023-11-08T12:27:58.126703+0000","last_undegraded":"2023-11-08T12:27:58.126703+0000","last_fullsized":"2023-11-08T12:27:58.126703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.174800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110510+0000","last_change":"2023-11-08T12:27:54.109186+0000","last_active":"2023-11-08T12:27:58.110510+0000","last_peered":"2023-11-08T12:27:58.110510+0000","last_clean":"2023-11-08T12:27:58.110510+0000","last_became_active":"2023-11-08T12:27:54.108861+0000","last_became_peered":"2023-11-08T12:27:54.108861+0000","last_unstale":"2023-11-08T12:27:58.110510+0000","last_undegraded":"2023-11-08T12:27:58.110510+0000","last_fullsized":"2023-11-08T12:27:58.110510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130596+0000","last_change":"2023-11-08T12:27:54.107459+0000","last_active":"2023-11-08T12:27:58.130596+0000","last_peered":"2023-11-08T12:27:58.130596+0000","last_clean":"2023-11-08T12:27:58.130596+0000","last_became_active":"2023-11-08T12:27:54.107098+0000","last_became_peered":"2023-11-08T12:27:54.107098+0000","last_unstale":"2023-11-08T12:27:58.130596+0000","last_undegraded":"2023-11-08T12:27:58.130596+0000","last_fullsized":"2023-11-08T12:27:58.130596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109785+0000","last_change":"2023-11-08T12:27:54.094309+0000","last_active":"2023-11-08T12:27:58.109785+0000","last_peered":"2023-11-08T12:27:58.109785+0000","last_clean":"2023-11-08T12:27:58.109785+0000","last_became_active":"2023-11-08T12:27:54.094019+0000","last_became_peered":"2023-11-08T12:27:54.094019+0000","last_unstale":"2023-11-08T12:27:58.109785+0000","last_undegraded":"2023-11-08T12:27:58.109785+0000","last_fullsized":"2023-11-08T12:27:58.109785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127510+0000","last_change":"2023-11-08T12:27:54.115331+0000","last_active":"2023-11-08T12:27:58.127510+0000","last_peered":"2023-11-08T12:27:58.127510+0000","last_clean":"2023-11-08T12:27:58.127510+0000","last_became_active":"2023-11-08T12:27:54.114822+0000","last_became_peered":"2023-11-08T12:27:54.114822+0000","last_unstale":"2023-11-08T12:27:58.127510+0000","last_undegraded":"2023-11-08T12:27:58.127510+0000","last_fullsized":"2023-11-08T12:27:58.127510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127152+0000","last_change":"2023-11-08T12:27:54.110256+0000","last_active":"2023-11-08T12:27:58.127152+0000","last_peered":"2023-11-08T12:27:58.127152+0000","last_clean":"2023-11-08T12:27:58.127152+0000","last_became_active":"2023-11-08T12:27:54.109960+0000","last_became_peered":"2023-11-08T12:27:54.109960+0000","last_unstale":"2023-11-08T12:27:58.127152+0000","last_undegraded":"2023-11-08T12:27:58.127152+0000","last_fullsized":"2023-11-08T12:27:58.127152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:50.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129321+0000","last_change":"2023-11-08T12:27:54.113205+0000","last_active":"2023-11-08T12:27:58.129321+0000","last_peered":"2023-11-08T12:27:58.129321+0000","last_clean":"2023-11-08T12:27:58.129321+0000","last_became_active":"2023-11-08T12:27:54.100836+0000","last_became_peered":"2023-11-08T12:27:54.100836+0000","last_unstale":"2023-11-08T12:27:58.129321+0000","last_undegraded":"2023-11-08T12:27:58.129321+0000","last_fullsized":"2023-11-08T12:27:58.129321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134239+0000","last_change":"2023-11-08T12:27:54.113012+0000","last_active":"2023-11-08T12:27:58.134239+0000","last_peered":"2023-11-08T12:27:58.134239+0000","last_clean":"2023-11-08T12:27:58.134239+0000","last_became_active":"2023-11-08T12:27:54.112671+0000","last_became_peered":"2023-11-08T12:27:54.112671+0000","last_unstale":"2023-11-08T12:27:58.134239+0000","last_undegraded":"2023-11-08T12:27:58.134239+0000","last_fullsized":"2023-11-08T12:27:58.134239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:36.178901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126621+0000","last_change":"2023-11-08T12:27:54.106855+0000","last_active":"2023-11-08T12:27:58.126621+0000","last_peered":"2023-11-08T12:27:58.126621+0000","last_clean":"2023-11-08T12:27:58.126621+0000","last_became_active":"2023-11-08T12:27:54.106572+0000","last_became_peered":"2023-11-08T12:27:54.106572+0000","last_unstale":"2023-11-08T12:27:58.126621+0000","last_undegraded":"2023-11-08T12:27:58.126621+0000","last_fullsized":"2023-11-08T12:27:58.126621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:20.409594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110499+0000","last_change":"2023-11-08T12:27:54.088006+0000","last_active":"2023-11-08T12:27:58.110499+0000","last_peered":"2023-11-08T12:27:58.110499+0000","last_clean":"2023-11-08T12:27:58.110499+0000","last_became_active":"2023-11-08T12:27:54.087733+0000","last_became_peered":"2023-11-08T12:27:54.087733+0000","last_unstale":"2023-11-08T12:27:58.110499+0000","last_undegraded":"2023-11-08T12:27:58.110499+0000","last_fullsized":"2023-11-08T12:27:58.110499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110178+0000","last_change":"2023-11-08T12:27:54.088141+0000","last_active":"2023-11-08T12:27:58.110178+0000","last_peered":"2023-11-08T12:27:58.110178+0000","last_clean":"2023-11-08T12:27:58.110178+0000","last_became_active":"2023-11-08T12:27:54.087785+0000","last_became_peered":"2023-11-08T12:27:54.087785+0000","last_unstale":"2023-11-08T12:27:58.110178+0000","last_undegraded":"2023-11-08T12:27:58.110178+0000","last_fullsized":"2023-11-08T12:27:58.110178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:16:17.839606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476748,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476748,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9296,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362544,"statfs":{"total":96636764160,"available":96627245056,"internally_reserved":0,"allocated":925696,"data_stored":719012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:28:26.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:28:26.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.353+0000 7fc39e43e700 1 Processor -- start 2023-11-08T12:28:26.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc39e43e700 1 -- start start 2023-11-08T12:28:26.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc39e43e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc39815a480 0x7fc3980cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc39e43e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3980c8d10 0x7fc3980cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc39e43e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39815a850 con 0x7fc3980ccd10 2023-11-08T12:28:26.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc39e43e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980ce060 con 0x7fc39815a480 2023-11-08T12:28:26.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc39e43e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980ce300 con 0x7fc3980c8d10 2023-11-08T12:28:26.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc397fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc39815a480 0x7fc3980cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc397fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc39815a480 0x7fc3980cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56632/0 (socket says 172.21.15.112:56632) 2023-11-08T12:28:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc397fff700 1 -- 172.21.15.112:0/4105351064 learned_addr learned my addr 172.21.15.112:0/4105351064 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc38ffff700 1 --2- 172.21.15.112:0/4105351064 >> v2:172.21.15.133:3300/0 conn(0x7fc3980c8d10 0x7fc3980cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc397fff700 1 -- 172.21.15.112:0/4105351064 >> v2:172.21.15.133:3300/0 conn(0x7fc3980c8d10 msgr2=0x7fc3980cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc397fff700 1 --2- 172.21.15.112:0/4105351064 >> v2:172.21.15.133:3300/0 conn(0x7fc3980c8d10 0x7fc3980cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc397fff700 1 -- 172.21.15.112:0/4105351064 >> v1:172.21.15.112:6789/0 conn(0x7fc3980ccd10 legacy=0x7fc39815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.357+0000 7fc397fff700 1 -- 172.21.15.112:0/4105351064 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980cada0 con 0x7fc39815a480 2023-11-08T12:28:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc397fff700 1 --2- 172.21.15.112:0/4105351064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc39815a480 0x7fc3980cc290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3980b1230 tx=0x7fc388009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11cfbfd67560095 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc3977fe700 1 -- 172.21.15.112:0/4105351064 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011830 con 0x7fc39815a480 2023-11-08T12:28:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc3977fe700 1 -- 172.21.15.112:0/4105351064 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388011990 con 0x7fc39815a480 2023-11-08T12:28:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc3977fe700 1 -- 172.21.15.112:0/4105351064 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011d20 con 0x7fc39815a480 2023-11-08T12:28:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 -- 172.21.15.112:0/4105351064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc39815a480 msgr2=0x7fc3980cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 --2- 172.21.15.112:0/4105351064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc39815a480 0x7fc3980cc290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3980b1230 tx=0x7fc388009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 -- 172.21.15.112:0/4105351064 shutdown_connections 2023-11-08T12:28:26.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 --2- 172.21.15.112:0/4105351064 >> v2:172.21.15.133:3300/0 conn(0x7fc3980c8d10 0x7fc3980cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 --2- 172.21.15.112:0/4105351064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc39815a480 0x7fc3980cc290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 -- 172.21.15.112:0/4105351064 >> 172.21.15.112:0/4105351064 conn(0x7fc3980cf350 msgr2=0x7fc3980b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:26.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 -- 172.21.15.112:0/4105351064 shutdown_connections 2023-11-08T12:28:26.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 -- 172.21.15.112:0/4105351064 wait complete. 2023-11-08T12:28:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.361+0000 7fc39e43e700 1 Processor -- start 2023-11-08T12:28:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 -- start start 2023-11-08T12:28:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3980c8d10 0x7fc39815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3980ccd10 0x7fc3980c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc39815a480 0x7fc3980b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3981f5240 con 0x7fc3980ccd10 2023-11-08T12:28:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39815d960 con 0x7fc3980c8d10 2023-11-08T12:28:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc398154e50 con 0x7fc39815a480 2023-11-08T12:28:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3980ccd10 0x7fc3980c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3980ccd10 0x7fc3980c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56648/0 (socket says 172.21.15.112:56648) 2023-11-08T12:28:26.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 -- 172.21.15.112:0/2990585512 learned_addr learned my addr 172.21.15.112:0/2990585512 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:26.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 -- 172.21.15.112:0/2990585512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc39815a480 msgr2=0x7fc3980b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc39815a480 0x7fc3980b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 -- 172.21.15.112:0/2990585512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3980c8d10 msgr2=0x7fc39815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3980c8d10 0x7fc39815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 -- 172.21.15.112:0/2990585512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388009570 con 0x7fc3980ccd10 2023-11-08T12:28:26.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc38ffff700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3980ccd10 0x7fc3980c8170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc38000e870 tx=0x7fc38000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:26.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc3957fa700 1 -- 172.21.15.112:0/2990585512 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3800095c0 con 0x7fc3980ccd10 2023-11-08T12:28:26.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc3957fa700 1 -- 172.21.15.112:0/2990585512 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38000ee70 con 0x7fc3980ccd10 2023-11-08T12:28:26.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc3957fa700 1 -- 172.21.15.112:0/2990585512 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38000ca70 con 0x7fc3980ccd10 2023-11-08T12:28:26.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3980add50 con 0x7fc3980ccd10 2023-11-08T12:28:26.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.365+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3980caa30 con 0x7fc3980ccd10 2023-11-08T12:28:26.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.369+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3980ca6e0 con 0x7fc3980ccd10 2023-11-08T12:28:26.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.369+0000 7fc3957fa700 1 -- 172.21.15.112:0/2990585512 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc380019030 con 0x7fc3980ccd10 2023-11-08T12:28:26.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.369+0000 7fc3957fa700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc378064ee0 0x7fc378067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.369+0000 7fc3957fa700 1 -- 172.21.15.112:0/2990585512 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3800820f0 con 0x7fc3980ccd10 2023-11-08T12:28:26.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.369+0000 7fc397fff700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc378064ee0 0x7fc378067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.373+0000 7fc397fff700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc378064ee0 0x7fc378067390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3980c7450 tx=0x7fc388010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:26.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.373+0000 7fc3957fa700 1 -- 172.21.15.112:0/2990585512 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc38004feb0 con 0x7fc3980ccd10 2023-11-08T12:28:26.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.525+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3980726c0 con 0x7fc378064ee0 2023-11-08T12:28:26.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.537+0000 7fc3957fa700 1 -- 172.21.15.112:0/2990585512 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367166 (secure 0 0 0) 0x7fc3980726c0 con 0x7fc378064ee0 2023-11-08T12:28:26.545 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:26.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc378064ee0 msgr2=0x7fc378067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc378064ee0 0x7fc378067390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3980c7450 tx=0x7fc388010000 comp rx=0 tx=0).stop 2023-11-08T12:28:26.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3980ccd10 msgr2=0x7fc3980c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3980ccd10 0x7fc3980c8170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc38000e870 tx=0x7fc38000ec30 comp rx=0 tx=0).stop 2023-11-08T12:28:26.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 shutdown_connections 2023-11-08T12:28:26.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc378064ee0 0x7fc378067390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc39815a480 0x7fc3980b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3980ccd10 0x7fc3980c8170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 --2- 172.21.15.112:0/2990585512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3980c8d10 0x7fc39815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 >> 172.21.15.112:0/2990585512 conn(0x7fc3980cf350 msgr2=0x7fc39806cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:26.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 shutdown_connections 2023-11-08T12:28:26.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.545+0000 7fc39e43e700 1 -- 172.21.15.112:0/2990585512 wait complete. 2023-11-08T12:28:26.551 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:28:26.568 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-11-08T12:28:24.717630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594895,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67592,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907128,"statfs":{"total":773094113280,"available":773024899072,"internally_reserved":0,"allocated":3678208,"data_stored":2187254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005453"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734482+0000","last_change":"2023-11-08T12:27:58.143715+0000","last_active":"2023-11-08T12:27:58.734482+0000","last_peered":"2023-11-08T12:27:58.734482+0000","last_clean":"2023-11-08T12:27:58.734482+0000","last_became_active":"2023-11-08T12:27:58.143212+0000","last_became_peered":"2023-11-08T12:27:58.143212+0000","last_unstale":"2023-11-08T12:27:58.734482+0000","last_undegraded":"2023-11-08T12:27:58.734482+0000","last_fullsized":"2023-11-08T12:27:58.734482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:00:05.519929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130697+0000","last_change":"2023-11-08T12:27:53.619554+0000","last_active":"2023-11-08T12:27:58.130697+0000","last_peered":"2023-11-08T12:27:58.130697+0000","last_clean":"2023-11-08T12:27:58.130697+0000","last_became_active":"2023-11-08T12:27:53.618719+0000","last_became_peered":"2023-11-08T12:27:53.618719+0000","last_unstale":"2023-11-08T12:27:58.130697+0000","last_undegraded":"2023-11-08T12:27:58.130697+0000","last_fullsized":"2023-11-08T12:27:58.130697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126104+0000","last_change":"2023-11-08T12:27:54.093845+0000","last_active":"2023-11-08T12:27:58.126104+0000","last_peered":"2023-11-08T12:27:58.126104+0000","last_clean":"2023-11-08T12:27:58.126104+0000","last_became_active":"2023-11-08T12:27:54.093578+0000","last_became_peered":"2023-11-08T12:27:54.093578+0000","last_unstale":"2023-11-08T12:27:58.126104+0000","last_undegraded":"2023-11-08T12:27:58.126104+0000","last_fullsized":"2023-11-08T12:27:58.126104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625901+0000","last_change":"2023-11-08T12:27:58.137408+0000","last_active":"2023-11-08T12:27:58.625901+0000","last_peered":"2023-11-08T12:27:58.625901+0000","last_clean":"2023-11-08T12:27:58.625901+0000","last_became_active":"2023-11-08T12:27:58.136515+0000","last_became_peered":"2023-11-08T12:27:58.136515+0000","last_unstale":"2023-11-08T12:27:58.625901+0000","last_undegraded":"2023-11-08T12:27:58.625901+0000","last_fullsized":"2023-11-08T12:27:58.625901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:02:41.434275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.116564+0000","last_change":"2023-11-08T12:27:53.619875+0000","last_active":"2023-11-08T12:27:58.116564+0000","last_peered":"2023-11-08T12:27:58.116564+0000","last_clean":"2023-11-08T12:27:58.116564+0000","last_became_active":"2023-11-08T12:27:53.619543+0000","last_became_peered":"2023-11-08T12:27:53.619543+0000","last_unstale":"2023-11-08T12:27:58.116564+0000","last_undegraded":"2023-11-08T12:27:58.116564+0000","last_fullsized":"2023-11-08T12:27:58.116564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111227+0000","last_change":"2023-11-08T12:27:54.083208+0000","last_active":"2023-11-08T12:27:58.111227+0000","last_peered":"2023-11-08T12:27:58.111227+0000","last_clean":"2023-11-08T12:27:58.111227+0000","last_became_active":"2023-11-08T12:27:54.082680+0000","last_became_peered":"2023-11-08T12:27:54.082680+0000","last_unstale":"2023-11-08T12:27:58.111227+0000","last_undegraded":"2023-11-08T12:27:58.111227+0000","last_fullsized":"2023-11-08T12:27:58.111227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574345+0000","last_change":"2023-11-08T12:27:58.142185+0000","last_active":"2023-11-08T12:27:58.574345+0000","last_peered":"2023-11-08T12:27:58.574345+0000","last_clean":"2023-11-08T12:27:58.574345+0000","last_became_active":"2023-11-08T12:27:58.141842+0000","last_became_peered":"2023-11-08T12:27:58.141842+0000","last_unstale":"2023-11-08T12:27:58.574345+0000","last_undegraded":"2023-11-08T12:27:58.574345+0000","last_fullsized":"2023-11-08T12:27:58.574345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:02:41.632614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110470+0000","last_change":"2023-11-08T12:27:53.624797+0000","last_active":"2023-11-08T12:27:58.110470+0000","last_peered":"2023-11-08T12:27:58.110470+0000","last_clean":"2023-11-08T12:27:58.110470+0000","last_became_active":"2023-11-08T12:27:53.624543+0000","last_became_peered":"2023-11-08T12:27:53.624543+0000","last_unstale":"2023-11-08T12:27:58.110470+0000","last_undegraded":"2023-11-08T12:27:58.110470+0000","last_fullsized":"2023-11-08T12:27:58.110470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:30.363156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127249+0000","last_change":"2023-11-08T12:27:54.100828+0000","last_active":"2023-11-08T12:27:58.127249+0000","last_peered":"2023-11-08T12:27:58.127249+0000","last_clean":"2023-11-08T12:27:58.127249+0000","last_became_active":"2023-11-08T12:27:54.100558+0000","last_became_peered":"2023-11-08T12:27:54.100558+0000","last_unstale":"2023-11-08T12:27:58.127249+0000","last_undegraded":"2023-11-08T12:27:58.127249+0000","last_fullsized":"2023-11-08T12:27:58.127249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879088+0000","last_change":"2023-11-08T12:27:58.154104+0000","last_active":"2023-11-08T12:27:58.879088+0000","last_peered":"2023-11-08T12:27:58.879088+0000","last_clean":"2023-11-08T12:27:58.879088+0000","last_became_active":"2023-11-08T12:27:58.153162+0000","last_became_peered":"2023-11-08T12:27:58.153162+0000","last_unstale":"2023-11-08T12:27:58.879088+0000","last_undegraded":"2023-11-08T12:27:58.879088+0000","last_fullsized":"2023-11-08T12:27:58.879088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109644+0000","last_change":"2023-11-08T12:27:53.622313+0000","last_active":"2023-11-08T12:27:58.109644+0000","last_peered":"2023-11-08T12:27:58.109644+0000","last_clean":"2023-11-08T12:27:58.109644+0000","last_became_active":"2023-11-08T12:27:53.621963+0000","last_became_peered":"2023-11-08T12:27:53.621963+0000","last_unstale":"2023-11-08T12:27:58.109644+0000","last_undegraded":"2023-11-08T12:27:58.109644+0000","last_fullsized":"2023-11-08T12:27:58.109644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:58.001489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127020+0000","last_change":"2023-11-08T12:27:54.096898+0000","last_active":"2023-11-08T12:27:58.127020+0000","last_peered":"2023-11-08T12:27:58.127020+0000","last_clean":"2023-11-08T12:27:58.127020+0000","last_became_active":"2023-11-08T12:27:54.096604+0000","last_became_peered":"2023-11-08T12:27:54.096604+0000","last_unstale":"2023-11-08T12:27:58.127020+0000","last_undegraded":"2023-11-08T12:27:58.127020+0000","last_fullsized":"2023-11-08T12:27:58.127020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735720+0000","last_change":"2023-11-08T12:27:58.144552+0000","last_active":"2023-11-08T12:27:58.735720+0000","last_peered":"2023-11-08T12:27:58.735720+0000","last_clean":"2023-11-08T12:27:58.735720+0000","last_became_active":"2023-11-08T12:27:58.144149+0000","last_became_peered":"2023-11-08T12:27:58.144149+0000","last_unstale":"2023-11-08T12:27:58.735720+0000","last_undegraded":"2023-11-08T12:27:58.735720+0000","last_fullsized":"2023-11-08T12:27:58.735720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.131880+0000","last_change":"2023-11-08T12:27:53.626681+0000","last_active":"2023-11-08T12:27:58.131880+0000","last_peered":"2023-11-08T12:27:58.131880+0000","last_clean":"2023-11-08T12:27:58.131880+0000","last_became_active":"2023-11-08T12:27:53.625885+0000","last_became_peered":"2023-11-08T12:27:53.625885+0000","last_unstale":"2023-11-08T12:27:58.131880+0000","last_undegraded":"2023-11-08T12:27:58.131880+0000","last_fullsized":"2023-11-08T12:27:58.131880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112234+0000","last_change":"2023-11-08T12:27:54.089379+0000","last_active":"2023-11-08T12:27:58.112234+0000","last_peered":"2023-11-08T12:27:58.112234+0000","last_clean":"2023-11-08T12:27:58.112234+0000","last_became_active":"2023-11-08T12:27:54.089095+0000","last_became_peered":"2023-11-08T12:27:54.089095+0000","last_unstale":"2023-11-08T12:27:58.112234+0000","last_undegraded":"2023-11-08T12:27:58.112234+0000","last_fullsized":"2023-11-08T12:27:58.112234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:02.028291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.626502+0000","last_change":"2023-11-08T12:27:58.143308+0000","last_active":"2023-11-08T12:27:58.626502+0000","last_peered":"2023-11-08T12:27:58.626502+0000","last_clean":"2023-11-08T12:27:58.626502+0000","last_became_active":"2023-11-08T12:27:58.142966+0000","last_became_peered":"2023-11-08T12:27:58.142966+0000","last_unstale":"2023-11-08T12:27:58.626502+0000","last_undegraded":"2023-11-08T12:27:58.626502+0000","last_fullsized":"2023-11-08T12:27:58.626502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:16:55.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127396+0000","last_change":"2023-11-08T12:27:53.627388+0000","last_active":"2023-11-08T12:27:58.127396+0000","last_peered":"2023-11-08T12:27:58.127396+0000","last_clean":"2023-11-08T12:27:58.127396+0000","last_became_active":"2023-11-08T12:27:53.625097+0000","last_became_peered":"2023-11-08T12:27:53.625097+0000","last_unstale":"2023-11-08T12:27:58.127396+0000","last_undegraded":"2023-11-08T12:27:58.127396+0000","last_fullsized":"2023-11-08T12:27:58.127396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:48.205657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112661+0000","last_change":"2023-11-08T12:27:54.091732+0000","last_active":"2023-11-08T12:27:58.112661+0000","last_peered":"2023-11-08T12:27:58.112661+0000","last_clean":"2023-11-08T12:27:58.112661+0000","last_became_active":"2023-11-08T12:27:54.090672+0000","last_became_peered":"2023-11-08T12:27:54.090672+0000","last_unstale":"2023-11-08T12:27:58.112661+0000","last_undegraded":"2023-11-08T12:27:58.112661+0000","last_fullsized":"2023-11-08T12:27:58.112661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.068573+0000","last_change":"2023-11-08T12:27:58.149046+0000","last_active":"2023-11-08T12:27:59.068573+0000","last_peered":"2023-11-08T12:27:59.068573+0000","last_clean":"2023-11-08T12:27:59.068573+0000","last_became_active":"2023-11-08T12:27:58.148283+0000","last_became_peered":"2023-11-08T12:27:58.148283+0000","last_unstale":"2023-11-08T12:27:59.068573+0000","last_undegraded":"2023-11-08T12:27:59.068573+0000","last_fullsized":"2023-11-08T12:27:59.068573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:06.214828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123874+0000","last_change":"2023-11-08T12:27:53.618474+0000","last_active":"2023-11-08T12:27:58.123874+0000","last_peered":"2023-11-08T12:27:58.123874+0000","last_clean":"2023-11-08T12:27:58.123874+0000","last_became_active":"2023-11-08T12:27:53.617981+0000","last_became_peered":"2023-11-08T12:27:53.617981+0000","last_unstale":"2023-11-08T12:27:58.123874+0000","last_undegraded":"2023-11-08T12:27:58.123874+0000","last_fullsized":"2023-11-08T12:27:58.123874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128422+0000","last_change":"2023-11-08T12:27:54.116480+0000","last_active":"2023-11-08T12:27:58.128422+0000","last_peered":"2023-11-08T12:27:58.128422+0000","last_clean":"2023-11-08T12:27:58.128422+0000","last_became_active":"2023-11-08T12:27:54.116211+0000","last_became_peered":"2023-11-08T12:27:54.116211+0000","last_unstale":"2023-11-08T12:27:58.128422+0000","last_undegraded":"2023-11-08T12:27:58.128422+0000","last_fullsized":"2023-11-08T12:27:58.128422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727992+0000","last_change":"2023-11-08T12:27:58.145667+0000","last_active":"2023-11-08T12:27:58.727992+0000","last_peered":"2023-11-08T12:27:58.727992+0000","last_clean":"2023-11-08T12:27:58.727992+0000","last_became_active":"2023-11-08T12:27:58.145298+0000","last_became_peered":"2023-11-08T12:27:58.145298+0000","last_unstale":"2023-11-08T12:27:58.727992+0000","last_undegraded":"2023-11-08T12:27:58.727992+0000","last_fullsized":"2023-11-08T12:27:58.727992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112268+0000","last_change":"2023-11-08T12:27:53.612017+0000","last_active":"2023-11-08T12:27:58.112268+0000","last_peered":"2023-11-08T12:27:58.112268+0000","last_clean":"2023-11-08T12:27:58.112268+0000","last_became_active":"2023-11-08T12:27:53.611179+0000","last_became_peered":"2023-11-08T12:27:53.611179+0000","last_unstale":"2023-11-08T12:27:58.112268+0000","last_undegraded":"2023-11-08T12:27:58.112268+0000","last_fullsized":"2023-11-08T12:27:58.112268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135571+0000","last_change":"2023-11-08T12:27:54.089485+0000","last_active":"2023-11-08T12:27:58.135571+0000","last_peered":"2023-11-08T12:27:58.135571+0000","last_clean":"2023-11-08T12:27:58.135571+0000","last_became_active":"2023-11-08T12:27:54.089151+0000","last_became_peered":"2023-11-08T12:27:54.089151+0000","last_unstale":"2023-11-08T12:27:58.135571+0000","last_undegraded":"2023-11-08T12:27:58.135571+0000","last_fullsized":"2023-11-08T12:27:58.135571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:14.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111497+0000","last_change":"2023-11-08T12:27:54.084403+0000","last_active":"2023-11-08T12:27:58.111497+0000","last_peered":"2023-11-08T12:27:58.111497+0000","last_clean":"2023-11-08T12:27:58.111497+0000","last_became_active":"2023-11-08T12:27:54.084144+0000","last_became_peered":"2023-11-08T12:27:54.084144+0000","last_unstale":"2023-11-08T12:27:58.111497+0000","last_undegraded":"2023-11-08T12:27:58.111497+0000","last_fullsized":"2023-11-08T12:27:58.111497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130737+0000","last_change":"2023-11-08T12:27:53.621364+0000","last_active":"2023-11-08T12:27:58.130737+0000","last_peered":"2023-11-08T12:27:58.130737+0000","last_clean":"2023-11-08T12:27:58.130737+0000","last_became_active":"2023-11-08T12:27:53.619170+0000","last_became_peered":"2023-11-08T12:27:53.619170+0000","last_unstale":"2023-11-08T12:27:58.130737+0000","last_undegraded":"2023-11-08T12:27:58.130737+0000","last_fullsized":"2023-11-08T12:27:58.130737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067445+0000","last_change":"2023-11-08T12:27:58.143148+0000","last_active":"2023-11-08T12:27:59.067445+0000","last_peered":"2023-11-08T12:27:59.067445+0000","last_clean":"2023-11-08T12:27:59.067445+0000","last_became_active":"2023-11-08T12:27:58.142740+0000","last_became_peered":"2023-11-08T12:27:58.142740+0000","last_unstale":"2023-11-08T12:27:59.067445+0000","last_undegraded":"2023-11-08T12:27:59.067445+0000","last_fullsized":"2023-11-08T12:27:59.067445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:35.390792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111098+0000","last_change":"2023-11-08T12:27:54.117016+0000","last_active":"2023-11-08T12:27:58.111098+0000","last_peered":"2023-11-08T12:27:58.111098+0000","last_clean":"2023-11-08T12:27:58.111098+0000","last_became_active":"2023-11-08T12:27:54.116727+0000","last_became_peered":"2023-11-08T12:27:54.116727+0000","last_unstale":"2023-11-08T12:27:58.111098+0000","last_undegraded":"2023-11-08T12:27:58.111098+0000","last_fullsized":"2023-11-08T12:27:58.111098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110642+0000","last_change":"2023-11-08T12:27:53.615988+0000","last_active":"2023-11-08T12:27:58.110642+0000","last_peered":"2023-11-08T12:27:58.110642+0000","last_clean":"2023-11-08T12:27:58.110642+0000","last_became_active":"2023-11-08T12:27:53.615438+0000","last_became_peered":"2023-11-08T12:27:53.615438+0000","last_unstale":"2023-11-08T12:27:58.110642+0000","last_undegraded":"2023-11-08T12:27:58.110642+0000","last_fullsized":"2023-11-08T12:27:58.110642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:35.164663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878583+0000","last_change":"2023-11-08T12:27:58.153999+0000","last_active":"2023-11-08T12:27:58.878583+0000","last_peered":"2023-11-08T12:27:58.878583+0000","last_clean":"2023-11-08T12:27:58.878583+0000","last_became_active":"2023-11-08T12:27:58.152623+0000","last_became_peered":"2023-11-08T12:27:58.152623+0000","last_unstale":"2023-11-08T12:27:58.878583+0000","last_undegraded":"2023-11-08T12:27:58.878583+0000","last_fullsized":"2023-11-08T12:27:58.878583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122939+0000","last_change":"2023-11-08T12:27:53.621214+0000","last_active":"2023-11-08T12:27:58.122939+0000","last_peered":"2023-11-08T12:27:58.122939+0000","last_clean":"2023-11-08T12:27:58.122939+0000","last_became_active":"2023-11-08T12:27:53.620914+0000","last_became_peered":"2023-11-08T12:27:53.620914+0000","last_unstale":"2023-11-08T12:27:58.122939+0000","last_undegraded":"2023-11-08T12:27:58.122939+0000","last_fullsized":"2023-11-08T12:27:58.122939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:07.559515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127137+0000","last_change":"2023-11-08T12:27:54.093415+0000","last_active":"2023-11-08T12:27:58.127137+0000","last_peered":"2023-11-08T12:27:58.127137+0000","last_clean":"2023-11-08T12:27:58.127137+0000","last_became_active":"2023-11-08T12:27:54.092409+0000","last_became_peered":"2023-11-08T12:27:54.092409+0000","last_unstale":"2023-11-08T12:27:58.127137+0000","last_undegraded":"2023-11-08T12:27:58.127137+0000","last_fullsized":"2023-11-08T12:27:58.127137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:25:08.805427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572683+0000","last_change":"2023-11-08T12:27:58.143576+0000","last_active":"2023-11-08T12:27:58.572683+0000","last_peered":"2023-11-08T12:27:58.572683+0000","last_clean":"2023-11-08T12:27:58.572683+0000","last_became_active":"2023-11-08T12:27:58.143166+0000","last_became_peered":"2023-11-08T12:27:58.143166+0000","last_unstale":"2023-11-08T12:27:58.572683+0000","last_undegraded":"2023-11-08T12:27:58.572683+0000","last_fullsized":"2023-11-08T12:27:58.572683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:28:10.838649+0000","last_change":"2023-11-08T12:27:53.627035+0000","last_active":"2023-11-08T12:28:10.838649+0000","last_peered":"2023-11-08T12:28:10.838649+0000","last_clean":"2023-11-08T12:28:10.838649+0000","last_became_active":"2023-11-08T12:27:53.625128+0000","last_became_peered":"2023-11-08T12:27:53.625128+0000","last_unstale":"2023-11-08T12:28:10.838649+0000","last_undegraded":"2023-11-08T12:28:10.838649+0000","last_fullsized":"2023-11-08T12:28:10.838649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127106+0000","last_change":"2023-11-08T12:27:54.095419+0000","last_active":"2023-11-08T12:27:58.127106+0000","last_peered":"2023-11-08T12:27:58.127106+0000","last_clean":"2023-11-08T12:27:58.127106+0000","last_became_active":"2023-11-08T12:27:54.095149+0000","last_became_peered":"2023-11-08T12:27:54.095149+0000","last_unstale":"2023-11-08T12:27:58.127106+0000","last_undegraded":"2023-11-08T12:27:58.127106+0000","last_fullsized":"2023-11-08T12:27:58.127106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.734672+0000","last_change":"2023-11-08T12:27:58.153991+0000","last_active":"2023-11-08T12:27:58.734672+0000","last_peered":"2023-11-08T12:27:58.734672+0000","last_clean":"2023-11-08T12:27:58.734672+0000","last_became_active":"2023-11-08T12:27:58.153570+0000","last_became_peered":"2023-11-08T12:27:58.153570+0000","last_unstale":"2023-11-08T12:27:58.734672+0000","last_undegraded":"2023-11-08T12:27:58.734672+0000","last_fullsized":"2023-11-08T12:27:58.734672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:18:44.567768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126320+0000","last_change":"2023-11-08T12:27:54.097273+0000","last_active":"2023-11-08T12:27:58.126320+0000","last_peered":"2023-11-08T12:27:58.126320+0000","last_clean":"2023-11-08T12:27:58.126320+0000","last_became_active":"2023-11-08T12:27:54.097022+0000","last_became_peered":"2023-11-08T12:27:54.097022+0000","last_unstale":"2023-11-08T12:27:58.126320+0000","last_undegraded":"2023-11-08T12:27:58.126320+0000","last_fullsized":"2023-11-08T12:27:58.126320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.135667+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:27:58.135667+0000","last_peered":"2023-11-08T12:27:58.135667+0000","last_clean":"2023-11-08T12:27:58.135667+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:27:58.135667+0000","last_undegraded":"2023-11-08T12:27:58.135667+0000","last_fullsized":"2023-11-08T12:27:58.135667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'1","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.728537+0000","last_change":"2023-11-08T12:27:53.620399+0000","last_active":"2023-11-08T12:27:58.728537+0000","last_peered":"2023-11-08T12:27:58.728537+0000","last_clean":"2023-11-08T12:27:58.728537+0000","last_became_active":"2023-11-08T12:27:53.619858+0000","last_became_peered":"2023-11-08T12:27:53.619858+0000","last_unstale":"2023-11-08T12:27:58.728537+0000","last_undegraded":"2023-11-08T12:27:58.728537+0000","last_fullsized":"2023-11-08T12:27:58.728537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:58:56.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.572203+0000","last_change":"2023-11-08T12:27:58.138249+0000","last_active":"2023-11-08T12:27:58.572203+0000","last_peered":"2023-11-08T12:27:58.572203+0000","last_clean":"2023-11-08T12:27:58.572203+0000","last_became_active":"2023-11-08T12:27:58.136905+0000","last_became_peered":"2023-11-08T12:27:58.136905+0000","last_unstale":"2023-11-08T12:27:58.572203+0000","last_undegraded":"2023-11-08T12:27:58.572203+0000","last_fullsized":"2023-11-08T12:27:58.572203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:39:38.782448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.111643+0000","last_change":"2023-11-08T12:27:54.113672+0000","last_active":"2023-11-08T12:27:58.111643+0000","last_peered":"2023-11-08T12:27:58.111643+0000","last_clean":"2023-11-08T12:27:58.111643+0000","last_became_active":"2023-11-08T12:27:54.113329+0000","last_became_peered":"2023-11-08T12:27:54.113329+0000","last_unstale":"2023-11-08T12:27:58.111643+0000","last_undegraded":"2023-11-08T12:27:58.111643+0000","last_fullsized":"2023-11-08T12:27:58.111643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126943+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:27:58.126943+0000","last_peered":"2023-11-08T12:27:58.126943+0000","last_clean":"2023-11-08T12:27:58.126943+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:27:58.126943+0000","last_undegraded":"2023-11-08T12:27:58.126943+0000","last_fullsized":"2023-11-08T12:27:58.126943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.118099+0000","last_change":"2023-11-08T12:27:53.617273+0000","last_active":"2023-11-08T12:27:58.118099+0000","last_peered":"2023-11-08T12:27:58.118099+0000","last_clean":"2023-11-08T12:27:58.118099+0000","last_became_active":"2023-11-08T12:27:53.616974+0000","last_became_peered":"2023-11-08T12:27:53.616974+0000","last_unstale":"2023-11-08T12:27:58.118099+0000","last_undegraded":"2023-11-08T12:27:58.118099+0000","last_fullsized":"2023-11-08T12:27:58.118099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.625634+0000","last_change":"2023-11-08T12:27:58.149407+0000","last_active":"2023-11-08T12:27:58.625634+0000","last_peered":"2023-11-08T12:27:58.625634+0000","last_clean":"2023-11-08T12:27:58.625634+0000","last_became_active":"2023-11-08T12:27:58.148897+0000","last_became_peered":"2023-11-08T12:27:58.148897+0000","last_unstale":"2023-11-08T12:27:58.625634+0000","last_undegraded":"2023-11-08T12:27:58.625634+0000","last_fullsized":"2023-11-08T12:27:58.625634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:49.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129170+0000","last_change":"2023-11-08T12:27:54.116232+0000","last_active":"2023-11-08T12:27:58.129170+0000","last_peered":"2023-11-08T12:27:58.129170+0000","last_clean":"2023-11-08T12:27:58.129170+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129170+0000","last_undegraded":"2023-11-08T12:27:58.129170+0000","last_fullsized":"2023-11-08T12:27:58.129170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:53:31.883630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123167+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:27:58.123167+0000","last_peered":"2023-11-08T12:27:58.123167+0000","last_clean":"2023-11-08T12:27:58.123167+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:27:58.123167+0000","last_undegraded":"2023-11-08T12:27:58.123167+0000","last_fullsized":"2023-11-08T12:27:58.123167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126485+0000","last_change":"2023-11-08T12:27:53.615162+0000","last_active":"2023-11-08T12:27:58.126485+0000","last_peered":"2023-11-08T12:27:58.126485+0000","last_clean":"2023-11-08T12:27:58.126485+0000","last_became_active":"2023-11-08T12:27:53.613969+0000","last_became_peered":"2023-11-08T12:27:53.613969+0000","last_unstale":"2023-11-08T12:27:58.126485+0000","last_undegraded":"2023-11-08T12:27:58.126485+0000","last_fullsized":"2023-11-08T12:27:58.126485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:59.067771+0000","last_change":"2023-11-08T12:27:58.135959+0000","last_active":"2023-11-08T12:27:59.067771+0000","last_peered":"2023-11-08T12:27:59.067771+0000","last_clean":"2023-11-08T12:27:59.067771+0000","last_became_active":"2023-11-08T12:27:58.135005+0000","last_became_peered":"2023-11-08T12:27:58.135005+0000","last_unstale":"2023-11-08T12:27:59.067771+0000","last_undegraded":"2023-11-08T12:27:59.067771+0000","last_fullsized":"2023-11-08T12:27:59.067771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:40.554359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127218+0000","last_change":"2023-11-08T12:27:54.101570+0000","last_active":"2023-11-08T12:27:58.127218+0000","last_peered":"2023-11-08T12:27:58.127218+0000","last_clean":"2023-11-08T12:27:58.127218+0000","last_became_active":"2023-11-08T12:27:54.101436+0000","last_became_peered":"2023-11-08T12:27:54.101436+0000","last_unstale":"2023-11-08T12:27:58.127218+0000","last_undegraded":"2023-11-08T12:27:58.127218+0000","last_fullsized":"2023-11-08T12:27:58.127218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127048+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:27:58.127048+0000","last_peered":"2023-11-08T12:27:58.127048+0000","last_clean":"2023-11-08T12:27:58.127048+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:27:58.127048+0000","last_undegraded":"2023-11-08T12:27:58.127048+0000","last_fullsized":"2023-11-08T12:27:58.127048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110574+0000","last_change":"2023-11-08T12:27:53.610684+0000","last_active":"2023-11-08T12:27:58.110574+0000","last_peered":"2023-11-08T12:27:58.110574+0000","last_clean":"2023-11-08T12:27:58.110574+0000","last_became_active":"2023-11-08T12:27:53.610294+0000","last_became_peered":"2023-11-08T12:27:53.610294+0000","last_unstale":"2023-11-08T12:27:58.110574+0000","last_undegraded":"2023-11-08T12:27:58.110574+0000","last_fullsized":"2023-11-08T12:27:58.110574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727740+0000","last_change":"2023-11-08T12:27:58.142126+0000","last_active":"2023-11-08T12:27:58.727740+0000","last_peered":"2023-11-08T12:27:58.727740+0000","last_clean":"2023-11-08T12:27:58.727740+0000","last_became_active":"2023-11-08T12:27:58.139937+0000","last_became_peered":"2023-11-08T12:27:58.139937+0000","last_unstale":"2023-11-08T12:27:58.727740+0000","last_undegraded":"2023-11-08T12:27:58.727740+0000","last_fullsized":"2023-11-08T12:27:58.727740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:25:36.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126398+0000","last_change":"2023-11-08T12:27:54.098374+0000","last_active":"2023-11-08T12:27:58.126398+0000","last_peered":"2023-11-08T12:27:58.126398+0000","last_clean":"2023-11-08T12:27:58.126398+0000","last_became_active":"2023-11-08T12:27:54.095259+0000","last_became_peered":"2023-11-08T12:27:54.095259+0000","last_unstale":"2023-11-08T12:27:58.126398+0000","last_undegraded":"2023-11-08T12:27:58.126398+0000","last_fullsized":"2023-11-08T12:27:58.126398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127272+0000","last_change":"2023-11-08T12:27:53.624589+0000","last_active":"2023-11-08T12:27:58.127272+0000","last_peered":"2023-11-08T12:27:58.127272+0000","last_clean":"2023-11-08T12:27:58.127272+0000","last_became_active":"2023-11-08T12:27:53.624171+0000","last_became_peered":"2023-11-08T12:27:53.624171+0000","last_unstale":"2023-11-08T12:27:58.127272+0000","last_undegraded":"2023-11-08T12:27:58.127272+0000","last_fullsized":"2023-11-08T12:27:58.127272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109600+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:27:58.109600+0000","last_peered":"2023-11-08T12:27:58.109600+0000","last_clean":"2023-11-08T12:27:58.109600+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:27:58.109600+0000","last_undegraded":"2023-11-08T12:27:58.109600+0000","last_fullsized":"2023-11-08T12:27:58.109600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.727835+0000","last_change":"2023-11-08T12:27:58.142674+0000","last_active":"2023-11-08T12:27:58.727835+0000","last_peered":"2023-11-08T12:27:58.727835+0000","last_clean":"2023-11-08T12:27:58.727835+0000","last_became_active":"2023-11-08T12:27:58.142302+0000","last_became_peered":"2023-11-08T12:27:58.142302+0000","last_unstale":"2023-11-08T12:27:58.727835+0000","last_undegraded":"2023-11-08T12:27:58.727835+0000","last_fullsized":"2023-11-08T12:27:58.727835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127069+0000","last_change":"2023-11-08T12:27:54.102964+0000","last_active":"2023-11-08T12:27:58.127069+0000","last_peered":"2023-11-08T12:27:58.127069+0000","last_clean":"2023-11-08T12:27:58.127069+0000","last_became_active":"2023-11-08T12:27:54.102407+0000","last_became_peered":"2023-11-08T12:27:54.102407+0000","last_unstale":"2023-11-08T12:27:58.127069+0000","last_undegraded":"2023-11-08T12:27:58.127069+0000","last_fullsized":"2023-11-08T12:27:58.127069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:05.031348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130328+0000","last_change":"2023-11-08T12:27:53.616006+0000","last_active":"2023-11-08T12:27:58.130328+0000","last_peered":"2023-11-08T12:27:58.130328+0000","last_clean":"2023-11-08T12:27:58.130328+0000","last_became_active":"2023-11-08T12:27:53.615753+0000","last_became_peered":"2023-11-08T12:27:53.615753+0000","last_unstale":"2023-11-08T12:27:58.130328+0000","last_undegraded":"2023-11-08T12:27:58.130328+0000","last_fullsized":"2023-11-08T12:27:58.130328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:52:01.806623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112019+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:27:58.112019+0000","last_peered":"2023-11-08T12:27:58.112019+0000","last_clean":"2023-11-08T12:27:58.112019+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:27:58.112019+0000","last_undegraded":"2023-11-08T12:27:58.112019+0000","last_fullsized":"2023-11-08T12:27:58.112019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575827+0000","last_change":"2023-11-08T12:27:58.150621+0000","last_active":"2023-11-08T12:27:58.575827+0000","last_peered":"2023-11-08T12:27:58.575827+0000","last_clean":"2023-11-08T12:27:58.575827+0000","last_became_active":"2023-11-08T12:27:58.150173+0000","last_became_peered":"2023-11-08T12:27:58.150173+0000","last_unstale":"2023-11-08T12:27:58.575827+0000","last_undegraded":"2023-11-08T12:27:58.575827+0000","last_fullsized":"2023-11-08T12:27:58.575827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:22:48.495503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128502+0000","last_change":"2023-11-08T12:27:54.105866+0000","last_active":"2023-11-08T12:27:58.128502+0000","last_peered":"2023-11-08T12:27:58.128502+0000","last_clean":"2023-11-08T12:27:58.128502+0000","last_became_active":"2023-11-08T12:27:54.105572+0000","last_became_peered":"2023-11-08T12:27:54.105572+0000","last_unstale":"2023-11-08T12:27:58.128502+0000","last_undegraded":"2023-11-08T12:27:58.128502+0000","last_fullsized":"2023-11-08T12:27:58.128502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.120729+0000","last_change":"2023-11-08T12:27:53.626369+0000","last_active":"2023-11-08T12:27:58.120729+0000","last_peered":"2023-11-08T12:27:58.120729+0000","last_clean":"2023-11-08T12:27:58.120729+0000","last_became_active":"2023-11-08T12:27:53.625999+0000","last_became_peered":"2023-11-08T12:27:53.625999+0000","last_unstale":"2023-11-08T12:27:58.120729+0000","last_undegraded":"2023-11-08T12:27:58.120729+0000","last_fullsized":"2023-11-08T12:27:58.120729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:44:55.697687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124321+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:27:58.124321+0000","last_peered":"2023-11-08T12:27:58.124321+0000","last_clean":"2023-11-08T12:27:58.124321+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:27:58.124321+0000","last_undegraded":"2023-11-08T12:27:58.124321+0000","last_fullsized":"2023-11-08T12:27:58.124321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574864+0000","last_change":"2023-11-08T12:27:58.143351+0000","last_active":"2023-11-08T12:27:58.574864+0000","last_peered":"2023-11-08T12:27:58.574864+0000","last_clean":"2023-11-08T12:27:58.574864+0000","last_became_active":"2023-11-08T12:27:58.142889+0000","last_became_peered":"2023-11-08T12:27:58.142889+0000","last_unstale":"2023-11-08T12:27:58.574864+0000","last_undegraded":"2023-11-08T12:27:58.574864+0000","last_fullsized":"2023-11-08T12:27:58.574864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134390+0000","last_change":"2023-11-08T12:27:54.094331+0000","last_active":"2023-11-08T12:27:58.134390+0000","last_peered":"2023-11-08T12:27:58.134390+0000","last_clean":"2023-11-08T12:27:58.134390+0000","last_became_active":"2023-11-08T12:27:54.093211+0000","last_became_peered":"2023-11-08T12:27:54.093211+0000","last_unstale":"2023-11-08T12:27:58.134390+0000","last_undegraded":"2023-11-08T12:27:58.134390+0000","last_fullsized":"2023-11-08T12:27:58.134390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:08.573753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112852+0000","last_change":"2023-11-08T12:27:53.602187+0000","last_active":"2023-11-08T12:27:58.112852+0000","last_peered":"2023-11-08T12:27:58.112852+0000","last_clean":"2023-11-08T12:27:58.112852+0000","last_became_active":"2023-11-08T12:27:53.601789+0000","last_became_peered":"2023-11-08T12:27:53.601789+0000","last_unstale":"2023-11-08T12:27:58.112852+0000","last_undegraded":"2023-11-08T12:27:58.112852+0000","last_fullsized":"2023-11-08T12:27:58.112852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109985+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:27:58.109985+0000","last_peered":"2023-11-08T12:27:58.109985+0000","last_clean":"2023-11-08T12:27:58.109985+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:27:58.109985+0000","last_undegraded":"2023-11-08T12:27:58.109985+0000","last_fullsized":"2023-11-08T12:27:58.109985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124400+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:27:58.124400+0000","last_peered":"2023-11-08T12:27:58.124400+0000","last_clean":"2023-11-08T12:27:58.124400+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:27:58.124400+0000","last_undegraded":"2023-11-08T12:27:58.124400+0000","last_fullsized":"2023-11-08T12:27:58.124400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.879351+0000","last_change":"2023-11-08T12:27:58.142022+0000","last_active":"2023-11-08T12:27:58.879351+0000","last_peered":"2023-11-08T12:27:58.879351+0000","last_clean":"2023-11-08T12:27:58.879351+0000","last_became_active":"2023-11-08T12:27:58.141645+0000","last_became_peered":"2023-11-08T12:27:58.141645+0000","last_unstale":"2023-11-08T12:27:58.879351+0000","last_undegraded":"2023-11-08T12:27:58.879351+0000","last_fullsized":"2023-11-08T12:27:58.879351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126920+0000","last_change":"2023-11-08T12:27:54.098077+0000","last_active":"2023-11-08T12:27:58.126920+0000","last_peered":"2023-11-08T12:27:58.126920+0000","last_clean":"2023-11-08T12:27:58.126920+0000","last_became_active":"2023-11-08T12:27:54.097691+0000","last_became_peered":"2023-11-08T12:27:54.097691+0000","last_unstale":"2023-11-08T12:27:58.126920+0000","last_undegraded":"2023-11-08T12:27:58.126920+0000","last_fullsized":"2023-11-08T12:27:58.126920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112388+0000","last_change":"2023-11-08T12:27:53.618293+0000","last_active":"2023-11-08T12:27:58.112388+0000","last_peered":"2023-11-08T12:27:58.112388+0000","last_clean":"2023-11-08T12:27:58.112388+0000","last_became_active":"2023-11-08T12:27:53.618041+0000","last_became_peered":"2023-11-08T12:27:53.618041+0000","last_unstale":"2023-11-08T12:27:58.112388+0000","last_undegraded":"2023-11-08T12:27:58.112388+0000","last_fullsized":"2023-11-08T12:27:58.112388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:15:11.119558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.627085+0000","last_change":"2023-11-08T12:27:58.147482+0000","last_active":"2023-11-08T12:27:58.627085+0000","last_peered":"2023-11-08T12:27:58.627085+0000","last_clean":"2023-11-08T12:27:58.627085+0000","last_became_active":"2023-11-08T12:27:58.142932+0000","last_became_peered":"2023-11-08T12:27:58.142932+0000","last_unstale":"2023-11-08T12:27:58.627085+0000","last_undegraded":"2023-11-08T12:27:58.627085+0000","last_fullsized":"2023-11-08T12:27:58.627085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:44:57.061749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127731+0000","last_change":"2023-11-08T12:27:54.096854+0000","last_active":"2023-11-08T12:27:58.127731+0000","last_peered":"2023-11-08T12:27:58.127731+0000","last_clean":"2023-11-08T12:27:58.127731+0000","last_became_active":"2023-11-08T12:27:54.095714+0000","last_became_peered":"2023-11-08T12:27:54.095714+0000","last_unstale":"2023-11-08T12:27:58.127731+0000","last_undegraded":"2023-11-08T12:27:58.127731+0000","last_fullsized":"2023-11-08T12:27:58.127731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:27.524364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126342+0000","last_change":"2023-11-08T12:27:53.615271+0000","last_active":"2023-11-08T12:27:58.126342+0000","last_peered":"2023-11-08T12:27:58.126342+0000","last_clean":"2023-11-08T12:27:58.126342+0000","last_became_active":"2023-11-08T12:27:53.614914+0000","last_became_peered":"2023-11-08T12:27:53.614914+0000","last_unstale":"2023-11-08T12:27:58.126342+0000","last_undegraded":"2023-11-08T12:27:58.126342+0000","last_fullsized":"2023-11-08T12:27:58.126342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574743+0000","last_change":"2023-11-08T12:27:58.137274+0000","last_active":"2023-11-08T12:27:58.574743+0000","last_peered":"2023-11-08T12:27:58.574743+0000","last_clean":"2023-11-08T12:27:58.574743+0000","last_became_active":"2023-11-08T12:27:58.136837+0000","last_became_peered":"2023-11-08T12:27:58.136837+0000","last_unstale":"2023-11-08T12:27:58.574743+0000","last_undegraded":"2023-11-08T12:27:58.574743+0000","last_fullsized":"2023-11-08T12:27:58.574743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126782+0000","last_change":"2023-11-08T12:27:54.099673+0000","last_active":"2023-11-08T12:27:58.126782+0000","last_peered":"2023-11-08T12:27:58.126782+0000","last_clean":"2023-11-08T12:27:58.126782+0000","last_became_active":"2023-11-08T12:27:54.096740+0000","last_became_peered":"2023-11-08T12:27:54.096740+0000","last_unstale":"2023-11-08T12:27:58.126782+0000","last_undegraded":"2023-11-08T12:27:58.126782+0000","last_fullsized":"2023-11-08T12:27:58.126782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134615+0000","last_change":"2023-11-08T12:27:53.628166+0000","last_active":"2023-11-08T12:27:58.134615+0000","last_peered":"2023-11-08T12:27:58.134615+0000","last_clean":"2023-11-08T12:27:58.134615+0000","last_became_active":"2023-11-08T12:27:53.627825+0000","last_became_peered":"2023-11-08T12:27:53.627825+0000","last_unstale":"2023-11-08T12:27:58.134615+0000","last_undegraded":"2023-11-08T12:27:58.134615+0000","last_fullsized":"2023-11-08T12:27:58.134615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:15:39.317596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.735076+0000","last_change":"2023-11-08T12:27:58.140971+0000","last_active":"2023-11-08T12:27:58.735076+0000","last_peered":"2023-11-08T12:27:58.735076+0000","last_clean":"2023-11-08T12:27:58.735076+0000","last_became_active":"2023-11-08T12:27:58.140628+0000","last_became_peered":"2023-11-08T12:27:58.140628+0000","last_unstale":"2023-11-08T12:27:58.735076+0000","last_undegraded":"2023-11-08T12:27:58.735076+0000","last_fullsized":"2023-11-08T12:27:58.735076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:06:59.562359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127582+0000","last_change":"2023-11-08T12:27:54.099418+0000","last_active":"2023-11-08T12:27:58.127582+0000","last_peered":"2023-11-08T12:27:58.127582+0000","last_clean":"2023-11-08T12:27:58.127582+0000","last_became_active":"2023-11-08T12:27:54.098046+0000","last_became_peered":"2023-11-08T12:27:54.098046+0000","last_unstale":"2023-11-08T12:27:58.127582+0000","last_undegraded":"2023-11-08T12:27:58.127582+0000","last_fullsized":"2023-11-08T12:27:58.127582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112929+0000","last_change":"2023-11-08T12:27:53.623957+0000","last_active":"2023-11-08T12:27:58.112929+0000","last_peered":"2023-11-08T12:27:58.112929+0000","last_clean":"2023-11-08T12:27:58.112929+0000","last_became_active":"2023-11-08T12:27:53.623625+0000","last_became_peered":"2023-11-08T12:27:53.623625+0000","last_unstale":"2023-11-08T12:27:58.112929+0000","last_undegraded":"2023-11-08T12:27:58.112929+0000","last_fullsized":"2023-11-08T12:27:58.112929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575667+0000","last_change":"2023-11-08T12:27:58.144841+0000","last_active":"2023-11-08T12:27:58.575667+0000","last_peered":"2023-11-08T12:27:58.575667+0000","last_clean":"2023-11-08T12:27:58.575667+0000","last_became_active":"2023-11-08T12:27:58.144375+0000","last_became_peered":"2023-11-08T12:27:58.144375+0000","last_unstale":"2023-11-08T12:27:58.575667+0000","last_undegraded":"2023-11-08T12:27:58.575667+0000","last_fullsized":"2023-11-08T12:27:58.575667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:58:16.447050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129079+0000","last_change":"2023-11-08T12:27:54.116845+0000","last_active":"2023-11-08T12:27:58.129079+0000","last_peered":"2023-11-08T12:27:58.129079+0000","last_clean":"2023-11-08T12:27:58.129079+0000","last_became_active":"2023-11-08T12:27:54.115888+0000","last_became_peered":"2023-11-08T12:27:54.115888+0000","last_unstale":"2023-11-08T12:27:58.129079+0000","last_undegraded":"2023-11-08T12:27:58.129079+0000","last_fullsized":"2023-11-08T12:27:58.129079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109551+0000","last_change":"2023-11-08T12:27:53.610197+0000","last_active":"2023-11-08T12:27:58.109551+0000","last_peered":"2023-11-08T12:27:58.109551+0000","last_clean":"2023-11-08T12:27:58.109551+0000","last_became_active":"2023-11-08T12:27:53.609789+0000","last_became_peered":"2023-11-08T12:27:53.609789+0000","last_unstale":"2023-11-08T12:27:58.109551+0000","last_undegraded":"2023-11-08T12:27:58.109551+0000","last_fullsized":"2023-11-08T12:27:58.109551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:55.652498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575442+0000","last_change":"2023-11-08T12:27:58.138875+0000","last_active":"2023-11-08T12:27:58.575442+0000","last_peered":"2023-11-08T12:27:58.575442+0000","last_clean":"2023-11-08T12:27:58.575442+0000","last_became_active":"2023-11-08T12:27:58.138194+0000","last_became_peered":"2023-11-08T12:27:58.138194+0000","last_unstale":"2023-11-08T12:27:58.575442+0000","last_undegraded":"2023-11-08T12:27:58.575442+0000","last_fullsized":"2023-11-08T12:27:58.575442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:11:58.510559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134393+0000","last_change":"2023-11-08T12:27:54.091331+0000","last_active":"2023-11-08T12:27:58.134393+0000","last_peered":"2023-11-08T12:27:58.134393+0000","last_clean":"2023-11-08T12:27:58.134393+0000","last_became_active":"2023-11-08T12:27:54.090934+0000","last_became_peered":"2023-11-08T12:27:54.090934+0000","last_unstale":"2023-11-08T12:27:58.134393+0000","last_undegraded":"2023-11-08T12:27:58.134393+0000","last_fullsized":"2023-11-08T12:27:58.134393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:22:31.377393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.123027+0000","last_change":"2023-11-08T12:27:53.619884+0000","last_active":"2023-11-08T12:27:58.123027+0000","last_peered":"2023-11-08T12:27:58.123027+0000","last_clean":"2023-11-08T12:27:58.123027+0000","last_became_active":"2023-11-08T12:27:53.619224+0000","last_became_peered":"2023-11-08T12:27:53.619224+0000","last_unstale":"2023-11-08T12:27:58.123027+0000","last_undegraded":"2023-11-08T12:27:58.123027+0000","last_fullsized":"2023-11-08T12:27:58.123027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:03:13.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575454+0000","last_change":"2023-11-08T12:27:58.146347+0000","last_active":"2023-11-08T12:27:58.575454+0000","last_peered":"2023-11-08T12:27:58.575454+0000","last_clean":"2023-11-08T12:27:58.575454+0000","last_became_active":"2023-11-08T12:27:58.141366+0000","last_became_peered":"2023-11-08T12:27:58.141366+0000","last_unstale":"2023-11-08T12:27:58.575454+0000","last_undegraded":"2023-11-08T12:27:58.575454+0000","last_fullsized":"2023-11-08T12:27:58.575454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:21:31.033260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126220+0000","last_change":"2023-11-08T12:27:54.096017+0000","last_active":"2023-11-08T12:27:58.126220+0000","last_peered":"2023-11-08T12:27:58.126220+0000","last_clean":"2023-11-08T12:27:58.126220+0000","last_became_active":"2023-11-08T12:27:54.095626+0000","last_became_peered":"2023-11-08T12:27:54.095626+0000","last_unstale":"2023-11-08T12:27:58.126220+0000","last_undegraded":"2023-11-08T12:27:58.126220+0000","last_fullsized":"2023-11-08T12:27:58.126220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:39.760166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122741+0000","last_change":"2023-11-08T12:27:53.629941+0000","last_active":"2023-11-08T12:27:58.122741+0000","last_peered":"2023-11-08T12:27:58.122741+0000","last_clean":"2023-11-08T12:27:58.122741+0000","last_became_active":"2023-11-08T12:27:53.629616+0000","last_became_peered":"2023-11-08T12:27:53.629616+0000","last_unstale":"2023-11-08T12:27:58.122741+0000","last_undegraded":"2023-11-08T12:27:58.122741+0000","last_fullsized":"2023-11-08T12:27:58.122741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:41:54.461363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.575103+0000","last_change":"2023-11-08T12:27:58.134296+0000","last_active":"2023-11-08T12:27:58.575103+0000","last_peered":"2023-11-08T12:27:58.575103+0000","last_clean":"2023-11-08T12:27:58.575103+0000","last_became_active":"2023-11-08T12:27:58.133923+0000","last_became_peered":"2023-11-08T12:27:58.133923+0000","last_unstale":"2023-11-08T12:27:58.575103+0000","last_undegraded":"2023-11-08T12:27:58.575103+0000","last_fullsized":"2023-11-08T12:27:58.575103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:19:06.502167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109786+0000","last_change":"2023-11-08T12:27:54.114859+0000","last_active":"2023-11-08T12:27:58.109786+0000","last_peered":"2023-11-08T12:27:58.109786+0000","last_clean":"2023-11-08T12:27:58.109786+0000","last_became_active":"2023-11-08T12:27:54.114573+0000","last_became_peered":"2023-11-08T12:27:54.114573+0000","last_unstale":"2023-11-08T12:27:58.109786+0000","last_undegraded":"2023-11-08T12:27:58.109786+0000","last_fullsized":"2023-11-08T12:27:58.109786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121705+0000","last_change":"2023-11-08T12:27:53.632041+0000","last_active":"2023-11-08T12:27:58.121705+0000","last_peered":"2023-11-08T12:27:58.121705+0000","last_clean":"2023-11-08T12:27:58.121705+0000","last_became_active":"2023-11-08T12:27:53.631715+0000","last_became_peered":"2023-11-08T12:27:53.631715+0000","last_unstale":"2023-11-08T12:27:58.121705+0000","last_undegraded":"2023-11-08T12:27:58.121705+0000","last_fullsized":"2023-11-08T12:27:58.121705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:13.451343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.878943+0000","last_change":"2023-11-08T12:27:58.153252+0000","last_active":"2023-11-08T12:27:58.878943+0000","last_peered":"2023-11-08T12:27:58.878943+0000","last_clean":"2023-11-08T12:27:58.878943+0000","last_became_active":"2023-11-08T12:27:58.152715+0000","last_became_peered":"2023-11-08T12:27:58.152715+0000","last_unstale":"2023-11-08T12:27:58.878943+0000","last_undegraded":"2023-11-08T12:27:58.878943+0000","last_fullsized":"2023-11-08T12:27:58.878943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:26.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574571+0000","last_change":"2023-11-08T12:27:58.134922+0000","last_active":"2023-11-08T12:27:58.574571+0000","last_peered":"2023-11-08T12:27:58.574571+0000","last_clean":"2023-11-08T12:27:58.574571+0000","last_became_active":"2023-11-08T12:27:58.134553+0000","last_became_peered":"2023-11-08T12:27:58.134553+0000","last_unstale":"2023-11-08T12:27:58.574571+0000","last_undegraded":"2023-11-08T12:27:58.574571+0000","last_fullsized":"2023-11-08T12:27:58.574571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:27.184115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130484+0000","last_change":"2023-11-08T12:27:53.613363+0000","last_active":"2023-11-08T12:27:58.130484+0000","last_peered":"2023-11-08T12:27:58.130484+0000","last_clean":"2023-11-08T12:27:58.130484+0000","last_became_active":"2023-11-08T12:27:53.613054+0000","last_became_peered":"2023-11-08T12:27:53.613054+0000","last_unstale":"2023-11-08T12:27:58.130484+0000","last_undegraded":"2023-11-08T12:27:58.130484+0000","last_fullsized":"2023-11-08T12:27:58.130484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:19:06.450847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.117992+0000","last_change":"2023-11-08T12:27:54.113407+0000","last_active":"2023-11-08T12:27:58.117992+0000","last_peered":"2023-11-08T12:27:58.117992+0000","last_clean":"2023-11-08T12:27:58.117992+0000","last_became_active":"2023-11-08T12:27:54.113143+0000","last_became_peered":"2023-11-08T12:27:54.113143+0000","last_unstale":"2023-11-08T12:27:58.117992+0000","last_undegraded":"2023-11-08T12:27:58.117992+0000","last_fullsized":"2023-11-08T12:27:58.117992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574644+0000","last_change":"2023-11-08T12:27:58.152343+0000","last_active":"2023-11-08T12:27:58.574644+0000","last_peered":"2023-11-08T12:27:58.574644+0000","last_clean":"2023-11-08T12:27:58.574644+0000","last_became_active":"2023-11-08T12:27:58.150007+0000","last_became_peered":"2023-11-08T12:27:58.150007+0000","last_unstale":"2023-11-08T12:27:58.574644+0000","last_undegraded":"2023-11-08T12:27:58.574644+0000","last_fullsized":"2023-11-08T12:27:58.574644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:56:03.995250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127705+0000","last_change":"2023-11-08T12:27:53.629979+0000","last_active":"2023-11-08T12:27:58.127705+0000","last_peered":"2023-11-08T12:27:58.127705+0000","last_clean":"2023-11-08T12:27:58.127705+0000","last_became_active":"2023-11-08T12:27:53.629610+0000","last_became_peered":"2023-11-08T12:27:53.629610+0000","last_unstale":"2023-11-08T12:27:58.127705+0000","last_undegraded":"2023-11-08T12:27:58.127705+0000","last_fullsized":"2023-11-08T12:27:58.127705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:10:20.186679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.128585+0000","last_change":"2023-11-08T12:27:54.105236+0000","last_active":"2023-11-08T12:27:58.128585+0000","last_peered":"2023-11-08T12:27:58.128585+0000","last_clean":"2023-11-08T12:27:58.128585+0000","last_became_active":"2023-11-08T12:27:54.101882+0000","last_became_peered":"2023-11-08T12:27:54.101882+0000","last_unstale":"2023-11-08T12:27:58.128585+0000","last_undegraded":"2023-11-08T12:27:58.128585+0000","last_fullsized":"2023-11-08T12:27:58.128585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.122039+0000","last_change":"2023-11-08T12:27:53.623671+0000","last_active":"2023-11-08T12:27:58.122039+0000","last_peered":"2023-11-08T12:27:58.122039+0000","last_clean":"2023-11-08T12:27:58.122039+0000","last_became_active":"2023-11-08T12:27:53.623278+0000","last_became_peered":"2023-11-08T12:27:53.623278+0000","last_unstale":"2023-11-08T12:27:58.122039+0000","last_undegraded":"2023-11-08T12:27:58.122039+0000","last_fullsized":"2023-11-08T12:27:58.122039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:28:04.800725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110357+0000","last_change":"2023-11-08T12:27:54.112710+0000","last_active":"2023-11-08T12:27:58.110357+0000","last_peered":"2023-11-08T12:27:58.110357+0000","last_clean":"2023-11-08T12:27:58.110357+0000","last_became_active":"2023-11-08T12:27:54.111530+0000","last_became_peered":"2023-11-08T12:27:54.111530+0000","last_unstale":"2023-11-08T12:27:58.110357+0000","last_undegraded":"2023-11-08T12:27:58.110357+0000","last_fullsized":"2023-11-08T12:27:58.110357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.573865+0000","last_change":"2023-11-08T12:27:58.147598+0000","last_active":"2023-11-08T12:27:58.573865+0000","last_peered":"2023-11-08T12:27:58.573865+0000","last_clean":"2023-11-08T12:27:58.573865+0000","last_became_active":"2023-11-08T12:27:58.142637+0000","last_became_peered":"2023-11-08T12:27:58.142637+0000","last_unstale":"2023-11-08T12:27:58.573865+0000","last_undegraded":"2023-11-08T12:27:58.573865+0000","last_fullsized":"2023-11-08T12:27:58.573865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:15.627959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121493+0000","last_change":"2023-11-08T12:27:53.629943+0000","last_active":"2023-11-08T12:27:58.121493+0000","last_peered":"2023-11-08T12:27:58.121493+0000","last_clean":"2023-11-08T12:27:58.121493+0000","last_became_active":"2023-11-08T12:27:53.629644+0000","last_became_peered":"2023-11-08T12:27:53.629644+0000","last_unstale":"2023-11-08T12:27:58.121493+0000","last_undegraded":"2023-11-08T12:27:58.121493+0000","last_fullsized":"2023-11-08T12:27:58.121493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:52.564924+0000","last_clean_scrub_stamp":"2023-11-08T12:27:52.564924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:17.958287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112153+0000","last_change":"2023-11-08T12:27:54.087612+0000","last_active":"2023-11-08T12:27:58.112153+0000","last_peered":"2023-11-08T12:27:58.112153+0000","last_clean":"2023-11-08T12:27:58.112153+0000","last_became_active":"2023-11-08T12:27:54.087329+0000","last_became_peered":"2023-11-08T12:27:54.087329+0000","last_unstale":"2023-11-08T12:27:58.112153+0000","last_undegraded":"2023-11-08T12:27:58.112153+0000","last_fullsized":"2023-11-08T12:27:58.112153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:44:33.656921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.574522+0000","last_change":"2023-11-08T12:27:58.143756+0000","last_active":"2023-11-08T12:27:58.574522+0000","last_peered":"2023-11-08T12:27:58.574522+0000","last_clean":"2023-11-08T12:27:58.574522+0000","last_became_active":"2023-11-08T12:27:58.142849+0000","last_became_peered":"2023-11-08T12:27:58.142849+0000","last_unstale":"2023-11-08T12:27:58.574522+0000","last_undegraded":"2023-11-08T12:27:58.574522+0000","last_fullsized":"2023-11-08T12:27:58.574522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:57.086323+0000","last_clean_scrub_stamp":"2023-11-08T12:27:57.086323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:13:04.175791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130357+0000","last_change":"2023-11-08T12:27:54.090219+0000","last_active":"2023-11-08T12:27:58.130357+0000","last_peered":"2023-11-08T12:27:58.130357+0000","last_clean":"2023-11-08T12:27:58.130357+0000","last_became_active":"2023-11-08T12:27:54.089953+0000","last_became_peered":"2023-11-08T12:27:54.089953+0000","last_unstale":"2023-11-08T12:27:58.130357+0000","last_undegraded":"2023-11-08T12:27:58.130357+0000","last_fullsized":"2023-11-08T12:27:58.130357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:32:59.015726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110954+0000","last_change":"2023-11-08T12:27:54.089673+0000","last_active":"2023-11-08T12:27:58.110954+0000","last_peered":"2023-11-08T12:27:58.110954+0000","last_clean":"2023-11-08T12:27:58.110954+0000","last_became_active":"2023-11-08T12:27:54.088838+0000","last_became_peered":"2023-11-08T12:27:54.088838+0000","last_unstale":"2023-11-08T12:27:58.110954+0000","last_undegraded":"2023-11-08T12:27:58.110954+0000","last_fullsized":"2023-11-08T12:27:58.110954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127306+0000","last_change":"2023-11-08T12:27:54.101563+0000","last_active":"2023-11-08T12:27:58.127306+0000","last_peered":"2023-11-08T12:27:58.127306+0000","last_clean":"2023-11-08T12:27:58.127306+0000","last_became_active":"2023-11-08T12:27:54.101287+0000","last_became_peered":"2023-11-08T12:27:54.101287+0000","last_unstale":"2023-11-08T12:27:58.127306+0000","last_undegraded":"2023-11-08T12:27:58.127306+0000","last_fullsized":"2023-11-08T12:27:58.127306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112764+0000","last_change":"2023-11-08T12:27:54.112891+0000","last_active":"2023-11-08T12:27:58.112764+0000","last_peered":"2023-11-08T12:27:58.112764+0000","last_clean":"2023-11-08T12:27:58.112764+0000","last_became_active":"2023-11-08T12:27:54.112236+0000","last_became_peered":"2023-11-08T12:27:54.112236+0000","last_unstale":"2023-11-08T12:27:58.112764+0000","last_undegraded":"2023-11-08T12:27:58.112764+0000","last_fullsized":"2023-11-08T12:27:58.112764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127544+0000","last_change":"2023-11-08T12:27:54.112391+0000","last_active":"2023-11-08T12:27:58.127544+0000","last_peered":"2023-11-08T12:27:58.127544+0000","last_clean":"2023-11-08T12:27:58.127544+0000","last_became_active":"2023-11-08T12:27:54.112033+0000","last_became_peered":"2023-11-08T12:27:54.112033+0000","last_unstale":"2023-11-08T12:27:58.127544+0000","last_undegraded":"2023-11-08T12:27:58.127544+0000","last_fullsized":"2023-11-08T12:27:58.127544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:27.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110253+0000","last_change":"2023-11-08T12:27:54.111812+0000","last_active":"2023-11-08T12:27:58.110253+0000","last_peered":"2023-11-08T12:27:58.110253+0000","last_clean":"2023-11-08T12:27:58.110253+0000","last_became_active":"2023-11-08T12:27:54.111143+0000","last_became_peered":"2023-11-08T12:27:54.111143+0000","last_unstale":"2023-11-08T12:27:58.110253+0000","last_undegraded":"2023-11-08T12:27:58.110253+0000","last_fullsized":"2023-11-08T12:27:58.110253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126839+0000","last_change":"2023-11-08T12:27:54.098992+0000","last_active":"2023-11-08T12:27:58.126839+0000","last_peered":"2023-11-08T12:27:58.126839+0000","last_clean":"2023-11-08T12:27:58.126839+0000","last_became_active":"2023-11-08T12:27:54.096650+0000","last_became_peered":"2023-11-08T12:27:54.096650+0000","last_unstale":"2023-11-08T12:27:58.126839+0000","last_undegraded":"2023-11-08T12:27:58.126839+0000","last_fullsized":"2023-11-08T12:27:58.126839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:01:18.972524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126259+0000","last_change":"2023-11-08T12:27:54.102716+0000","last_active":"2023-11-08T12:27:58.126259+0000","last_peered":"2023-11-08T12:27:58.126259+0000","last_clean":"2023-11-08T12:27:58.126259+0000","last_became_active":"2023-11-08T12:27:54.102078+0000","last_became_peered":"2023-11-08T12:27:54.102078+0000","last_unstale":"2023-11-08T12:27:58.126259+0000","last_undegraded":"2023-11-08T12:27:58.126259+0000","last_fullsized":"2023-11-08T12:27:58.126259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.124250+0000","last_change":"2023-11-08T12:27:54.114137+0000","last_active":"2023-11-08T12:27:58.124250+0000","last_peered":"2023-11-08T12:27:58.124250+0000","last_clean":"2023-11-08T12:27:58.124250+0000","last_became_active":"2023-11-08T12:27:54.111468+0000","last_became_peered":"2023-11-08T12:27:54.111468+0000","last_unstale":"2023-11-08T12:27:58.124250+0000","last_undegraded":"2023-11-08T12:27:58.124250+0000","last_fullsized":"2023-11-08T12:27:58.124250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:21:11.497282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110810+0000","last_change":"2023-11-08T12:27:54.111270+0000","last_active":"2023-11-08T12:27:58.110810+0000","last_peered":"2023-11-08T12:27:58.110810+0000","last_clean":"2023-11-08T12:27:58.110810+0000","last_became_active":"2023-11-08T12:27:54.110978+0000","last_became_peered":"2023-11-08T12:27:54.110978+0000","last_unstale":"2023-11-08T12:27:58.110810+0000","last_undegraded":"2023-11-08T12:27:58.110810+0000","last_fullsized":"2023-11-08T12:27:58.110810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:05:37.047197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121952+0000","last_change":"2023-11-08T12:27:54.110870+0000","last_active":"2023-11-08T12:27:58.121952+0000","last_peered":"2023-11-08T12:27:58.121952+0000","last_clean":"2023-11-08T12:27:58.121952+0000","last_became_active":"2023-11-08T12:27:54.110578+0000","last_became_peered":"2023-11-08T12:27:54.110578+0000","last_unstale":"2023-11-08T12:27:58.121952+0000","last_undegraded":"2023-11-08T12:27:58.121952+0000","last_fullsized":"2023-11-08T12:27:58.121952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:04:09.085692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.121410+0000","last_change":"2023-11-08T12:27:54.110928+0000","last_active":"2023-11-08T12:27:58.121410+0000","last_peered":"2023-11-08T12:27:58.121410+0000","last_clean":"2023-11-08T12:27:58.121410+0000","last_became_active":"2023-11-08T12:27:54.110627+0000","last_became_peered":"2023-11-08T12:27:54.110627+0000","last_unstale":"2023-11-08T12:27:58.121410+0000","last_undegraded":"2023-11-08T12:27:58.121410+0000","last_fullsized":"2023-11-08T12:27:58.121410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127487+0000","last_change":"2023-11-08T12:27:54.099305+0000","last_active":"2023-11-08T12:27:58.127487+0000","last_peered":"2023-11-08T12:27:58.127487+0000","last_clean":"2023-11-08T12:27:58.127487+0000","last_became_active":"2023-11-08T12:27:54.096530+0000","last_became_peered":"2023-11-08T12:27:54.096530+0000","last_unstale":"2023-11-08T12:27:58.127487+0000","last_undegraded":"2023-11-08T12:27:58.127487+0000","last_fullsized":"2023-11-08T12:27:58.127487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:03:24.809478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112660+0000","last_change":"2023-11-08T12:27:54.091908+0000","last_active":"2023-11-08T12:27:58.112660+0000","last_peered":"2023-11-08T12:27:58.112660+0000","last_clean":"2023-11-08T12:27:58.112660+0000","last_became_active":"2023-11-08T12:27:54.091565+0000","last_became_peered":"2023-11-08T12:27:54.091565+0000","last_unstale":"2023-11-08T12:27:58.112660+0000","last_undegraded":"2023-11-08T12:27:58.112660+0000","last_fullsized":"2023-11-08T12:27:58.112660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:26:48.409713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127626+0000","last_change":"2023-11-08T12:27:54.102006+0000","last_active":"2023-11-08T12:27:58.127626+0000","last_peered":"2023-11-08T12:27:58.127626+0000","last_clean":"2023-11-08T12:27:58.127626+0000","last_became_active":"2023-11-08T12:27:54.101747+0000","last_became_peered":"2023-11-08T12:27:54.101747+0000","last_unstale":"2023-11-08T12:27:58.127626+0000","last_undegraded":"2023-11-08T12:27:58.127626+0000","last_fullsized":"2023-11-08T12:27:58.127626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130643+0000","last_change":"2023-11-08T12:27:54.107313+0000","last_active":"2023-11-08T12:27:58.130643+0000","last_peered":"2023-11-08T12:27:58.130643+0000","last_clean":"2023-11-08T12:27:58.130643+0000","last_became_active":"2023-11-08T12:27:54.106868+0000","last_became_peered":"2023-11-08T12:27:54.106868+0000","last_unstale":"2023-11-08T12:27:58.130643+0000","last_undegraded":"2023-11-08T12:27:58.130643+0000","last_fullsized":"2023-11-08T12:27:58.130643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126067+0000","last_change":"2023-11-08T12:27:54.104910+0000","last_active":"2023-11-08T12:27:58.126067+0000","last_peered":"2023-11-08T12:27:58.126067+0000","last_clean":"2023-11-08T12:27:58.126067+0000","last_became_active":"2023-11-08T12:27:54.104571+0000","last_became_peered":"2023-11-08T12:27:54.104571+0000","last_unstale":"2023-11-08T12:27:58.126067+0000","last_undegraded":"2023-11-08T12:27:58.126067+0000","last_fullsized":"2023-11-08T12:27:58.126067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127618+0000","last_change":"2023-11-08T12:27:54.117605+0000","last_active":"2023-11-08T12:27:58.127618+0000","last_peered":"2023-11-08T12:27:58.127618+0000","last_clean":"2023-11-08T12:27:58.127618+0000","last_became_active":"2023-11-08T12:27:54.115128+0000","last_became_peered":"2023-11-08T12:27:54.115128+0000","last_unstale":"2023-11-08T12:27:58.127618+0000","last_undegraded":"2023-11-08T12:27:58.127618+0000","last_fullsized":"2023-11-08T12:27:58.127618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109727+0000","last_change":"2023-11-08T12:27:54.078100+0000","last_active":"2023-11-08T12:27:58.109727+0000","last_peered":"2023-11-08T12:27:58.109727+0000","last_clean":"2023-11-08T12:27:58.109727+0000","last_became_active":"2023-11-08T12:27:54.077806+0000","last_became_peered":"2023-11-08T12:27:54.077806+0000","last_unstale":"2023-11-08T12:27:58.109727+0000","last_undegraded":"2023-11-08T12:27:58.109727+0000","last_fullsized":"2023-11-08T12:27:58.109727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:30.390296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.115584+0000","last_change":"2023-11-08T12:27:54.079682+0000","last_active":"2023-11-08T12:27:58.115584+0000","last_peered":"2023-11-08T12:27:58.115584+0000","last_clean":"2023-11-08T12:27:58.115584+0000","last_became_active":"2023-11-08T12:27:54.079412+0000","last_became_peered":"2023-11-08T12:27:54.079412+0000","last_unstale":"2023-11-08T12:27:58.115584+0000","last_undegraded":"2023-11-08T12:27:58.115584+0000","last_fullsized":"2023-11-08T12:27:58.115584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:03:48.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.112090+0000","last_change":"2023-11-08T12:27:54.094245+0000","last_active":"2023-11-08T12:27:58.112090+0000","last_peered":"2023-11-08T12:27:58.112090+0000","last_clean":"2023-11-08T12:27:58.112090+0000","last_became_active":"2023-11-08T12:27:54.093989+0000","last_became_peered":"2023-11-08T12:27:54.093989+0000","last_unstale":"2023-11-08T12:27:58.112090+0000","last_undegraded":"2023-11-08T12:27:58.112090+0000","last_fullsized":"2023-11-08T12:27:58.112090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:45.542969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126703+0000","last_change":"2023-11-08T12:27:54.093474+0000","last_active":"2023-11-08T12:27:58.126703+0000","last_peered":"2023-11-08T12:27:58.126703+0000","last_clean":"2023-11-08T12:27:58.126703+0000","last_became_active":"2023-11-08T12:27:54.093141+0000","last_became_peered":"2023-11-08T12:27:54.093141+0000","last_unstale":"2023-11-08T12:27:58.126703+0000","last_undegraded":"2023-11-08T12:27:58.126703+0000","last_fullsized":"2023-11-08T12:27:58.126703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:21:00.174800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110510+0000","last_change":"2023-11-08T12:27:54.109186+0000","last_active":"2023-11-08T12:27:58.110510+0000","last_peered":"2023-11-08T12:27:58.110510+0000","last_clean":"2023-11-08T12:27:58.110510+0000","last_became_active":"2023-11-08T12:27:54.108861+0000","last_became_peered":"2023-11-08T12:27:54.108861+0000","last_unstale":"2023-11-08T12:27:58.110510+0000","last_undegraded":"2023-11-08T12:27:58.110510+0000","last_fullsized":"2023-11-08T12:27:58.110510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.130596+0000","last_change":"2023-11-08T12:27:54.107459+0000","last_active":"2023-11-08T12:27:58.130596+0000","last_peered":"2023-11-08T12:27:58.130596+0000","last_clean":"2023-11-08T12:27:58.130596+0000","last_became_active":"2023-11-08T12:27:54.107098+0000","last_became_peered":"2023-11-08T12:27:54.107098+0000","last_unstale":"2023-11-08T12:27:58.130596+0000","last_undegraded":"2023-11-08T12:27:58.130596+0000","last_fullsized":"2023-11-08T12:27:58.130596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.109785+0000","last_change":"2023-11-08T12:27:54.094309+0000","last_active":"2023-11-08T12:27:58.109785+0000","last_peered":"2023-11-08T12:27:58.109785+0000","last_clean":"2023-11-08T12:27:58.109785+0000","last_became_active":"2023-11-08T12:27:54.094019+0000","last_became_peered":"2023-11-08T12:27:54.094019+0000","last_unstale":"2023-11-08T12:27:58.109785+0000","last_undegraded":"2023-11-08T12:27:58.109785+0000","last_fullsized":"2023-11-08T12:27:58.109785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:13.100084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127510+0000","last_change":"2023-11-08T12:27:54.115331+0000","last_active":"2023-11-08T12:27:58.127510+0000","last_peered":"2023-11-08T12:27:58.127510+0000","last_clean":"2023-11-08T12:27:58.127510+0000","last_became_active":"2023-11-08T12:27:54.114822+0000","last_became_peered":"2023-11-08T12:27:54.114822+0000","last_unstale":"2023-11-08T12:27:58.127510+0000","last_undegraded":"2023-11-08T12:27:58.127510+0000","last_fullsized":"2023-11-08T12:27:58.127510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:56:02.707667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.127152+0000","last_change":"2023-11-08T12:27:54.110256+0000","last_active":"2023-11-08T12:27:58.127152+0000","last_peered":"2023-11-08T12:27:58.127152+0000","last_clean":"2023-11-08T12:27:58.127152+0000","last_became_active":"2023-11-08T12:27:54.109960+0000","last_became_peered":"2023-11-08T12:27:54.109960+0000","last_unstale":"2023-11-08T12:27:58.127152+0000","last_undegraded":"2023-11-08T12:27:58.127152+0000","last_fullsized":"2023-11-08T12:27:58.127152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:50.933121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.129321+0000","last_change":"2023-11-08T12:27:54.113205+0000","last_active":"2023-11-08T12:27:58.129321+0000","last_peered":"2023-11-08T12:27:58.129321+0000","last_clean":"2023-11-08T12:27:58.129321+0000","last_became_active":"2023-11-08T12:27:54.100836+0000","last_became_peered":"2023-11-08T12:27:54.100836+0000","last_unstale":"2023-11-08T12:27:58.129321+0000","last_undegraded":"2023-11-08T12:27:58.129321+0000","last_fullsized":"2023-11-08T12:27:58.129321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:07:01.482884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.134239+0000","last_change":"2023-11-08T12:27:54.113012+0000","last_active":"2023-11-08T12:27:58.134239+0000","last_peered":"2023-11-08T12:27:58.134239+0000","last_clean":"2023-11-08T12:27:58.134239+0000","last_became_active":"2023-11-08T12:27:54.112671+0000","last_became_peered":"2023-11-08T12:27:54.112671+0000","last_unstale":"2023-11-08T12:27:58.134239+0000","last_undegraded":"2023-11-08T12:27:58.134239+0000","last_fullsized":"2023-11-08T12:27:58.134239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:48:36.178901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.126621+0000","last_change":"2023-11-08T12:27:54.106855+0000","last_active":"2023-11-08T12:27:58.126621+0000","last_peered":"2023-11-08T12:27:58.126621+0000","last_clean":"2023-11-08T12:27:58.126621+0000","last_became_active":"2023-11-08T12:27:54.106572+0000","last_became_peered":"2023-11-08T12:27:54.106572+0000","last_unstale":"2023-11-08T12:27:58.126621+0000","last_undegraded":"2023-11-08T12:27:58.126621+0000","last_fullsized":"2023-11-08T12:27:58.126621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:32:20.409594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110499+0000","last_change":"2023-11-08T12:27:54.088006+0000","last_active":"2023-11-08T12:27:58.110499+0000","last_peered":"2023-11-08T12:27:58.110499+0000","last_clean":"2023-11-08T12:27:58.110499+0000","last_became_active":"2023-11-08T12:27:54.087733+0000","last_became_peered":"2023-11-08T12:27:54.087733+0000","last_unstale":"2023-11-08T12:27:58.110499+0000","last_undegraded":"2023-11-08T12:27:58.110499+0000","last_fullsized":"2023-11-08T12:27:58.110499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:37:42.319339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-08T12:27:58.110178+0000","last_change":"2023-11-08T12:27:54.088141+0000","last_active":"2023-11-08T12:27:58.110178+0000","last_peered":"2023-11-08T12:27:58.110178+0000","last_clean":"2023-11-08T12:27:58.110178+0000","last_became_active":"2023-11-08T12:27:54.087785+0000","last_became_peered":"2023-11-08T12:27:54.087785+0000","last_unstale":"2023-11-08T12:27:58.110178+0000","last_undegraded":"2023-11-08T12:27:58.110178+0000","last_fullsized":"2023-11-08T12:27:58.110178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:53.579161+0000","last_clean_scrub_stamp":"2023-11-08T12:27:53.579161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:16:17.839606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4527,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476748,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476748,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9296,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362544,"statfs":{"total":96636764160,"available":96627245056,"internally_reserved":0,"allocated":925696,"data_stored":719012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8184,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363656,"statfs":{"total":96636764160,"available":96628383744,"internally_reserved":0,"allocated":311296,"data_stored":125319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]}]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8112,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363728,"statfs":{"total":96636764160,"available":96628457472,"internally_reserved":0,"allocated":303104,"data_stored":124683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:28:26.576 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-08T12:28:26.576 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-08T12:28:26.577 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-08T12:28:26.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-08T12:28:26.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.777+0000 7f2c7c2bc700 1 Processor -- start 2023-11-08T12:28:26.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.777+0000 7f2c7c2bc700 1 -- start start 2023-11-08T12:28:26.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.777+0000 7f2c7c2bc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c740cbff0 0x7f2c7406c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.777+0000 7f2c7c2bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2c740714d0 0x7f2c7406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.777+0000 7f2c7c2bc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7415dd30 con 0x7f2c7415a310 2023-11-08T12:28:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.777+0000 7f2c7c2bc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7415eb90 con 0x7f2c740cbff0 2023-11-08T12:28:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.777+0000 7f2c7c2bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c740b12b0 con 0x7f2c740714d0 2023-11-08T12:28:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c740cbff0 0x7f2c7406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c740cbff0 0x7f2c7406c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56654/0 (socket says 172.21.15.112:56654) 2023-11-08T12:28:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7a058700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2c7415a310 0x7f2c740cb8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34278/0 (socket says 172.21.15.112:34278) 2023-11-08T12:28:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 -- 172.21.15.112:0/3691561918 learned_addr learned my addr 172.21.15.112:0/3691561918 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7a859700 1 --2- 172.21.15.112:0/3691561918 >> v2:172.21.15.133:3300/0 conn(0x7f2c740714d0 0x7f2c7406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 -- 172.21.15.112:0/3691561918 >> v2:172.21.15.133:3300/0 conn(0x7f2c740714d0 msgr2=0x7f2c7406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 --2- 172.21.15.112:0/3691561918 >> v2:172.21.15.133:3300/0 conn(0x7f2c740714d0 0x7f2c7406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 -- 172.21.15.112:0/3691561918 >> v1:172.21.15.112:6789/0 conn(0x7f2c7415a310 legacy=0x7f2c740cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 -- 172.21.15.112:0/3691561918 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7415df80 con 0x7f2c740cbff0 2023-11-08T12:28:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79056700 1 -- 172.21.15.112:0/3691561918 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609354365 0 0) 0x7f2c7415dd30 con 0x7f2c7415a310 2023-11-08T12:28:26.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79857700 1 --2- 172.21.15.112:0/3691561918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740cbff0 0x7f2c7406c250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2c7406b6b0 tx=0x7f2c64009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10eb782ee2911d98 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:26.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79056700 1 -- 172.21.15.112:0/3691561918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64011830 con 0x7f2c740cbff0 2023-11-08T12:28:26.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79056700 1 -- 172.21.15.112:0/3691561918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c64011990 con 0x7f2c740cbff0 2023-11-08T12:28:26.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c79056700 1 -- 172.21.15.112:0/3691561918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64011d20 con 0x7f2c740cbff0 2023-11-08T12:28:26.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/3691561918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740cbff0 msgr2=0x7f2c7406c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/3691561918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740cbff0 0x7f2c7406c250 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2c7406b6b0 tx=0x7f2c64009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/3691561918 shutdown_connections 2023-11-08T12:28:26.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/3691561918 >> v2:172.21.15.133:3300/0 conn(0x7f2c740714d0 0x7f2c7406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/3691561918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740cbff0 0x7f2c7406c250 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/3691561918 >> 172.21.15.112:0/3691561918 conn(0x7f2c740cf380 msgr2=0x7f2c740cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:26.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/3691561918 shutdown_connections 2023-11-08T12:28:26.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.781+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/3691561918 wait complete. 2023-11-08T12:28:26.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.785+0000 7f2c7c2bc700 1 Processor -- start 2023-11-08T12:28:26.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.785+0000 7f2c7c2bc700 1 -- start start 2023-11-08T12:28:26.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740714d0 0x7f2c7415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c740cbff0 0x7f2c7414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c7415a310 0x7f2c7414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7414ea50 con 0x7f2c740714d0 2023-11-08T12:28:26.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7415bae0 con 0x7f2c7415a310 2023-11-08T12:28:26.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7414d470 con 0x7f2c740cbff0 2023-11-08T12:28:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740714d0 0x7f2c7415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740714d0 0x7f2c7415cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56658/0 (socket says 172.21.15.112:56658) 2023-11-08T12:28:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 -- 172.21.15.112:0/4122466158 learned_addr learned my addr 172.21.15.112:0/4122466158 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c79857700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c740cbff0 0x7f2c7414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a859700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c7415a310 0x7f2c7414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 -- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c740cbff0 msgr2=0x7f2c7414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c740cbff0 0x7f2c7414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 -- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c7415a310 msgr2=0x7f2c7414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:26.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c7415a310 0x7f2c7414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:26.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 -- 172.21.15.112:0/4122466158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009570 con 0x7f2c740714d0 2023-11-08T12:28:26.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7a058700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740714d0 0x7f2c7415cf60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000c580 tx=0x7f2c7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:26.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c6affd700 1 -- 172.21.15.112:0/4122466158 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70004ca0 con 0x7f2c740714d0 2023-11-08T12:28:26.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c6affd700 1 -- 172.21.15.112:0/4122466158 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c70004e20 con 0x7f2c740714d0 2023-11-08T12:28:26.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7415e540 con 0x7f2c740714d0 2023-11-08T12:28:26.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c6affd700 1 -- 172.21.15.112:0/4122466158 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70007310 con 0x7f2c740714d0 2023-11-08T12:28:26.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7415e260 con 0x7f2c740714d0 2023-11-08T12:28:26.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.789+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7415e820 con 0x7f2c740714d0 2023-11-08T12:28:26.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.793+0000 7f2c6affd700 1 -- 172.21.15.112:0/4122466158 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2c7001a020 con 0x7f2c740714d0 2023-11-08T12:28:26.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.793+0000 7f2c6affd700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c58064ee0 0x7f2c58067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:26.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.793+0000 7f2c6affd700 1 -- 172.21.15.112:0/4122466158 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2c70081ef0 con 0x7f2c740714d0 2023-11-08T12:28:26.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.793+0000 7f2c79857700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c58064ee0 0x7f2c58067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:26.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.797+0000 7f2c79857700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c58064ee0 0x7f2c58067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c740cc3e0 tx=0x7f2c64008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:26.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:26.801+0000 7f2c6affd700 1 -- 172.21.15.112:0/4122466158 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2c7004fcb0 con 0x7f2c740714d0 2023-11-08T12:28:27.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.001+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2c740726c0 con 0x7f2c740714d0 2023-11-08T12:28:27.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.001+0000 7f2c6affd700 1 -- 172.21.15.112:0/4122466158 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2c700532d0 con 0x7f2c740714d0 2023-11-08T12:28:27.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:27.005 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-08T12:28:27.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c58064ee0 msgr2=0x7f2c58067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c58064ee0 0x7f2c58067390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c740cc3e0 tx=0x7f2c64008030 comp rx=0 tx=0).stop 2023-11-08T12:28:27.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740714d0 msgr2=0x7f2c7415cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740714d0 0x7f2c7415cf60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000c580 tx=0x7f2c7000c940 comp rx=0 tx=0).stop 2023-11-08T12:28:27.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 shutdown_connections 2023-11-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c58064ee0 0x7f2c58067390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c7415a310 0x7f2c7414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c740cbff0 0x7f2c7414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 --2- 172.21.15.112:0/4122466158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c740714d0 0x7f2c7415cf60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.005+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 >> 172.21.15.112:0/4122466158 conn(0x7f2c740cf380 msgr2=0x7f2c740cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.009+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 shutdown_connections 2023-11-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.009+0000 7f2c7c2bc700 1 -- 172.21.15.112:0/4122466158 wait complete. 2023-11-08T12:28:27.031 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-08T12:28:27.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:27.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36af3e700 1 Processor -- start 2023-11-08T12:28:27.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36af3e700 1 -- start start 2023-11-08T12:28:27.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36af3e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc364071aa0 0x7fc36406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36af3e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc364069e00 0x7fc36406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36af3e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36406c600 con 0x7fc36415c640 2023-11-08T12:28:27.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36af3e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36406cef0 con 0x7fc364069e00 2023-11-08T12:28:27.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36af3e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3640d38f0 con 0x7fc364071aa0 2023-11-08T12:28:27.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc369f3c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc36415c640 0x7fc3640d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34294/0 (socket says 172.21.15.112:34294) 2023-11-08T12:28:27.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc369f3c700 1 -- 172.21.15.112:0/2950714811 learned_addr learned my addr 172.21.15.112:0/2950714811 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:27.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36a73d700 1 --2- 172.21.15.112:0/2950714811 >> v2:172.21.15.112:3300/0 conn(0x7fc364069e00 0x7fc36406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.205+0000 7fc36973b700 1 --2- 172.21.15.112:0/2950714811 >> v2:172.21.15.133:3300/0 conn(0x7fc364071aa0 0x7fc36406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc368f3a700 1 -- 172.21.15.112:0/2950714811 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202579910 0 0) 0x7fc36406c600 con 0x7fc36415c640 2023-11-08T12:28:27.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc368f3a700 1 -- 172.21.15.112:0/2950714811 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3500035d0 con 0x7fc36415c640 2023-11-08T12:28:27.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36a73d700 1 -- 172.21.15.112:0/2950714811 >> v2:172.21.15.133:3300/0 conn(0x7fc364071aa0 msgr2=0x7fc36406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:27.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36a73d700 1 --2- 172.21.15.112:0/2950714811 >> v2:172.21.15.133:3300/0 conn(0x7fc364071aa0 0x7fc36406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36a73d700 1 -- 172.21.15.112:0/2950714811 >> v1:172.21.15.112:6789/0 conn(0x7fc36415c640 legacy=0x7fc3640d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36a73d700 1 -- 172.21.15.112:0/2950714811 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640722f0 con 0x7fc364069e00 2023-11-08T12:28:27.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36973b700 1 --2- 172.21.15.112:0/2950714811 >> v2:172.21.15.133:3300/0 conn(0x7fc364071aa0 0x7fc36406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:27.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36a73d700 1 --2- 172.21.15.112:0/2950714811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364069e00 0x7fc36406a280 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc364070e70 tx=0x7fc35c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7326c1861e3d4118 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc368f3a700 1 -- 172.21.15.112:0/2950714811 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c011830 con 0x7fc364069e00 2023-11-08T12:28:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc368f3a700 1 -- 172.21.15.112:0/2950714811 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c011990 con 0x7fc364069e00 2023-11-08T12:28:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc368f3a700 1 -- 172.21.15.112:0/2950714811 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c011d00 con 0x7fc364069e00 2023-11-08T12:28:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 -- 172.21.15.112:0/2950714811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364069e00 msgr2=0x7fc36406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 --2- 172.21.15.112:0/2950714811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364069e00 0x7fc36406a280 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc364070e70 tx=0x7fc35c009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:27.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 -- 172.21.15.112:0/2950714811 shutdown_connections 2023-11-08T12:28:27.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 --2- 172.21.15.112:0/2950714811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364069e00 0x7fc36406a280 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 --2- 172.21.15.112:0/2950714811 >> v2:172.21.15.133:3300/0 conn(0x7fc364071aa0 0x7fc36406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 -- 172.21.15.112:0/2950714811 >> 172.21.15.112:0/2950714811 conn(0x7fc3640b6520 msgr2=0x7fc364071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:27.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 -- 172.21.15.112:0/2950714811 shutdown_connections 2023-11-08T12:28:27.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.209+0000 7fc36af3e700 1 -- 172.21.15.112:0/2950714811 wait complete. 2023-11-08T12:28:27.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 Processor -- start 2023-11-08T12:28:27.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 -- start start 2023-11-08T12:28:27.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc364069e00 0x7fc36409bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364071aa0 0x7fc3640ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36415c640 0x7fc3640c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c7c80 con 0x7fc364071aa0 2023-11-08T12:28:27.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c8ae0 con 0x7fc36415c640 2023-11-08T12:28:27.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36af3e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640c7ed0 con 0x7fc364069e00 2023-11-08T12:28:27.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364071aa0 0x7fc3640ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364071aa0 0x7fc3640ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56670/0 (socket says 172.21.15.112:56670) 2023-11-08T12:28:27.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 -- 172.21.15.112:0/4112986003 learned_addr learned my addr 172.21.15.112:0/4112986003 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:27.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc369f3c700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc364069e00 0x7fc36409bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36a73d700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36415c640 0x7fc3640c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 -- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc364069e00 msgr2=0x7fc36409bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc364069e00 0x7fc36409bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 -- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36415c640 msgr2=0x7fc3640c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36415c640 0x7fc3640c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 -- 172.21.15.112:0/4112986003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0094b0 con 0x7fc364071aa0 2023-11-08T12:28:27.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36a73d700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36415c640 0x7fc3640c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:27.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.213+0000 7fc36973b700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364071aa0 0x7fc3640ccde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc35400e840 tx=0x7fc35400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:27.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.217+0000 7fc35a7fc700 1 -- 172.21.15.112:0/4112986003 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354004230 con 0x7fc364071aa0 2023-11-08T12:28:27.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.217+0000 7fc35a7fc700 1 -- 172.21.15.112:0/4112986003 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354004390 con 0x7fc364071aa0 2023-11-08T12:28:27.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.217+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364072010 con 0x7fc364071aa0 2023-11-08T12:28:27.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.217+0000 7fc35a7fc700 1 -- 172.21.15.112:0/4112986003 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540036c0 con 0x7fc364071aa0 2023-11-08T12:28:27.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.217+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36415ca10 con 0x7fc364071aa0 2023-11-08T12:28:27.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.217+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36406c830 con 0x7fc364071aa0 2023-11-08T12:28:27.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.217+0000 7fc35a7fc700 1 -- 172.21.15.112:0/4112986003 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc354022070 con 0x7fc364071aa0 2023-11-08T12:28:27.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.221+0000 7fc35a7fc700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc348064ee0 0x7fc348067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.221+0000 7fc35a7fc700 1 -- 172.21.15.112:0/4112986003 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc354081d30 con 0x7fc364071aa0 2023-11-08T12:28:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.221+0000 7fc369f3c700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc348064ee0 0x7fc348067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.221+0000 7fc369f3c700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc348064ee0 0x7fc348067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc360005cb0 tx=0x7fc360009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:27.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.225+0000 7fc35a7fc700 1 -- 172.21.15.112:0/4112986003 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc35404fa10 con 0x7fc364071aa0 2023-11-08T12:28:27.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.393+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc364072c10 con 0x7fc364071aa0 2023-11-08T12:28:27.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.397+0000 7fc35a7fc700 1 -- 172.21.15.112:0/4112986003 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19700 (secure 0 0 0) 0x7fc354053030 con 0x7fc364071aa0 2023-11-08T12:28:27.399 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:27.400 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:27:58.562832+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.397+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc348064ee0 msgr2=0x7fc348067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.397+0000 7fc36af3e700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc348064ee0 0x7fc348067390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc360005cb0 tx=0x7fc360009040 comp rx=0 tx=0).stop 2023-11-08T12:28:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.397+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364071aa0 msgr2=0x7fc3640ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.397+0000 7fc36af3e700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364071aa0 0x7fc3640ccde0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc35400e840 tx=0x7fc35400ec00 comp rx=0 tx=0).stop 2023-11-08T12:28:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 shutdown_connections 2023-11-08T12:28:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc348064ee0 0x7fc348067390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc36415c640 0x7fc3640c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc364071aa0 0x7fc3640ccde0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 --2- 172.21.15.112:0/4112986003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc364069e00 0x7fc36409bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 >> 172.21.15.112:0/4112986003 conn(0x7fc3640b6520 msgr2=0x7fc3640b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 shutdown_connections 2023-11-08T12:28:27.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.401+0000 7fc36af3e700 1 -- 172.21.15.112:0/4112986003 wait complete. 2023-11-08T12:28:27.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:27.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:27.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.597+0000 7febef597700 1 Processor -- start 2023-11-08T12:28:27.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.597+0000 7febef597700 1 -- start start 2023-11-08T12:28:27.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febef597700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febe80c8c90 0x7febe815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febef597700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe8070600 con 0x7febe8159f10 2023-11-08T12:28:27.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febef597700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe80c9090 con 0x7febe8070a90 2023-11-08T12:28:27.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febef597700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80afcc0 con 0x7febe80c8c90 2023-11-08T12:28:27.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febee595700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7febe8159f10 0x7febe815a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34298/0 (socket says 172.21.15.112:34298) 2023-11-08T12:28:27.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febee595700 1 -- 172.21.15.112:0/4156562568 learned_addr learned my addr 172.21.15.112:0/4156562568 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:27.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febeed96700 1 --2- 172.21.15.112:0/4156562568 >> v2:172.21.15.112:3300/0 conn(0x7febe80c8c90 0x7febe815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febed593700 1 -- 172.21.15.112:0/4156562568 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108150212 0 0) 0x7febe80c9090 con 0x7febe8070a90 2023-11-08T12:28:27.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febed593700 1 -- 172.21.15.112:0/4156562568 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd40035d0 con 0x7febe8070a90 2023-11-08T12:28:27.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febed593700 1 -- 172.21.15.112:0/4156562568 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765682288 0 0) 0x7febe8070600 con 0x7febe8159f10 2023-11-08T12:28:27.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febeed96700 1 -- 172.21.15.112:0/4156562568 >> v1:172.21.15.133:6789/0 conn(0x7febe8070a90 legacy=0x7febe806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febeed96700 1 -- 172.21.15.112:0/4156562568 >> v1:172.21.15.112:6789/0 conn(0x7febe8159f10 legacy=0x7febe815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febeed96700 1 -- 172.21.15.112:0/4156562568 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe806ffb0 con 0x7febe80c8c90 2023-11-08T12:28:27.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febeed96700 1 --2- 172.21.15.112:0/4156562568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe80c8c90 0x7febe815a9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7febe0009d90 tx=0x7febe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196621c41acdac02 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:27.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febed593700 1 -- 172.21.15.112:0/4156562568 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000e070 con 0x7febe80c8c90 2023-11-08T12:28:27.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febed593700 1 -- 172.21.15.112:0/4156562568 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000bb20 con 0x7febe80c8c90 2023-11-08T12:28:27.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.601+0000 7febed593700 1 -- 172.21.15.112:0/4156562568 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000bed0 con 0x7febe80c8c90 2023-11-08T12:28:27.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.605+0000 7febef597700 1 -- 172.21.15.112:0/4156562568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe80c8c90 msgr2=0x7febe815a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.605+0000 7febef597700 1 --2- 172.21.15.112:0/4156562568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe80c8c90 0x7febe815a9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7febe0009d90 tx=0x7febe000b330 comp rx=0 tx=0).stop 2023-11-08T12:28:27.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.605+0000 7febef597700 1 -- 172.21.15.112:0/4156562568 shutdown_connections 2023-11-08T12:28:27.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.605+0000 7febef597700 1 --2- 172.21.15.112:0/4156562568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe80c8c90 0x7febe815a9f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.605+0000 7febef597700 1 -- 172.21.15.112:0/4156562568 >> 172.21.15.112:0/4156562568 conn(0x7febe80cf280 msgr2=0x7febe80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:27.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.605+0000 7febef597700 1 -- 172.21.15.112:0/4156562568 shutdown_connections 2023-11-08T12:28:27.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.605+0000 7febef597700 1 -- 172.21.15.112:0/4156562568 wait complete. 2023-11-08T12:28:27.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 Processor -- start 2023-11-08T12:28:27.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 -- start start 2023-11-08T12:28:27.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febe8070a90 0x7febe81f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80c8c90 0x7febe80c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe8159f10 0x7febe80b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe81f14c0 con 0x7febe8159f10 2023-11-08T12:28:27.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80c5fa0 con 0x7febe80c8c90 2023-11-08T12:28:27.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febef597700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe80c6280 con 0x7febe8070a90 2023-11-08T12:28:27.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febeed96700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe8159f10 0x7febe80b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febeed96700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe8159f10 0x7febe80b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56684/0 (socket says 172.21.15.112:56684) 2023-11-08T12:28:27.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febeed96700 1 -- 172.21.15.112:0/752029116 learned_addr learned my addr 172.21.15.112:0/752029116 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:27.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febedd94700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80c8c90 0x7febe80c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.609+0000 7febee595700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febe8070a90 0x7febe81f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febeed96700 1 -- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febe8070a90 msgr2=0x7febe81f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febeed96700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febe8070a90 0x7febe81f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febeed96700 1 -- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80c8c90 msgr2=0x7febe80c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febeed96700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80c8c90 0x7febe80c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febeed96700 1 -- 172.21.15.112:0/752029116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0009a70 con 0x7febe8159f10 2023-11-08T12:28:27.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febeed96700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe8159f10 0x7febe80b0130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7febe0014040 tx=0x7febe0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:27.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febdeffd700 1 -- 172.21.15.112:0/752029116 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe001b810 con 0x7febe8159f10 2023-11-08T12:28:27.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febdeffd700 1 -- 172.21.15.112:0/752029116 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0020070 con 0x7febe8159f10 2023-11-08T12:28:27.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febef597700 1 -- 172.21.15.112:0/752029116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80affa0 con 0x7febe8159f10 2023-11-08T12:28:27.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febdeffd700 1 -- 172.21.15.112:0/752029116 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe001bbb0 con 0x7febe8159f10 2023-11-08T12:28:27.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febef597700 1 -- 172.21.15.112:0/752029116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe8070290 con 0x7febe8159f10 2023-11-08T12:28:27.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.613+0000 7febef597700 1 -- 172.21.15.112:0/752029116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe806b300 con 0x7febe8159f10 2023-11-08T12:28:27.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.617+0000 7febdeffd700 1 -- 172.21.15.112:0/752029116 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7febe001bd10 con 0x7febe8159f10 2023-11-08T12:28:27.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.617+0000 7febdeffd700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7febcc064ee0 0x7febcc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:27.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.617+0000 7febdeffd700 1 -- 172.21.15.112:0/752029116 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febe0022070 con 0x7febe8159f10 2023-11-08T12:28:27.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.617+0000 7febee595700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7febcc064ee0 0x7febcc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:27.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.621+0000 7febee595700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7febcc064ee0 0x7febcc067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febe4000f60 tx=0x7febe4007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:27.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.625+0000 7febdeffd700 1 -- 172.21.15.112:0/752029116 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7febe0052780 con 0x7febe8159f10 2023-11-08T12:28:27.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 -- 172.21.15.112:0/752029116 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febe806cf30 con 0x7febe8159f10 2023-11-08T12:28:27.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febdeffd700 1 -- 172.21.15.112:0/752029116 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7febe0055da0 con 0x7febe8159f10 2023-11-08T12:28:27.807 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:27.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 -- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7febcc064ee0 msgr2=0x7febcc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7febcc064ee0 0x7febcc067390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febe4000f60 tx=0x7febe4007cb0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 -- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe8159f10 msgr2=0x7febe80b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:27.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe8159f10 0x7febe80b0130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7febe0014040 tx=0x7febe0004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 -- 172.21.15.112:0/752029116 shutdown_connections 2023-11-08T12:28:27.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7febcc064ee0 0x7febcc067390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febe8159f10 0x7febe80b0130 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80c8c90 0x7febe80c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 --2- 172.21.15.112:0/752029116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febe8070a90 0x7febe81f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:27.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 -- 172.21.15.112:0/752029116 >> 172.21.15.112:0/752029116 conn(0x7febe80cf280 msgr2=0x7febe80c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:27.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 -- 172.21.15.112:0/752029116 shutdown_connections 2023-11-08T12:28:27.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:27.805+0000 7febef597700 1 -- 172.21.15.112:0/752029116 wait complete. 2023-11-08T12:28:27.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:28.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.009+0000 7f9d523bc700 1 Processor -- start 2023-11-08T12:28:28.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.009+0000 7f9d523bc700 1 -- start start 2023-11-08T12:28:28.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d523bc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d4c0cc1a0 0x7f9d4c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d523bc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c15d650 con 0x7f9d4c06ff10 2023-11-08T12:28:28.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d523bc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c15a0a0 con 0x7f9d4c159cd0 2023-11-08T12:28:28.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d523bc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c06be80 con 0x7f9d4c0cc1a0 2023-11-08T12:28:28.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d51bbb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9d4c06ff10 0x7f9d4c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34304/0 (socket says 172.21.15.112:34304) 2023-11-08T12:28:28.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d50bb9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d4c0cc1a0 0x7f9d4c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d51bbb700 1 -- 172.21.15.112:0/3133052961 learned_addr learned my addr 172.21.15.112:0/3133052961 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:28.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d50bb9700 1 -- 172.21.15.112:0/3133052961 >> v1:172.21.15.133:6789/0 conn(0x7f9d4c159cd0 legacy=0x7f9d4c06c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d50bb9700 1 -- 172.21.15.112:0/3133052961 >> v1:172.21.15.112:6789/0 conn(0x7f9d4c06ff10 legacy=0x7f9d4c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d50bb9700 1 -- 172.21.15.112:0/3133052961 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0cdf80 con 0x7f9d4c0cc1a0 2023-11-08T12:28:28.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.013+0000 7f9d43fff700 1 -- 172.21.15.112:0/3133052961 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046472063 0 0) 0x7f9d4c15d650 con 0x7f9d4c06ff10 2023-11-08T12:28:28.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d50bb9700 1 --2- 172.21.15.112:0/3133052961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c0cc1a0 0x7f9d4c15d110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009850 tx=0x7f9d3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3af2830926943b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d43fff700 1 -- 172.21.15.112:0/3133052961 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c011830 con 0x7f9d4c0cc1a0 2023-11-08T12:28:28.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d43fff700 1 -- 172.21.15.112:0/3133052961 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c011990 con 0x7f9d4c0cc1a0 2023-11-08T12:28:28.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d43fff700 1 -- 172.21.15.112:0/3133052961 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c011d20 con 0x7f9d4c0cc1a0 2023-11-08T12:28:28.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d523bc700 1 -- 172.21.15.112:0/3133052961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c0cc1a0 msgr2=0x7f9d4c15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d523bc700 1 --2- 172.21.15.112:0/3133052961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c0cc1a0 0x7f9d4c15d110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009850 tx=0x7f9d3c009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:28.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d523bc700 1 -- 172.21.15.112:0/3133052961 shutdown_connections 2023-11-08T12:28:28.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d523bc700 1 --2- 172.21.15.112:0/3133052961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c0cc1a0 0x7f9d4c15d110 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d523bc700 1 -- 172.21.15.112:0/3133052961 >> 172.21.15.112:0/3133052961 conn(0x7f9d4c0cf280 msgr2=0x7f9d4c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:28.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d523bc700 1 -- 172.21.15.112:0/3133052961 shutdown_connections 2023-11-08T12:28:28.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.017+0000 7f9d523bc700 1 -- 172.21.15.112:0/3133052961 wait complete. 2023-11-08T12:28:28.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 Processor -- start 2023-11-08T12:28:28.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 -- start start 2023-11-08T12:28:28.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c06ff10 0x7f9d4c0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4c0cc1a0 0x7f9d4c146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d4c159cd0 0x7f9d4c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c156960 con 0x7f9d4c06ff10 2023-11-08T12:28:28.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0c57d0 con 0x7f9d4c159cd0 2023-11-08T12:28:28.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0c5ab0 con 0x7f9d4c0cc1a0 2023-11-08T12:28:28.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c06ff10 0x7f9d4c0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c06ff10 0x7f9d4c0c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56710/0 (socket says 172.21.15.112:56710) 2023-11-08T12:28:28.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 -- 172.21.15.112:0/1586666863 learned_addr learned my addr 172.21.15.112:0/1586666863 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d50bb9700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4c0cc1a0 0x7f9d4c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d51bbb700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d4c159cd0 0x7f9d4c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 -- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4c0cc1a0 msgr2=0x7f9d4c146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4c0cc1a0 0x7f9d4c146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 -- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d4c159cd0 msgr2=0x7f9d4c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d4c159cd0 0x7f9d4c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 -- 172.21.15.112:0/1586666863 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0094b0 con 0x7f9d4c06ff10 2023-11-08T12:28:28.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d513ba700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c06ff10 0x7f9d4c0c62b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c500 tx=0x7f9d4800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d41ffb700 1 -- 172.21.15.112:0/1586666863 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480052d0 con 0x7f9d4c06ff10 2023-11-08T12:28:28.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d41ffb700 1 -- 172.21.15.112:0/1586666863 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48005430 con 0x7f9d4c06ff10 2023-11-08T12:28:28.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d41ffb700 1 -- 172.21.15.112:0/1586666863 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480055a0 con 0x7f9d4c06ff10 2023-11-08T12:28:28.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.021+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c06c090 con 0x7f9d4c06ff10 2023-11-08T12:28:28.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.025+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c0ce260 con 0x7f9d4c06ff10 2023-11-08T12:28:28.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.025+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c06c370 con 0x7f9d4c06ff10 2023-11-08T12:28:28.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.025+0000 7f9d41ffb700 1 -- 172.21.15.112:0/1586666863 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d48019030 con 0x7f9d4c06ff10 2023-11-08T12:28:28.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.029+0000 7f9d41ffb700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d30064ee0 0x7f9d30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.029+0000 7f9d41ffb700 1 -- 172.21.15.112:0/1586666863 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9d480814e0 con 0x7f9d4c06ff10 2023-11-08T12:28:28.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.029+0000 7f9d50bb9700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d30064ee0 0x7f9d30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.029+0000 7f9d50bb9700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d30064ee0 0x7f9d30067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0090b0 tx=0x7f9d3c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.033+0000 7f9d41ffb700 1 -- 172.21.15.112:0/1586666863 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9d4804f2a0 con 0x7f9d4c06ff10 2023-11-08T12:28:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.213+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9d4c0cca80 con 0x7f9d4c06ff10 2023-11-08T12:28:28.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.213+0000 7f9d41ffb700 1 -- 172.21.15.112:0/1586666863 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9d480528c0 con 0x7f9d4c06ff10 2023-11-08T12:28:28.216 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:28.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d30064ee0 msgr2=0x7f9d30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d30064ee0 0x7f9d30067390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0090b0 tx=0x7f9d3c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:28.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c06ff10 msgr2=0x7f9d4c0c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c06ff10 0x7f9d4c0c62b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c500 tx=0x7f9d4800c810 comp rx=0 tx=0).stop 2023-11-08T12:28:28.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 shutdown_connections 2023-11-08T12:28:28.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d30064ee0 0x7f9d30067390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d4c159cd0 0x7f9d4c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4c0cc1a0 0x7f9d4c146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 --2- 172.21.15.112:0/1586666863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d4c06ff10 0x7f9d4c0c62b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 >> 172.21.15.112:0/1586666863 conn(0x7f9d4c0cf280 msgr2=0x7f9d4c069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:28.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 shutdown_connections 2023-11-08T12:28:28.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.217+0000 7f9d523bc700 1 -- 172.21.15.112:0/1586666863 wait complete. 2023-11-08T12:28:28.241 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:28.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.425+0000 7efebaa98700 1 Processor -- start 2023-11-08T12:28:28.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.425+0000 7efebaa98700 1 -- start start 2023-11-08T12:28:28.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.425+0000 7efebaa98700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efeb40cdc50 0x7efeb4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.425+0000 7efebaa98700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb415e560 con 0x7efeb415e190 2023-11-08T12:28:28.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efebaa98700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb406be80 con 0x7efeb406ff10 2023-11-08T12:28:28.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efebaa98700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb40ce0a0 con 0x7efeb40cdc50 2023-11-08T12:28:28.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb9a96700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efeb415e190 0x7efeb4161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34318/0 (socket says 172.21.15.112:34318) 2023-11-08T12:28:28.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb9a96700 1 -- 172.21.15.112:0/2782583893 learned_addr learned my addr 172.21.15.112:0/2782583893 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:28.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb9295700 1 --2- 172.21.15.112:0/2782583893 >> v2:172.21.15.133:3300/0 conn(0x7efeb40cdc50 0x7efeb4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb8a94700 1 -- 172.21.15.112:0/2782583893 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358582306 0 0) 0x7efeb0001110 con 0x7efeb415e190 2023-11-08T12:28:28.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb8a94700 1 -- 172.21.15.112:0/2782583893 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea00035d0 con 0x7efeb415e190 2023-11-08T12:28:28.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb9295700 1 -- 172.21.15.112:0/2782583893 >> v1:172.21.15.133:6789/0 conn(0x7efeb406ff10 legacy=0x7efeb406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb9295700 1 -- 172.21.15.112:0/2782583893 >> v1:172.21.15.112:6789/0 conn(0x7efeb415e190 legacy=0x7efeb4161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb9295700 1 -- 172.21.15.112:0/2782583893 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40ce330 con 0x7efeb40cdc50 2023-11-08T12:28:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb9295700 1 --2- 172.21.15.112:0/2782583893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb40cdc50 0x7efeb4069bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efea4009850 tx=0x7efea4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d6a3d8e3e6c63a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb8a94700 1 -- 172.21.15.112:0/2782583893 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4011830 con 0x7efeb40cdc50 2023-11-08T12:28:28.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb8a94700 1 -- 172.21.15.112:0/2782583893 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4011990 con 0x7efeb40cdc50 2023-11-08T12:28:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efeb8a94700 1 -- 172.21.15.112:0/2782583893 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4011d40 con 0x7efeb40cdc50 2023-11-08T12:28:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efebaa98700 1 -- 172.21.15.112:0/2782583893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb40cdc50 msgr2=0x7efeb4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efebaa98700 1 --2- 172.21.15.112:0/2782583893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb40cdc50 0x7efeb4069bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efea4009850 tx=0x7efea4009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efebaa98700 1 -- 172.21.15.112:0/2782583893 shutdown_connections 2023-11-08T12:28:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efebaa98700 1 --2- 172.21.15.112:0/2782583893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb40cdc50 0x7efeb4069bf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.429+0000 7efebaa98700 1 -- 172.21.15.112:0/2782583893 >> 172.21.15.112:0/2782583893 conn(0x7efeb40cf280 msgr2=0x7efeb40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:28.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 -- 172.21.15.112:0/2782583893 shutdown_connections 2023-11-08T12:28:28.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 -- 172.21.15.112:0/2782583893 wait complete. 2023-11-08T12:28:28.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 Processor -- start 2023-11-08T12:28:28.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 -- start start 2023-11-08T12:28:28.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb406ff10 0x7efeb40b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efeb40cdc50 0x7efeb4156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb415e190 0x7efeb415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4155c50 con 0x7efeb415e190 2023-11-08T12:28:28.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4155340 con 0x7efeb406ff10 2023-11-08T12:28:28.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.433+0000 7efebaa98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41584c0 con 0x7efeb40cdc50 2023-11-08T12:28:28.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb415e190 0x7efeb415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb415e190 0x7efeb415f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56722/0 (socket says 172.21.15.112:56722) 2023-11-08T12:28:28.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeb9a96700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb406ff10 0x7efeb40b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 -- 172.21.15.112:0/2013719045 learned_addr learned my addr 172.21.15.112:0/2013719045 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeb9295700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efeb40cdc50 0x7efeb4156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 -- 172.21.15.112:0/2013719045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efeb40cdc50 msgr2=0x7efeb4156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efeb40cdc50 0x7efeb4156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 -- 172.21.15.112:0/2013719045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb406ff10 msgr2=0x7efeb40b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb406ff10 0x7efeb40b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 -- 172.21.15.112:0/2013719045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40094b0 con 0x7efeb415e190 2023-11-08T12:28:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeba297700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb415e190 0x7efeb415f750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efeac00cc50 tx=0x7efeac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeaa7fc700 1 -- 172.21.15.112:0/2013719045 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac003c20 con 0x7efeb415e190 2023-11-08T12:28:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeaa7fc700 1 -- 172.21.15.112:0/2013719045 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac003d80 con 0x7efeb415e190 2023-11-08T12:28:28.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb40afc70 con 0x7efeb415e190 2023-11-08T12:28:28.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efeaa7fc700 1 -- 172.21.15.112:0/2013719045 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00aab0 con 0x7efeb415e190 2023-11-08T12:28:28.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb40af990 con 0x7efeb415e190 2023-11-08T12:28:28.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.437+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb40aff50 con 0x7efeb415e190 2023-11-08T12:28:28.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.441+0000 7efeaa7fc700 1 -- 172.21.15.112:0/2013719045 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efeac010050 con 0x7efeb415e190 2023-11-08T12:28:28.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.441+0000 7efeaa7fc700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efe98064f10 0x7efe980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.441+0000 7efeaa7fc700 1 -- 172.21.15.112:0/2013719045 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efeac082020 con 0x7efeb415e190 2023-11-08T12:28:28.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.441+0000 7efeb9a96700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efe98064f10 0x7efe980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.441+0000 7efeb9a96700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efe98064f10 0x7efe980673c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efeb0007fd0 tx=0x7efeb0007c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.449+0000 7efeaa7fc700 1 -- 172.21.15.112:0/2013719045 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efeac04fe70 con 0x7efeb415e190 2023-11-08T12:28:28.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.616+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efeb4155d90 con 0x7efeb415e190 2023-11-08T12:28:28.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efeaa7fc700 1 -- 172.21.15.112:0/2013719045 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7efeb4155d90 con 0x7efeb415e190 2023-11-08T12:28:28.623 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:28.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efe98064f10 msgr2=0x7efe980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efe98064f10 0x7efe980673c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efeb0007fd0 tx=0x7efeb0007c60 comp rx=0 tx=0).stop 2023-11-08T12:28:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb415e190 msgr2=0x7efeb415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb415e190 0x7efeb415f750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efeac00cc50 tx=0x7efeac00cf60 comp rx=0 tx=0).stop 2023-11-08T12:28:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 shutdown_connections 2023-11-08T12:28:28.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efe98064f10 0x7efe980673c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efeb415e190 0x7efeb415f750 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efeb40cdc50 0x7efeb4156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 --2- 172.21.15.112:0/2013719045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb406ff10 0x7efeb40b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 >> 172.21.15.112:0/2013719045 conn(0x7efeb40cf280 msgr2=0x7efeb40c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:28.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 shutdown_connections 2023-11-08T12:28:28.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.620+0000 7efebaa98700 1 -- 172.21.15.112:0/2013719045 wait complete. 2023-11-08T12:28:28.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:28.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.832+0000 7fb805d18700 1 Processor -- start 2023-11-08T12:28:28.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb805d18700 1 -- start start 2023-11-08T12:28:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb805d18700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb800159f10 0x7fb800070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb805d18700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8000c8c90 0x7fb80006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb805d18700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb800070600 con 0x7fb80015a2e0 2023-11-08T12:28:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb805d18700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000c9130 con 0x7fb8000c8c90 2023-11-08T12:28:28.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb805d18700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80006b840 con 0x7fb800159f10 2023-11-08T12:28:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb7f7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8000c8c90 0x7fb80006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb804d16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb800159f10 0x7fb800070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb7f7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8000c8c90 0x7fb80006b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56736/0 (socket says 172.21.15.112:56736) 2023-11-08T12:28:28.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb7f7fff700 1 -- 172.21.15.112:0/1099888972 learned_addr learned my addr 172.21.15.112:0/1099888972 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:28.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.836+0000 7fb805517700 1 --1- 172.21.15.112:0/1099888972 >> v1:172.21.15.133:6789/0 conn(0x7fb80015a2e0 0x7fb80015a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:34544/0 (socket says 172.21.15.112:34544) 2023-11-08T12:28:28.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f7fff700 1 -- 172.21.15.112:0/1099888972 >> v2:172.21.15.133:3300/0 conn(0x7fb800159f10 msgr2=0x7fb800070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:28.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f7fff700 1 --2- 172.21.15.112:0/1099888972 >> v2:172.21.15.133:3300/0 conn(0x7fb800159f10 0x7fb800070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f7fff700 1 -- 172.21.15.112:0/1099888972 >> v1:172.21.15.133:6789/0 conn(0x7fb80015a2e0 legacy=0x7fb80015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f7fff700 1 -- 172.21.15.112:0/1099888972 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80015adf0 con 0x7fb8000c8c90 2023-11-08T12:28:28.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f7fff700 1 --2- 172.21.15.112:0/1099888972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8000c8c90 0x7fb80006b300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8000cc0e0 tx=0x7fb7f0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653a7b67300f10da server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f77fe700 1 -- 172.21.15.112:0/1099888972 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0011830 con 0x7fb8000c8c90 2023-11-08T12:28:28.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f77fe700 1 -- 172.21.15.112:0/1099888972 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0011990 con 0x7fb8000c8c90 2023-11-08T12:28:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb7f77fe700 1 -- 172.21.15.112:0/1099888972 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0011d20 con 0x7fb8000c8c90 2023-11-08T12:28:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 -- 172.21.15.112:0/1099888972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8000c8c90 msgr2=0x7fb80006b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 --2- 172.21.15.112:0/1099888972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8000c8c90 0x7fb80006b300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8000cc0e0 tx=0x7fb7f0009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 -- 172.21.15.112:0/1099888972 shutdown_connections 2023-11-08T12:28:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 --2- 172.21.15.112:0/1099888972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8000c8c90 0x7fb80006b300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 --2- 172.21.15.112:0/1099888972 >> v2:172.21.15.133:3300/0 conn(0x7fb800159f10 0x7fb800070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 -- 172.21.15.112:0/1099888972 >> 172.21.15.112:0/1099888972 conn(0x7fb8000cf280 msgr2=0x7fb8000cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 -- 172.21.15.112:0/1099888972 shutdown_connections 2023-11-08T12:28:28.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.840+0000 7fb805d18700 1 -- 172.21.15.112:0/1099888972 wait complete. 2023-11-08T12:28:28.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.844+0000 7fb805d18700 1 Processor -- start 2023-11-08T12:28:28.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.844+0000 7fb805d18700 1 -- start start 2023-11-08T12:28:28.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8000c8c90 0x7fb8000b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800159f10 0x7fb8000c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb80015a2e0 0x7fb8001f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c67c0 con 0x7fb80015a2e0 2023-11-08T12:28:28.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000b1b90 con 0x7fb8000c8c90 2023-11-08T12:28:28.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000b1e70 con 0x7fb800159f10 2023-11-08T12:28:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb80015a2e0 0x7fb8001f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb80015a2e0 0x7fb8001f06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56742/0 (socket says 172.21.15.112:56742) 2023-11-08T12:28:28.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 -- 172.21.15.112:0/1096871649 learned_addr learned my addr 172.21.15.112:0/1096871649 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb804d16700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8000c8c90 0x7fb8000b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb7f7fff700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800159f10 0x7fb8000c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 -- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800159f10 msgr2=0x7fb8000c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800159f10 0x7fb8000c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 -- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8000c8c90 msgr2=0x7fb8000b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:28.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8000c8c90 0x7fb8000b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:28.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 -- 172.21.15.112:0/1096871649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0009570 con 0x7fb80015a2e0 2023-11-08T12:28:28.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb7f7fff700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800159f10 0x7fb8000c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805517700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb80015a2e0 0x7fb8001f06f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800cbc0 tx=0x7fb7f800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb7f57fa700 1 -- 172.21.15.112:0/1096871649 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800aaa0 con 0x7fb80015a2e0 2023-11-08T12:28:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb7f57fa700 1 -- 172.21.15.112:0/1096871649 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f800ac00 con 0x7fb80015a2e0 2023-11-08T12:28:28.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb7f57fa700 1 -- 172.21.15.112:0/1096871649 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8007070 con 0x7fb80015a2e0 2023-11-08T12:28:28.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80006ffb0 con 0x7fb80015a2e0 2023-11-08T12:28:28.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.848+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000afcc0 con 0x7fb80015a2e0 2023-11-08T12:28:28.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.852+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb800070290 con 0x7fb80015a2e0 2023-11-08T12:28:28.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.852+0000 7fb7f57fa700 1 -- 172.21.15.112:0/1096871649 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb7f8019030 con 0x7fb80015a2e0 2023-11-08T12:28:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.852+0000 7fb7f57fa700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7ec064ee0 0x7fb7ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.852+0000 7fb7f57fa700 1 -- 172.21.15.112:0/1096871649 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb7f8081c60 con 0x7fb80015a2e0 2023-11-08T12:28:28.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.852+0000 7fb804d16700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7ec064ee0 0x7fb7ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.852+0000 7fb804d16700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7ec064ee0 0x7fb7ec067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb8000caea0 tx=0x7fb7fc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:28.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:28.856+0000 7fb7f57fa700 1 -- 172.21.15.112:0/1096871649 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb7f804a400 con 0x7fb80015a2e0 2023-11-08T12:28:29.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.028+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb80006cf30 con 0x7fb80015a2e0 2023-11-08T12:28:29.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.028+0000 7fb7f57fa700 1 -- 172.21.15.112:0/1096871649 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7f8017020 con 0x7fb80015a2e0 2023-11-08T12:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:29.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7ec064ee0 msgr2=0x7fb7ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7ec064ee0 0x7fb7ec067390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb8000caea0 tx=0x7fb7fc009240 comp rx=0 tx=0).stop 2023-11-08T12:28:29.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb80015a2e0 msgr2=0x7fb8001f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb80015a2e0 0x7fb8001f06f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800cbc0 tx=0x7fb7f800ced0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 shutdown_connections 2023-11-08T12:28:29.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb7ec064ee0 0x7fb7ec067390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb80015a2e0 0x7fb8001f06f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800159f10 0x7fb8000c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 --2- 172.21.15.112:0/1096871649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8000c8c90 0x7fb8000b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 >> 172.21.15.112:0/1096871649 conn(0x7fb8000cf280 msgr2=0x7fb80006c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:29.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 shutdown_connections 2023-11-08T12:28:29.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.032+0000 7fb805d18700 1 -- 172.21.15.112:0/1096871649 wait complete. 2023-11-08T12:28:29.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:29.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.236+0000 7f08f9956700 1 Processor -- start 2023-11-08T12:28:29.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.236+0000 7f08f9956700 1 -- start start 2023-11-08T12:28:29.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f9956700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08f415c150 0x7f08f40b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f9956700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f406ff10 0x7f08f4070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f9956700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f415c520 con 0x7f08f415fc30 2023-11-08T12:28:29.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f9956700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f40b4240 con 0x7f08f415c150 2023-11-08T12:28:29.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f9956700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40708a0 con 0x7f08f406ff10 2023-11-08T12:28:29.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f3fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f406ff10 0x7f08f4070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f8954700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08f415c150 0x7f08f40b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f9155700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f08f415fc30 0x7f08f41600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:34548/0 (socket says 172.21.15.112:34548) 2023-11-08T12:28:29.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f9155700 1 -- 172.21.15.112:0/17093471 learned_addr learned my addr 172.21.15.112:0/17093471 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f3fff700 1 -- 172.21.15.112:0/17093471 >> v2:172.21.15.133:3300/0 conn(0x7f08f415c150 msgr2=0x7f08f40b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f3fff700 1 --2- 172.21.15.112:0/17093471 >> v2:172.21.15.133:3300/0 conn(0x7f08f415c150 0x7f08f40b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f3fff700 1 -- 172.21.15.112:0/17093471 >> v1:172.21.15.133:6789/0 conn(0x7f08f415fc30 legacy=0x7f08f41600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f3fff700 1 -- 172.21.15.112:0/17093471 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f406ac00 con 0x7f08f406ff10 2023-11-08T12:28:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f8954700 1 --2- 172.21.15.112:0/17093471 >> v2:172.21.15.133:3300/0 conn(0x7f08f415c150 0x7f08f40b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f37fe700 1 -- 172.21.15.112:0/17093471 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105532686 0 0) 0x7f08f415c520 con 0x7f08f415fc30 2023-11-08T12:28:29.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f3fff700 1 --2- 172.21.15.112:0/17093471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f406ff10 0x7f08f4070360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009840 tx=0x7f08e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851bd586b851e075 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:29.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f37fe700 1 -- 172.21.15.112:0/17093471 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0005e50 con 0x7f08f406ff10 2023-11-08T12:28:29.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f37fe700 1 -- 172.21.15.112:0/17093471 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0006030 con 0x7f08f406ff10 2023-11-08T12:28:29.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.240+0000 7f08f37fe700 1 -- 172.21.15.112:0/17093471 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e00063c0 con 0x7f08f406ff10 2023-11-08T12:28:29.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 -- 172.21.15.112:0/17093471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f406ff10 msgr2=0x7f08f4070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 --2- 172.21.15.112:0/17093471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f406ff10 0x7f08f4070360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009840 tx=0x7f08e0009b50 comp rx=0 tx=0).stop 2023-11-08T12:28:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 -- 172.21.15.112:0/17093471 shutdown_connections 2023-11-08T12:28:29.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 --2- 172.21.15.112:0/17093471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f406ff10 0x7f08f4070360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 --2- 172.21.15.112:0/17093471 >> v2:172.21.15.133:3300/0 conn(0x7f08f415c150 0x7f08f40b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 -- 172.21.15.112:0/17093471 >> 172.21.15.112:0/17093471 conn(0x7f08f40d3680 msgr2=0x7f08f40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:29.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 -- 172.21.15.112:0/17093471 shutdown_connections 2023-11-08T12:28:29.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.244+0000 7f08f9956700 1 -- 172.21.15.112:0/17093471 wait complete. 2023-11-08T12:28:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 Processor -- start 2023-11-08T12:28:29.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 -- start start 2023-11-08T12:28:29.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f406ff10 0x7f08f41f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f415c150 0x7f08f40b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f415fc30 0x7f08f40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40c9a40 con 0x7f08f406ff10 2023-11-08T12:28:29.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40ca5c0 con 0x7f08f415fc30 2023-11-08T12:28:29.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f9956700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40c9c90 con 0x7f08f415c150 2023-11-08T12:28:29.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.248+0000 7f08f8954700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f406ff10 0x7f08f41f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f406ff10 0x7f08f41f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56756/0 (socket says 172.21.15.112:56756) 2023-11-08T12:28:29.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 -- 172.21.15.112:0/1695841622 learned_addr learned my addr 172.21.15.112:0/1695841622 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:29.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f3fff700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f415c150 0x7f08f40b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f9155700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f415fc30 0x7f08f40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 -- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f415c150 msgr2=0x7f08f40b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f415c150 0x7f08f40b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 -- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f415fc30 msgr2=0x7f08f40cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f415fc30 0x7f08f40cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 -- 172.21.15.112:0/1695841622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e80094b0 con 0x7f08f406ff10 2023-11-08T12:28:29.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f8954700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f406ff10 0x7f08f41f55f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ec10 tx=0x7f08e800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:29.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f17fa700 1 -- 172.21.15.112:0/1695841622 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800c850 con 0x7f08f406ff10 2023-11-08T12:28:29.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f17fa700 1 -- 172.21.15.112:0/1695841622 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800c9b0 con 0x7f08f406ff10 2023-11-08T12:28:29.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f17fa700 1 -- 172.21.15.112:0/1695841622 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800cd40 con 0x7f08f406ff10 2023-11-08T12:28:29.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e0009450 con 0x7f08f406ff10 2023-11-08T12:28:29.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f40d2450 con 0x7f08f406ff10 2023-11-08T12:28:29.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.252+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f406cc50 con 0x7f08f406ff10 2023-11-08T12:28:29.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.256+0000 7f08f17fa700 1 -- 172.21.15.112:0/1695841622 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f08e8019030 con 0x7f08f406ff10 2023-11-08T12:28:29.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.256+0000 7f08f17fa700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.256+0000 7f08f17fa700 1 -- 172.21.15.112:0/1695841622 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08e80820d0 con 0x7f08f406ff10 2023-11-08T12:28:29.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.256+0000 7f08f3fff700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.260+0000 7f08f3fff700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009b90 tx=0x7f08e0008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:29.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.264+0000 7f08f17fa700 1 -- 172.21.15.112:0/1695841622 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f08e804ff80 con 0x7f08f406ff10 2023-11-08T12:28:29.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.432+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08f40d2730 con 0x7f08f406ff10 2023-11-08T12:28:29.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.432+0000 7f08f17fa700 1 -- 172.21.15.112:0/1695841622 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08e800cea0 con 0x7f08f406ff10 2023-11-08T12:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 msgr2=0x7f08d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009b90 tx=0x7f08e0008070 comp rx=0 tx=0).stop 2023-11-08T12:28:29.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f406ff10 msgr2=0x7f08f41f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f406ff10 0x7f08f41f55f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ec10 tx=0x7f08e800ef20 comp rx=0 tx=0).stop 2023-11-08T12:28:29.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 shutdown_connections 2023-11-08T12:28:29.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f415fc30 0x7f08f40cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f415c150 0x7f08f40b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 --2- 172.21.15.112:0/1695841622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f406ff10 0x7f08f41f55f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 >> 172.21.15.112:0/1695841622 conn(0x7f08f40d3680 msgr2=0x7f08f41581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:29.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 shutdown_connections 2023-11-08T12:28:29.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.436+0000 7f08f9956700 1 -- 172.21.15.112:0/1695841622 wait complete. 2023-11-08T12:28:29.461 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:28:29.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef91508700 1 Processor -- start 2023-11-08T12:28:29.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef91508700 1 -- start start 2023-11-08T12:28:29.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef91508700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c15c640 0x7fef8c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef91508700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef8c071aa0 0x7fef8c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef91508700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c06c600 con 0x7fef8c069e00 2023-11-08T12:28:29.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef91508700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c06cef0 con 0x7fef8c071aa0 2023-11-08T12:28:29.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef91508700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0722f0 con 0x7fef8c15c640 2023-11-08T12:28:29.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef90d07700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fef8c069e00 0x7fef8c0d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34324/0 (socket says 172.21.15.112:34324) 2023-11-08T12:28:29.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef90d07700 1 -- 172.21.15.112:0/2037784982 learned_addr learned my addr 172.21.15.112:0/2037784982 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:29.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef8b7fe700 1 --2- 172.21.15.112:0/2037784982 >> v2:172.21.15.112:3300/0 conn(0x7fef8c071aa0 0x7fef8c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef8bfff700 1 --2- 172.21.15.112:0/2037784982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c15c640 0x7fef8c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef8b7fe700 1 -- 172.21.15.112:0/2037784982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c15c640 msgr2=0x7fef8c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:29.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef8b7fe700 1 --2- 172.21.15.112:0/2037784982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c15c640 0x7fef8c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.628+0000 7fef8b7fe700 1 -- 172.21.15.112:0/2037784982 >> v1:172.21.15.112:6789/0 conn(0x7fef8c069e00 legacy=0x7fef8c0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef8b7fe700 1 -- 172.21.15.112:0/2037784982 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c15ca10 con 0x7fef8c071aa0 2023-11-08T12:28:29.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef8affd700 1 -- 172.21.15.112:0/2037784982 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006080695 0 0) 0x7fef8c06c600 con 0x7fef8c069e00 2023-11-08T12:28:29.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef8b7fe700 1 --2- 172.21.15.112:0/2037784982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c071aa0 0x7fef8c06d310 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef80009850 tx=0x7fef80009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cb70fb91a0aa6a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:29.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef8affd700 1 -- 172.21.15.112:0/2037784982 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef80011830 con 0x7fef8c071aa0 2023-11-08T12:28:29.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef8affd700 1 -- 172.21.15.112:0/2037784982 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef80011990 con 0x7fef8c071aa0 2023-11-08T12:28:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef8affd700 1 -- 172.21.15.112:0/2037784982 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef80011d20 con 0x7fef8c071aa0 2023-11-08T12:28:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 -- 172.21.15.112:0/2037784982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c071aa0 msgr2=0x7fef8c06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 --2- 172.21.15.112:0/2037784982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c071aa0 0x7fef8c06d310 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef80009850 tx=0x7fef80009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:29.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 -- 172.21.15.112:0/2037784982 shutdown_connections 2023-11-08T12:28:29.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 --2- 172.21.15.112:0/2037784982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c071aa0 0x7fef8c06d310 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 --2- 172.21.15.112:0/2037784982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c15c640 0x7fef8c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 -- 172.21.15.112:0/2037784982 >> 172.21.15.112:0/2037784982 conn(0x7fef8c0b6520 msgr2=0x7fef8c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:29.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 -- 172.21.15.112:0/2037784982 shutdown_connections 2023-11-08T12:28:29.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.632+0000 7fef91508700 1 -- 172.21.15.112:0/2037784982 wait complete. 2023-11-08T12:28:29.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.636+0000 7fef91508700 1 Processor -- start 2023-11-08T12:28:29.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.636+0000 7fef91508700 1 -- start start 2023-11-08T12:28:29.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c069e00 0x7fef8c158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c071aa0 0x7fef8c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c15c640 0x7fef8c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c7ef0 con 0x7fef8c069e00 2023-11-08T12:28:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0b4ca0 con 0x7fef8c15c640 2023-11-08T12:28:29.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0c8a10 con 0x7fef8c071aa0 2023-11-08T12:28:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c069e00 0x7fef8c158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c069e00 0x7fef8c158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56768/0 (socket says 172.21.15.112:56768) 2023-11-08T12:28:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 -- 172.21.15.112:0/3954388545 learned_addr learned my addr 172.21.15.112:0/3954388545 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8b7fe700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c071aa0 0x7fef8c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef90d07700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c15c640 0x7fef8c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 -- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c071aa0 msgr2=0x7fef8c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c071aa0 0x7fef8c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 -- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c15c640 msgr2=0x7fef8c0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c15c640 0x7fef8c0b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 -- 172.21.15.112:0/3954388545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800094b0 con 0x7fef8c069e00 2023-11-08T12:28:29.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8b7fe700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c071aa0 0x7fef8c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:29.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef8bfff700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c069e00 0x7fef8c158ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e760 tx=0x7fef7c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:29.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef88ff9700 1 -- 172.21.15.112:0/3954388545 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c013610 con 0x7fef8c069e00 2023-11-08T12:28:29.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef88ff9700 1 -- 172.21.15.112:0/3954388545 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c013770 con 0x7fef8c069e00 2023-11-08T12:28:29.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef88ff9700 1 -- 172.21.15.112:0/3954388545 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c013ae0 con 0x7fef8c069e00 2023-11-08T12:28:29.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c06c830 con 0x7fef8c069e00 2023-11-08T12:28:29.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.640+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c072010 con 0x7fef8c069e00 2023-11-08T12:28:29.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.644+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c06cb10 con 0x7fef8c069e00 2023-11-08T12:28:29.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.644+0000 7fef88ff9700 1 -- 172.21.15.112:0/3954388545 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef7c023070 con 0x7fef8c069e00 2023-11-08T12:28:29.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.648+0000 7fef88ff9700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef78064f10 0x7fef780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.648+0000 7fef88ff9700 1 -- 172.21.15.112:0/3954388545 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fef7c081f30 con 0x7fef8c069e00 2023-11-08T12:28:29.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.648+0000 7fef8b7fe700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef78064f10 0x7fef780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:29.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.648+0000 7fef8b7fe700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef78064f10 0x7fef780673c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef80014040 tx=0x7fef80008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:29.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.656+0000 7fef88ff9700 1 -- 172.21.15.112:0/3954388545 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef7c04fcf0 con 0x7fef8c069e00 2023-11-08T12:28:29.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.860+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef8c073cb0 con 0x7fef8c069e00 2023-11-08T12:28:29.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef88ff9700 1 -- 172.21.15.112:0/3954388545 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7fef7c053310 con 0x7fef8c069e00 2023-11-08T12:28:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:29.867 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:28:19.810915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T12:28:29.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef78064f10 msgr2=0x7fef780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef78064f10 0x7fef780673c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef80014040 tx=0x7fef80008030 comp rx=0 tx=0).stop 2023-11-08T12:28:29.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c069e00 msgr2=0x7fef8c158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:29.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c069e00 0x7fef8c158ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e760 tx=0x7fef7c00eb20 comp rx=0 tx=0).stop 2023-11-08T12:28:29.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 shutdown_connections 2023-11-08T12:28:29.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef78064f10 0x7fef780673c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c15c640 0x7fef8c0b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef8c071aa0 0x7fef8c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 --2- 172.21.15.112:0/3954388545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef8c069e00 0x7fef8c158ae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:29.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 >> 172.21.15.112:0/3954388545 conn(0x7fef8c0b6520 msgr2=0x7fef8c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:29.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 shutdown_connections 2023-11-08T12:28:29.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:29.864+0000 7fef91508700 1 -- 172.21.15.112:0/3954388545 wait complete. 2023-11-08T12:28:29.871 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-11-08T12:28:30.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T12:27:54.061640+0000', 'modified': '2023-11-08T12:28:19.810915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6833/67340016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 67340016}, {'type': 'v1', 'addr': '172.21.15.133:6833', 'nonce': 67340016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T12:28:30.291 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T12:28:30.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-08T12:28:30.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.476+0000 7f187b59e700 1 Processor -- start 2023-11-08T12:28:30.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.476+0000 7f187b59e700 1 -- start start 2023-11-08T12:28:30.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f187c0b43a0 0x7f187c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c070790 0x7f187c06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187b59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187c15a550 con 0x7f187c0b1640 2023-11-08T12:28:30.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187b59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187c06b0a0 con 0x7f187c0b43a0 2023-11-08T12:28:30.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0caac0 con 0x7f187c070790 2023-11-08T12:28:30.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f187c0b43a0 0x7f187c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f1873fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f187c0b1640 0x7f187c070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34340/0 (socket says 172.21.15.112:34340) 2023-11-08T12:28:30.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f1873fff700 1 -- 172.21.15.112:0/1334094394 learned_addr learned my addr 172.21.15.112:0/1334094394 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187ad9d700 1 --2- 172.21.15.112:0/1334094394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c070790 0x7f187c06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187a59c700 1 -- 172.21.15.112:0/1334094394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c070790 msgr2=0x7f187c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f1879d9b700 1 -- 172.21.15.112:0/1334094394 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276346092 0 0) 0x7f1864001110 con 0x7f187c0b1640 2023-11-08T12:28:30.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187a59c700 1 --2- 172.21.15.112:0/1334094394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c070790 0x7f187c06bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187a59c700 1 -- 172.21.15.112:0/1334094394 >> v1:172.21.15.112:6789/0 conn(0x7f187c0b1640 legacy=0x7f187c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.480+0000 7f187a59c700 1 -- 172.21.15.112:0/1334094394 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c0cada0 con 0x7f187c0b43a0 2023-11-08T12:28:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187a59c700 1 --2- 172.21.15.112:0/1334094394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c0b43a0 0x7f187c15e5d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f186c009850 tx=0x7f186c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a198d669ebff7cb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f1879d9b700 1 -- 172.21.15.112:0/1334094394 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c011830 con 0x7f187c0b43a0 2023-11-08T12:28:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f1879d9b700 1 -- 172.21.15.112:0/1334094394 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c011990 con 0x7f187c0b43a0 2023-11-08T12:28:30.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f1879d9b700 1 -- 172.21.15.112:0/1334094394 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c011d20 con 0x7f187c0b43a0 2023-11-08T12:28:30.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 -- 172.21.15.112:0/1334094394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c0b43a0 msgr2=0x7f187c15e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 --2- 172.21.15.112:0/1334094394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c0b43a0 0x7f187c15e5d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f186c009850 tx=0x7f186c009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 -- 172.21.15.112:0/1334094394 shutdown_connections 2023-11-08T12:28:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 --2- 172.21.15.112:0/1334094394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c070790 0x7f187c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 --2- 172.21.15.112:0/1334094394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c0b43a0 0x7f187c15e5d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 -- 172.21.15.112:0/1334094394 >> 172.21.15.112:0/1334094394 conn(0x7f187c0b0f80 msgr2=0x7f187c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:30.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 -- 172.21.15.112:0/1334094394 shutdown_connections 2023-11-08T12:28:30.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.484+0000 7f187b59e700 1 -- 172.21.15.112:0/1334094394 wait complete. 2023-11-08T12:28:30.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.488+0000 7f187b59e700 1 Processor -- start 2023-11-08T12:28:30.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.488+0000 7f187b59e700 1 -- start start 2023-11-08T12:28:30.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c070790 0x7f187c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f187c0b1640 0x7f187c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c0b43a0 0x7f187c1f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c1f3ac0 con 0x7f187c070790 2023-11-08T12:28:30.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c1f3da0 con 0x7f187c0b1640 2023-11-08T12:28:30.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187c0c59a0 con 0x7f187c0b43a0 2023-11-08T12:28:30.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c070790 0x7f187c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c070790 0x7f187c0c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56788/0 (socket says 172.21.15.112:56788) 2023-11-08T12:28:30.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 -- 172.21.15.112:0/4044411081 learned_addr learned my addr 172.21.15.112:0/4044411081 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:30.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f1873fff700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f187c0b1640 0x7f187c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187ad9d700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c0b43a0 0x7f187c1f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 -- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c0b43a0 msgr2=0x7f187c1f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c0b43a0 0x7f187c1f30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 -- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f187c0b1640 msgr2=0x7f187c14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f187c0b1640 0x7f187c14ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 -- 172.21.15.112:0/4044411081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0094b0 con 0x7f187c070790 2023-11-08T12:28:30.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187a59c700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c070790 0x7f187c0c2750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f186c009fd0 tx=0x7f186c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:30.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f1872ffd700 1 -- 172.21.15.112:0/4044411081 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c004590 con 0x7f187c070790 2023-11-08T12:28:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f1872ffd700 1 -- 172.21.15.112:0/4044411081 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c01e070 con 0x7f187c070790 2023-11-08T12:28:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c06b5d0 con 0x7f187c070790 2023-11-08T12:28:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f1872ffd700 1 -- 172.21.15.112:0/4044411081 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0038e0 con 0x7f187c070790 2023-11-08T12:28:30.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.492+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c06b2f0 con 0x7f187c070790 2023-11-08T12:28:30.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.496+0000 7f1872ffd700 1 -- 172.21.15.112:0/4044411081 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f186c00f050 con 0x7f187c070790 2023-11-08T12:28:30.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1872ffd700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f185c064ee0 0x7f185c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1872ffd700 1 -- 172.21.15.112:0/4044411081 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f186c0830e0 con 0x7f187c070790 2023-11-08T12:28:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1873fff700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f185c064ee0 0x7f185c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1873fff700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f185c064ee0 0x7f185c067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f187c1f3040 tx=0x7f1864007c40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:30.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1883d59740 1 Processor -- start 2023-11-08T12:28:30.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1883d59740 1 -- start start 2023-11-08T12:28:30.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.500+0000 7f1883d59740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1115120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x1117670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xfc5ae0 con 0xe56710 2023-11-08T12:28:30.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1035bd0 con 0xea1790 2023-11-08T12:28:30.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x102eed0 con 0xe56ae0 2023-11-08T12:28:30.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1115120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56792/0 (socket says 172.21.15.112:56792) 2023-11-08T12:28:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 -- 172.21.15.112:0/1860705261 learned_addr learned my addr 172.21.15.112:0/1860705261 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:30.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f187a59c700 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f187ad9d700 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x1117670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 -- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 msgr2=0x11053b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11053b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 -- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 msgr2=0x1117670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x1117670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 -- 172.21.15.112:0/1860705261 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1054cc0 con 0xe56710 2023-11-08T12:28:30.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f187ad9d700 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x1117670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:30.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1873fff700 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1115120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1864001710 tx=0x7f1864012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73765a66707a53cf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:30.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f185bfff700 1 -- 172.21.15.112:0/1860705261 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864021450 con 0xe56710 2023-11-08T12:28:30.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f185bfff700 1 -- 172.21.15.112:0/1860705261 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18640215b0 con 0xe56710 2023-11-08T12:28:30.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f185bfff700 1 -- 172.21.15.112:0/1860705261 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864021920 con 0xe56710 2023-11-08T12:28:30.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- 172.21.15.112:0/1860705261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 msgr2=0x1115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1115120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1864001710 tx=0x7f1864012000 comp rx=0 tx=0).stop 2023-11-08T12:28:30.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- 172.21.15.112:0/1860705261 shutdown_connections 2023-11-08T12:28:30.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x1117670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1115120 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 --2- 172.21.15.112:0/1860705261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- 172.21.15.112:0/1860705261 >> 172.21.15.112:0/1860705261 conn(0xe56eb0 msgr2=0x10ef700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:30.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- 172.21.15.112:0/1860705261 shutdown_connections 2023-11-08T12:28:30.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.504+0000 7f1883d59740 1 -- 172.21.15.112:0/1860705261 wait complete. 2023-11-08T12:28:30.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 -- start start 2023-11-08T12:28:30.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 Processor -- start 2023-11-08T12:28:30.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1109280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11104f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xedbb20 con 0xe56710 2023-11-08T12:28:30.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x110f610 con 0xea1790 2023-11-08T12:28:30.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x11097c0 con 0xe56ae0 2023-11-08T12:28:30.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1883d59740 10 client.0 _ll_register_callbacks cb 0x108b0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:28:30.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f187a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1109280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f187a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1109280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56806/0 (socket says 172.21.15.112:56806) 2023-11-08T12:28:30.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f187a59c700 1 -- 172.21.15.112:0/1485726195 learned_addr learned my addr 172.21.15.112:0/1485726195 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:30.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.508+0000 7f1873fff700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f187ad9d700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f187a59c700 1 -- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 msgr2=0x11104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f187a59c700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f187a59c700 1 -- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 msgr2=0x10ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f187a59c700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10ec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f187a59c700 1 -- 172.21.15.112:0/1485726195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1864001440 con 0xe56710 2023-11-08T12:28:30.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1873fff700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:30.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f187a59c700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1109280 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f186c014040 tx=0x7f186c05cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67492ffd4eb80852 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:30.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f18597fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:28:30.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f18597fa700 1 -- 172.21.15.112:0/1485726195 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c05c960 con 0xe56710 2023-11-08T12:28:30.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f18597fa700 1 -- 172.21.15.112:0/1485726195 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f186c050950 con 0xe56710 2023-11-08T12:28:30.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1027f50 con 0xe56710 2023-11-08T12:28:30.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f18597fa700 1 -- 172.21.15.112:0/1485726195 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f186c050b10 con 0xe56710 2023-11-08T12:28:30.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 10 client.4824 fetch_fsmap learned FSMap version 9 2023-11-08T12:28:30.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0xea29e0 con 0xe56710 2023-11-08T12:28:30.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f18597fa700 1 -- 172.21.15.112:0/1485726195 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c062080 con 0xe56710 2023-11-08T12:28:30.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f18597fa700 1 -- 172.21.15.112:0/1485726195 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f186c058ac0 con 0xe56710 2023-11-08T12:28:30.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2023-11-08T12:28:30.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 10 client.4824 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T12:28:30.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 20 client.4824 populate_metadata read hostname 'smithi112' 2023-11-08T12:28:30.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x10ecd60 0x110ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 4 client.4824 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:28:30.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 --> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1027c70 con 0x10ecd60 2023-11-08T12:28:30.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1873fff700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x10ecd60 0x110ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f18597fa700 10 client.4824 ms_handle_connect on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:30.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.512+0000 7f1873fff700 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x10ecd60 0x110ac00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec57b12a310578b4 server_cookie=996b68784f84453f in_seq=0 out_seq=0 2023-11-08T12:28:30.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f18597fa700 1 -- 172.21.15.112:0/1485726195 <== mds.0 v2:172.21.15.133:6832/67340016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1027c70 con 0x10ecd60 2023-11-08T12:28:30.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f18597fa700 10 client.4824 handle_command_reply: tid=0 2023-11-08T12:28:30.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 client.4824 shutdown 2023-11-08T12:28:30.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 msgr2=0x1109280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1109280 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f186c014040 tx=0x7f186c05cd10 comp rx=0 tx=0).stop 2023-11-08T12:28:30.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 shutdown_connections 2023-11-08T12:28:30.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x10ecd60 0x110ac00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x11104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 --2- 172.21.15.112:0/1485726195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56710 0x1109280 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 >> 172.21.15.112:0/1485726195 conn(0xe56eb0 msgr2=0x1108660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:30.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f18597fa700 0 client.4824 ms_handle_reset on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:30.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 shutdown_connections 2023-11-08T12:28:30.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 1 -- 172.21.15.112:0/1485726195 wait complete. 2023-11-08T12:28:30.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.516+0000 7f1883d59740 20 client.4824 trim_cache size 0 max 16384 2023-11-08T12:28:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 Processor -- start 2023-11-08T12:28:30.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 -- start start 2023-11-08T12:28:30.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56710 0x1121460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56ae0 0x11219a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1004de0 con 0xe56ae0 2023-11-08T12:28:30.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x102dd60 con 0xea1790 2023-11-08T12:28:30.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.536+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x102c6e0 con 0xe56710 2023-11-08T12:28:30.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56710 0x1121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56710 0x1121460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51832/0 (socket says 172.21.15.112:51832) 2023-11-08T12:28:30.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1873fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56ae0 0x11219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 -- 172.21.15.112:0/3769617905 learned_addr learned my addr 172.21.15.112:0/3769617905 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:30.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187ad9d700 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 -- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 msgr2=0x10c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 -- 172.21.15.112:0/3769617905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56ae0 msgr2=0x11219a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56ae0 0x11219a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 -- 172.21.15.112:0/3769617905 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c159cf0 con 0xe56710 2023-11-08T12:28:30.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1873fff700 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56ae0 0x11219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:30.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f187a59c700 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56710 0x1121460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f186c05cd90 tx=0x7f186c057000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f9183a656a5e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:30.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1870ff9700 1 -- 172.21.15.112:0/3769617905 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0548d0 con 0xe56710 2023-11-08T12:28:30.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1870ff9700 1 -- 172.21.15.112:0/3769617905 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1027f50 con 0xe56710 2023-11-08T12:28:30.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1870ff9700 1 -- 172.21.15.112:0/3769617905 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c05c960 con 0xe56710 2023-11-08T12:28:30.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 -- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56710 msgr2=0x1121460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56710 0x1121460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f186c05cd90 tx=0x7f186c057000 comp rx=0 tx=0).stop 2023-11-08T12:28:30.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 -- 172.21.15.112:0/3769617905 shutdown_connections 2023-11-08T12:28:30.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xea1790 0x10c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xe56ae0 0x11219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 --2- 172.21.15.112:0/3769617905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56710 0x1121460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 -- 172.21.15.112:0/3769617905 >> 172.21.15.112:0/3769617905 conn(0xe56eb0 msgr2=0x10ec200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:30.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 -- 172.21.15.112:0/3769617905 shutdown_connections 2023-11-08T12:28:30.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 -- 172.21.15.112:0/3769617905 wait complete. 2023-11-08T12:28:30.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 -- start start 2023-11-08T12:28:30.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.540+0000 7f1883d59740 1 Processor -- start 2023-11-08T12:28:30.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xe56710 0x112a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x1171810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xea1790 0x11251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1031a30 con 0xea1790 2023-11-08T12:28:30.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x102dbf0 con 0xe56710 2023-11-08T12:28:30.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1036e60 con 0xe56ae0 2023-11-08T12:28:30.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 10 client.0 _ll_register_callbacks cb 0xfdb2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:28:30.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xea1790 0x11251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xea1790 0x11251e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56826/0 (socket says 172.21.15.112:56826) 2023-11-08T12:28:30.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 -- 172.21.15.112:0/2846728640 learned_addr learned my addr 172.21.15.112:0/2846728640 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:30.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187a59c700 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xe56710 0x112a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1873fff700 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x1171810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 -- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 msgr2=0x1171810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x1171810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 -- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xe56710 msgr2=0x112a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:30.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xe56710 0x112a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 -- 172.21.15.112:0/2846728640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1054cc0 con 0xea1790 2023-11-08T12:28:30.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f187ad9d700 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xea1790 0x11251e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1874004630 tx=0x7f1874004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659ba3d983d759d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:30.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f18597fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:28:30.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f18597fa700 1 -- 172.21.15.112:0/2846728640 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874017820 con 0xea1790 2023-11-08T12:28:30.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f18597fa700 1 -- 172.21.15.112:0/2846728640 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1874017980 con 0xea1790 2023-11-08T12:28:30.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18640215b0 con 0xea1790 2023-11-08T12:28:30.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f18597fa700 1 -- 172.21.15.112:0/2846728640 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1874017b40 con 0xea1790 2023-11-08T12:28:30.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 10 client.4830 fetch_fsmap learned FSMap version 9 2023-11-08T12:28:30.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.544+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0xea29e0 con 0xea1790 2023-11-08T12:28:30.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f18597fa700 1 -- 172.21.15.112:0/2846728640 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18640215b0 con 0xea1790 2023-11-08T12:28:30.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f18597fa700 1 -- 172.21.15.112:0/2846728640 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f187401d020 con 0xea1790 2023-11-08T12:28:30.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 10 client.4830 fetch_fsmap finished waiting for FSMap version 9 2023-11-08T12:28:30.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 10 client.4830 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-08T12:28:30.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 20 client.4830 populate_metadata read hostname 'smithi112' 2023-11-08T12:28:30.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x1128580 0x1128950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:30.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 4 client.4830 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-11-08T12:28:30.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 --> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] -- command(tid 0: {"prefix": "status"}) v1 -- 0xed3260 con 0x1128580 2023-11-08T12:28:30.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f187a59c700 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x1128580 0x1128950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:30.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f187a59c700 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x1128580 0x1128950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc0812b69bec2e07 server_cookie=dacf962ef9dee785 in_seq=0 out_seq=0 2023-11-08T12:28:30.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f18597fa700 10 client.4830 ms_handle_connect on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:30.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f18597fa700 1 -- 172.21.15.112:0/2846728640 <== mds.0 v2:172.21.15.133:6832/67340016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xed3260 con 0x1128580 2023-11-08T12:28:30.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f18597fa700 10 client.4830 handle_command_reply: tid=0 2023-11-08T12:28:30.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 client.4830 shutdown 2023-11-08T12:28:30.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xea1790 msgr2=0x11251e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xea1790 0x11251e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1874004630 tx=0x7f1874004660 comp rx=0 tx=0).stop 2023-11-08T12:28:30.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 shutdown_connections 2023-11-08T12:28:30.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:6832/67340016,v1:172.21.15.133:6833/67340016] conn(0x1128580 0x1128950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xea1790 0x11251e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xe56ae0 0x1171810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 --2- 172.21.15.112:0/2846728640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xe56710 0x112a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f18597fa700 0 client.4830 ms_handle_reset on v2:172.21.15.133:6832/67340016 2023-11-08T12:28:30.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 >> 172.21.15.112:0/2846728640 conn(0xe56eb0 msgr2=0x10ec200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:30.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 shutdown_connections 2023-11-08T12:28:30.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 1 -- 172.21.15.112:0/2846728640 wait complete. 2023-11-08T12:28:30.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.548+0000 7f1883d59740 20 client.4830 trim_cache size 0 max 16384 2023-11-08T12:28:30.564 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:28:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "c14663df-4425-4498-9232-3ffa5f578bfa", 2023-11-08T12:28:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-11-08T12:28:30.564 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4302, 2023-11-08T12:28:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-11-08T12:28:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-11-08T12:28:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-11-08T12:28:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 36.484416238999998, 2023-11-08T12:28:30.565 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 9, 2023-11-08T12:28:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 29, 2023-11-08T12:28:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 29, 2023-11-08T12:28:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 41.833110288999997 2023-11-08T12:28:30.566 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:28:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f185c064ee0 msgr2=0x7f185c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f185c064ee0 0x7f185c067390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f187c1f3040 tx=0x7f1864007c40 comp rx=0 tx=0).stop 2023-11-08T12:28:30.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c070790 msgr2=0x7f187c0c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c070790 0x7f187c0c2750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f186c009fd0 tx=0x7f186c004770 comp rx=0 tx=0).stop 2023-11-08T12:28:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 shutdown_connections 2023-11-08T12:28:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f185c064ee0 0x7f185c067390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f187c0b43a0 0x7f187c1f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f187c0b1640 0x7f187c14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 --2- 172.21.15.112:0/4044411081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f187c070790 0x7f187c0c2750 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:30.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 >> 172.21.15.112:0/4044411081 conn(0x7f187c0b0f80 msgr2=0x7f187c0c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:30.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 shutdown_connections 2023-11-08T12:28:30.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:30.552+0000 7f187b59e700 1 -- 172.21.15.112:0/4044411081 wait complete. 2023-11-08T12:28:30.574 INFO:teuthology.run_tasks:Running task kclient... 2023-11-08T12:28:30.588 INFO:tasks.kclient:Mounting kernel clients... 2023-11-08T12:28:30.588 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-08T12:28:30.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:30.589 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:28:30.606 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-08T12:28:30.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:30.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-08T12:28:30.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:30.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-11-08T12:28:30.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:30.891 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:28:30.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:30.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-11-08T12:28:30.992 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-11-08T12:28:30.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:28:30.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:30.996 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-11-08T12:28:31.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:31.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-11-08T12:28:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-11-08T12:28:31.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:28:31.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:31.111 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-11-08T12:28:31.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:31.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-11-08T12:28:31.255 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-11-08T12:28:31.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:28:31.260 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-08T12:28:31.260 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T12:28:31.260 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T12:28:31.261 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:28:31.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b515dc700 1 Processor -- start 2023-11-08T12:28:31.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b515dc700 1 -- start start 2023-11-08T12:28:31.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b515dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 0x7f2b4c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b515dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b4c0b1640 0x7f2b4c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b515dc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c15a550 con 0x7f2b4c0c9040 2023-11-08T12:28:31.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b515dc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c06b0a0 con 0x7f2b4c0b1640 2023-11-08T12:28:31.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b515dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0caac0 con 0x7f2b4c0b43a0 2023-11-08T12:28:31.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b50ddb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2b4c0c9040 0x7f2b4c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34348/0 (socket says 172.21.15.112:34348) 2023-11-08T12:28:31.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b50ddb700 1 -- 172.21.15.112:0/704260738 learned_addr learned my addr 172.21.15.112:0/704260738 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:31.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.448+0000 7f2b4bfff700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 0x7f2b4c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/704260738 >> v2:172.21.15.133:3300/0 conn(0x7f2b4c0b1640 0x7f2b4c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523456939 0 0) 0x7f2b44001490 con 0x7f2b4c0c9040 2023-11-08T12:28:31.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b340035d0 con 0x7f2b4c0c9040 2023-11-08T12:28:31.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 563988579 0 0) 0x7f2b340035d0 con 0x7f2b4c0c9040 2023-11-08T12:28:31.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 msgr2=0x7f2b4c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:31.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 0x7f2b4c15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 >> v2:172.21.15.133:3300/0 conn(0x7f2b4c0b1640 msgr2=0x7f2b4c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:31.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 --2- 172.21.15.112:0/704260738 >> v2:172.21.15.133:3300/0 conn(0x7f2b4c0b1640 0x7f2b4c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0cada0 con 0x7f2b4c0c9040 2023-11-08T12:28:31.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f2b44001b80 con 0x7f2b4c0c9040 2023-11-08T12:28:31.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 >> v1:172.21.15.112:6789/0 conn(0x7f2b4c0c9040 legacy=0x7f2b4c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:31.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 0x7f2b34003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b34003fa0 0x7f2b34004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b34004db0 0x7f2b34005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c06b0a0 con 0x7f2b34003fa0 2023-11-08T12:28:31.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0caac0 con 0x7f2b34004db0 2023-11-08T12:28:31.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3400fe70 con 0x7f2b4c0b43a0 2023-11-08T12:28:31.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b34003fa0 0x7f2b34004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4bfff700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 0x7f2b34003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b50ddb700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b34004db0 0x7f2b34005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 -- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 msgr2=0x7f2b34003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:31.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0b43a0 0x7f2b34003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 -- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b34004db0 msgr2=0x7f2b34005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:31.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b34004db0 0x7f2b34005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 -- 172.21.15.112:0/704260738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340035d0 con 0x7f2b34003fa0 2023-11-08T12:28:31.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b34003fa0 0x7f2b34004870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009b70 tx=0x7f2b340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a51ac9ca6f20219 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:31.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000e660 con 0x7f2b34003fa0 2023-11-08T12:28:31.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4000e7c0 con 0x7f2b34003fa0 2023-11-08T12:28:31.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b4affd700 1 -- 172.21.15.112:0/704260738 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000eb30 con 0x7f2b34003fa0 2023-11-08T12:28:31.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b515dc700 1 -- 172.21.15.112:0/704260738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b34003fa0 msgr2=0x7f2b34004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:31.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b515dc700 1 --2- 172.21.15.112:0/704260738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b34003fa0 0x7f2b34004870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009b70 tx=0x7f2b340058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.452+0000 7f2b50ddb700 1 -- 172.21.15.112:0/704260738 reap_dead start 2023-11-08T12:28:31.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.456+0000 7f2b515dc700 1 -- 172.21.15.112:0/704260738 shutdown_connections 2023-11-08T12:28:31.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.456+0000 7f2b515dc700 1 -- 172.21.15.112:0/704260738 >> 172.21.15.112:0/704260738 conn(0x7f2b4c0b0f80 msgr2=0x7f2b4c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:31.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.456+0000 7f2b515dc700 1 -- 172.21.15.112:0/704260738 shutdown_connections 2023-11-08T12:28:31.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.456+0000 7f2b515dc700 1 -- 172.21.15.112:0/704260738 wait complete. 2023-11-08T12:28:31.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.456+0000 7f2b515dc700 1 Processor -- start 2023-11-08T12:28:31.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 -- start start 2023-11-08T12:28:31.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4c0ada50 0x7f2b4c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4c155910 0x7f2b4c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0c5d60 0x7f2b4c0c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0b3420 con 0x7f2b4c0ada50 2023-11-08T12:28:31.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c61d0 con 0x7f2b4c155910 2023-11-08T12:28:31.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c15a920 con 0x7f2b4c0c5d60 2023-11-08T12:28:31.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4c0ada50 0x7f2b4c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4c0ada50 0x7f2b4c0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56838/0 (socket says 172.21.15.112:56838) 2023-11-08T12:28:31.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 -- 172.21.15.112:0/2866012858 learned_addr learned my addr 172.21.15.112:0/2866012858 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:31.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4c155910 0x7f2b4c0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b50ddb700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0c5d60 0x7f2b4c0c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 -- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0c5d60 msgr2=0x7f2b4c0c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:31.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0c5d60 0x7f2b4c0c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 -- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4c155910 msgr2=0x7f2b4c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:31.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4c155910 0x7f2b4c0c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 -- 172.21.15.112:0/2866012858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c06b5d0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b4bfff700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4c0ada50 0x7f2b4c0b2480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c011730 tx=0x7f2b3c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:31.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b48ff9700 1 -- 172.21.15.112:0/2866012858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c015870 con 0x7f2b4c0ada50 2023-11-08T12:28:31.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b48ff9700 1 -- 172.21.15.112:0/2866012858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c0159d0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c06b2f0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b48ff9700 1 -- 172.21.15.112:0/2866012858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c015d40 con 0x7f2b4c0ada50 2023-11-08T12:28:31.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.460+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c0ca7b0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.464+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c15a6f0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.464+0000 7f2b48ff9700 1 -- 172.21.15.112:0/2866012858 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2b3c012040 con 0x7f2b4c0ada50 2023-11-08T12:28:31.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.468+0000 7f2b48ff9700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b38064ee0 0x7f2b38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:31.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.468+0000 7f2b48ff9700 1 -- 172.21.15.112:0/2866012858 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2b3c082440 con 0x7f2b4c0ada50 2023-11-08T12:28:31.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.468+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b38064ee0 0x7f2b38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:31.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.468+0000 7f2b4b7fe700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b38064ee0 0x7f2b38067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c063810 tx=0x7f2b40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:31.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.472+0000 7f2b48ff9700 1 -- 172.21.15.112:0/2866012858 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2b4c15a6f0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.680+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b4c15a6f0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b48ff9700 1 -- 172.21.15.112:0/2866012858 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2b4c15a6f0 con 0x7f2b4c0ada50 2023-11-08T12:28:31.686 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T12:28:31.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b38064ee0 msgr2=0x7f2b38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:31.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b38064ee0 0x7f2b38067390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c063810 tx=0x7f2b40008030 comp rx=0 tx=0).stop 2023-11-08T12:28:31.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4c0ada50 msgr2=0x7f2b4c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:31.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4c0ada50 0x7f2b4c0b2480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c011730 tx=0x7f2b3c011af0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 shutdown_connections 2023-11-08T12:28:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b38064ee0 0x7f2b38067390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b4c0c5d60 0x7f2b4c0c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4c155910 0x7f2b4c0c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 --2- 172.21.15.112:0/2866012858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b4c0ada50 0x7f2b4c0b2480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 >> 172.21.15.112:0/2866012858 conn(0x7f2b4c0b0f80 msgr2=0x7f2b4c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.684+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 shutdown_connections 2023-11-08T12:28:31.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:31.688+0000 7f2b515dc700 1 -- 172.21.15.112:0/2866012858 wait complete. 2023-11-08T12:28:31.710 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T12:28:31.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:28:31.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-11-08T12:28:31.711 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T12:28:31.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T12:28:31.712 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T12:28:31.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T12:28:31.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:28:31.713 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:28:31.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:31.713 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-11-08T12:28:31.731 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:31.731 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:31.731 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:31.731 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:31.732 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:31.732 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:31.732 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:31.732 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:31.732 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-11-08T12:28:31.733 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-11-08T12:28:31.733 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:31.733 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:31.734 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:28:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:28:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42319sec preferred_lft 42319sec 2023-11-08T12:28:31.734 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-11-08T12:28:31.735 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:31.735 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:28:31.735 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:61:4e:41:39 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:31.735 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:28:31.735 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:31.736 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-08T12:28:31.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:31.737 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:31.737 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:31.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2023-11-08T12:28:31.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2023-11-08T12:28:31.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2023-11-08T12:28:31.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-08T12:28:31.739 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:31.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:31.895 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:28:31.928 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-11-08T12:28:31.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:31.934 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-11-08T12:28:32.002 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-11-08T12:28:32.003 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:28:32.003 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:28:32.003 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:28:32.003 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:28:32.003 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:28:32.004 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:28:32.004 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:28:32.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.005 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:32.005 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:32.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:28:32.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:28:32.006 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:28:32.006 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:32.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.142 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:28:32.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.161 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-11-08T12:28:32.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.225 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:32.225 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:32.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T12:28:32.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-08T12:28:32.226 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:32.343 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-08T12:28:32.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.344 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:32.344 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:32.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-08T12:28:32.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-08T12:28:32.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-08T12:28:32.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-08T12:28:32.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-08T12:28:32.346 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:32.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.492 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:32.492 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:32.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-11-08T12:28:32.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2023-11-08T12:28:32.493 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:32.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:32.563 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T12:28:32.579 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:28:32.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:32.579 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:28:32.639 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-08T12:28:32.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:32.770 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:32.770 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:32.920 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:32.920 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:32.920 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-11-08T12:28:32.921 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@c14663df-4425-4498-9232-3ffa5f578bfa.cephfs=/ 2023-11-08T12:28:32.921 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-11-08T12:28:32.930 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T12:28:32.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.930 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:28:32.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:32.960 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:33.032 INFO:teuthology.orchestra.run.smithi112.stdout:client4774 2023-11-08T12:28:33.032 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:33.032 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:33.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:33.096 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:33.166 INFO:teuthology.orchestra.run.smithi112.stdout:client4774 2023-11-08T12:28:33.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:33.167 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:33.235 INFO:teuthology.orchestra.run.smithi112.stdout:client4774 2023-11-08T12:28:33.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:33.236 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c14663df-4425-4498-9232-3ffa5f578bfa.client4774/status') 2023-11-08T12:28:33.318 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4774 (3)172.21.15.112:0/4092593108 2023-11-08T12:28:33.318 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2023-11-08T12:28:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2023-11-08T12:28:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2023-11-08T12:28:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:71 bytes copied, 0.000135785 s, 523 kB/s 2023-11-08T12:28:33.321 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-11-08T12:28:33.322 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T12:28:33.322 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-08T12:28:33.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:28:33.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.540+0000 7f4006bba700 1 Processor -- start 2023-11-08T12:28:33.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.540+0000 7f4006bba700 1 -- start start 2023-11-08T12:28:33.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4006bba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f400015a210 0x7f40000cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:33.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4006bba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f4000069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:33.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4006bba700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f40000ae6e0 0x7f400006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:33.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4006bba700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000aef40 con 0x7f40000ae6e0 2023-11-08T12:28:33.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4006bba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000ca2b0 con 0x7f400015a210 2023-11-08T12:28:33.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4006bba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400006c240 con 0x7f40000cbcb0 2023-11-08T12:28:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f40000ae6e0 0x7f400006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f40000ae6e0 0x7f400006a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56854/0 (socket says 172.21.15.112:56854) 2023-11-08T12:28:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 -- 172.21.15.112:0/3950390500 learned_addr learned my addr 172.21.15.112:0/3950390500 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:33.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f3ffffff700 1 --2- 172.21.15.112:0/3950390500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f4000069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4004956700 1 --2- 172.21.15.112:0/3950390500 >> v2:172.21.15.133:3300/0 conn(0x7f400015a210 0x7f40000cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 -- 172.21.15.112:0/3950390500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 msgr2=0x7f4000069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 --2- 172.21.15.112:0/3950390500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f4000069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 -- 172.21.15.112:0/3950390500 >> v2:172.21.15.133:3300/0 conn(0x7f400015a210 msgr2=0x7f40000cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:33.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 --2- 172.21.15.112:0/3950390500 >> v2:172.21.15.133:3300/0 conn(0x7f400015a210 0x7f40000cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 -- 172.21.15.112:0/3950390500 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400006c520 con 0x7f40000ae6e0 2023-11-08T12:28:33.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f4005157700 1 --2- 172.21.15.112:0/3950390500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40000ae6e0 0x7f400006a340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f400006db60 tx=0x7f3ff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52843778829c0d92 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:33.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f3fff7fe700 1 -- 172.21.15.112:0/3950390500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800e070 con 0x7f40000ae6e0 2023-11-08T12:28:33.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f3fff7fe700 1 -- 172.21.15.112:0/3950390500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800b9c0 con 0x7f40000ae6e0 2023-11-08T12:28:33.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.544+0000 7f3fff7fe700 1 -- 172.21.15.112:0/3950390500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800bd70 con 0x7f40000ae6e0 2023-11-08T12:28:33.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 -- 172.21.15.112:0/3950390500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40000ae6e0 msgr2=0x7f400006a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:33.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 --2- 172.21.15.112:0/3950390500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40000ae6e0 0x7f400006a340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f400006db60 tx=0x7f3ff800b330 comp rx=0 tx=0).stop 2023-11-08T12:28:33.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 -- 172.21.15.112:0/3950390500 shutdown_connections 2023-11-08T12:28:33.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 --2- 172.21.15.112:0/3950390500 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f4000069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 --2- 172.21.15.112:0/3950390500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40000ae6e0 0x7f400006a340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 --2- 172.21.15.112:0/3950390500 >> v2:172.21.15.133:3300/0 conn(0x7f400015a210 0x7f40000cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 -- 172.21.15.112:0/3950390500 >> 172.21.15.112:0/3950390500 conn(0x7f40000cc290 msgr2=0x7f40000cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:33.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 -- 172.21.15.112:0/3950390500 shutdown_connections 2023-11-08T12:28:33.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 -- 172.21.15.112:0/3950390500 wait complete. 2023-11-08T12:28:33.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 Processor -- start 2023-11-08T12:28:33.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.548+0000 7f4006bba700 1 -- start start 2023-11-08T12:28:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40000ae6e0 0x7f40001f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f400015c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f400015a210 0x7f4000157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400015b450 con 0x7f400015a210 2023-11-08T12:28:33.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40001f2e70 con 0x7f40000ae6e0 2023-11-08T12:28:33.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40001f33f0 con 0x7f40000cbcb0 2023-11-08T12:28:33.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f400015a210 0x7f4000157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:33.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f3ffffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f400015c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:33.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f400015a210 0x7f4000157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56868/0 (socket says 172.21.15.112:56868) 2023-11-08T12:28:33.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4004956700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40000ae6e0 0x7f40001f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:33.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 -- 172.21.15.112:0/509039233 learned_addr learned my addr 172.21.15.112:0/509039233 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:33.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 -- 172.21.15.112:0/509039233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 msgr2=0x7f400015c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:33.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f400015c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 -- 172.21.15.112:0/509039233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40000ae6e0 msgr2=0x7f40001f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40000ae6e0 0x7f40001f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 -- 172.21.15.112:0/509039233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009b30 con 0x7f400015a210 2023-11-08T12:28:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f3ffffff700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f400015c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4005157700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f400015a210 0x7f4000157710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4000070f30 tx=0x7f3ff8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:33.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f3ffd7fa700 1 -- 172.21.15.112:0/509039233 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80099b0 con 0x7f400015a210 2023-11-08T12:28:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f3ffd7fa700 1 -- 172.21.15.112:0/509039233 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8004250 con 0x7f400015a210 2023-11-08T12:28:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f3ffd7fa700 1 -- 172.21.15.112:0/509039233 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8004600 con 0x7f400015a210 2023-11-08T12:28:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000ca830 con 0x7f400015a210 2023-11-08T12:28:33.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.552+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40000ca550 con 0x7f400015a210 2023-11-08T12:28:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.556+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400006bef0 con 0x7f400015a210 2023-11-08T12:28:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.556+0000 7f3ffd7fa700 1 -- 172.21.15.112:0/509039233 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3ff802b070 con 0x7f400015a210 2023-11-08T12:28:33.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.556+0000 7f3ffd7fa700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fe4064ee0 0x7f3fe4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:33.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.556+0000 7f3ffd7fa700 1 -- 172.21.15.112:0/509039233 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ff8083250 con 0x7f400015a210 2023-11-08T12:28:33.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.560+0000 7f4004956700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fe4064ee0 0x7f3fe4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:33.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.560+0000 7f4004956700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fe4064ee0 0x7f3fe4067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009a00 tx=0x7f3ff4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:33.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.564+0000 7f3ffd7fa700 1 -- 172.21.15.112:0/509039233 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3ff8050f90 con 0x7f400015a210 2023-11-08T12:28:33.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.776+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40001f3560 con 0x7f400015a210 2023-11-08T12:28:33.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f3ffd7fa700 1 -- 172.21.15.112:0/509039233 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3ff80545b0 con 0x7f400015a210 2023-11-08T12:28:33.782 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T12:28:33.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fe4064ee0 msgr2=0x7f3fe4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fe4064ee0 0x7f3fe4067390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009a00 tx=0x7f3ff4008040 comp rx=0 tx=0).stop 2023-11-08T12:28:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f400015a210 msgr2=0x7f4000157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f400015a210 0x7f4000157710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4000070f30 tx=0x7f3ff8004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 shutdown_connections 2023-11-08T12:28:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3fe4064ee0 0x7f3fe4067390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f400015a210 0x7f4000157710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40000cbcb0 0x7f400015c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 --2- 172.21.15.112:0/509039233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40000ae6e0 0x7f40001f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 >> 172.21.15.112:0/509039233 conn(0x7f40000cc290 msgr2=0x7f4000069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:33.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 shutdown_connections 2023-11-08T12:28:33.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:33.780+0000 7f4006bba700 1 -- 172.21.15.112:0/509039233 wait complete. 2023-11-08T12:28:33.955 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T12:28:33.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:28:33.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-11-08T12:28:33.957 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-08T12:28:33.957 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-08T12:28:33.957 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T12:28:33.958 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T12:28:33.958 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:28:33.959 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-08T12:28:33.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:33.960 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-11-08T12:28:33.980 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:33.982 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-11-08T12:28:33.982 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-11-08T12:28:33.983 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:33.983 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:28:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:28:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42317sec preferred_lft 42317sec 2023-11-08T12:28:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-11-08T12:28:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:33.985 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:28:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:61:4e:41:39 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:28:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:33.986 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:28:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2e:62:07:0d:fa:29 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T12:28:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::e41f:52ff:fe23:f36d/64 scope link 2023-11-08T12:28:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:33.988 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:28:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2e:62:07:0d:fa:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T12:28:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2c62:7ff:fe0d:fa29/64 scope link tentative 2023-11-08T12:28:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:33.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:33.989 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:28:34.068 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-11-08T12:28:34.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.072 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-11-08T12:28:34.134 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-11-08T12:28:34.134 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:28:34.134 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:28:34.135 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:28:34.135 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:28:34.135 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:28:34.135 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:28:34.135 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:28:34.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.137 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:34.137 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:34.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:28:34.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:28:34.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:28:34.138 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:34.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.274 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:28:34.291 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T12:28:34.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.293 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2023-11-08T12:28:34.350 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-08T12:28:34.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.352 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:34.352 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:34.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T12:28:34.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-08T12:28:34.353 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:34.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-08T12:28:34.516 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:34.516 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:34.516 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:34.516 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.517 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:34.517 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.518 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:28:34.519 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 8e:36:0a:49:25:ff brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T12:28:34.519 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T12:28:34.519 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.520 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c36:aff:fe49:25ff/64 scope link 2023-11-08T12:28:34.520 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.522 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-08T12:28:34.602 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:34.603 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:34.603 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:34.603 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.603 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:34.604 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.604 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:28:34.604 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 8e:36:0a:49:25:ff brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T12:28:34.604 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T12:28:34.604 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.605 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::8c36:aff:fe49:25ff/64 scope link 2023-11-08T12:28:34.605 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:34.607 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-08T12:28:34.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.607 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:34.608 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:34.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-08T12:28:34.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-08T12:28:34.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-08T12:28:34.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-08T12:28:34.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-08T12:28:34.609 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:34.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.797 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:28:34.797 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:28:34.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2023-11-08T12:28:34.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2023-11-08T12:28:34.798 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:28:34.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:34.874 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-08T12:28:34.893 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-08T12:28:34.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:34.894 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-08T12:28:34.957 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-11-08T12:28:34.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:34.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:35.100 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:35.101 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:35.134 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:35.134 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:35.134 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-11-08T12:28:35.135 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 2@c14663df-4425-4498-9232-3ffa5f578bfa.cephfs=/ 2023-11-08T12:28:35.135 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.112:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-11-08T12:28:35.143 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T12:28:35.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:35.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-08T12:28:35.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:35.177 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:35.238 INFO:teuthology.orchestra.run.smithi112.stdout:client4783 2023-11-08T12:28:35.239 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:35.239 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:35.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:35.301 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:35.370 INFO:teuthology.orchestra.run.smithi112.stdout:client4783 2023-11-08T12:28:35.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:35.371 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:35.443 INFO:teuthology.orchestra.run.smithi112.stdout:client4783 2023-11-08T12:28:35.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:35.444 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c14663df-4425-4498-9232-3ffa5f578bfa.client4783/status') 2023-11-08T12:28:35.526 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4783 (3)172.21.15.112:0/227482029 2023-11-08T12:28:35.527 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2023-11-08T12:28:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2023-11-08T12:28:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2023-11-08T12:28:35.528 INFO:teuthology.orchestra.run.smithi112.stderr:70 bytes copied, 0.000156347 s, 448 kB/s 2023-11-08T12:28:35.530 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-11-08T12:28:35.531 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T12:28:35.531 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-08T12:28:35.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:28:35.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.756+0000 7f7cd1db7700 1 Processor -- start 2023-11-08T12:28:35.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.756+0000 7f7cd1db7700 1 -- start start 2023-11-08T12:28:35.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.756+0000 7f7cd1db7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:35.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.756+0000 7f7cd1db7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ccc0ce370 0x7f7ccc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.756+0000 7f7cd1db7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc0cb9c0 con 0x7f7ccc0cd950 2023-11-08T12:28:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.756+0000 7f7cd1db7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ccc0ced30 con 0x7f7ccc0ce370 2023-11-08T12:28:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.756+0000 7f7cd1db7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc0cadf0 con 0x7f7ccc0b1b30 2023-11-08T12:28:35.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cc3fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7ccc0cd950 0x7f7ccc0b35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55268/0 (socket says 172.21.15.112:55268) 2023-11-08T12:28:35.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cc3fff700 1 -- 172.21.15.112:0/3253441906 learned_addr learned my addr 172.21.15.112:0/3253441906 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:35.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd15b6700 1 --2- 172.21.15.112:0/3253441906 >> v2:172.21.15.133:3300/0 conn(0x7f7ccc0ce370 0x7f7ccc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:35.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd0db5700 1 --2- 172.21.15.112:0/3253441906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:35.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cc37fe700 1 -- 172.21.15.112:0/3253441906 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681565098 0 0) 0x7f7ccc0cb9c0 con 0x7f7ccc0cd950 2023-11-08T12:28:35.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cc37fe700 1 -- 172.21.15.112:0/3253441906 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb40035d0 con 0x7f7ccc0cd950 2023-11-08T12:28:35.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd0db5700 1 -- 172.21.15.112:0/3253441906 >> v2:172.21.15.133:3300/0 conn(0x7f7ccc0ce370 msgr2=0x7f7ccc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:35.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd0db5700 1 --2- 172.21.15.112:0/3253441906 >> v2:172.21.15.133:3300/0 conn(0x7f7ccc0ce370 0x7f7ccc0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:35.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd0db5700 1 -- 172.21.15.112:0/3253441906 >> v1:172.21.15.112:6789/0 conn(0x7f7ccc0cd950 legacy=0x7f7ccc0b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:35.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd0db5700 1 -- 172.21.15.112:0/3253441906 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0cb090 con 0x7f7ccc0b1b30 2023-11-08T12:28:35.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd15b6700 1 --2- 172.21.15.112:0/3253441906 >> v2:172.21.15.133:3300/0 conn(0x7f7ccc0ce370 0x7f7ccc0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:35.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd0db5700 1 --2- 172.21.15.112:0/3253441906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc0cca20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009870 tx=0x7f7cc8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b4b9a2d93cc867 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:35.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cc37fe700 1 -- 172.21.15.112:0/3253441906 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8005e50 con 0x7f7ccc0b1b30 2023-11-08T12:28:35.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cc37fe700 1 -- 172.21.15.112:0/3253441906 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8006030 con 0x7f7ccc0b1b30 2023-11-08T12:28:35.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cc37fe700 1 -- 172.21.15.112:0/3253441906 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80063c0 con 0x7f7ccc0b1b30 2023-11-08T12:28:35.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.760+0000 7f7cd1db7700 1 -- 172.21.15.112:0/3253441906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 msgr2=0x7f7ccc0cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:35.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/3253441906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc0cca20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009870 tx=0x7f7cc8009b80 comp rx=0 tx=0).stop 2023-11-08T12:28:35.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 -- 172.21.15.112:0/3253441906 shutdown_connections 2023-11-08T12:28:35.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/3253441906 >> v2:172.21.15.133:3300/0 conn(0x7f7ccc0ce370 0x7f7ccc0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:35.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/3253441906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc0cca20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:35.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 -- 172.21.15.112:0/3253441906 >> 172.21.15.112:0/3253441906 conn(0x7f7ccc099af0 msgr2=0x7f7ccc0d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:35.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 -- 172.21.15.112:0/3253441906 shutdown_connections 2023-11-08T12:28:35.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 -- 172.21.15.112:0/3253441906 wait complete. 2023-11-08T12:28:35.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.764+0000 7f7cd1db7700 1 Processor -- start 2023-11-08T12:28:35.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd1db7700 1 -- start start 2023-11-08T12:28:35.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd1db7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:35.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd1db7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ccc0cd950 0x7f7ccc1f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:35.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd1db7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ccc0ce370 0x7f7ccc158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:35.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd1db7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc157d70 con 0x7f7ccc0ce370 2023-11-08T12:28:35.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd1db7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc1f2d60 con 0x7f7ccc0cd950 2023-11-08T12:28:35.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd1db7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc157160 con 0x7f7ccc0b1b30 2023-11-08T12:28:35.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ccc0ce370 0x7f7ccc158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:35.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ccc0ce370 0x7f7ccc158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36012/0 (socket says 172.21.15.112:36012) 2023-11-08T12:28:35.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 -- 172.21.15.112:0/1199775807 learned_addr learned my addr 172.21.15.112:0/1199775807 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:35.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cc3fff700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ccc0cd950 0x7f7ccc1f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:35.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd0db5700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:35.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 -- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 msgr2=0x7f7ccc14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:35.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:35.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 -- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ccc0cd950 msgr2=0x7f7ccc1f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:35.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ccc0cd950 0x7f7ccc1f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:35.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.768+0000 7f7cd15b6700 1 -- 172.21.15.112:0/1199775807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4009a70 con 0x7f7ccc0ce370 2023-11-08T12:28:35.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.772+0000 7f7cd15b6700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ccc0ce370 0x7f7ccc158200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400efc0 tx=0x7f7cc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:35.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.772+0000 7f7cc17fa700 1 -- 172.21.15.112:0/1199775807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc400ca90 con 0x7f7ccc0ce370 2023-11-08T12:28:35.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.772+0000 7f7cc17fa700 1 -- 172.21.15.112:0/1199775807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc400f040 con 0x7f7ccc0ce370 2023-11-08T12:28:35.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.772+0000 7f7cc17fa700 1 -- 172.21.15.112:0/1199775807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc400ce10 con 0x7f7ccc0ce370 2023-11-08T12:28:35.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.772+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8009450 con 0x7f7ccc0ce370 2023-11-08T12:28:35.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.772+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc0cb650 con 0x7f7ccc0ce370 2023-11-08T12:28:35.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.772+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ccc0cb370 con 0x7f7ccc0ce370 2023-11-08T12:28:35.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.776+0000 7f7cc17fa700 1 -- 172.21.15.112:0/1199775807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7cc4014480 con 0x7f7ccc0ce370 2023-11-08T12:28:35.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.776+0000 7f7cc17fa700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7cb8064f10 0x7f7cb80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:35.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.776+0000 7f7cc17fa700 1 -- 172.21.15.112:0/1199775807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7cc4082970 con 0x7f7ccc0ce370 2023-11-08T12:28:35.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.776+0000 7f7cd0db5700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7cb8064f10 0x7f7cb80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:35.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.776+0000 7f7cd0db5700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7cb8064f10 0x7f7cb80673c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009bc0 tx=0x7f7cc8008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:35.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.780+0000 7f7cc17fa700 1 -- 172.21.15.112:0/1199775807 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7cc4050780 con 0x7f7ccc0ce370 2023-11-08T12:28:35.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.992+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ccc0b3d00 con 0x7f7ccc0ce370 2023-11-08T12:28:35.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.992+0000 7f7cc17fa700 1 -- 172.21.15.112:0/1199775807 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7cc4009d70 con 0x7f7ccc0ce370 2023-11-08T12:28:35.997 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T12:28:36.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.996+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7cb8064f10 msgr2=0x7f7cb80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:36.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.996+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7cb8064f10 0x7f7cb80673c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009bc0 tx=0x7f7cc8008070 comp rx=0 tx=0).stop 2023-11-08T12:28:36.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.996+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ccc0ce370 msgr2=0x7f7ccc158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:36.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:35.996+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ccc0ce370 0x7f7ccc158200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400efc0 tx=0x7f7cc400c3a0 comp rx=0 tx=0).stop 2023-11-08T12:28:36.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 shutdown_connections 2023-11-08T12:28:36.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7cb8064f10 0x7f7cb80673c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:36.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ccc0ce370 0x7f7ccc158200 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:36.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ccc0cd950 0x7f7ccc1f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:36.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 --2- 172.21.15.112:0/1199775807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ccc0b1b30 0x7f7ccc14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:36.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 >> 172.21.15.112:0/1199775807 conn(0x7f7ccc099af0 msgr2=0x7f7ccc0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:36.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 shutdown_connections 2023-11-08T12:28:36.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:36.000+0000 7f7cd1db7700 1 -- 172.21.15.112:0/1199775807 wait complete. 2023-11-08T12:28:36.023 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T12:28:36.024 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:28:36.024 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-11-08T12:28:36.024 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-08T12:28:36.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-08T12:28:36.025 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T12:28:36.025 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T12:28:36.025 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:28:36.025 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-08T12:28:36.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.026 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-11-08T12:28:36.041 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:36.041 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:36.042 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:36.042 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:36.042 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:36.042 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:36.042 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:36.043 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:36.043 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-11-08T12:28:36.043 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:36.043 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:36.043 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-11-08T12:28:36.044 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:36.044 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:36.044 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:28:36.044 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:36.044 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:28:36.045 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42309sec preferred_lft 42309sec 2023-11-08T12:28:36.045 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-11-08T12:28:36.045 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:36.045 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:28:36.045 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:1e:69:41:dc brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:36.046 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:28:36.046 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:36.047 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-08T12:28:36.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.047 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:36.048 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:36.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2023-11-08T12:28:36.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2023-11-08T12:28:36.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2023-11-08T12:28:36.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-08T12:28:36.049 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:36.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.201 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:28:36.230 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-11-08T12:28:36.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.234 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-11-08T12:28:36.317 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-11-08T12:28:36.317 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:28:36.317 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:28:36.317 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:28:36.318 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:28:36.318 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:28:36.318 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:28:36.318 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:28:36.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.320 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:36.320 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:36.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:28:36.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:28:36.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:28:36.321 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:36.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.442 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-11-08T12:28:36.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.460 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-11-08T12:28:36.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.525 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:36.525 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:36.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-08T12:28:36.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-08T12:28:36.526 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:36.653 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-08T12:28:36.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.654 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:36.655 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:36.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-08T12:28:36.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-08T12:28:36.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-08T12:28:36.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-08T12:28:36.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-08T12:28:36.657 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:36.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.830 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:36.831 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:36.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-11-08T12:28:36.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2023-11-08T12:28:36.831 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:36.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:36.904 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-08T12:28:36.919 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-08T12:28:36.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:36.920 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-08T12:28:36.978 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-08T12:28:36.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:36.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:37.108 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:37.109 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:37.255 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:37.255 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:37.255 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-11-08T12:28:37.255 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 1@c14663df-4425-4498-9232-3ffa5f578bfa.cephfs=/ 2023-11-08T12:28:37.256 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.112:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-11-08T12:28:37.261 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T12:28:37.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:37.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-08T12:28:37.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:37.294 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:37.377 INFO:teuthology.orchestra.run.smithi133.stdout:client4851 2023-11-08T12:28:37.377 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:28:37.378 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:37.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:28:37.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:28:37.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:37.438 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:37.500 INFO:teuthology.orchestra.run.smithi133.stdout:client4851 2023-11-08T12:28:37.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:37.501 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:37.569 INFO:teuthology.orchestra.run.smithi133.stdout:client4851 2023-11-08T12:28:37.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:37.570 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c14663df-4425-4498-9232-3ffa5f578bfa.client4851/status') 2023-11-08T12:28:37.652 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.4851 (3)172.21.15.133:0/2863058094 2023-11-08T12:28:37.653 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2023-11-08T12:28:37.653 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2023-11-08T12:28:37.654 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2023-11-08T12:28:37.654 INFO:teuthology.orchestra.run.smithi133.stderr:71 bytes copied, 0.00015403 s, 461 kB/s 2023-11-08T12:28:37.655 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-11-08T12:28:37.656 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-08T12:28:37.656 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-08T12:28:37.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:28:37.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc198d70700 1 Processor -- start 2023-11-08T12:28:37.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc198d70700 1 -- start start 2023-11-08T12:28:37.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc198d70700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc19415c640 0x7fc1940d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:37.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc198d70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc194069e00 0x7fc19406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:37.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc198d70700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19406c600 con 0x7fc194071aa0 2023-11-08T12:28:37.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc198d70700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19406cef0 con 0x7fc19415c640 2023-11-08T12:28:37.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc198d70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19406a7c0 con 0x7fc194069e00 2023-11-08T12:28:37.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc1937fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc19415c640 0x7fc1940d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:37.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc1937fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc19415c640 0x7fc1940d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36022/0 (socket says 172.21.15.112:36022) 2023-11-08T12:28:37.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.836+0000 7fc1937fe700 1 -- 172.21.15.112:0/3185072131 learned_addr learned my addr 172.21.15.112:0/3185072131 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:37.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc193fff700 1 --2- 172.21.15.112:0/3185072131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc194069e00 0x7fc19406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:37.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc1937fe700 1 -- 172.21.15.112:0/3185072131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc194069e00 msgr2=0x7fc19406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:37.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc1937fe700 1 --2- 172.21.15.112:0/3185072131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc194069e00 0x7fc19406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:37.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc1937fe700 1 -- 172.21.15.112:0/3185072131 >> v1:172.21.15.133:6789/0 conn(0x7fc194071aa0 legacy=0x7fc19406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:37.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc1937fe700 1 -- 172.21.15.112:0/3185072131 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1940722f0 con 0x7fc19415c640 2023-11-08T12:28:37.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc1937fe700 1 --2- 172.21.15.112:0/3185072131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc19415c640 0x7fc1940d31e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc184009e50 tx=0x7fc18400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bebd374ff7750b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:37.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc192ffd700 1 -- 172.21.15.112:0/3185072131 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18400e070 con 0x7fc19415c640 2023-11-08T12:28:37.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc192ffd700 1 -- 172.21.15.112:0/3185072131 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18400b9c0 con 0x7fc19415c640 2023-11-08T12:28:37.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc192ffd700 1 -- 172.21.15.112:0/3185072131 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18400bd70 con 0x7fc19415c640 2023-11-08T12:28:37.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 -- 172.21.15.112:0/3185072131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc19415c640 msgr2=0x7fc1940d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:37.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 --2- 172.21.15.112:0/3185072131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc19415c640 0x7fc1940d31e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc184009e50 tx=0x7fc18400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:37.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 -- 172.21.15.112:0/3185072131 shutdown_connections 2023-11-08T12:28:37.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 --2- 172.21.15.112:0/3185072131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc194069e00 0x7fc19406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:37.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 --2- 172.21.15.112:0/3185072131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc19415c640 0x7fc1940d31e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:37.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 -- 172.21.15.112:0/3185072131 >> 172.21.15.112:0/3185072131 conn(0x7fc1940b6520 msgr2=0x7fc194071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:37.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 -- 172.21.15.112:0/3185072131 shutdown_connections 2023-11-08T12:28:37.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.840+0000 7fc198d70700 1 -- 172.21.15.112:0/3185072131 wait complete. 2023-11-08T12:28:37.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.844+0000 7fc198d70700 1 Processor -- start 2023-11-08T12:28:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.844+0000 7fc198d70700 1 -- start start 2023-11-08T12:28:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194069e00 0x7fc1941f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc194071aa0 0x7fc1940cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:37.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc19415c640 0x7fc1940c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940cca10 con 0x7fc194069e00 2023-11-08T12:28:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940ca630 con 0x7fc194071aa0 2023-11-08T12:28:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940ca910 con 0x7fc19415c640 2023-11-08T12:28:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194069e00 0x7fc1941f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194069e00 0x7fc1941f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36030/0 (socket says 172.21.15.112:36030) 2023-11-08T12:28:37.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 -- 172.21.15.112:0/1056261552 learned_addr learned my addr 172.21.15.112:0/1056261552 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc18affd700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc194071aa0 0x7fc1940cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc193fff700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc19415c640 0x7fc1940c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 -- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc19415c640 msgr2=0x7fc1940c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:37.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc19415c640 0x7fc1940c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 -- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc194071aa0 msgr2=0x7fc1940cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc194071aa0 0x7fc1940cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 -- 172.21.15.112:0/1056261552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184009b30 con 0x7fc194069e00 2023-11-08T12:28:37.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc193fff700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc19415c640 0x7fc1940c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:37.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc1937fe700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194069e00 0x7fc1941f1630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b370 tx=0x7fc184004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:37.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc190ff9700 1 -- 172.21.15.112:0/1056261552 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184004250 con 0x7fc194069e00 2023-11-08T12:28:37.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc190ff9700 1 -- 172.21.15.112:0/1056261552 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1840043d0 con 0x7fc194069e00 2023-11-08T12:28:37.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19415ca10 con 0x7fc194069e00 2023-11-08T12:28:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc190ff9700 1 -- 172.21.15.112:0/1056261552 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184004780 con 0x7fc194069e00 2023-11-08T12:28:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.848+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19406da20 con 0x7fc194069e00 2023-11-08T12:28:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.852+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc194072010 con 0x7fc194069e00 2023-11-08T12:28:37.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.852+0000 7fc190ff9700 1 -- 172.21.15.112:0/1056261552 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc18401b430 con 0x7fc194069e00 2023-11-08T12:28:37.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.856+0000 7fc190ff9700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc174064ee0 0x7fc174067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:37.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.856+0000 7fc190ff9700 1 -- 172.21.15.112:0/1056261552 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc184083700 con 0x7fc194069e00 2023-11-08T12:28:37.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.856+0000 7fc18affd700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc174064ee0 0x7fc174067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:37.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.856+0000 7fc18affd700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc174064ee0 0x7fc174067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1940c6440 tx=0x7fc17c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:37.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:37.860+0000 7fc190ff9700 1 -- 172.21.15.112:0/1056261552 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc1840513a0 con 0x7fc194069e00 2023-11-08T12:28:38.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.068+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1940ca770 con 0x7fc194069e00 2023-11-08T12:28:38.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.068+0000 7fc190ff9700 1 -- 172.21.15.112:0/1056261552 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc18401f070 con 0x7fc194069e00 2023-11-08T12:28:38.074 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-08T12:28:38.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc174064ee0 msgr2=0x7fc174067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:38.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc174064ee0 0x7fc174067390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1940c6440 tx=0x7fc17c009040 comp rx=0 tx=0).stop 2023-11-08T12:28:38.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194069e00 msgr2=0x7fc1941f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:38.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194069e00 0x7fc1941f1630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b370 tx=0x7fc184004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:38.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 shutdown_connections 2023-11-08T12:28:38.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc174064ee0 0x7fc174067390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:38.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc19415c640 0x7fc1940c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:38.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc194071aa0 0x7fc1940cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:38.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 --2- 172.21.15.112:0/1056261552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc194069e00 0x7fc1941f1630 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:38.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 >> 172.21.15.112:0/1056261552 conn(0x7fc1940b6520 msgr2=0x7fc1940b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:38.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 shutdown_connections 2023-11-08T12:28:38.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:38.072+0000 7fc198d70700 1 -- 172.21.15.112:0/1056261552 wait complete. 2023-11-08T12:28:38.099 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-08T12:28:38.100 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:28:38.100 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-11-08T12:28:38.100 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-08T12:28:38.100 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-08T12:28:38.101 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-08T12:28:38.101 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-08T12:28:38.101 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:28:38.101 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-08T12:28:38.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.102 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-11-08T12:28:38.123 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:38.123 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:38.123 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:38.123 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.124 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:38.124 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.124 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:38.124 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:38.124 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-11-08T12:28:38.125 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:38.125 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:38.125 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-11-08T12:28:38.125 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:28:38.125 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:38.126 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:28:38.126 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:38.126 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:28:38.126 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42307sec preferred_lft 42307sec 2023-11-08T12:28:38.126 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-11-08T12:28:38.127 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.127 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:28:38.127 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:1e:69:41:dc brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:38.127 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:28:38.127 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.128 INFO:teuthology.orchestra.run.smithi133.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:28:38.128 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 3a:23:a0:4c:9c:86 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:28:38.128 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T12:28:38.128 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.128 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e4c2:15ff:fea7:7c2f/64 scope link 2023-11-08T12:28:38.129 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.129 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:28:38.129 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 3a:23:a0:4c:9c:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-08T12:28:38.129 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::3823:a0ff:fe4c:9c86/64 scope link tentative 2023-11-08T12:28:38.129 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.131 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:28:38.208 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-11-08T12:28:38.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.211 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-11-08T12:28:38.279 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-11-08T12:28:38.279 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:28:38.279 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:28:38.280 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:28:38.280 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:28:38.280 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:28:38.280 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:28:38.280 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:28:38.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.282 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:38.282 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:38.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:28:38.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:28:38.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:28:38.283 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:38.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.415 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-11-08T12:28:38.432 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-08T12:28:38.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.433 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-11-08T12:28:38.495 INFO:teuthology.orchestra.run.smithi133.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-08T12:28:38.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.497 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:38.497 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:38.498 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-08T12:28:38.498 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-08T12:28:38.498 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:38.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.612 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-08T12:28:38.647 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:38.648 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:38.648 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:38.648 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.648 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:38.649 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.649 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:28:38.649 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:15:a8:d6:26:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T12:28:38.649 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T12:28:38.649 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.650 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c415:a8ff:fed6:26eb/64 scope link 2023-11-08T12:28:38.650 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.652 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-08T12:28:38.731 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:28:38.732 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:28:38.732 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:28:38.732 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.732 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-11-08T12:28:38.733 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.733 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:28:38.733 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:15:a8:d6:26:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-08T12:28:38.734 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-08T12:28:38.734 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.734 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c415:a8ff:fed6:26eb/64 scope link 2023-11-08T12:28:38.734 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:28:38.735 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-08T12:28:38.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.736 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:38.736 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:38.737 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-08T12:28:38.737 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-08T12:28:38.737 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-08T12:28:38.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-08T12:28:38.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-08T12:28:38.739 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:38.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:38.919 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-11-08T12:28:38.919 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-11-08T12:28:38.920 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.1 up 2023-11-08T12:28:38.920 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.1 master ceph-brx 2023-11-08T12:28:38.920 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-11-08T12:28:39.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:39.001 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-08T12:28:39.035 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-08T12:28:39.036 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:28:39.037 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-08T12:28:39.101 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-11-08T12:28:39.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:39.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:39.240 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:39.240 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:39.266 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:28:39.266 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:28:39.266 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-11-08T12:28:39.267 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 3@c14663df-4425-4498-9232-3ffa5f578bfa.cephfs=/ 2023-11-08T12:28:39.267 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.112:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-11-08T12:28:39.272 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T12:28:39.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:39.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-08T12:28:39.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:39.306 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:39.376 INFO:teuthology.orchestra.run.smithi133.stdout:client4798 2023-11-08T12:28:39.376 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:28:39.377 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:39.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:39.439 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:39.510 INFO:teuthology.orchestra.run.smithi133.stdout:client4798 2023-11-08T12:28:39.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:39.511 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:28:39.581 INFO:teuthology.orchestra.run.smithi133.stdout:client4798 2023-11-08T12:28:39.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:39.582 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c14663df-4425-4498-9232-3ffa5f578bfa.client4798/status') 2023-11-08T12:28:39.666 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.4798 (3)192.168.0.2:0/1151261568 2023-11-08T12:28:39.666 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2023-11-08T12:28:39.667 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2023-11-08T12:28:39.667 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2023-11-08T12:28:39.667 INFO:teuthology.orchestra.run.smithi133.stderr:69 bytes copied, 0.000109928 s, 628 kB/s 2023-11-08T12:28:39.669 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-08T12:28:39.688 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:39.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d64bc700 1 Processor -- start 2023-11-08T12:28:39.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d64bc700 1 -- start start 2023-11-08T12:28:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d64bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7d0160710 0x7fe7d00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d64bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 0x7fe7d0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d64bc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d00ad6c0 con 0x7fe7d00705c0 2023-11-08T12:28:39.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d64bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d0070a60 con 0x7fe7d0160710 2023-11-08T12:28:39.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d64bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d006b1c0 con 0x7fe7d00cc860 2023-11-08T12:28:39.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d5cbb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe7d00705c0 0x7fe7d0069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55284/0 (socket says 172.21.15.112:55284) 2023-11-08T12:28:39.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/326265383 learned_addr learned my addr 172.21.15.112:0/326265383 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:39.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d4cb9700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 0x7fe7d0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505687976 0 0) 0x7fe7d00ad6c0 con 0x7fe7d00705c0 2023-11-08T12:28:39.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7bc0035d0 con 0x7fe7d00705c0 2023-11-08T12:28:39.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.868+0000 7fe7d54ba700 1 --2- 172.21.15.112:0/326265383 >> v2:172.21.15.133:3300/0 conn(0x7fe7d0160710 0x7fe7d00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086153953 0 0) 0x7fe7bc0035d0 con 0x7fe7d00705c0 2023-11-08T12:28:39.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 msgr2=0x7fe7d0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:39.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 0x7fe7d0070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:39.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 >> v2:172.21.15.133:3300/0 conn(0x7fe7d0160710 msgr2=0x7fe7d00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:39.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 --2- 172.21.15.112:0/326265383 >> v2:172.21.15.133:3300/0 conn(0x7fe7d0160710 0x7fe7d00cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:39.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00adc60 con 0x7fe7d00705c0 2023-11-08T12:28:39.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fe7c80019f0 con 0x7fe7d00705c0 2023-11-08T12:28:39.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 >> v1:172.21.15.112:6789/0 conn(0x7fe7d00705c0 legacy=0x7fe7d0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:39.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc003a20 0x7fe7bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 0x7fe7bc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7bc004db0 0x7fe7bc005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d006b1c0 con 0x7fe7bc004db0 2023-11-08T12:28:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc00ba30 con 0x7fe7bc003a20 2023-11-08T12:28:39.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc00bb70 con 0x7fe7d00cc860 2023-11-08T12:28:39.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7bc004db0 0x7fe7bc005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d54ba700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc003a20 0x7fe7bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d4cb9700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 0x7fe7bc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 msgr2=0x7fe7bc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:39.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 0x7fe7bc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:39.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc003a20 msgr2=0x7fe7bc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:39.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc003a20 0x7fe7bc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:39.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/326265383 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0035d0 con 0x7fe7bc004db0 2023-11-08T12:28:39.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d4cb9700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d00cc860 0x7fe7bc004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:39.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7bc004db0 0x7fe7bc005220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800a8d0 tx=0x7fe7bc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f2556d6fc60e11 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:39.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800a340 con 0x7fe7bc004db0 2023-11-08T12:28:39.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c80072d0 con 0x7fe7bc004db0 2023-11-08T12:28:39.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7c7fff700 1 -- 172.21.15.112:0/326265383 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8007680 con 0x7fe7bc004db0 2023-11-08T12:28:39.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d64bc700 1 -- 172.21.15.112:0/326265383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7bc004db0 msgr2=0x7fe7bc005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:39.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d64bc700 1 --2- 172.21.15.112:0/326265383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7bc004db0 0x7fe7bc005220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800a8d0 tx=0x7fe7bc0058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:39.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/326265383 reap_dead start 2023-11-08T12:28:39.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d64bc700 1 -- 172.21.15.112:0/326265383 shutdown_connections 2023-11-08T12:28:39.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d64bc700 1 -- 172.21.15.112:0/326265383 >> 172.21.15.112:0/326265383 conn(0x7fe7d00b0f80 msgr2=0x7fe7d00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:39.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d64bc700 1 -- 172.21.15.112:0/326265383 shutdown_connections 2023-11-08T12:28:39.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.872+0000 7fe7d64bc700 1 -- 172.21.15.112:0/326265383 wait complete. 2023-11-08T12:28:39.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.876+0000 7fe7d64bc700 1 Processor -- start 2023-11-08T12:28:39.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.876+0000 7fe7d64bc700 1 -- start start 2023-11-08T12:28:39.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.876+0000 7fe7d64bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc004db0 0x7fe7d014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d01f99d0 0x7fe7d014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7d014c360 0x7fe7d00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01502b0 con 0x7fe7d014c360 2023-11-08T12:28:39.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d015eda0 con 0x7fe7bc004db0 2023-11-08T12:28:39.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01f9e40 con 0x7fe7d01f99d0 2023-11-08T12:28:39.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7d014c360 0x7fe7d00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7d014c360 0x7fe7d00b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36044/0 (socket says 172.21.15.112:36044) 2023-11-08T12:28:39.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/3647713250 learned_addr learned my addr 172.21.15.112:0/3647713250 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:39.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d4cb9700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d01f99d0 0x7fe7d014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d54ba700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc004db0 0x7fe7d014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d01f99d0 msgr2=0x7fe7d014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:39.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d01f99d0 0x7fe7d014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:39.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc004db0 msgr2=0x7fe7d014a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:39.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc004db0 0x7fe7d014a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:39.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 -- 172.21.15.112:0/3647713250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d006b6b0 con 0x7fe7d014c360 2023-11-08T12:28:39.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d5cbb700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7d014c360 0x7fe7d00b3810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800abe0 tx=0x7fe7c8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:39.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7c5ffb700 1 -- 172.21.15.112:0/3647713250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8025030 con 0x7fe7d014c360 2023-11-08T12:28:39.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7c5ffb700 1 -- 172.21.15.112:0/3647713250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c80019c0 con 0x7fe7d014c360 2023-11-08T12:28:39.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7c5ffb700 1 -- 172.21.15.112:0/3647713250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800a340 con 0x7fe7d014c360 2023-11-08T12:28:39.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d006b3d0 con 0x7fe7d014c360 2023-11-08T12:28:39.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d00ad8f0 con 0x7fe7d014c360 2023-11-08T12:28:39.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.880+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d0073cb0 con 0x7fe7d014c360 2023-11-08T12:28:39.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.884+0000 7fe7c5ffb700 1 -- 172.21.15.112:0/3647713250 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe7c8010070 con 0x7fe7d014c360 2023-11-08T12:28:39.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.884+0000 7fe7c5ffb700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7b4064ee0 0x7fe7b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:39.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.884+0000 7fe7c5ffb700 1 -- 172.21.15.112:0/3647713250 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe7c8026070 con 0x7fe7d014c360 2023-11-08T12:28:39.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.884+0000 7fe7d54ba700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7b4064ee0 0x7fe7b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:39.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.888+0000 7fe7d54ba700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7b4064ee0 0x7fe7b4067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc004490 tx=0x7fe7cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:39.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:39.892+0000 7fe7c5ffb700 1 -- 172.21.15.112:0/3647713250 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe7c8051be0 con 0x7fe7d014c360 2023-11-08T12:28:40.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.064+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7d00711c0 con 0x7fe7d014c360 2023-11-08T12:28:40.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.068+0000 7fe7c5ffb700 1 -- 172.21.15.112:0/3647713250 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7fe7c8055200 con 0x7fe7d014c360 2023-11-08T12:28:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:40.074 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:40.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7b4064ee0 msgr2=0x7fe7b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7b4064ee0 0x7fe7b4067390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc004490 tx=0x7fe7cc008040 comp rx=0 tx=0).stop 2023-11-08T12:28:40.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7d014c360 msgr2=0x7fe7d00b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7d014c360 0x7fe7d00b3810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800abe0 tx=0x7fe7c8001360 comp rx=0 tx=0).stop 2023-11-08T12:28:40.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 shutdown_connections 2023-11-08T12:28:40.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7b4064ee0 0x7fe7b4067390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7d014c360 0x7fe7d00b3810 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7d01f99d0 0x7fe7d014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 --2- 172.21.15.112:0/3647713250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7bc004db0 0x7fe7d014a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 >> 172.21.15.112:0/3647713250 conn(0x7fe7d00b0f80 msgr2=0x7fe7d015c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:40.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 shutdown_connections 2023-11-08T12:28:40.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.072+0000 7fe7d64bc700 1 -- 172.21.15.112:0/3647713250 wait complete. 2023-11-08T12:28:40.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:40.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:40.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 Processor -- start 2023-11-08T12:28:40.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 -- start start 2023-11-08T12:28:40.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f7015c700 0x7f9f700702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f700b2130 0x7f9f70070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f700b1be0 0x7f9f7006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700cd360 con 0x7f9f700b2130 2023-11-08T12:28:40.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f70160190 con 0x7f9f700b1be0 2023-11-08T12:28:40.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f76cae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70160470 con 0x7f9f7015c700 2023-11-08T12:28:40.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f6ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f700b2130 0x7f9f70070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f6ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f700b2130 0x7f9f70070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36052/0 (socket says 172.21.15.112:36052) 2023-11-08T12:28:40.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f6ffff700 1 -- 172.21.15.112:0/9281793 learned_addr learned my addr 172.21.15.112:0/9281793 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:40.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.276+0000 7f9f74a4a700 1 --2- 172.21.15.112:0/9281793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f7015c700 0x7f9f700702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f7524b700 1 --2- 172.21.15.112:0/9281793 >> v2:172.21.15.133:3300/0 conn(0x7f9f700b1be0 0x7f9f7006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6ffff700 1 -- 172.21.15.112:0/9281793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f7015c700 msgr2=0x7f9f700702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:40.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6ffff700 1 --2- 172.21.15.112:0/9281793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f7015c700 0x7f9f700702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6ffff700 1 -- 172.21.15.112:0/9281793 >> v2:172.21.15.133:3300/0 conn(0x7f9f700b1be0 msgr2=0x7f9f7006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:40.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6ffff700 1 --2- 172.21.15.112:0/9281793 >> v2:172.21.15.133:3300/0 conn(0x7f9f700b1be0 0x7f9f7006c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6ffff700 1 -- 172.21.15.112:0/9281793 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70160750 con 0x7f9f700b2130 2023-11-08T12:28:40.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f7524b700 1 --2- 172.21.15.112:0/9281793 >> v2:172.21.15.133:3300/0 conn(0x7f9f700b1be0 0x7f9f7006c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:40.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6ffff700 1 --2- 172.21.15.112:0/9281793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b2130 0x7f9f70070830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f700b2700 tx=0x7f9f5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de72e22216f07a24 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:40.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6f7fe700 1 -- 172.21.15.112:0/9281793 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c011830 con 0x7f9f700b2130 2023-11-08T12:28:40.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6f7fe700 1 -- 172.21.15.112:0/9281793 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c011990 con 0x7f9f700b2130 2023-11-08T12:28:40.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f6f7fe700 1 -- 172.21.15.112:0/9281793 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c011d20 con 0x7f9f700b2130 2023-11-08T12:28:40.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 -- 172.21.15.112:0/9281793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b2130 msgr2=0x7f9f70070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 --2- 172.21.15.112:0/9281793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b2130 0x7f9f70070830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f700b2700 tx=0x7f9f5c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 -- 172.21.15.112:0/9281793 shutdown_connections 2023-11-08T12:28:40.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 --2- 172.21.15.112:0/9281793 >> v2:172.21.15.133:3300/0 conn(0x7f9f700b1be0 0x7f9f7006c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 --2- 172.21.15.112:0/9281793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b2130 0x7f9f70070830 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 --2- 172.21.15.112:0/9281793 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f7015c700 0x7f9f700702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 -- 172.21.15.112:0/9281793 >> 172.21.15.112:0/9281793 conn(0x7f9f700d2d10 msgr2=0x7f9f700d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:40.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 -- 172.21.15.112:0/9281793 shutdown_connections 2023-11-08T12:28:40.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.280+0000 7f9f76cae700 1 -- 172.21.15.112:0/9281793 wait complete. 2023-11-08T12:28:40.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.284+0000 7f9f76cae700 1 Processor -- start 2023-11-08T12:28:40.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.284+0000 7f9f76cae700 1 -- start start 2023-11-08T12:28:40.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b1be0 0x7f9f700b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f700b2130 0x7f9f7014c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7015c700 0x7f9f701585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701566d0 con 0x7f9f700b1be0 2023-11-08T12:28:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b7590 con 0x7f9f7015c700 2023-11-08T12:28:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b7870 con 0x7f9f700b2130 2023-11-08T12:28:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b1be0 0x7f9f700b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b1be0 0x7f9f700b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36066/0 (socket says 172.21.15.112:36066) 2023-11-08T12:28:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 -- 172.21.15.112:0/3081010434 learned_addr learned my addr 172.21.15.112:0/3081010434 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f6ffff700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f700b2130 0x7f9f7014c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f7524b700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7015c700 0x7f9f701585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 -- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f700b2130 msgr2=0x7f9f7014c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f700b2130 0x7f9f7014c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 -- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7015c700 msgr2=0x7f9f701585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7015c700 0x7f9f701585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 -- 172.21.15.112:0/3081010434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c009570 con 0x7f9f700b1be0 2023-11-08T12:28:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f6ffff700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f700b2130 0x7f9f7014c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f7524b700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7015c700 0x7f9f701585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f74a4a700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b1be0 0x7f9f700b8630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400efc0 tx=0x7f9f6400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f6d7fa700 1 -- 172.21.15.112:0/3081010434 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64009ba0 con 0x7f9f700b1be0 2023-11-08T12:28:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f6d7fa700 1 -- 172.21.15.112:0/3081010434 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400f040 con 0x7f9f700b1be0 2023-11-08T12:28:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7006b530 con 0x7f9f700b1be0 2023-11-08T12:28:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f6d7fa700 1 -- 172.21.15.112:0/3081010434 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64014480 con 0x7f9f700b1be0 2023-11-08T12:28:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.288+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f70160a30 con 0x7f9f700b1be0 2023-11-08T12:28:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.292+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7006c620 con 0x7f9f700b1be0 2023-11-08T12:28:40.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.292+0000 7f9f6d7fa700 1 -- 172.21.15.112:0/3081010434 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9f640145e0 con 0x7f9f700b1be0 2023-11-08T12:28:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.292+0000 7f9f6d7fa700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9f54064ee0 0x7f9f54067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.292+0000 7f9f6d7fa700 1 -- 172.21.15.112:0/3081010434 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9f64082c00 con 0x7f9f700b1be0 2023-11-08T12:28:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.292+0000 7f9f6ffff700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9f54064ee0 0x7f9f54067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.296+0000 7f9f6ffff700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9f54064ee0 0x7f9f54067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c000c00 tx=0x7f9f5c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:40.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.300+0000 7f9f6d7fa700 1 -- 172.21.15.112:0/3081010434 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9f64088020 con 0x7f9f700b1be0 2023-11-08T12:28:40.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.472+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f700726c0 con 0x7f9f700b1be0 2023-11-08T12:28:40.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f6d7fa700 1 -- 172.21.15.112:0/3081010434 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f640544a0 con 0x7f9f700b1be0 2023-11-08T12:28:40.479 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:40.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9f54064ee0 msgr2=0x7f9f54067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9f54064ee0 0x7f9f54067390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c000c00 tx=0x7f9f5c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b1be0 msgr2=0x7f9f700b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b1be0 0x7f9f700b8630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400efc0 tx=0x7f9f6400c3a0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 shutdown_connections 2023-11-08T12:28:40.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9f54064ee0 0x7f9f54067390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7015c700 0x7f9f701585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f700b2130 0x7f9f7014c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 --2- 172.21.15.112:0/3081010434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f700b1be0 0x7f9f700b8630 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 >> 172.21.15.112:0/3081010434 conn(0x7f9f700d2d10 msgr2=0x7f9f7006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 shutdown_connections 2023-11-08T12:28:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.476+0000 7f9f76cae700 1 -- 172.21.15.112:0/3081010434 wait complete. 2023-11-08T12:28:40.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.676+0000 7fce2f3d5700 1 Processor -- start 2023-11-08T12:28:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.676+0000 7fce2f3d5700 1 -- start start 2023-11-08T12:28:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2f3d5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce28070620 0x7fce280b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2f3d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce2806a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2f3d5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2815c520 con 0x7fce2815c150 2023-11-08T12:28:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2f3d5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280b4240 con 0x7fce28070620 2023-11-08T12:28:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2f3d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2806cc50 con 0x7fce28069bf0 2023-11-08T12:28:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2e3d3700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fce2815c150 0x7fce2806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55292/0 (socket says 172.21.15.112:55292) 2023-11-08T12:28:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2e3d3700 1 -- 172.21.15.112:0/3407924009 learned_addr learned my addr 172.21.15.112:0/3407924009 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2dbd2700 1 --2- 172.21.15.112:0/3407924009 >> v2:172.21.15.112:3300/0 conn(0x7fce28070620 0x7fce280b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2dbd2700 1 -- 172.21.15.112:0/3407924009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 msgr2=0x7fce2806a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2ebd4700 1 --2- 172.21.15.112:0/3407924009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce2806a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2dbd2700 1 --2- 172.21.15.112:0/3407924009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce2806a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2d3d1700 1 -- 172.21.15.112:0/3407924009 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003227415 0 0) 0x7fce2815c520 con 0x7fce2815c150 2023-11-08T12:28:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2dbd2700 1 -- 172.21.15.112:0/3407924009 >> v1:172.21.15.112:6789/0 conn(0x7fce2815c150 legacy=0x7fce2806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2dbd2700 1 -- 172.21.15.112:0/3407924009 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280d2450 con 0x7fce28070620 2023-11-08T12:28:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2ebd4700 1 --2- 172.21.15.112:0/3407924009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce2806a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2dbd2700 1 --2- 172.21.15.112:0/3407924009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce28070620 0x7fce280b3d00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce18009840 tx=0x7fce18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b512a48ee19b8543 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2d3d1700 1 -- 172.21.15.112:0/3407924009 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18011830 con 0x7fce28070620 2023-11-08T12:28:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2d3d1700 1 -- 172.21.15.112:0/3407924009 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18011990 con 0x7fce28070620 2023-11-08T12:28:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.680+0000 7fce2d3d1700 1 -- 172.21.15.112:0/3407924009 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18011d20 con 0x7fce28070620 2023-11-08T12:28:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- 172.21.15.112:0/3407924009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce28070620 msgr2=0x7fce280b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/3407924009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce28070620 0x7fce280b3d00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fce18009840 tx=0x7fce18009b50 comp rx=0 tx=0).stop 2023-11-08T12:28:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- 172.21.15.112:0/3407924009 shutdown_connections 2023-11-08T12:28:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/3407924009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce2806a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/3407924009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce28070620 0x7fce280b3d00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- 172.21.15.112:0/3407924009 >> 172.21.15.112:0/3407924009 conn(0x7fce280d3680 msgr2=0x7fce280cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- 172.21.15.112:0/3407924009 shutdown_connections 2023-11-08T12:28:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- 172.21.15.112:0/3407924009 wait complete. 2023-11-08T12:28:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 Processor -- start 2023-11-08T12:28:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- start start 2023-11-08T12:28:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce281f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce28070620 0x7fce280b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2815c150 0x7fce280b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b65c0 con 0x7fce2815c150 2023-11-08T12:28:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b59f0 con 0x7fce28070620 2023-11-08T12:28:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.684+0000 7fce2f3d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b5c90 con 0x7fce28069bf0 2023-11-08T12:28:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2815c150 0x7fce280b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2815c150 0x7fce280b8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36082/0 (socket says 172.21.15.112:36082) 2023-11-08T12:28:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 -- 172.21.15.112:0/2279035750 learned_addr learned my addr 172.21.15.112:0/2279035750 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2e3d3700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce281f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2dbd2700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce28070620 0x7fce280b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 -- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 msgr2=0x7fce281f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce281f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 -- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce28070620 msgr2=0x7fce280b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce28070620 0x7fce280b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 -- 172.21.15.112:0/2279035750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18009450 con 0x7fce2815c150 2023-11-08T12:28:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2ebd4700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2815c150 0x7fce280b8160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce2000cef0 tx=0x7fce2000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce1effd700 1 -- 172.21.15.112:0/2279035750 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2000ae50 con 0x7fce2815c150 2023-11-08T12:28:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce1effd700 1 -- 172.21.15.112:0/2279035750 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20015440 con 0x7fce2815c150 2023-11-08T12:28:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280d05e0 con 0x7fce2815c150 2023-11-08T12:28:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce1effd700 1 -- 172.21.15.112:0/2279035750 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200157f0 con 0x7fce2815c150 2023-11-08T12:28:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce280d2730 con 0x7fce2815c150 2023-11-08T12:28:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.688+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce280d2140 con 0x7fce2815c150 2023-11-08T12:28:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.692+0000 7fce1effd700 1 -- 172.21.15.112:0/2279035750 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fce2001c030 con 0x7fce2815c150 2023-11-08T12:28:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.692+0000 7fce1effd700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce0c064ee0 0x7fce0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.692+0000 7fce1effd700 1 -- 172.21.15.112:0/2279035750 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fce20082760 con 0x7fce2815c150 2023-11-08T12:28:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.696+0000 7fce2e3d3700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce0c064ee0 0x7fce0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:40.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.696+0000 7fce2e3d3700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce0c064ee0 0x7fce0c067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce24000f60 tx=0x7fce24007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:40.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.700+0000 7fce1effd700 1 -- 172.21.15.112:0/2279035750 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fce200504e0 con 0x7fce2815c150 2023-11-08T12:28:40.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.872+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce28073d20 con 0x7fce2815c150 2023-11-08T12:28:40.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.872+0000 7fce1effd700 1 -- 172.21.15.112:0/2279035750 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce2001a0a0 con 0x7fce2815c150 2023-11-08T12:28:40.876 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:40.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce0c064ee0 msgr2=0x7fce0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce0c064ee0 0x7fce0c067390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce24000f60 tx=0x7fce24007cb0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2815c150 msgr2=0x7fce280b8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:40.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2815c150 0x7fce280b8160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fce2000cef0 tx=0x7fce2000a340 comp rx=0 tx=0).stop 2023-11-08T12:28:40.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 shutdown_connections 2023-11-08T12:28:40.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce0c064ee0 0x7fce0c067390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2815c150 0x7fce280b8160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce28070620 0x7fce280b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 --2- 172.21.15.112:0/2279035750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce28069bf0 0x7fce281f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:40.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 >> 172.21.15.112:0/2279035750 conn(0x7fce280d3680 msgr2=0x7fce280b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:40.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 shutdown_connections 2023-11-08T12:28:40.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:40.876+0000 7fce2f3d5700 1 -- 172.21.15.112:0/2279035750 wait complete. 2023-11-08T12:28:40.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:41.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.064+0000 7f9d9d46f700 1 Processor -- start 2023-11-08T12:28:41.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.064+0000 7f9d9d46f700 1 -- start start 2023-11-08T12:28:41.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d9d46f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d98159f10 0x7f9d98070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d9d46f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d98070600 con 0x7f9d9815a9f0 2023-11-08T12:28:41.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d9d46f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9815adf0 con 0x7f9d980c8c90 2023-11-08T12:28:41.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d9d46f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980c9130 con 0x7f9d98159f10 2023-11-08T12:28:41.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d9cc6e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9d9815a9f0 0x7f9d9806be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55300/0 (socket says 172.21.15.112:55300) 2023-11-08T12:28:41.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d9cc6e700 1 -- 172.21.15.112:0/4070159814 learned_addr learned my addr 172.21.15.112:0/4070159814 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:41.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d97fff700 1 --2- 172.21.15.112:0/4070159814 >> v2:172.21.15.133:3300/0 conn(0x7f9d98159f10 0x7f9d98070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d977fe700 1 -- 172.21.15.112:0/4070159814 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225447326 0 0) 0x7f9d98070600 con 0x7f9d9815a9f0 2023-11-08T12:28:41.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d977fe700 1 -- 172.21.15.112:0/4070159814 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d840035d0 con 0x7f9d9815a9f0 2023-11-08T12:28:41.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d977fe700 1 -- 172.21.15.112:0/4070159814 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46722122 0 0) 0x7f9d9815adf0 con 0x7f9d980c8c90 2023-11-08T12:28:41.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d977fe700 1 -- 172.21.15.112:0/4070159814 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d98070600 con 0x7f9d980c8c90 2023-11-08T12:28:41.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d97fff700 1 -- 172.21.15.112:0/4070159814 >> v1:172.21.15.133:6789/0 conn(0x7f9d980c8c90 legacy=0x7f9d9815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d97fff700 1 -- 172.21.15.112:0/4070159814 >> v1:172.21.15.112:6789/0 conn(0x7f9d9815a9f0 legacy=0x7f9d9806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d97fff700 1 -- 172.21.15.112:0/4070159814 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980afcc0 con 0x7f9d98159f10 2023-11-08T12:28:41.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.068+0000 7f9d97fff700 1 --2- 172.21.15.112:0/4070159814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d98159f10 0x7f9d98070a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009850 tx=0x7f9d88009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa9baccb1a6fe886 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d977fe700 1 -- 172.21.15.112:0/4070159814 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88011830 con 0x7f9d98159f10 2023-11-08T12:28:41.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d977fe700 1 -- 172.21.15.112:0/4070159814 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88011990 con 0x7f9d98159f10 2023-11-08T12:28:41.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d977fe700 1 -- 172.21.15.112:0/4070159814 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88011d00 con 0x7f9d98159f10 2023-11-08T12:28:41.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d9d46f700 1 -- 172.21.15.112:0/4070159814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d98159f10 msgr2=0x7f9d98070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/4070159814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d98159f10 0x7f9d98070a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009850 tx=0x7f9d88009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:41.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d9d46f700 1 -- 172.21.15.112:0/4070159814 shutdown_connections 2023-11-08T12:28:41.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/4070159814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d98159f10 0x7f9d98070a90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d9d46f700 1 -- 172.21.15.112:0/4070159814 >> 172.21.15.112:0/4070159814 conn(0x7f9d980cf280 msgr2=0x7f9d980cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:41.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d9d46f700 1 -- 172.21.15.112:0/4070159814 shutdown_connections 2023-11-08T12:28:41.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.072+0000 7f9d9d46f700 1 -- 172.21.15.112:0/4070159814 wait complete. 2023-11-08T12:28:41.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 Processor -- start 2023-11-08T12:28:41.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 -- start start 2023-11-08T12:28:41.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d980c8c90 0x7f9d9815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d98159f10 0x7f9d980c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d9815a9f0 0x7f9d981eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9815d260 con 0x7f9d980c8c90 2023-11-08T12:28:41.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98153390 con 0x7f9d9815a9f0 2023-11-08T12:28:41.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.076+0000 7f9d9d46f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980c8390 con 0x7f9d98159f10 2023-11-08T12:28:41.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d980c8c90 0x7f9d9815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d980c8c90 0x7f9d9815c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36088/0 (socket says 172.21.15.112:36088) 2023-11-08T12:28:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 -- 172.21.15.112:0/2861536586 learned_addr learned my addr 172.21.15.112:0/2861536586 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d8f7fe700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d98159f10 0x7f9d980c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d9cc6e700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d9815a9f0 0x7f9d981eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 -- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d98159f10 msgr2=0x7f9d980c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d98159f10 0x7f9d980c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 -- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d9815a9f0 msgr2=0x7f9d981eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d9815a9f0 0x7f9d981eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 -- 172.21.15.112:0/2861536586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d880094b0 con 0x7f9d980c8c90 2023-11-08T12:28:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d97fff700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d980c8c90 0x7f9d9815c610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d980717e0 tx=0x7f9d88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d957fa700 1 -- 172.21.15.112:0/2861536586 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880044d0 con 0x7f9d980c8c90 2023-11-08T12:28:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d957fa700 1 -- 172.21.15.112:0/2861536586 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8801f070 con 0x7f9d980c8c90 2023-11-08T12:28:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d957fa700 1 -- 172.21.15.112:0/2861536586 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880038c0 con 0x7f9d980c8c90 2023-11-08T12:28:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d98070290 con 0x7f9d980c8c90 2023-11-08T12:28:41.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.080+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9806ffb0 con 0x7f9d980c8c90 2023-11-08T12:28:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.084+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d980affa0 con 0x7f9d980c8c90 2023-11-08T12:28:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.084+0000 7f9d957fa700 1 -- 172.21.15.112:0/2861536586 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d8800f050 con 0x7f9d980c8c90 2023-11-08T12:28:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.084+0000 7f9d957fa700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d78064ee0 0x7f9d78067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.084+0000 7f9d957fa700 1 -- 172.21.15.112:0/2861536586 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9d88021070 con 0x7f9d980c8c90 2023-11-08T12:28:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.084+0000 7f9d8f7fe700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d78064ee0 0x7f9d78067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.088+0000 7f9d8f7fe700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d78064ee0 0x7f9d78067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d98155610 tx=0x7f9d80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.092+0000 7f9d957fa700 1 -- 172.21.15.112:0/2861536586 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9d880517b0 con 0x7f9d980c8c90 2023-11-08T12:28:41.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.264+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d9806cf30 con 0x7f9d980c8c90 2023-11-08T12:28:41.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.268+0000 7f9d957fa700 1 -- 172.21.15.112:0/2861536586 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d88015020 con 0x7f9d980c8c90 2023-11-08T12:28:41.270 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:41.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d78064ee0 msgr2=0x7f9d78067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d78064ee0 0x7f9d78067390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d98155610 tx=0x7f9d80009040 comp rx=0 tx=0).stop 2023-11-08T12:28:41.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d980c8c90 msgr2=0x7f9d9815c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d980c8c90 0x7f9d9815c610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d980717e0 tx=0x7f9d88004770 comp rx=0 tx=0).stop 2023-11-08T12:28:41.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 shutdown_connections 2023-11-08T12:28:41.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d78064ee0 0x7f9d78067390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d9815a9f0 0x7f9d981eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d98159f10 0x7f9d980c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 --2- 172.21.15.112:0/2861536586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d980c8c90 0x7f9d9815c610 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 >> 172.21.15.112:0/2861536586 conn(0x7f9d980cf280 msgr2=0x7f9d980c3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:41.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 shutdown_connections 2023-11-08T12:28:41.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.272+0000 7f9d9d46f700 1 -- 172.21.15.112:0/2861536586 wait complete. 2023-11-08T12:28:41.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.476+0000 7f5f6759e700 1 Processor -- start 2023-11-08T12:28:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.476+0000 7f5f6759e700 1 -- start start 2023-11-08T12:28:41.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f6815c150 0x7f5f680b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6759e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f6806ff10 0x7f5f68070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6815c520 con 0x7f5f6815fc30 2023-11-08T12:28:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6759e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680b4240 con 0x7f5f6806ff10 2023-11-08T12:28:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680708a0 con 0x7f5f6815c150 2023-11-08T12:28:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f6806ff10 0x7f5f68070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f6806ff10 0x7f5f68070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36094/0 (socket says 172.21.15.112:36094) 2023-11-08T12:28:41.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 -- 172.21.15.112:0/3054286202 learned_addr learned my addr 172.21.15.112:0/3054286202 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6659c700 1 --2- 172.21.15.112:0/3054286202 >> v2:172.21.15.133:3300/0 conn(0x7f5f6815c150 0x7f5f680b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 -- 172.21.15.112:0/3054286202 >> v2:172.21.15.133:3300/0 conn(0x7f5f6815c150 msgr2=0x7f5f680b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 --2- 172.21.15.112:0/3054286202 >> v2:172.21.15.133:3300/0 conn(0x7f5f6815c150 0x7f5f680b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 -- 172.21.15.112:0/3054286202 >> v1:172.21.15.133:6789/0 conn(0x7f5f6815fc30 legacy=0x7f5f68160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 -- 172.21.15.112:0/3054286202 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6806ac00 con 0x7f5f6806ff10 2023-11-08T12:28:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f65d9b700 1 --2- 172.21.15.112:0/3054286202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6806ff10 0x7f5f68070360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f68071900 tx=0x7f5f5c009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476f95ee3ffb70ab server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6559a700 1 -- 172.21.15.112:0/3054286202 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00b8a0 con 0x7f5f6806ff10 2023-11-08T12:28:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6559a700 1 -- 172.21.15.112:0/3054286202 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00ba00 con 0x7f5f6806ff10 2023-11-08T12:28:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.480+0000 7f5f6559a700 1 -- 172.21.15.112:0/3054286202 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00bd90 con 0x7f5f6806ff10 2023-11-08T12:28:41.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 -- 172.21.15.112:0/3054286202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6806ff10 msgr2=0x7f5f68070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 --2- 172.21.15.112:0/3054286202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6806ff10 0x7f5f68070360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f68071900 tx=0x7f5f5c009be0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 -- 172.21.15.112:0/3054286202 shutdown_connections 2023-11-08T12:28:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 --2- 172.21.15.112:0/3054286202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6806ff10 0x7f5f68070360 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 --2- 172.21.15.112:0/3054286202 >> v2:172.21.15.133:3300/0 conn(0x7f5f6815c150 0x7f5f680b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 -- 172.21.15.112:0/3054286202 >> 172.21.15.112:0/3054286202 conn(0x7f5f680d3680 msgr2=0x7f5f680cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:41.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 -- 172.21.15.112:0/3054286202 shutdown_connections 2023-11-08T12:28:41.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 -- 172.21.15.112:0/3054286202 wait complete. 2023-11-08T12:28:41.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 Processor -- start 2023-11-08T12:28:41.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.484+0000 7f5f6759e700 1 -- start start 2023-11-08T12:28:41.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f6806ff10 0x7f5f68157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6815c150 0x7f5f681f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f6815fc30 0x7f5f680c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680cf830 con 0x7f5f6815c150 2023-11-08T12:28:41.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68158510 con 0x7f5f6815fc30 2023-11-08T12:28:41.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6815a650 con 0x7f5f6806ff10 2023-11-08T12:28:41.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6815c150 0x7f5f681f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6815c150 0x7f5f681f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36108/0 (socket says 172.21.15.112:36108) 2023-11-08T12:28:41.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 -- 172.21.15.112:0/189410680 learned_addr learned my addr 172.21.15.112:0/189410680 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:41.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f66d9d700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f6815fc30 0x7f5f680c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6659c700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f6806ff10 0x7f5f68157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 -- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f6806ff10 msgr2=0x7f5f68157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f6806ff10 0x7f5f68157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 -- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f6815fc30 msgr2=0x7f5f680c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f6815fc30 0x7f5f680c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 -- 172.21.15.112:0/189410680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009510 con 0x7f5f6815c150 2023-11-08T12:28:41.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f65d9b700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6815c150 0x7f5f681f1270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009c20 tx=0x7f5f5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f56ffd700 1 -- 172.21.15.112:0/189410680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c004450 con 0x7f5f6815c150 2023-11-08T12:28:41.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f56ffd700 1 -- 172.21.15.112:0/189410680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c01f070 con 0x7f5f6815c150 2023-11-08T12:28:41.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f680d2450 con 0x7f5f6815c150 2023-11-08T12:28:41.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f56ffd700 1 -- 172.21.15.112:0/189410680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c003900 con 0x7f5f6815c150 2023-11-08T12:28:41.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.488+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6806cc50 con 0x7f5f6815c150 2023-11-08T12:28:41.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.492+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f680d2730 con 0x7f5f6815c150 2023-11-08T12:28:41.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.492+0000 7f5f56ffd700 1 -- 172.21.15.112:0/189410680 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5f5c00f050 con 0x7f5f6815c150 2023-11-08T12:28:41.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.492+0000 7f5f56ffd700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5f48064ee0 0x7f5f48067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.496+0000 7f5f56ffd700 1 -- 172.21.15.112:0/189410680 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5f5c021070 con 0x7f5f6815c150 2023-11-08T12:28:41.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.496+0000 7f5f6659c700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5f48064ee0 0x7f5f48067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.496+0000 7f5f6659c700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5f48064ee0 0x7f5f48067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ccc90 tx=0x7f5f58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.500+0000 7f5f56ffd700 1 -- 172.21.15.112:0/189410680 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5f5c0517a0 con 0x7f5f6815c150 2023-11-08T12:28:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.668+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f68073d20 con 0x7f5f6815c150 2023-11-08T12:28:41.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.668+0000 7f5f56ffd700 1 -- 172.21.15.112:0/189410680 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f5c015020 con 0x7f5f6815c150 2023-11-08T12:28:41.674 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:41.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5f48064ee0 msgr2=0x7f5f48067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5f48064ee0 0x7f5f48067390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ccc90 tx=0x7f5f58008040 comp rx=0 tx=0).stop 2023-11-08T12:28:41.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6815c150 msgr2=0x7f5f681f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6815c150 0x7f5f681f1270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009c20 tx=0x7f5f5c004770 comp rx=0 tx=0).stop 2023-11-08T12:28:41.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 shutdown_connections 2023-11-08T12:28:41.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5f48064ee0 0x7f5f48067390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f6815fc30 0x7f5f680c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6815c150 0x7f5f681f1270 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 --2- 172.21.15.112:0/189410680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f6806ff10 0x7f5f68157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 >> 172.21.15.112:0/189410680 conn(0x7f5f680d3680 msgr2=0x7f5f680b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:41.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 shutdown_connections 2023-11-08T12:28:41.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.672+0000 7f5f6759e700 1 -- 172.21.15.112:0/189410680 wait complete. 2023-11-08T12:28:41.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:41.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.872+0000 7f072359e700 1 Processor -- start 2023-11-08T12:28:41.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.872+0000 7f072359e700 1 -- start start 2023-11-08T12:28:41.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f07240d1310 0x7f07240700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0724070600 0x7f0724069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07240cd080 con 0x7f072415c310 2023-11-08T12:28:41.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072406d240 con 0x7f07240d1310 2023-11-08T12:28:41.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07240d21a0 con 0x7f0724070600 2023-11-08T12:28:41.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f0721d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f07240d1310 0x7f07240700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f072415c310 0x7f072406b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55314/0 (socket says 172.21.15.112:55314) 2023-11-08T12:28:41.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072259c700 1 -- 172.21.15.112:0/4179149464 learned_addr learned my addr 172.21.15.112:0/4179149464 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:41.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f0722d9d700 1 --2- 172.21.15.112:0/4179149464 >> v2:172.21.15.133:3300/0 conn(0x7f0724070600 0x7f0724069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f0721d9b700 1 -- 172.21.15.112:0/4179149464 >> v2:172.21.15.133:3300/0 conn(0x7f0724070600 msgr2=0x7f0724069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:41.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f0721d9b700 1 --2- 172.21.15.112:0/4179149464 >> v2:172.21.15.133:3300/0 conn(0x7f0724070600 0x7f0724069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f0721d9b700 1 -- 172.21.15.112:0/4179149464 >> v1:172.21.15.112:6789/0 conn(0x7f072415c310 legacy=0x7f072406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f0721d9b700 1 -- 172.21.15.112:0/4179149464 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724070a60 con 0x7f07240d1310 2023-11-08T12:28:41.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f0721d9b700 1 --2- 172.21.15.112:0/4179149464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240d1310 0x7f07240700c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0724160e70 tx=0x7f0718009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87abeea232ff9b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072159a700 1 -- 172.21.15.112:0/4179149464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718011830 con 0x7f07240d1310 2023-11-08T12:28:41.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.876+0000 7f072159a700 1 -- 172.21.15.112:0/4179149464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718011990 con 0x7f07240d1310 2023-11-08T12:28:41.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072159a700 1 -- 172.21.15.112:0/4179149464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718011d40 con 0x7f07240d1310 2023-11-08T12:28:41.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 -- 172.21.15.112:0/4179149464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240d1310 msgr2=0x7f07240700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 --2- 172.21.15.112:0/4179149464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240d1310 0x7f07240700c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0724160e70 tx=0x7f0718009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:41.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 -- 172.21.15.112:0/4179149464 shutdown_connections 2023-11-08T12:28:41.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 --2- 172.21.15.112:0/4179149464 >> v2:172.21.15.133:3300/0 conn(0x7f0724070600 0x7f0724069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 --2- 172.21.15.112:0/4179149464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240d1310 0x7f07240700c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 -- 172.21.15.112:0/4179149464 >> 172.21.15.112:0/4179149464 conn(0x7f07240d0140 msgr2=0x7f07240d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:41.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 -- 172.21.15.112:0/4179149464 shutdown_connections 2023-11-08T12:28:41.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 -- 172.21.15.112:0/4179149464 wait complete. 2023-11-08T12:28:41.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 Processor -- start 2023-11-08T12:28:41.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.880+0000 7f072359e700 1 -- start start 2023-11-08T12:28:41.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0724070600 0x7f07240cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07240d1310 0x7f07241561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f072415c310 0x7f07241e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240c6a70 con 0x7f0724070600 2023-11-08T12:28:41.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240cc920 con 0x7f07240d1310 2023-11-08T12:28:41.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240cc360 con 0x7f072415c310 2023-11-08T12:28:41.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0724070600 0x7f07240cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0724070600 0x7f07240cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36140/0 (socket says 172.21.15.112:36140) 2023-11-08T12:28:41.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 -- 172.21.15.112:0/2104758285 learned_addr learned my addr 172.21.15.112:0/2104758285 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:41.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 -- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f072415c310 msgr2=0x7f07241e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f072415c310 0x7f07241e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 -- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07240d1310 msgr2=0x7f07241561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:41.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f0721d9b700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07240d1310 0x7f07241561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07240d1310 0x7f07241561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:41.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 -- 172.21.15.112:0/2104758285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07180094b0 con 0x7f0724070600 2023-11-08T12:28:41.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f0721d9b700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07240d1310 0x7f07241561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:41.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072259c700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0724070600 0x7f07240cbc80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0714001eb0 tx=0x7f071400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f0712ffd700 1 -- 172.21.15.112:0/2104758285 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714005d90 con 0x7f0724070600 2023-11-08T12:28:41.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f0712ffd700 1 -- 172.21.15.112:0/2104758285 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07140070d0 con 0x7f0724070600 2023-11-08T12:28:41.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072415c6e0 con 0x7f0724070600 2023-11-08T12:28:41.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f0712ffd700 1 -- 172.21.15.112:0/2104758285 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714007440 con 0x7f0724070600 2023-11-08T12:28:41.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.884+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240d1900 con 0x7f0724070600 2023-11-08T12:28:41.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.888+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072406d450 con 0x7f0724070600 2023-11-08T12:28:41.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.888+0000 7f0712ffd700 1 -- 172.21.15.112:0/2104758285 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0714019030 con 0x7f0724070600 2023-11-08T12:28:41.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.888+0000 7f0712ffd700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0704064ee0 0x7f0704067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:41.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.888+0000 7f0712ffd700 1 -- 172.21.15.112:0/2104758285 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f07140813f0 con 0x7f0724070600 2023-11-08T12:28:41.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.888+0000 7f0721d9b700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0704064ee0 0x7f0704067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:41.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.888+0000 7f0721d9b700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0704064ee0 0x7f0704067390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f07240c82a0 tx=0x7f0718008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:41.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:41.892+0000 7f0712ffd700 1 -- 172.21.15.112:0/2104758285 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f071404a400 con 0x7f0724070600 2023-11-08T12:28:42.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.064+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0724073d20 con 0x7f0724070600 2023-11-08T12:28:42.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.064+0000 7f0712ffd700 1 -- 172.21.15.112:0/2104758285 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f071404f310 con 0x7f0724070600 2023-11-08T12:28:42.067 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:42.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.064+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0704064ee0 msgr2=0x7f0704067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.064+0000 7f072359e700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0704064ee0 0x7f0704067390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f07240c82a0 tx=0x7f0718008030 comp rx=0 tx=0).stop 2023-11-08T12:28:42.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.064+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0724070600 msgr2=0x7f07240cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.064+0000 7f072359e700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0724070600 0x7f07240cbc80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0714001eb0 tx=0x7f071400c860 comp rx=0 tx=0).stop 2023-11-08T12:28:42.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 shutdown_connections 2023-11-08T12:28:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0704064ee0 0x7f0704067390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f072415c310 0x7f07241e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07240d1310 0x7f07241561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 --2- 172.21.15.112:0/2104758285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0724070600 0x7f07240cbc80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 >> 172.21.15.112:0/2104758285 conn(0x7f07240d0140 msgr2=0x7f072415fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 shutdown_connections 2023-11-08T12:28:42.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.068+0000 7f072359e700 1 -- 172.21.15.112:0/2104758285 wait complete. 2023-11-08T12:28:42.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:42.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.260+0000 7f0e6790d700 1 Processor -- start 2023-11-08T12:28:42.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.260+0000 7f0e6790d700 1 -- start start 2023-11-08T12:28:42.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e6790d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e6006ad70 0x7f0e60165210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e6790d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6015a850 con 0x7f0e6015a480 2023-11-08T12:28:42.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e6790d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600cada0 con 0x7f0e600c8d10 2023-11-08T12:28:42.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e6790d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600cd0b0 con 0x7f0e6006ad70 2023-11-08T12:28:42.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e656a9700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0e6015a480 0x7f0e600cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55330/0 (socket says 172.21.15.112:55330) 2023-11-08T12:28:42.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e656a9700 1 -- 172.21.15.112:0/4135701189 learned_addr learned my addr 172.21.15.112:0/4135701189 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:42.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e65eaa700 1 --2- 172.21.15.112:0/4135701189 >> v2:172.21.15.112:3300/0 conn(0x7f0e6006ad70 0x7f0e60165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e65eaa700 1 -- 172.21.15.112:0/4135701189 >> v1:172.21.15.133:6789/0 conn(0x7f0e600c8d10 legacy=0x7f0e600cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e57fff700 1 -- 172.21.15.112:0/4135701189 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412744285 0 0) 0x7f0e6015a850 con 0x7f0e6015a480 2023-11-08T12:28:42.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e65eaa700 1 -- 172.21.15.112:0/4135701189 >> v1:172.21.15.112:6789/0 conn(0x7f0e6015a480 legacy=0x7f0e600cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.264+0000 7f0e65eaa700 1 -- 172.21.15.112:0/4135701189 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600ce060 con 0x7f0e6006ad70 2023-11-08T12:28:42.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e65eaa700 1 --2- 172.21.15.112:0/4135701189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6006ad70 0x7f0e60165210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009850 tx=0x7f0e58009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2d7605728cc3ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:42.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e57fff700 1 -- 172.21.15.112:0/4135701189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58011830 con 0x7f0e6006ad70 2023-11-08T12:28:42.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e57fff700 1 -- 172.21.15.112:0/4135701189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e58011990 con 0x7f0e6006ad70 2023-11-08T12:28:42.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e57fff700 1 -- 172.21.15.112:0/4135701189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58011d20 con 0x7f0e6006ad70 2023-11-08T12:28:42.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e6790d700 1 -- 172.21.15.112:0/4135701189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6006ad70 msgr2=0x7f0e60165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e6790d700 1 --2- 172.21.15.112:0/4135701189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6006ad70 0x7f0e60165210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009850 tx=0x7f0e58009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:42.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e6790d700 1 -- 172.21.15.112:0/4135701189 shutdown_connections 2023-11-08T12:28:42.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e6790d700 1 --2- 172.21.15.112:0/4135701189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e6006ad70 0x7f0e60165210 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e6790d700 1 -- 172.21.15.112:0/4135701189 >> 172.21.15.112:0/4135701189 conn(0x7f0e600cf350 msgr2=0x7f0e600b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:42.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e6790d700 1 -- 172.21.15.112:0/4135701189 shutdown_connections 2023-11-08T12:28:42.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.268+0000 7f0e6790d700 1 -- 172.21.15.112:0/4135701189 wait complete. 2023-11-08T12:28:42.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 Processor -- start 2023-11-08T12:28:42.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 -- start start 2023-11-08T12:28:42.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6006ad70 0x7f0e60151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e600c8d10 0x7f0e600c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6015a480 0x7f0e600c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e601f0eb0 con 0x7f0e600c8d10 2023-11-08T12:28:42.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e601f1430 con 0x7f0e6006ad70 2023-11-08T12:28:42.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6015e410 con 0x7f0e6015a480 2023-11-08T12:28:42.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e600c8d10 0x7f0e600c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e600c8d10 0x7f0e600c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36158/0 (socket says 172.21.15.112:36158) 2023-11-08T12:28:42.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 -- 172.21.15.112:0/203333595 learned_addr learned my addr 172.21.15.112:0/203333595 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:42.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e65eaa700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6015a480 0x7f0e600c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e656a9700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6006ad70 0x7f0e60151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 -- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6015a480 msgr2=0x7f0e600c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6015a480 0x7f0e600c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 -- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6006ad70 msgr2=0x7f0e60151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6006ad70 0x7f0e60151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 -- 172.21.15.112:0/203333595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580094b0 con 0x7f0e600c8d10 2023-11-08T12:28:42.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e64ea8700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e600c8d10 0x7f0e600c61a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c500 tx=0x7f0e5000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:42.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e55ffb700 1 -- 172.21.15.112:0/203333595 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500052d0 con 0x7f0e600c8d10 2023-11-08T12:28:42.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e55ffb700 1 -- 172.21.15.112:0/203333595 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50005430 con 0x7f0e600c8d10 2023-11-08T12:28:42.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600caa30 con 0x7f0e600c8d10 2023-11-08T12:28:42.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.272+0000 7f0e55ffb700 1 -- 172.21.15.112:0/203333595 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500055a0 con 0x7f0e600c8d10 2023-11-08T12:28:42.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.276+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e600ce300 con 0x7f0e600c8d10 2023-11-08T12:28:42.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.276+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e601f15e0 con 0x7f0e600c8d10 2023-11-08T12:28:42.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.276+0000 7f0e55ffb700 1 -- 172.21.15.112:0/203333595 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0e50019030 con 0x7f0e600c8d10 2023-11-08T12:28:42.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.280+0000 7f0e55ffb700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e44064ee0 0x7f0e44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.280+0000 7f0e55ffb700 1 -- 172.21.15.112:0/203333595 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0e50081400 con 0x7f0e600c8d10 2023-11-08T12:28:42.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.280+0000 7f0e656a9700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e44064ee0 0x7f0e44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.280+0000 7f0e656a9700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e44064ee0 0x7f0e44067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0012e0 tx=0x7f0e5c001b70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:42.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.284+0000 7f0e55ffb700 1 -- 172.21.15.112:0/203333595 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0e5004f1e0 con 0x7f0e600c8d10 2023-11-08T12:28:42.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.456+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e600726c0 con 0x7f0e600c8d10 2023-11-08T12:28:42.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.456+0000 7f0e55ffb700 1 -- 172.21.15.112:0/203333595 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f0e50017090 con 0x7f0e600c8d10 2023-11-08T12:28:42.461 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:42.461 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:42.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e44064ee0 msgr2=0x7f0e44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e44064ee0 0x7f0e44067390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0012e0 tx=0x7f0e5c001b70 comp rx=0 tx=0).stop 2023-11-08T12:28:42.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e600c8d10 msgr2=0x7f0e600c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e600c8d10 0x7f0e600c61a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c500 tx=0x7f0e5000c810 comp rx=0 tx=0).stop 2023-11-08T12:28:42.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 shutdown_connections 2023-11-08T12:28:42.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e44064ee0 0x7f0e44067390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6015a480 0x7f0e600c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e600c8d10 0x7f0e600c61a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 --2- 172.21.15.112:0/203333595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6006ad70 0x7f0e60151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 >> 172.21.15.112:0/203333595 conn(0x7f0e600cf350 msgr2=0x7f0e600b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:42.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 shutdown_connections 2023-11-08T12:28:42.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.460+0000 7f0e6790d700 1 -- 172.21.15.112:0/203333595 wait complete. 2023-11-08T12:28:42.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:42.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.656+0000 7fb199545700 1 Processor -- start 2023-11-08T12:28:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.656+0000 7fb199545700 1 -- start start 2023-11-08T12:28:42.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb199545700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb194159cd0 0x7fb19415d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb199545700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb1940cc1a0 0x7fb19406c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb199545700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19415d650 con 0x7fb19406ff10 2023-11-08T12:28:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb199545700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19406be80 con 0x7fb1940cc1a0 2023-11-08T12:28:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb199545700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19415a0a0 con 0x7fb194159cd0 2023-11-08T12:28:42.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb18b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb1940cc1a0 0x7fb19406c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb198d44700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb19406ff10 0x7fb194069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55342/0 (socket says 172.21.15.112:55342) 2023-11-08T12:28:42.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb198d44700 1 -- 172.21.15.112:0/2833324425 learned_addr learned my addr 172.21.15.112:0/2833324425 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:42.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb193fff700 1 --2- 172.21.15.112:0/2833324425 >> v2:172.21.15.133:3300/0 conn(0x7fb194159cd0 0x7fb19415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb1937fe700 1 -- 172.21.15.112:0/2833324425 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39216666 0 0) 0x7fb19415d650 con 0x7fb19406ff10 2023-11-08T12:28:42.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb18b7fe700 1 -- 172.21.15.112:0/2833324425 >> v2:172.21.15.133:3300/0 conn(0x7fb194159cd0 msgr2=0x7fb19415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:42.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb18b7fe700 1 --2- 172.21.15.112:0/2833324425 >> v2:172.21.15.133:3300/0 conn(0x7fb194159cd0 0x7fb19415d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb18b7fe700 1 -- 172.21.15.112:0/2833324425 >> v1:172.21.15.112:6789/0 conn(0x7fb19406ff10 legacy=0x7fb194069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb18b7fe700 1 -- 172.21.15.112:0/2833324425 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940cdf80 con 0x7fb1940cc1a0 2023-11-08T12:28:42.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.660+0000 7fb18b7fe700 1 --2- 172.21.15.112:0/2833324425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb19406c890 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1940cb9b0 tx=0x7fb17c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6794935278577fd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:42.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb1937fe700 1 -- 172.21.15.112:0/2833324425 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c011830 con 0x7fb1940cc1a0 2023-11-08T12:28:42.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb1937fe700 1 -- 172.21.15.112:0/2833324425 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c011990 con 0x7fb1940cc1a0 2023-11-08T12:28:42.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb1937fe700 1 -- 172.21.15.112:0/2833324425 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c011d20 con 0x7fb1940cc1a0 2023-11-08T12:28:42.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 -- 172.21.15.112:0/2833324425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 msgr2=0x7fb19406c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 --2- 172.21.15.112:0/2833324425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb19406c890 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb1940cb9b0 tx=0x7fb17c009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:42.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 -- 172.21.15.112:0/2833324425 shutdown_connections 2023-11-08T12:28:42.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 --2- 172.21.15.112:0/2833324425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb19406c890 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 --2- 172.21.15.112:0/2833324425 >> v2:172.21.15.133:3300/0 conn(0x7fb194159cd0 0x7fb19415d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 -- 172.21.15.112:0/2833324425 >> 172.21.15.112:0/2833324425 conn(0x7fb1940cf280 msgr2=0x7fb1940cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:42.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 -- 172.21.15.112:0/2833324425 shutdown_connections 2023-11-08T12:28:42.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 -- 172.21.15.112:0/2833324425 wait complete. 2023-11-08T12:28:42.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.664+0000 7fb199545700 1 Processor -- start 2023-11-08T12:28:42.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 -- start start 2023-11-08T12:28:42.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb19406ff10 0x7fb1940b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb1940b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194159cd0 0x7fb1940c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b4270 con 0x7fb1940cc1a0 2023-11-08T12:28:42.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b1e00 con 0x7fb194159cd0 2023-11-08T12:28:42.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19415a270 con 0x7fb19406ff10 2023-11-08T12:28:42.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb1940b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb1940b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36172/0 (socket says 172.21.15.112:36172) 2023-11-08T12:28:42.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 -- 172.21.15.112:0/3749388341 learned_addr learned my addr 172.21.15.112:0/3749388341 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:42.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb193fff700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb19406ff10 0x7fb1940b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb198d44700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194159cd0 0x7fb1940c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 -- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb19406ff10 msgr2=0x7fb1940b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb19406ff10 0x7fb1940b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 -- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194159cd0 msgr2=0x7fb1940c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194159cd0 0x7fb1940c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 -- 172.21.15.112:0/3749388341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0094b0 con 0x7fb1940cc1a0 2023-11-08T12:28:42.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb18b7fe700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb1940b18c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009fd0 tx=0x7fb17c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:42.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb1917fa700 1 -- 172.21.15.112:0/3749388341 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c004480 con 0x7fb1940cc1a0 2023-11-08T12:28:42.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb1917fa700 1 -- 172.21.15.112:0/3749388341 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c01f070 con 0x7fb1940cc1a0 2023-11-08T12:28:42.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb1917fa700 1 -- 172.21.15.112:0/3749388341 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c003900 con 0x7fb1940cc1a0 2023-11-08T12:28:42.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19406c090 con 0x7fb1940cc1a0 2023-11-08T12:28:42.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.668+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1940ce260 con 0x7fb1940cc1a0 2023-11-08T12:28:42.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.672+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19406c370 con 0x7fb1940cc1a0 2023-11-08T12:28:42.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.672+0000 7fb1917fa700 1 -- 172.21.15.112:0/3749388341 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb17c02a020 con 0x7fb1940cc1a0 2023-11-08T12:28:42.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.676+0000 7fb1917fa700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb174064ee0 0x7fb174067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:42.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.676+0000 7fb1917fa700 1 -- 172.21.15.112:0/3749388341 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb17c0836b0 con 0x7fb1940cc1a0 2023-11-08T12:28:42.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.676+0000 7fb193fff700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb174064ee0 0x7fb174067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:42.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.676+0000 7fb193fff700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb174064ee0 0x7fb174067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb184009b50 tx=0x7fb184009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:42.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.680+0000 7fb1917fa700 1 -- 172.21.15.112:0/3749388341 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb17c051520 con 0x7fb1940cc1a0 2023-11-08T12:28:42.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.848+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1940cca80 con 0x7fb1940cc1a0 2023-11-08T12:28:42.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.852+0000 7fb1917fa700 1 -- 172.21.15.112:0/3749388341 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb17c0150a0 con 0x7fb1940cc1a0 2023-11-08T12:28:42.854 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb174064ee0 msgr2=0x7fb174067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb174064ee0 0x7fb174067390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb184009b50 tx=0x7fb184009240 comp rx=0 tx=0).stop 2023-11-08T12:28:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 msgr2=0x7fb1940b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:42.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb1940b18c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009fd0 tx=0x7fb17c004770 comp rx=0 tx=0).stop 2023-11-08T12:28:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 shutdown_connections 2023-11-08T12:28:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb174064ee0 0x7fb174067390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194159cd0 0x7fb1940c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1940cc1a0 0x7fb1940b18c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 --2- 172.21.15.112:0/3749388341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb19406ff10 0x7fb1940b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:42.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 >> 172.21.15.112:0/3749388341 conn(0x7fb1940cf280 msgr2=0x7fb1940c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:42.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 shutdown_connections 2023-11-08T12:28:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:42.856+0000 7fb199545700 1 -- 172.21.15.112:0/3749388341 wait complete. 2023-11-08T12:28:42.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.056+0000 7f1d49a62700 1 Processor -- start 2023-11-08T12:28:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.060+0000 7f1d49a62700 1 -- start start 2023-11-08T12:28:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.060+0000 7f1d49a62700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d4415c150 0x7f1d440b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.060+0000 7f1d49a62700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d44070360 0x7f1d44160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.060+0000 7f1d49a62700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4415c520 con 0x7f1d4406ff10 2023-11-08T12:28:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.060+0000 7f1d49a62700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d440b4240 con 0x7f1d4415c150 2023-11-08T12:28:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4406ac00 con 0x7f1d44070360 2023-11-08T12:28:43.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d437fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d4415c150 0x7f1d440b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d42ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1d4406ff10 0x7f1d4415fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55354/0 (socket says 172.21.15.112:55354) 2023-11-08T12:28:43.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d42ffd700 1 -- 172.21.15.112:0/3083547627 learned_addr learned my addr 172.21.15.112:0/3083547627 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:43.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d43fff700 1 --2- 172.21.15.112:0/3083547627 >> v2:172.21.15.133:3300/0 conn(0x7f1d44070360 0x7f1d44160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d427fc700 1 -- 172.21.15.112:0/3083547627 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745346881 0 0) 0x7f1d4415c520 con 0x7f1d4406ff10 2023-11-08T12:28:43.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d427fc700 1 -- 172.21.15.112:0/3083547627 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c0035d0 con 0x7f1d4406ff10 2023-11-08T12:28:43.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d437fe700 1 -- 172.21.15.112:0/3083547627 >> v2:172.21.15.133:3300/0 conn(0x7f1d44070360 msgr2=0x7f1d44160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:43.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d437fe700 1 --2- 172.21.15.112:0/3083547627 >> v2:172.21.15.133:3300/0 conn(0x7f1d44070360 0x7f1d44160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d437fe700 1 -- 172.21.15.112:0/3083547627 >> v1:172.21.15.112:6789/0 conn(0x7f1d4406ff10 legacy=0x7f1d4415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d437fe700 1 -- 172.21.15.112:0/3083547627 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4406cc50 con 0x7f1d4415c150 2023-11-08T12:28:43.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d437fe700 1 --2- 172.21.15.112:0/3083547627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d4415c150 0x7f1d440b3d00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d4406de90 tx=0x7f1d34009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34576d2dde61daa server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d427fc700 1 -- 172.21.15.112:0/3083547627 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34011830 con 0x7f1d4415c150 2023-11-08T12:28:43.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d427fc700 1 -- 172.21.15.112:0/3083547627 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34011990 con 0x7f1d4415c150 2023-11-08T12:28:43.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d427fc700 1 -- 172.21.15.112:0/3083547627 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34011d20 con 0x7f1d4415c150 2023-11-08T12:28:43.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 -- 172.21.15.112:0/3083547627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d4415c150 msgr2=0x7f1d440b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 --2- 172.21.15.112:0/3083547627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d4415c150 0x7f1d440b3d00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d4406de90 tx=0x7f1d34009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:43.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 -- 172.21.15.112:0/3083547627 shutdown_connections 2023-11-08T12:28:43.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 --2- 172.21.15.112:0/3083547627 >> v2:172.21.15.133:3300/0 conn(0x7f1d44070360 0x7f1d44160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 --2- 172.21.15.112:0/3083547627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d4415c150 0x7f1d440b3d00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 -- 172.21.15.112:0/3083547627 >> 172.21.15.112:0/3083547627 conn(0x7f1d440d3680 msgr2=0x7f1d440cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:43.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 -- 172.21.15.112:0/3083547627 shutdown_connections 2023-11-08T12:28:43.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.064+0000 7f1d49a62700 1 -- 172.21.15.112:0/3083547627 wait complete. 2023-11-08T12:28:43.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.068+0000 7f1d49a62700 1 Processor -- start 2023-11-08T12:28:43.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.068+0000 7f1d49a62700 1 -- start start 2023-11-08T12:28:43.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d49a62700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d4406ff10 0x7f1d4415fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d49a62700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d44070360 0x7f1d4415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d49a62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d4415c150 0x7f1d440b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d49a62700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4415d610 con 0x7f1d44070360 2023-11-08T12:28:43.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d49a62700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4415d8b0 con 0x7f1d4406ff10 2023-11-08T12:28:43.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d49a62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4415db90 con 0x7f1d4415c150 2023-11-08T12:28:43.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d44070360 0x7f1d4415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d44070360 0x7f1d4415d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36200/0 (socket says 172.21.15.112:36200) 2023-11-08T12:28:43.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 -- 172.21.15.112:0/4109914095 learned_addr learned my addr 172.21.15.112:0/4109914095 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:43.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d437fe700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d4406ff10 0x7f1d4415fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d43fff700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d4415c150 0x7f1d440b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 -- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d4415c150 msgr2=0x7f1d440b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d4415c150 0x7f1d440b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 -- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d4406ff10 msgr2=0x7f1d4415fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d4406ff10 0x7f1d4415fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 -- 172.21.15.112:0/4109914095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340094b0 con 0x7f1d44070360 2023-11-08T12:28:43.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.072+0000 7f1d42ffd700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d44070360 0x7f1d4415d0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1d38001260 tx=0x7f1d3800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.076+0000 7f1d2bfff700 1 -- 172.21.15.112:0/4109914095 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380074e0 con 0x7f1d44070360 2023-11-08T12:28:43.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.076+0000 7f1d2bfff700 1 -- 172.21.15.112:0/4109914095 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d38007640 con 0x7f1d44070360 2023-11-08T12:28:43.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.076+0000 7f1d2bfff700 1 -- 172.21.15.112:0/4109914095 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38005a50 con 0x7f1d44070360 2023-11-08T12:28:43.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.076+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d440d2730 con 0x7f1d44070360 2023-11-08T12:28:43.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.076+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d440d2450 con 0x7f1d44070360 2023-11-08T12:28:43.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.076+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d440d05e0 con 0x7f1d44070360 2023-11-08T12:28:43.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.076+0000 7f1d2bfff700 1 -- 172.21.15.112:0/4109914095 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1d38019030 con 0x7f1d44070360 2023-11-08T12:28:43.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.080+0000 7f1d2bfff700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1d30064ee0 0x7f1d30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.080+0000 7f1d2bfff700 1 -- 172.21.15.112:0/4109914095 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d380813b0 con 0x7f1d44070360 2023-11-08T12:28:43.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.080+0000 7f1d437fe700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1d30064ee0 0x7f1d30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.080+0000 7f1d437fe700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1d30064ee0 0x7f1d30067390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d34000c00 tx=0x7f1d34008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.084+0000 7f1d2bfff700 1 -- 172.21.15.112:0/4109914095 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1d3804a400 con 0x7f1d44070360 2023-11-08T12:28:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.256+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1d44073d20 con 0x7f1d44070360 2023-11-08T12:28:43.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d2bfff700 1 -- 172.21.15.112:0/4109914095 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1d38017020 con 0x7f1d44070360 2023-11-08T12:28:43.263 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1d30064ee0 msgr2=0x7f1d30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1d30064ee0 0x7f1d30067390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d34000c00 tx=0x7f1d34008030 comp rx=0 tx=0).stop 2023-11-08T12:28:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d44070360 msgr2=0x7f1d4415d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d44070360 0x7f1d4415d0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1d38001260 tx=0x7f1d3800c9e0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 shutdown_connections 2023-11-08T12:28:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1d30064ee0 0x7f1d30067390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d4415c150 0x7f1d440b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d44070360 0x7f1d4415d0d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 --2- 172.21.15.112:0/4109914095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d4406ff10 0x7f1d4415fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 >> 172.21.15.112:0/4109914095 conn(0x7f1d440d3680 msgr2=0x7f1d440b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:43.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 shutdown_connections 2023-11-08T12:28:43.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.260+0000 7f1d49a62700 1 -- 172.21.15.112:0/4109914095 wait complete. 2023-11-08T12:28:43.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:43.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3312dd700 1 Processor -- start 2023-11-08T12:28:43.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3312dd700 1 -- start start 2023-11-08T12:28:43.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3312dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb32c159f10 0x7fb32c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3312dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c15a9f0 0x7fb32c06b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3312dd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32c070600 con 0x7fb32c0c8c90 2023-11-08T12:28:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3312dd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32c0c9130 con 0x7fb32c159f10 2023-11-08T12:28:43.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3312dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c06b840 con 0x7fb32c15a9f0 2023-11-08T12:28:43.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3237fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb32c0c8c90 0x7fb32c15a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55364/0 (socket says 172.21.15.112:55364) 2023-11-08T12:28:43.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb3237fe700 1 -- 172.21.15.112:0/1495393850 learned_addr learned my addr 172.21.15.112:0/1495393850 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:43.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb32bfff700 1 --2- 172.21.15.112:0/1495393850 >> v2:172.21.15.133:3300/0 conn(0x7fb32c159f10 0x7fb32c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.472+0000 7fb330adc700 1 --2- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c15a9f0 0x7fb32c06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32b7fe700 1 -- 172.21.15.112:0/1495393850 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605108552 0 0) 0x7fb32c070600 con 0x7fb32c0c8c90 2023-11-08T12:28:43.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32b7fe700 1 -- 172.21.15.112:0/1495393850 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3180035d0 con 0x7fb32c0c8c90 2023-11-08T12:28:43.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32bfff700 1 -- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c15a9f0 msgr2=0x7fb32c06b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:43.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32bfff700 1 --2- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c15a9f0 0x7fb32c06b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32bfff700 1 -- 172.21.15.112:0/1495393850 >> v1:172.21.15.112:6789/0 conn(0x7fb32c0c8c90 legacy=0x7fb32c15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32b7fe700 1 -- 172.21.15.112:0/1495393850 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250566494 0 0) 0x7fb3180035d0 con 0x7fb32c0c8c90 2023-11-08T12:28:43.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32bfff700 1 -- 172.21.15.112:0/1495393850 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c15ae10 con 0x7fb32c159f10 2023-11-08T12:28:43.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32bfff700 1 --2- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c159f10 0x7fb32c070a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009850 tx=0x7fb31c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6fae72448d146ef server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32b7fe700 1 -- 172.21.15.112:0/1495393850 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314001670 con 0x7fb32c159f10 2023-11-08T12:28:43.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32b7fe700 1 -- 172.21.15.112:0/1495393850 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c004030 con 0x7fb32c159f10 2023-11-08T12:28:43.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb32b7fe700 1 -- 172.21.15.112:0/1495393850 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0043e0 con 0x7fb32c159f10 2023-11-08T12:28:43.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 -- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c159f10 msgr2=0x7fb32c070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c159f10 0x7fb32c070a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009850 tx=0x7fb31c009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:43.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 -- 172.21.15.112:0/1495393850 shutdown_connections 2023-11-08T12:28:43.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c15a9f0 0x7fb32c06b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1495393850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c159f10 0x7fb32c070a90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 -- 172.21.15.112:0/1495393850 >> 172.21.15.112:0/1495393850 conn(0x7fb32c0cf280 msgr2=0x7fb32c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:43.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 -- 172.21.15.112:0/1495393850 shutdown_connections 2023-11-08T12:28:43.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.476+0000 7fb3312dd700 1 -- 172.21.15.112:0/1495393850 wait complete. 2023-11-08T12:28:43.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 Processor -- start 2023-11-08T12:28:43.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 -- start start 2023-11-08T12:28:43.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c0c8c90 0x7fb32c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32c159f10 0x7fb32c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c15a9f0 0x7fb32c0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c0abf70 con 0x7fb32c159f10 2023-11-08T12:28:43.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c154ab0 con 0x7fb32c15a9f0 2023-11-08T12:28:43.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3312dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c0b2c80 con 0x7fb32c0c8c90 2023-11-08T12:28:43.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3237fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32c159f10 0x7fb32c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3237fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32c159f10 0x7fb32c0affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36202/0 (socket says 172.21.15.112:36202) 2023-11-08T12:28:43.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb330adc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c15a9f0 0x7fb32c0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb3237fe700 1 -- 172.21.15.112:0/1177860290 learned_addr learned my addr 172.21.15.112:0/1177860290 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:43.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.480+0000 7fb32bfff700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c0c8c90 0x7fb32c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb330adc700 1 -- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c0c8c90 msgr2=0x7fb32c154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb330adc700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c0c8c90 0x7fb32c154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb330adc700 1 -- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32c159f10 msgr2=0x7fb32c0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb330adc700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32c159f10 0x7fb32c0affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb330adc700 1 -- 172.21.15.112:0/1177860290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0094b0 con 0x7fb32c15a9f0 2023-11-08T12:28:43.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb3237fe700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32c159f10 0x7fb32c0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:43.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb330adc700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c15a9f0 0x7fb32c0b04e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb32400eba0 tx=0x7fb32400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb3297fa700 1 -- 172.21.15.112:0/1177860290 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324009a80 con 0x7fb32c15a9f0 2023-11-08T12:28:43.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb3297fa700 1 -- 172.21.15.112:0/1177860290 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32400f040 con 0x7fb32c15a9f0 2023-11-08T12:28:43.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c06ffb0 con 0x7fb32c15a9f0 2023-11-08T12:28:43.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb3297fa700 1 -- 172.21.15.112:0/1177860290 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32400cc40 con 0x7fb32c15a9f0 2023-11-08T12:28:43.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c0afcc0 con 0x7fb32c15a9f0 2023-11-08T12:28:43.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.484+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c070290 con 0x7fb32c15a9f0 2023-11-08T12:28:43.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.488+0000 7fb3297fa700 1 -- 172.21.15.112:0/1177860290 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb324014480 con 0x7fb32c15a9f0 2023-11-08T12:28:43.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.488+0000 7fb3297fa700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb30c064ee0 0x7fb30c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.488+0000 7fb3297fa700 1 -- 172.21.15.112:0/1177860290 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb324082cf0 con 0x7fb32c15a9f0 2023-11-08T12:28:43.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.488+0000 7fb32bfff700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb30c064ee0 0x7fb30c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.492+0000 7fb32bfff700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb30c064ee0 0x7fb30c067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0090b0 tx=0x7fb31c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.500+0000 7fb3297fa700 1 -- 172.21.15.112:0/1177860290 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb324050a10 con 0x7fb32c15a9f0 2023-11-08T12:28:43.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.676+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb32c06cf30 con 0x7fb32c15a9f0 2023-11-08T12:28:43.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.676+0000 7fb3297fa700 1 -- 172.21.15.112:0/1177860290 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb324018020 con 0x7fb32c15a9f0 2023-11-08T12:28:43.682 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb30c064ee0 msgr2=0x7fb30c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb30c064ee0 0x7fb30c067390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0090b0 tx=0x7fb31c008030 comp rx=0 tx=0).stop 2023-11-08T12:28:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c15a9f0 msgr2=0x7fb32c0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c15a9f0 0x7fb32c0b04e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb32400eba0 tx=0x7fb32400eeb0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 shutdown_connections 2023-11-08T12:28:43.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb30c064ee0 0x7fb30c067390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c15a9f0 0x7fb32c0b04e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb32c159f10 0x7fb32c0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 --2- 172.21.15.112:0/1177860290 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb32c0c8c90 0x7fb32c154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 >> 172.21.15.112:0/1177860290 conn(0x7fb32c0cf280 msgr2=0x7fb32c0c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:43.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 shutdown_connections 2023-11-08T12:28:43.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.684+0000 7fb3312dd700 1 -- 172.21.15.112:0/1177860290 wait complete. 2023-11-08T12:28:43.709 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:43.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.888+0000 7f4ac7fff700 1 Processor -- start 2023-11-08T12:28:43.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.888+0000 7f4ac7fff700 1 -- start start 2023-11-08T12:28:43.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ac8070620 0x7f4ac80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac7fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8069bf0 0x7f4ac806a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac7fff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac815c520 con 0x7f4ac815c150 2023-11-08T12:28:43.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac7fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac80b4240 con 0x7f4ac8070620 2023-11-08T12:28:43.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac7fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac806cc50 con 0x7f4ac8069bf0 2023-11-08T12:28:43.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac6ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4ac815c150 0x7f4ac806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55378/0 (socket says 172.21.15.112:55378) 2023-11-08T12:28:43.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac67fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ac8070620 0x7f4ac80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac6ffd700 1 -- 172.21.15.112:0/1534996951 learned_addr learned my addr 172.21.15.112:0/1534996951 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:43.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac77fe700 1 --2- 172.21.15.112:0/1534996951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8069bf0 0x7f4ac806a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac67fc700 1 -- 172.21.15.112:0/1534996951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8069bf0 msgr2=0x7f4ac806a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:43.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac67fc700 1 --2- 172.21.15.112:0/1534996951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8069bf0 0x7f4ac806a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac67fc700 1 -- 172.21.15.112:0/1534996951 >> v1:172.21.15.112:6789/0 conn(0x7f4ac815c150 legacy=0x7f4ac806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac5ffb700 1 -- 172.21.15.112:0/1534996951 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011633103 0 0) 0x7f4ac815c520 con 0x7f4ac815c150 2023-11-08T12:28:43.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac67fc700 1 -- 172.21.15.112:0/1534996951 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac80d2450 con 0x7f4ac8070620 2023-11-08T12:28:43.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac67fc700 1 --2- 172.21.15.112:0/1534996951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8070620 0x7f4ac80b3d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009840 tx=0x7f4abc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3432d7031ab968b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac5ffb700 1 -- 172.21.15.112:0/1534996951 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc005e50 con 0x7f4ac8070620 2023-11-08T12:28:43.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac5ffb700 1 -- 172.21.15.112:0/1534996951 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc006030 con 0x7f4ac8070620 2023-11-08T12:28:43.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac5ffb700 1 -- 172.21.15.112:0/1534996951 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0063c0 con 0x7f4ac8070620 2023-11-08T12:28:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac7fff700 1 -- 172.21.15.112:0/1534996951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8070620 msgr2=0x7f4ac80b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.892+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/1534996951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8070620 0x7f4ac80b3d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009840 tx=0x7f4abc009b50 comp rx=0 tx=0).stop 2023-11-08T12:28:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- 172.21.15.112:0/1534996951 shutdown_connections 2023-11-08T12:28:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/1534996951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8069bf0 0x7f4ac806a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/1534996951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8070620 0x7f4ac80b3d00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- 172.21.15.112:0/1534996951 >> 172.21.15.112:0/1534996951 conn(0x7f4ac80d3680 msgr2=0x7f4ac80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:43.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- 172.21.15.112:0/1534996951 shutdown_connections 2023-11-08T12:28:43.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- 172.21.15.112:0/1534996951 wait complete. 2023-11-08T12:28:43.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 Processor -- start 2023-11-08T12:28:43.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- start start 2023-11-08T12:28:43.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8069bf0 0x7f4ac80b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8070620 0x7f4ac80cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815c150 0x7f4ac8158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8140290 con 0x7f4ac8069bf0 2023-11-08T12:28:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80b7990 con 0x7f4ac815c150 2023-11-08T12:28:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.896+0000 7f4ac7fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80b7c70 con 0x7f4ac8070620 2023-11-08T12:28:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8069bf0 0x7f4ac80b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8069bf0 0x7f4ac80b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36210/0 (socket says 172.21.15.112:36210) 2023-11-08T12:28:43.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 -- 172.21.15.112:0/3091327146 learned_addr learned my addr 172.21.15.112:0/3091327146 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:43.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac67fc700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8070620 0x7f4ac80cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac77fe700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815c150 0x7f4ac8158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 -- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8070620 msgr2=0x7f4ac80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8070620 0x7f4ac80cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 -- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815c150 msgr2=0x7f4ac8158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:43.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815c150 0x7f4ac8158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:43.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 -- 172.21.15.112:0/3091327146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc009450 con 0x7f4ac8069bf0 2023-11-08T12:28:43.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac6ffd700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8069bf0 0x7f4ac80b7380 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c4e0 tx=0x7f4ab800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4aaf7fe700 1 -- 172.21.15.112:0/3091327146 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8004ca0 con 0x7f4ac8069bf0 2023-11-08T12:28:43.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4aaf7fe700 1 -- 172.21.15.112:0/3091327146 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab8004e20 con 0x7f4ac8069bf0 2023-11-08T12:28:43.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4aaf7fe700 1 -- 172.21.15.112:0/3091327146 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8007310 con 0x7f4ac8069bf0 2023-11-08T12:28:43.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac80d05e0 con 0x7f4ac8069bf0 2023-11-08T12:28:43.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac80d2730 con 0x7f4ac8069bf0 2023-11-08T12:28:43.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.900+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac80d2140 con 0x7f4ac8069bf0 2023-11-08T12:28:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.904+0000 7f4aaf7fe700 1 -- 172.21.15.112:0/3091327146 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ab801a020 con 0x7f4ac8069bf0 2023-11-08T12:28:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.904+0000 7f4aaf7fe700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ab4064f10 0x7f4ab40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.904+0000 7f4aaf7fe700 1 -- 172.21.15.112:0/3091327146 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ab8081bf0 con 0x7f4ac8069bf0 2023-11-08T12:28:43.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.904+0000 7f4ac67fc700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ab4064f10 0x7f4ab40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:43.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.908+0000 7f4ac67fc700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ab4064f10 0x7f4ab40673c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8070a10 tx=0x7f4abc008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:43.912+0000 7f4aaf7fe700 1 -- 172.21.15.112:0/3091327146 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ab804fa60 con 0x7f4ac8069bf0 2023-11-08T12:28:44.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.088+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ac8155fc0 con 0x7f4ac8069bf0 2023-11-08T12:28:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.088+0000 7f4aaf7fe700 1 -- 172.21.15.112:0/3091327146 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ab8053080 con 0x7f4ac8069bf0 2023-11-08T12:28:44.094 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ab4064f10 msgr2=0x7f4ab40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ab4064f10 0x7f4ab40673c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8070a10 tx=0x7f4abc008070 comp rx=0 tx=0).stop 2023-11-08T12:28:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8069bf0 msgr2=0x7f4ac80b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8069bf0 0x7f4ac80b7380 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c4e0 tx=0x7f4ab800c7f0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 shutdown_connections 2023-11-08T12:28:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ab4064f10 0x7f4ab40673c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac815c150 0x7f4ac8158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac8070620 0x7f4ac80cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 --2- 172.21.15.112:0/3091327146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ac8069bf0 0x7f4ac80b7380 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 >> 172.21.15.112:0/3091327146 conn(0x7f4ac80d3680 msgr2=0x7f4ac80c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 shutdown_connections 2023-11-08T12:28:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.092+0000 7f4ac7fff700 1 -- 172.21.15.112:0/3091327146 wait complete. 2023-11-08T12:28:44.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:44.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.304+0000 7fe4a2285700 1 Processor -- start 2023-11-08T12:28:44.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.304+0000 7fe4a2285700 1 -- start start 2023-11-08T12:28:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a2285700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe49c0b3d00 0x7fe49c06a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a2285700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c15c520 con 0x7fe49c070620 2023-11-08T12:28:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a2285700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c06cc50 con 0x7fe49c15c150 2023-11-08T12:28:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a2285700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0d2450 con 0x7fe49c0b3d00 2023-11-08T12:28:44.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a0a82700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe49c070620 0x7fe49c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55388/0 (socket says 172.21.15.112:55388) 2023-11-08T12:28:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a0a82700 1 -- 172.21.15.112:0/304550575 learned_addr learned my addr 172.21.15.112:0/304550575 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a1a84700 1 --2- 172.21.15.112:0/304550575 >> v2:172.21.15.133:3300/0 conn(0x7fe49c0b3d00 0x7fe49c06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121243515 0 0) 0x7fe49c06cc50 con 0x7fe49c15c150 2023-11-08T12:28:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4880035d0 con 0x7fe49c15c150 2023-11-08T12:28:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553583822 0 0) 0x7fe49c15c520 con 0x7fe49c070620 2023-11-08T12:28:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe49c06cc50 con 0x7fe49c070620 2023-11-08T12:28:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003716264 0 0) 0x7fe49c06cc50 con 0x7fe49c070620 2023-11-08T12:28:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 >> v2:172.21.15.133:3300/0 conn(0x7fe49c0b3d00 msgr2=0x7fe49c06a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 --2- 172.21.15.112:0/304550575 >> v2:172.21.15.133:3300/0 conn(0x7fe49c0b3d00 0x7fe49c06a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 >> v1:172.21.15.133:6789/0 conn(0x7fe49c15c150 legacy=0x7fe49c06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0d2730 con 0x7fe49c070620 2023-11-08T12:28:44.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fe48c005140 con 0x7fe49c070620 2023-11-08T12:28:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 >> v1:172.21.15.112:6789/0 conn(0x7fe49c070620 legacy=0x7fe49c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe488003bb0 0x7fe488003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488004870 0x7fe488004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe488005220 0x7fe48800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0d2450 con 0x7fe488004870 2023-11-08T12:28:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48800c080 con 0x7fe488005220 2023-11-08T12:28:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48800c240 con 0x7fe488003bb0 2023-11-08T12:28:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a1a84700 1 --2- 172.21.15.112:0/304550575 >> v2:172.21.15.133:3300/0 conn(0x7fe49c0b3d00 0x7fe49c06a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:44.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a0a82700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488004870 0x7fe488004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a1283700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe488003bb0 0x7fe488003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.308+0000 7fe4a1a84700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe488005220 0x7fe48800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a1283700 1 -- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe488005220 msgr2=0x7fe48800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a1283700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe488005220 0x7fe48800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a1283700 1 -- 172.21.15.112:0/304550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488004870 msgr2=0x7fe488004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a1283700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488004870 0x7fe488004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a1283700 1 -- 172.21.15.112:0/304550575 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c06cc50 con 0x7fe488003bb0 2023-11-08T12:28:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a1a84700 1 -- 172.21.15.112:0/304550575 reap_dead start 2023-11-08T12:28:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a1283700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe488003bb0 0x7fe488003fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe498001990 tx=0x7fe4880058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1822d388cc852d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4980052d0 con 0x7fe488003bb0 2023-11-08T12:28:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498005430 con 0x7fe488003bb0 2023-11-08T12:28:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe493fff700 1 -- 172.21.15.112:0/304550575 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4980055a0 con 0x7fe488003bb0 2023-11-08T12:28:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a2285700 1 -- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe488003bb0 msgr2=0x7fe488003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a2285700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe488003bb0 0x7fe488003fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe498001990 tx=0x7fe4880058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a2285700 1 -- 172.21.15.112:0/304550575 shutdown_connections 2023-11-08T12:28:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a2285700 1 --2- 172.21.15.112:0/304550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe488003bb0 0x7fe488003fa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a2285700 1 -- 172.21.15.112:0/304550575 >> 172.21.15.112:0/304550575 conn(0x7fe49c0d3680 msgr2=0x7fe49c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a2285700 1 -- 172.21.15.112:0/304550575 shutdown_connections 2023-11-08T12:28:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.312+0000 7fe4a2285700 1 -- 172.21.15.112:0/304550575 wait complete. 2023-11-08T12:28:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 Processor -- start 2023-11-08T12:28:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 -- start start 2023-11-08T12:28:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488003bb0 0x7fe49c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe49c0ccfa0 0x7fe49c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe49c0cd3f0 0x7fe49c159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1f2a90 con 0x7fe488003bb0 2023-11-08T12:28:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cfe00 con 0x7fe49c0ccfa0 2023-11-08T12:28:44.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a2285700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c157e70 con 0x7fe49c0cd3f0 2023-11-08T12:28:44.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a1283700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488003bb0 0x7fe49c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a1283700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488003bb0 0x7fe49c1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36232/0 (socket says 172.21.15.112:36232) 2023-11-08T12:28:44.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.316+0000 7fe4a1283700 1 -- 172.21.15.112:0/3322392851 learned_addr learned my addr 172.21.15.112:0/3322392851 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:44.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a1a84700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe49c0cd3f0 0x7fe49c159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a0a82700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe49c0ccfa0 0x7fe49c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a1283700 1 -- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe49c0cd3f0 msgr2=0x7fe49c159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a1283700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe49c0cd3f0 0x7fe49c159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a1283700 1 -- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe49c0ccfa0 msgr2=0x7fe49c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a1283700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe49c0ccfa0 0x7fe49c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a1283700 1 -- 172.21.15.112:0/3322392851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0d2140 con 0x7fe488003bb0 2023-11-08T12:28:44.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a1283700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488003bb0 0x7fe49c1556e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c3d0 tx=0x7fe4980012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:44.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe491ffb700 1 -- 172.21.15.112:0/3322392851 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4980055a0 con 0x7fe488003bb0 2023-11-08T12:28:44.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe491ffb700 1 -- 172.21.15.112:0/3322392851 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498001440 con 0x7fe488003bb0 2023-11-08T12:28:44.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe491ffb700 1 -- 172.21.15.112:0/3322392851 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498007280 con 0x7fe488003bb0 2023-11-08T12:28:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c0d05e0 con 0x7fe488003bb0 2023-11-08T12:28:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c070cd0 con 0x7fe488003bb0 2023-11-08T12:28:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.320+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c073d20 con 0x7fe488003bb0 2023-11-08T12:28:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.324+0000 7fe491ffb700 1 -- 172.21.15.112:0/3322392851 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe49802d070 con 0x7fe488003bb0 2023-11-08T12:28:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.324+0000 7fe491ffb700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe480064f10 0x7fe4800673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.324+0000 7fe491ffb700 1 -- 172.21.15.112:0/3322392851 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe498082be0 con 0x7fe488003bb0 2023-11-08T12:28:44.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.324+0000 7fe4a0a82700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe480064f10 0x7fe4800673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.328+0000 7fe4a0a82700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe480064f10 0x7fe4800673c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0cf1b0 tx=0x7fe48c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:44.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.332+0000 7fe491ffb700 1 -- 172.21.15.112:0/3322392851 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe498050960 con 0x7fe488003bb0 2023-11-08T12:28:44.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.508+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe49c0ccb00 con 0x7fe488003bb0 2023-11-08T12:28:44.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.508+0000 7fe491ffb700 1 -- 172.21.15.112:0/3322392851 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe498053f80 con 0x7fe488003bb0 2023-11-08T12:28:44.512 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe480064f10 msgr2=0x7fe4800673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe480064f10 0x7fe4800673c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0cf1b0 tx=0x7fe48c009040 comp rx=0 tx=0).stop 2023-11-08T12:28:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488003bb0 msgr2=0x7fe49c1556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488003bb0 0x7fe49c1556e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c3d0 tx=0x7fe4980012d0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 shutdown_connections 2023-11-08T12:28:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe480064f10 0x7fe4800673c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe49c0cd3f0 0x7fe49c159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe49c0ccfa0 0x7fe49c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 --2- 172.21.15.112:0/3322392851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe488003bb0 0x7fe49c1556e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 >> 172.21.15.112:0/3322392851 conn(0x7fe49c0d3680 msgr2=0x7fe49c0b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 shutdown_connections 2023-11-08T12:28:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.512+0000 7fe4a2285700 1 -- 172.21.15.112:0/3322392851 wait complete. 2023-11-08T12:28:44.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:44.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.704+0000 7f7971271700 1 Processor -- start 2023-11-08T12:28:44.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7971271700 1 -- start start 2023-11-08T12:28:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7971271700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0b43a0 0x7f796c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7971271700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f796c0b1640 0x7f796c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7971271700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c15a550 con 0x7f796c0c9040 2023-11-08T12:28:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7971271700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c06b0a0 con 0x7f796c0b1640 2023-11-08T12:28:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7971271700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0caac0 con 0x7f796c0b43a0 2023-11-08T12:28:44.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7963fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f796c0b1640 0x7f796c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7963fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f796c0b1640 0x7f796c070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36248/0 (socket says 172.21.15.112:36248) 2023-11-08T12:28:44.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7963fff700 1 -- 172.21.15.112:0/1536886887 learned_addr learned my addr 172.21.15.112:0/1536886887 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:44.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f796affd700 1 --2- 172.21.15.112:0/1536886887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0b43a0 0x7f796c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7963fff700 1 -- 172.21.15.112:0/1536886887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0b43a0 msgr2=0x7f796c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:44.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7963fff700 1 --2- 172.21.15.112:0/1536886887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0b43a0 0x7f796c15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7963fff700 1 -- 172.21.15.112:0/1536886887 >> v1:172.21.15.133:6789/0 conn(0x7f796c0c9040 legacy=0x7f796c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.708+0000 7f7963fff700 1 -- 172.21.15.112:0/1536886887 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0cada0 con 0x7f796c0b1640 2023-11-08T12:28:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7963fff700 1 --2- 172.21.15.112:0/1536886887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c070080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7954009910 tx=0x7f7954009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef4d2557a6a64df server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f796a7fc700 1 -- 172.21.15.112:0/1536886887 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400ba60 con 0x7f796c0b1640 2023-11-08T12:28:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f796a7fc700 1 -- 172.21.15.112:0/1536886887 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795400bbc0 con 0x7f796c0b1640 2023-11-08T12:28:44.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f796a7fc700 1 -- 172.21.15.112:0/1536886887 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954009e60 con 0x7f796c0b1640 2023-11-08T12:28:44.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 -- 172.21.15.112:0/1536886887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 msgr2=0x7f796c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 --2- 172.21.15.112:0/1536886887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c070080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7954009910 tx=0x7f7954009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 -- 172.21.15.112:0/1536886887 shutdown_connections 2023-11-08T12:28:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 --2- 172.21.15.112:0/1536886887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c070080 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 --2- 172.21.15.112:0/1536886887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0b43a0 0x7f796c15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 -- 172.21.15.112:0/1536886887 >> 172.21.15.112:0/1536886887 conn(0x7f796c0b0f80 msgr2=0x7f796c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:44.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 -- 172.21.15.112:0/1536886887 shutdown_connections 2023-11-08T12:28:44.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.712+0000 7f7971271700 1 -- 172.21.15.112:0/1536886887 wait complete. 2023-11-08T12:28:44.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 Processor -- start 2023-11-08T12:28:44.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 -- start start 2023-11-08T12:28:44.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c1f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f796c0b43a0 0x7f796c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0c9040 0x7f796c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ad520 con 0x7f796c0b1640 2023-11-08T12:28:44.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ad240 con 0x7f796c0b43a0 2023-11-08T12:28:44.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1f51c0 con 0x7f796c0c9040 2023-11-08T12:28:44.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c1f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c1f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36264/0 (socket says 172.21.15.112:36264) 2023-11-08T12:28:44.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 -- 172.21.15.112:0/251895712 learned_addr learned my addr 172.21.15.112:0/251895712 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:44.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 -- 172.21.15.112:0/251895712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0c9040 msgr2=0x7f796c0c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0c9040 0x7f796c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 -- 172.21.15.112:0/251895712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f796c0b43a0 msgr2=0x7f796c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7963fff700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f796c0b43a0 0x7f796c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f796c0b43a0 0x7f796c0cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 -- 172.21.15.112:0/251895712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009570 con 0x7f796c0b1640 2023-11-08T12:28:44.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f796affd700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c1f5ca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f795c00e760 tx=0x7f795c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:44.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f79637fe700 1 -- 172.21.15.112:0/251895712 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c013610 con 0x7f796c0b1640 2023-11-08T12:28:44.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f79637fe700 1 -- 172.21.15.112:0/251895712 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c013770 con 0x7f796c0b1640 2023-11-08T12:28:44.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f79637fe700 1 -- 172.21.15.112:0/251895712 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c013ae0 con 0x7f796c0b1640 2023-11-08T12:28:44.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.716+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c06b5d0 con 0x7f796c0b1640 2023-11-08T12:28:44.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.720+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c06b2f0 con 0x7f796c0b1640 2023-11-08T12:28:44.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.720+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c15eb10 con 0x7f796c0b1640 2023-11-08T12:28:44.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.720+0000 7f79637fe700 1 -- 172.21.15.112:0/251895712 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f795c023070 con 0x7f796c0b1640 2023-11-08T12:28:44.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.724+0000 7f79637fe700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f794c064ee0 0x7f794c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:44.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.724+0000 7f79637fe700 1 -- 172.21.15.112:0/251895712 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f795c081f90 con 0x7f796c0b1640 2023-11-08T12:28:44.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.724+0000 7f7963fff700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f794c064ee0 0x7f794c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:44.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.724+0000 7f7963fff700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f794c064ee0 0x7f794c067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f796c1582f0 tx=0x7f7954008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:44.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.728+0000 7f79637fe700 1 -- 172.21.15.112:0/251895712 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f795c04fd10 con 0x7f796c0b1640 2023-11-08T12:28:44.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.904+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f796c073cb0 con 0x7f796c0b1640 2023-11-08T12:28:44.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.908+0000 7f79637fe700 1 -- 172.21.15.112:0/251895712 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f795c053330 con 0x7f796c0b1640 2023-11-08T12:28:44.912 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:44.912 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f794c064ee0 msgr2=0x7f794c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f794c064ee0 0x7f794c067390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f796c1582f0 tx=0x7f7954008030 comp rx=0 tx=0).stop 2023-11-08T12:28:44.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 msgr2=0x7f796c1f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c1f5ca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f795c00e760 tx=0x7f795c00eb20 comp rx=0 tx=0).stop 2023-11-08T12:28:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 shutdown_connections 2023-11-08T12:28:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f794c064ee0 0x7f794c067390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f796c0c9040 0x7f796c0c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f796c0b43a0 0x7f796c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 --2- 172.21.15.112:0/251895712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0b1640 0x7f796c1f5ca0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:44.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 >> 172.21.15.112:0/251895712 conn(0x7f796c0b0f80 msgr2=0x7f796c0ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:44.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 shutdown_connections 2023-11-08T12:28:44.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:44.912+0000 7f7971271700 1 -- 172.21.15.112:0/251895712 wait complete. 2023-11-08T12:28:44.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:44.939 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:45.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.112+0000 7fa194d41700 1 Processor -- start 2023-11-08T12:28:45.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.112+0000 7fa194d41700 1 -- start start 2023-11-08T12:28:45.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa194d41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa19015e190 0x7fa1900cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa194d41700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa190161560 0x7fa190069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa194d41700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa19006ff10 0x7fa190070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa194d41700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900708d0 con 0x7fa190161560 2023-11-08T12:28:45.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa194d41700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19015e560 con 0x7fa19006ff10 2023-11-08T12:28:45.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa194d41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19006be80 con 0x7fa19015e190 2023-11-08T12:28:45.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa190161560 0x7fa190069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa190161560 0x7fa190069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36266/0 (socket says 172.21.15.112:36266) 2023-11-08T12:28:45.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 -- 172.21.15.112:0/2828031837 learned_addr learned my addr 172.21.15.112:0/2828031837 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:45.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18f7fe700 1 --2- 172.21.15.112:0/2828031837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa19015e190 0x7fa1900cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18ffff700 1 --2- 172.21.15.112:0/2828031837 >> v2:172.21.15.133:3300/0 conn(0x7fa19006ff10 0x7fa190070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 -- 172.21.15.112:0/2828031837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa19015e190 msgr2=0x7fa1900cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 --2- 172.21.15.112:0/2828031837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa19015e190 0x7fa1900cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 -- 172.21.15.112:0/2828031837 >> v2:172.21.15.133:3300/0 conn(0x7fa19006ff10 msgr2=0x7fa190070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 --2- 172.21.15.112:0/2828031837 >> v2:172.21.15.133:3300/0 conn(0x7fa19006ff10 0x7fa190070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 -- 172.21.15.112:0/2828031837 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900ce330 con 0x7fa190161560 2023-11-08T12:28:45.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18ffff700 1 --2- 172.21.15.112:0/2828031837 >> v2:172.21.15.133:3300/0 conn(0x7fa19006ff10 0x7fa190070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:45.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18effd700 1 --2- 172.21.15.112:0/2828031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa190161560 0x7fa190069bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1900b4800 tx=0x7fa184009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8bb0fde7f6f68e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18e7fc700 1 -- 172.21.15.112:0/2828031837 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184011830 con 0x7fa190161560 2023-11-08T12:28:45.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18e7fc700 1 -- 172.21.15.112:0/2828031837 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184011990 con 0x7fa190161560 2023-11-08T12:28:45.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.116+0000 7fa18e7fc700 1 -- 172.21.15.112:0/2828031837 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184011d20 con 0x7fa190161560 2023-11-08T12:28:45.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 -- 172.21.15.112:0/2828031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa190161560 msgr2=0x7fa190069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 --2- 172.21.15.112:0/2828031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa190161560 0x7fa190069bf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1900b4800 tx=0x7fa184009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 -- 172.21.15.112:0/2828031837 shutdown_connections 2023-11-08T12:28:45.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 --2- 172.21.15.112:0/2828031837 >> v2:172.21.15.133:3300/0 conn(0x7fa19006ff10 0x7fa190070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 --2- 172.21.15.112:0/2828031837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa190161560 0x7fa190069bf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 --2- 172.21.15.112:0/2828031837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa19015e190 0x7fa1900cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 -- 172.21.15.112:0/2828031837 >> 172.21.15.112:0/2828031837 conn(0x7fa1900cf280 msgr2=0x7fa1900cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:45.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 -- 172.21.15.112:0/2828031837 shutdown_connections 2023-11-08T12:28:45.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.120+0000 7fa194d41700 1 -- 172.21.15.112:0/2828031837 wait complete. 2023-11-08T12:28:45.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 Processor -- start 2023-11-08T12:28:45.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 -- start start 2023-11-08T12:28:45.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa19006ff10 0x7fa1901477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa19015e190 0x7fa190155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa190161560 0x7fa1900c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c5960 con 0x7fa19006ff10 2023-11-08T12:28:45.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c5c40 con 0x7fa19015e190 2023-11-08T12:28:45.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c5f20 con 0x7fa190161560 2023-11-08T12:28:45.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa19006ff10 0x7fa1901477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa19006ff10 0x7fa1901477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36274/0 (socket says 172.21.15.112:36274) 2023-11-08T12:28:45.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 -- 172.21.15.112:0/86150299 learned_addr learned my addr 172.21.15.112:0/86150299 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:45.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18ffff700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa190161560 0x7fa1900c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18effd700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa19015e190 0x7fa190155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 -- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa190161560 msgr2=0x7fa1900c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa190161560 0x7fa1900c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 -- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa19015e190 msgr2=0x7fa190155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa19015e190 0x7fa190155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 -- 172.21.15.112:0/86150299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184009570 con 0x7fa19006ff10 2023-11-08T12:28:45.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18ffff700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa190161560 0x7fa1900c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:45.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa18f7fe700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa19006ff10 0x7fa1901477a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa18000ebe0 tx=0x7fa180009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa177fff700 1 -- 172.21.15.112:0/86150299 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180009740 con 0x7fa19006ff10 2023-11-08T12:28:45.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa177fff700 1 -- 172.21.15.112:0/86150299 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18000c8b0 con 0x7fa19006ff10 2023-11-08T12:28:45.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa177fff700 1 -- 172.21.15.112:0/86150299 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18000cc40 con 0x7fa19006ff10 2023-11-08T12:28:45.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.124+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900afc70 con 0x7fa19006ff10 2023-11-08T12:28:45.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.128+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1900af990 con 0x7fa19006ff10 2023-11-08T12:28:45.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.128+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1900aff50 con 0x7fa19006ff10 2023-11-08T12:28:45.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.128+0000 7fa177fff700 1 -- 172.21.15.112:0/86150299 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa180019030 con 0x7fa19006ff10 2023-11-08T12:28:45.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.128+0000 7fa177fff700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa17c064f10 0x7fa17c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.128+0000 7fa177fff700 1 -- 172.21.15.112:0/86150299 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa180082160 con 0x7fa19006ff10 2023-11-08T12:28:45.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.132+0000 7fa18effd700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa17c064f10 0x7fa17c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.132+0000 7fa18effd700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa17c064f10 0x7fa17c0673c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa184008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.136+0000 7fa177fff700 1 -- 172.21.15.112:0/86150299 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa18004ffd0 con 0x7fa19006ff10 2023-11-08T12:28:45.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.308+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa190073d20 con 0x7fa19006ff10 2023-11-08T12:28:45.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.308+0000 7fa177fff700 1 -- 172.21.15.112:0/86150299 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1800535f0 con 0x7fa19006ff10 2023-11-08T12:28:45.312 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:45.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa17c064f10 msgr2=0x7fa17c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa17c064f10 0x7fa17c0673c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa184008030 comp rx=0 tx=0).stop 2023-11-08T12:28:45.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa19006ff10 msgr2=0x7fa1901477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa19006ff10 0x7fa1901477a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa18000ebe0 tx=0x7fa180009e00 comp rx=0 tx=0).stop 2023-11-08T12:28:45.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 shutdown_connections 2023-11-08T12:28:45.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa17c064f10 0x7fa17c0673c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa190161560 0x7fa1900c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa19015e190 0x7fa190155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 --2- 172.21.15.112:0/86150299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa19006ff10 0x7fa1901477a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.312+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 >> 172.21.15.112:0/86150299 conn(0x7fa1900cf280 msgr2=0x7fa19015ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:45.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.316+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 shutdown_connections 2023-11-08T12:28:45.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.316+0000 7fa194d41700 1 -- 172.21.15.112:0/86150299 wait complete. 2023-11-08T12:28:45.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:45.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.528+0000 7f613631e700 1 Processor -- start 2023-11-08T12:28:45.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.528+0000 7f613631e700 1 -- start start 2023-11-08T12:28:45.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f613631e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61300b1f10 0x7f6130160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f613631e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300d2a90 con 0x7f613015ce20 2023-11-08T12:28:45.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f613631e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61300b26f0 con 0x7f61300d0890 2023-11-08T12:28:45.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f613631e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613015d900 con 0x7f61300b1f10 2023-11-08T12:28:45.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f613015ce20 0x7f613015d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48512/0 (socket says 172.21.15.112:48512) 2023-11-08T12:28:45.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612ffff700 1 -- 172.21.15.112:0/906477052 learned_addr learned my addr 172.21.15.112:0/906477052 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:45.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612f7fe700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61300b1f10 0x7f6130160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496412507 0 0) 0x7f61300d2a90 con 0x7f613015ce20 2023-11-08T12:28:45.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f611c0035d0 con 0x7f613015ce20 2023-11-08T12:28:45.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002382870 0 0) 0x7f61300b26f0 con 0x7f61300d0890 2023-11-08T12:28:45.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61300d2a90 con 0x7f61300d0890 2023-11-08T12:28:45.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919016996 0 0) 0x7f611c0035d0 con 0x7f613015ce20 2023-11-08T12:28:45.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61300b1f10 msgr2=0x7f6130160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61300b1f10 0x7f6130160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 >> v1:172.21.15.133:6789/0 conn(0x7f61300d0890 legacy=0x7f6130069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300b2410 con 0x7f613015ce20 2023-11-08T12:28:45.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f61280019f0 con 0x7f613015ce20 2023-11-08T12:28:45.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 >> v1:172.21.15.112:6789/0 conn(0x7f613015ce20 legacy=0x7f613015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61300b1f10 0x7f611c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c004140 0x7f611c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f611c004db0 0x7f611c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613015d900 con 0x7f611c004db0 2023-11-08T12:28:45.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c00bae0 con 0x7f611c004140 2023-11-08T12:28:45.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c00bca0 con 0x7f61300b1f10 2023-11-08T12:28:45.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.532+0000 7f61348bb700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f611c004db0 0x7f611c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f612f7fe700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c004140 0x7f611c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f61348bb700 1 -- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61300b1f10 msgr2=0x7f611c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f61348bb700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61300b1f10 0x7f611c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f61348bb700 1 -- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c004140 msgr2=0x7f611c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f61348bb700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c004140 0x7f611c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f61348bb700 1 -- 172.21.15.112:0/906477052 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0035d0 con 0x7f611c004db0 2023-11-08T12:28:45.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f612f7fe700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c004140 0x7f611c004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:45.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f61348bb700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f611c004db0 0x7f611c005220 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6120007fd0 tx=0x7f611c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c9303dcbd81248 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120001450 con 0x7f611c004db0 2023-11-08T12:28:45.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61200052f0 con 0x7f611c004db0 2023-11-08T12:28:45.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f612effd700 1 -- 172.21.15.112:0/906477052 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120001d60 con 0x7f611c004db0 2023-11-08T12:28:45.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f613631e700 1 -- 172.21.15.112:0/906477052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f611c004db0 msgr2=0x7f611c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f613631e700 1 --2- 172.21.15.112:0/906477052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f611c004db0 0x7f611c005220 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6120007fd0 tx=0x7f611c0058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f61348bb700 1 -- 172.21.15.112:0/906477052 reap_dead start 2023-11-08T12:28:45.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f613631e700 1 -- 172.21.15.112:0/906477052 shutdown_connections 2023-11-08T12:28:45.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f613631e700 1 -- 172.21.15.112:0/906477052 >> 172.21.15.112:0/906477052 conn(0x7f61300b49d0 msgr2=0x7f61300b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:45.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f613631e700 1 -- 172.21.15.112:0/906477052 shutdown_connections 2023-11-08T12:28:45.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.536+0000 7f613631e700 1 -- 172.21.15.112:0/906477052 wait complete. 2023-11-08T12:28:45.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 Processor -- start 2023-11-08T12:28:45.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 -- start start 2023-11-08T12:28:45.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c004db0 0x7f61301f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61301f10a0 0x7f6130069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613006a160 0x7f613015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130148210 con 0x7f61301f10a0 2023-11-08T12:28:45.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613006a5d0 con 0x7f613006a160 2023-11-08T12:28:45.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f613631e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61301f5c60 con 0x7f611c004db0 2023-11-08T12:28:45.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f612ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c004db0 0x7f61301f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f61348bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613006a160 0x7f613015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f612f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61301f10a0 0x7f6130069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f61348bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613006a160 0x7f613015b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:36328/0 (socket says 172.21.15.112:36328) 2023-11-08T12:28:45.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.540+0000 7f61348bb700 1 -- 172.21.15.112:0/870229008 learned_addr learned my addr 172.21.15.112:0/870229008 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:45.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f61348bb700 1 -- 172.21.15.112:0/870229008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c004db0 msgr2=0x7f61301f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f61348bb700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c004db0 0x7f61301f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f61348bb700 1 -- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61301f10a0 msgr2=0x7f6130069c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f61348bb700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61301f10a0 0x7f6130069c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f61348bb700 1 -- 172.21.15.112:0/870229008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130160230 con 0x7f613006a160 2023-11-08T12:28:45.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f612f7fe700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61301f10a0 0x7f6130069c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:45.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f61348bb700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613006a160 0x7f613015b590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f611c0047f0 tx=0x7f61200012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f612cff9700 1 -- 172.21.15.112:0/870229008 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6120006c90 con 0x7f613006a160 2023-11-08T12:28:45.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f612cff9700 1 -- 172.21.15.112:0/870229008 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6120006df0 con 0x7f613006a160 2023-11-08T12:28:45.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f612cff9700 1 -- 172.21.15.112:0/870229008 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61200038e0 con 0x7f613006a160 2023-11-08T12:28:45.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613015ff50 con 0x7f613006a160 2023-11-08T12:28:45.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6130160510 con 0x7f613006a160 2023-11-08T12:28:45.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61300726c0 con 0x7f613006a160 2023-11-08T12:28:45.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.544+0000 7f612cff9700 1 -- 172.21.15.112:0/870229008 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6120010050 con 0x7f613006a160 2023-11-08T12:28:45.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.548+0000 7f612cff9700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6110064ee0 0x7f6110067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.548+0000 7f612cff9700 1 -- 172.21.15.112:0/870229008 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6120082d60 con 0x7f613006a160 2023-11-08T12:28:45.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.548+0000 7f612ffff700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6110064ee0 0x7f6110067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.548+0000 7f612ffff700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6110064ee0 0x7f6110067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6128002230 tx=0x7f6128001d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.560+0000 7f612cff9700 1 -- 172.21.15.112:0/870229008 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6120050a60 con 0x7f613006a160 2023-11-08T12:28:45.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.732+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f613014fc20 con 0x7f613006a160 2023-11-08T12:28:45.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.736+0000 7f612cff9700 1 -- 172.21.15.112:0/870229008 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f612002c160 con 0x7f613006a160 2023-11-08T12:28:45.738 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6110064ee0 msgr2=0x7f6110067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6110064ee0 0x7f6110067390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6128002230 tx=0x7f6128001d80 comp rx=0 tx=0).stop 2023-11-08T12:28:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613006a160 msgr2=0x7f613015b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613006a160 0x7f613015b590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f611c0047f0 tx=0x7f61200012d0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 shutdown_connections 2023-11-08T12:28:45.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6110064ee0 0x7f6110067390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613006a160 0x7f613015b590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61301f10a0 0x7f6130069c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 --2- 172.21.15.112:0/870229008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c004db0 0x7f61301f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 >> 172.21.15.112:0/870229008 conn(0x7f61300b49d0 msgr2=0x7f6130159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:45.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 shutdown_connections 2023-11-08T12:28:45.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.740+0000 7f613631e700 1 -- 172.21.15.112:0/870229008 wait complete. 2023-11-08T12:28:45.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.944+0000 7f889d420700 1 Processor -- start 2023-11-08T12:28:45.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.944+0000 7f889d420700 1 -- start start 2023-11-08T12:28:45.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f889d420700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8898159f10 0x7f8898070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f889d420700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8898070600 con 0x7f88980c8c90 2023-11-08T12:28:45.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f889d420700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889815adf0 con 0x7f889815a9f0 2023-11-08T12:28:45.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f889d420700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980c9130 con 0x7f8898159f10 2023-11-08T12:28:45.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f888f7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f88980c8c90 0x7f889815a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48524/0 (socket says 172.21.15.112:48524) 2023-11-08T12:28:45.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f888f7fe700 1 -- 172.21.15.112:0/1429073267 learned_addr learned my addr 172.21.15.112:0/1429073267 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:45.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f8897fff700 1 --2- 172.21.15.112:0/1429073267 >> v2:172.21.15.112:3300/0 conn(0x7f8898159f10 0x7f8898070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756648203 0 0) 0x7f8898070600 con 0x7f88980c8c90 2023-11-08T12:28:45.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88840035d0 con 0x7f88980c8c90 2023-11-08T12:28:45.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2582432771 0 0) 0x7f88840035d0 con 0x7f88980c8c90 2023-11-08T12:28:45.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 >> v2:172.21.15.112:3300/0 conn(0x7f8898159f10 msgr2=0x7f8898070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 --2- 172.21.15.112:0/1429073267 >> v2:172.21.15.112:3300/0 conn(0x7f8898159f10 0x7f8898070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 >> v1:172.21.15.133:6789/0 conn(0x7f889815a9f0 legacy=0x7f889806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980afcc0 con 0x7f88980c8c90 2023-11-08T12:28:45.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f8880001670 con 0x7f88980c8c90 2023-11-08T12:28:45.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 >> v1:172.21.15.112:6789/0 conn(0x7f88980c8c90 legacy=0x7f889815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884003a20 0x7f8884003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8884004870 0x7f8884004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884005220 0x7f888400fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c9130 con 0x7f8884003a20 2023-11-08T12:28:45.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840104b0 con 0x7f8884004870 2023-11-08T12:28:45.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8884010670 con 0x7f8884005220 2023-11-08T12:28:45.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.948+0000 7f8897fff700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884003a20 0x7f8884003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f8897fff700 1 -- 172.21.15.112:0/1429073267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884005220 msgr2=0x7f888400fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f8897fff700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884005220 0x7f888400fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f8897fff700 1 -- 172.21.15.112:0/1429073267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8884004870 msgr2=0x7f8884004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:45.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f8897fff700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8884004870 0x7f8884004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f8897fff700 1 -- 172.21.15.112:0/1429073267 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840035d0 con 0x7f8884003a20 2023-11-08T12:28:45.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889cc1f700 1 -- 172.21.15.112:0/1429073267 reap_dead start 2023-11-08T12:28:45.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f8897fff700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884003a20 0x7f8884003e30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fc0 tx=0x7f88840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59f71e99764317c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800ec30 con 0x7f8884003a20 2023-11-08T12:28:45.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888800f040 con 0x7f8884003a20 2023-11-08T12:28:45.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f88977fe700 1 -- 172.21.15.112:0/1429073267 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888014480 con 0x7f8884003a20 2023-11-08T12:28:45.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889d420700 1 -- 172.21.15.112:0/1429073267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884003a20 msgr2=0x7f8884003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889d420700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884003a20 0x7f8884003e30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fc0 tx=0x7f88840058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889d420700 1 -- 172.21.15.112:0/1429073267 shutdown_connections 2023-11-08T12:28:45.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889d420700 1 --2- 172.21.15.112:0/1429073267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884003a20 0x7f8884003e30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889d420700 1 -- 172.21.15.112:0/1429073267 >> 172.21.15.112:0/1429073267 conn(0x7f88980cf280 msgr2=0x7f88980cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:45.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889d420700 1 -- 172.21.15.112:0/1429073267 shutdown_connections 2023-11-08T12:28:45.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.952+0000 7f889d420700 1 -- 172.21.15.112:0/1429073267 wait complete. 2023-11-08T12:28:45.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 Processor -- start 2023-11-08T12:28:45.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 -- start start 2023-11-08T12:28:45.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884003a20 0x7f88981492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88980cddf0 0x7f88980c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8898147c10 0x7f8898148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980cc360 con 0x7f8898147c10 2023-11-08T12:28:45.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88981490b0 con 0x7f88980cddf0 2023-11-08T12:28:45.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889d420700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889815cda0 con 0x7f8884003a20 2023-11-08T12:28:45.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8898147c10 0x7f8898148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8898147c10 0x7f8898148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40394/0 (socket says 172.21.15.112:40394) 2023-11-08T12:28:45.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 -- 172.21.15.112:0/1135964221 learned_addr learned my addr 172.21.15.112:0/1135964221 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:45.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f8897fff700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884003a20 0x7f88981492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f888f7fe700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88980cddf0 0x7f88980c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 -- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884003a20 msgr2=0x7f88981492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884003a20 0x7f88981492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 -- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88980cddf0 msgr2=0x7f88980c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:45.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88980cddf0 0x7f88980c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:45.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f889cc1f700 1 -- 172.21.15.112:0/1135964221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898070290 con 0x7f8898147c10 2023-11-08T12:28:45.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.956+0000 7f888f7fe700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88980cddf0 0x7f88980c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:45.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f889cc1f700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8898147c10 0x7f8898148080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f88980af860 tx=0x7f889000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f88957fa700 1 -- 172.21.15.112:0/1135964221 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890004220 con 0x7f8898147c10 2023-11-08T12:28:45.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f88957fa700 1 -- 172.21.15.112:0/1135964221 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88900043a0 con 0x7f8898147c10 2023-11-08T12:28:45.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f88957fa700 1 -- 172.21.15.112:0/1135964221 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890005ab0 con 0x7f8898147c10 2023-11-08T12:28:45.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889806ffb0 con 0x7f8898147c10 2023-11-08T12:28:45.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88980affa0 con 0x7f8898147c10 2023-11-08T12:28:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889806cf30 con 0x7f8898147c10 2023-11-08T12:28:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.960+0000 7f88957fa700 1 -- 172.21.15.112:0/1135964221 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8890010070 con 0x7f8898147c10 2023-11-08T12:28:45.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.964+0000 7f88957fa700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8878064ee0 0x7f8878067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:45.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.964+0000 7f88957fa700 1 -- 172.21.15.112:0/1135964221 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f88900811a0 con 0x7f8898147c10 2023-11-08T12:28:45.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.964+0000 7f8897fff700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8878064ee0 0x7f8878067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:45.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.964+0000 7f8897fff700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8878064ee0 0x7f8878067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8888000f80 tx=0x7f8888013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:45.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:45.968+0000 7f88957fa700 1 -- 172.21.15.112:0/1135964221 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8890049400 con 0x7f8898147c10 2023-11-08T12:28:46.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.144+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8898073d20 con 0x7f8898147c10 2023-11-08T12:28:46.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.144+0000 7f88957fa700 1 -- 172.21.15.112:0/1135964221 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f889004ee40 con 0x7f8898147c10 2023-11-08T12:28:46.150 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:46.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8878064ee0 msgr2=0x7f8878067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8878064ee0 0x7f8878067390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8888000f80 tx=0x7f8888013000 comp rx=0 tx=0).stop 2023-11-08T12:28:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8898147c10 msgr2=0x7f8898148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8898147c10 0x7f8898148080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f88980af860 tx=0x7f889000c720 comp rx=0 tx=0).stop 2023-11-08T12:28:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 shutdown_connections 2023-11-08T12:28:46.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8878064ee0 0x7f8878067390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8898147c10 0x7f8898148080 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88980cddf0 0x7f88980c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 --2- 172.21.15.112:0/1135964221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8884003a20 0x7f88981492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 >> 172.21.15.112:0/1135964221 conn(0x7f88980cf280 msgr2=0x7f88980ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:46.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 shutdown_connections 2023-11-08T12:28:46.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.148+0000 7f889d420700 1 -- 172.21.15.112:0/1135964221 wait complete. 2023-11-08T12:28:46.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:46.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.344+0000 7f6f3649f700 1 Processor -- start 2023-11-08T12:28:46.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.344+0000 7f6f3649f700 1 -- start start 2023-11-08T12:28:46.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f3649f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f3015c150 0x7f6f300b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f3649f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f30070360 0x7f6f30160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f3649f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3015c520 con 0x7f6f3006ff10 2023-11-08T12:28:46.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f3649f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f300b4240 con 0x7f6f30070360 2023-11-08T12:28:46.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f3649f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3006ac00 con 0x7f6f3015c150 2023-11-08T12:28:46.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f30070360 0x7f6f30160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6f30070360 0x7f6f30160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40404/0 (socket says 172.21.15.112:40404) 2023-11-08T12:28:46.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 -- 172.21.15.112:0/1710007152 learned_addr learned my addr 172.21.15.112:0/1710007152 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:46.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 -- 172.21.15.112:0/1710007152 >> v2:172.21.15.133:3300/0 conn(0x7f6f3015c150 msgr2=0x7f6f300b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:46.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f3549d700 1 --2- 172.21.15.112:0/1710007152 >> v2:172.21.15.133:3300/0 conn(0x7f6f3015c150 0x7f6f300b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 --2- 172.21.15.112:0/1710007152 >> v2:172.21.15.133:3300/0 conn(0x7f6f3015c150 0x7f6f300b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 -- 172.21.15.112:0/1710007152 >> v1:172.21.15.133:6789/0 conn(0x7f6f3006ff10 legacy=0x7f6f3015fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 -- 172.21.15.112:0/1710007152 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3006cc50 con 0x7f6f30070360 2023-11-08T12:28:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f3549d700 1 --2- 172.21.15.112:0/1710007152 >> v2:172.21.15.133:3300/0 conn(0x7f6f3015c150 0x7f6f300b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f35c9e700 1 --2- 172.21.15.112:0/1710007152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30070360 0x7f6f30160340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f30071900 tx=0x7f6f2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e614ce492d13d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f27fff700 1 -- 172.21.15.112:0/1710007152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800e070 con 0x7f6f30070360 2023-11-08T12:28:46.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f27fff700 1 -- 172.21.15.112:0/1710007152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f28003a40 con 0x7f6f30070360 2023-11-08T12:28:46.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.348+0000 7f6f27fff700 1 -- 172.21.15.112:0/1710007152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28003df0 con 0x7f6f30070360 2023-11-08T12:28:46.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 -- 172.21.15.112:0/1710007152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30070360 msgr2=0x7f6f30160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 --2- 172.21.15.112:0/1710007152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30070360 0x7f6f30160340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f30071900 tx=0x7f6f2800b330 comp rx=0 tx=0).stop 2023-11-08T12:28:46.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 -- 172.21.15.112:0/1710007152 shutdown_connections 2023-11-08T12:28:46.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 --2- 172.21.15.112:0/1710007152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f30070360 0x7f6f30160340 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 --2- 172.21.15.112:0/1710007152 >> v2:172.21.15.133:3300/0 conn(0x7f6f3015c150 0x7f6f300b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 -- 172.21.15.112:0/1710007152 >> 172.21.15.112:0/1710007152 conn(0x7f6f300d3680 msgr2=0x7f6f300cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:46.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 -- 172.21.15.112:0/1710007152 shutdown_connections 2023-11-08T12:28:46.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 -- 172.21.15.112:0/1710007152 wait complete. 2023-11-08T12:28:46.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 Processor -- start 2023-11-08T12:28:46.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 -- start start 2023-11-08T12:28:46.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.352+0000 7f6f3649f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3006ff10 0x7f6f300b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3649f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f30070360 0x7f6f300c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3649f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f3015c150 0x7f6f301f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3649f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300b8740 con 0x7f6f3006ff10 2023-11-08T12:28:46.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3649f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cc850 con 0x7f6f30070360 2023-11-08T12:28:46.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3649f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cc570 con 0x7f6f3015c150 2023-11-08T12:28:46.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3006ff10 0x7f6f300b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3006ff10 0x7f6f300b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40410/0 (socket says 172.21.15.112:40410) 2023-11-08T12:28:46.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 -- 172.21.15.112:0/3147463131 learned_addr learned my addr 172.21.15.112:0/3147463131 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:46.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f34c9c700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f30070360 0x7f6f300c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f35c9e700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f3015c150 0x7f6f301f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 -- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f3015c150 msgr2=0x7f6f301f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f3015c150 0x7f6f301f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 -- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f30070360 msgr2=0x7f6f300c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f30070360 0x7f6f300c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 -- 172.21.15.112:0/3147463131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009b30 con 0x7f6f3006ff10 2023-11-08T12:28:46.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f34c9c700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f30070360 0x7f6f300c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:46.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3549d700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3006ff10 0x7f6f300b5950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c7c0 tx=0x7f6f2c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:46.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f25ffb700 1 -- 172.21.15.112:0/3147463131 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011800 con 0x7f6f3006ff10 2023-11-08T12:28:46.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f25ffb700 1 -- 172.21.15.112:0/3147463131 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c011960 con 0x7f6f3006ff10 2023-11-08T12:28:46.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f25ffb700 1 -- 172.21.15.112:0/3147463131 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011cf0 con 0x7f6f3006ff10 2023-11-08T12:28:46.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f300d2730 con 0x7f6f3006ff10 2023-11-08T12:28:46.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.356+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f300d2450 con 0x7f6f3006ff10 2023-11-08T12:28:46.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.360+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f300d05e0 con 0x7f6f3006ff10 2023-11-08T12:28:46.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.360+0000 7f6f25ffb700 1 -- 172.21.15.112:0/3147463131 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6f2c020070 con 0x7f6f3006ff10 2023-11-08T12:28:46.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.360+0000 7f6f25ffb700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f14064ee0 0x7f6f14067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.360+0000 7f6f25ffb700 1 -- 172.21.15.112:0/3147463131 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6f2c0821c0 con 0x7f6f3006ff10 2023-11-08T12:28:46.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.360+0000 7f6f34c9c700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f14064ee0 0x7f6f14067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.364+0000 7f6f34c9c700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f14064ee0 0x7f6f14067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f20007fd0 tx=0x7f6f20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:46.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.368+0000 7f6f25ffb700 1 -- 172.21.15.112:0/3147463131 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6f2c04fec0 con 0x7f6f3006ff10 2023-11-08T12:28:46.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.536+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f30073d20 con 0x7f6f3006ff10 2023-11-08T12:28:46.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.536+0000 7f6f25ffb700 1 -- 172.21.15.112:0/3147463131 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f2c0534e0 con 0x7f6f3006ff10 2023-11-08T12:28:46.542 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:46.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f14064ee0 msgr2=0x7f6f14067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f14064ee0 0x7f6f14067390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f20007fd0 tx=0x7f6f20009040 comp rx=0 tx=0).stop 2023-11-08T12:28:46.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3006ff10 msgr2=0x7f6f300b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3006ff10 0x7f6f300b5950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c7c0 tx=0x7f6f2c00cb80 comp rx=0 tx=0).stop 2023-11-08T12:28:46.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 shutdown_connections 2023-11-08T12:28:46.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f14064ee0 0x7f6f14067390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f3015c150 0x7f6f301f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f30070360 0x7f6f300c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 --2- 172.21.15.112:0/3147463131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f3006ff10 0x7f6f300b5950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 >> 172.21.15.112:0/3147463131 conn(0x7f6f300d3680 msgr2=0x7f6f30155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:46.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 shutdown_connections 2023-11-08T12:28:46.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.544+0000 7f6f3649f700 1 -- 172.21.15.112:0/3147463131 wait complete. 2023-11-08T12:28:46.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:46.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.760+0000 7fd29d169700 1 Processor -- start 2023-11-08T12:28:46.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.760+0000 7fd29d169700 1 -- start start 2023-11-08T12:28:46.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd29d169700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298070620 0x7fd2980b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd29d169700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd298069bf0 0x7fd29806a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd29d169700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29815c520 con 0x7fd29815c150 2023-11-08T12:28:46.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd29d169700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2980b4240 con 0x7fd298069bf0 2023-11-08T12:28:46.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd29d169700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29806cc50 con 0x7fd298070620 2023-11-08T12:28:46.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd297fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd29815c150 0x7fd29806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:60616/0 (socket says 172.21.15.112:60616) 2023-11-08T12:28:46.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd297fff700 1 -- 172.21.15.112:0/3139881104 learned_addr learned my addr 172.21.15.112:0/3139881104 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:46.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd2977fe700 1 --2- 172.21.15.112:0/3139881104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298070620 0x7fd2980b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd29c968700 1 --2- 172.21.15.112:0/3139881104 >> v2:172.21.15.133:3300/0 conn(0x7fd298069bf0 0x7fd29806a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd296ffd700 1 -- 172.21.15.112:0/3139881104 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171263628 0 0) 0x7fd29815c520 con 0x7fd29815c150 2023-11-08T12:28:46.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd296ffd700 1 -- 172.21.15.112:0/3139881104 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2800035d0 con 0x7fd29815c150 2023-11-08T12:28:46.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd2977fe700 1 -- 172.21.15.112:0/3139881104 >> v2:172.21.15.133:3300/0 conn(0x7fd298069bf0 msgr2=0x7fd29806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:46.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd2977fe700 1 --2- 172.21.15.112:0/3139881104 >> v2:172.21.15.133:3300/0 conn(0x7fd298069bf0 0x7fd29806a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd2977fe700 1 -- 172.21.15.112:0/3139881104 >> v1:172.21.15.133:6789/0 conn(0x7fd29815c150 legacy=0x7fd29806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd2977fe700 1 -- 172.21.15.112:0/3139881104 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980d2450 con 0x7fd298070620 2023-11-08T12:28:46.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd2977fe700 1 --2- 172.21.15.112:0/3139881104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298070620 0x7fd2980b3d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009840 tx=0x7fd28c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9db43584cf2da server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:46.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd296ffd700 1 -- 172.21.15.112:0/3139881104 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c005e50 con 0x7fd298070620 2023-11-08T12:28:46.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd296ffd700 1 -- 172.21.15.112:0/3139881104 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c006030 con 0x7fd298070620 2023-11-08T12:28:46.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.764+0000 7fd296ffd700 1 -- 172.21.15.112:0/3139881104 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0063a0 con 0x7fd298070620 2023-11-08T12:28:46.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 -- 172.21.15.112:0/3139881104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298070620 msgr2=0x7fd2980b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 --2- 172.21.15.112:0/3139881104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298070620 0x7fd2980b3d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009840 tx=0x7fd28c009b50 comp rx=0 tx=0).stop 2023-11-08T12:28:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 -- 172.21.15.112:0/3139881104 shutdown_connections 2023-11-08T12:28:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 --2- 172.21.15.112:0/3139881104 >> v2:172.21.15.133:3300/0 conn(0x7fd298069bf0 0x7fd29806a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 --2- 172.21.15.112:0/3139881104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298070620 0x7fd2980b3d00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 -- 172.21.15.112:0/3139881104 >> 172.21.15.112:0/3139881104 conn(0x7fd2980d3680 msgr2=0x7fd2980cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:46.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 -- 172.21.15.112:0/3139881104 shutdown_connections 2023-11-08T12:28:46.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.768+0000 7fd29d169700 1 -- 172.21.15.112:0/3139881104 wait complete. 2023-11-08T12:28:46.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 Processor -- start 2023-11-08T12:28:46.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 -- start start 2023-11-08T12:28:46.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298069bf0 0x7fd2980cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd298070620 0x7fd2980b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd29815c150 0x7fd2980b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2981f5ba0 con 0x7fd298070620 2023-11-08T12:28:46.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298159050 con 0x7fd29815c150 2023-11-08T12:28:46.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29d169700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2981f58c0 con 0x7fd298069bf0 2023-11-08T12:28:46.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd298070620 0x7fd2980b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd298070620 0x7fd2980b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40418/0 (socket says 172.21.15.112:40418) 2023-11-08T12:28:46.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 -- 172.21.15.112:0/1949779445 learned_addr learned my addr 172.21.15.112:0/1949779445 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:46.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd297fff700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298069bf0 0x7fd2980cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd29c968700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd29815c150 0x7fd2980b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 -- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298069bf0 msgr2=0x7fd2980cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298069bf0 0x7fd2980cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 -- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd29815c150 msgr2=0x7fd2980b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd29815c150 0x7fd2980b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.772+0000 7fd2977fe700 1 -- 172.21.15.112:0/1949779445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c009450 con 0x7fd298070620 2023-11-08T12:28:46.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.776+0000 7fd2977fe700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd298070620 0x7fd2980b6040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd28c013040 tx=0x7fd28c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:46.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.776+0000 7fd294ff9700 1 -- 172.21.15.112:0/1949779445 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0063a0 con 0x7fd298070620 2023-11-08T12:28:46.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.776+0000 7fd294ff9700 1 -- 172.21.15.112:0/1949779445 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c006500 con 0x7fd298070620 2023-11-08T12:28:46.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.776+0000 7fd294ff9700 1 -- 172.21.15.112:0/1949779445 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0068b0 con 0x7fd298070620 2023-11-08T12:28:46.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.776+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2980d05e0 con 0x7fd298070620 2023-11-08T12:28:46.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.776+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2980d2730 con 0x7fd298070620 2023-11-08T12:28:46.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.776+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2980d2140 con 0x7fd298070620 2023-11-08T12:28:46.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.780+0000 7fd294ff9700 1 -- 172.21.15.112:0/1949779445 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd28c00f050 con 0x7fd298070620 2023-11-08T12:28:46.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.780+0000 7fd294ff9700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd284064ee0 0x7fd284067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:46.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.780+0000 7fd294ff9700 1 -- 172.21.15.112:0/1949779445 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd28c083b30 con 0x7fd298070620 2023-11-08T12:28:46.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.780+0000 7fd297fff700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd284064ee0 0x7fd284067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:46.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.780+0000 7fd297fff700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd284064ee0 0x7fd284067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd288007fd0 tx=0x7fd288007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:46.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.784+0000 7fd294ff9700 1 -- 172.21.15.112:0/1949779445 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd28c0518b0 con 0x7fd298070620 2023-11-08T12:28:46.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.960+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd298073d20 con 0x7fd298070620 2023-11-08T12:28:46.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.960+0000 7fd294ff9700 1 -- 172.21.15.112:0/1949779445 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd28c02a020 con 0x7fd298070620 2023-11-08T12:28:46.965 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:46.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd284064ee0 msgr2=0x7fd284067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd284064ee0 0x7fd284067390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd288007fd0 tx=0x7fd288007de0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd298070620 msgr2=0x7fd2980b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd298070620 0x7fd2980b6040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd28c013040 tx=0x7fd28c004770 comp rx=0 tx=0).stop 2023-11-08T12:28:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 shutdown_connections 2023-11-08T12:28:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd284064ee0 0x7fd284067390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd29815c150 0x7fd2980b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd298070620 0x7fd2980b6040 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 --2- 172.21.15.112:0/1949779445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd298069bf0 0x7fd2980cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:46.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 >> 172.21.15.112:0/1949779445 conn(0x7fd2980d3680 msgr2=0x7fd2980b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:46.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 shutdown_connections 2023-11-08T12:28:46.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:46.964+0000 7fd29d169700 1 -- 172.21.15.112:0/1949779445 wait complete. 2023-11-08T12:28:46.989 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:47.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.184+0000 7f3a564b5700 1 Processor -- start 2023-11-08T12:28:47.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.184+0000 7f3a564b5700 1 -- start start 2023-11-08T12:28:47.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a564b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a5015a480 0x7f3a500cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a564b5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3a500c8d10 0x7f3a500cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a564b5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5015a850 con 0x7f3a500ccd10 2023-11-08T12:28:47.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a564b5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500ce060 con 0x7f3a500c8d10 2023-11-08T12:28:47.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a564b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500ce300 con 0x7f3a5015a480 2023-11-08T12:28:47.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a54a52700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3a500ccd10 0x7f3a5015dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48538/0 (socket says 172.21.15.112:48538) 2023-11-08T12:28:47.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a54a52700 1 -- 172.21.15.112:0/4001234974 learned_addr learned my addr 172.21.15.112:0/4001234974 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4f7fe700 1 --2- 172.21.15.112:0/4001234974 >> v2:172.21.15.112:3300/0 conn(0x7f3a500c8d10 0x7f3a500cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4ffff700 1 --2- 172.21.15.112:0/4001234974 >> v2:172.21.15.133:3300/0 conn(0x7f3a5015a480 0x7f3a500cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4effd700 1 -- 172.21.15.112:0/4001234974 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636745505 0 0) 0x7f3a5015a850 con 0x7f3a500ccd10 2023-11-08T12:28:47.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4effd700 1 -- 172.21.15.112:0/4001234974 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a380035d0 con 0x7f3a500ccd10 2023-11-08T12:28:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4ffff700 1 -- 172.21.15.112:0/4001234974 >> v2:172.21.15.112:3300/0 conn(0x7f3a500c8d10 msgr2=0x7f3a500cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4ffff700 1 --2- 172.21.15.112:0/4001234974 >> v2:172.21.15.112:3300/0 conn(0x7f3a500c8d10 0x7f3a500cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4ffff700 1 -- 172.21.15.112:0/4001234974 >> v1:172.21.15.112:6789/0 conn(0x7f3a500ccd10 legacy=0x7f3a5015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4ffff700 1 -- 172.21.15.112:0/4001234974 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500cada0 con 0x7f3a5015a480 2023-11-08T12:28:47.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4f7fe700 1 --2- 172.21.15.112:0/4001234974 >> v2:172.21.15.112:3300/0 conn(0x7f3a500c8d10 0x7f3a500cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:47.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4ffff700 1 --2- 172.21.15.112:0/4001234974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 0x7f3a500cc290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a500c9390 tx=0x7f3a40009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26aa373447743bfd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:47.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4effd700 1 -- 172.21.15.112:0/4001234974 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40011830 con 0x7f3a5015a480 2023-11-08T12:28:47.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4effd700 1 -- 172.21.15.112:0/4001234974 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a40011990 con 0x7f3a5015a480 2023-11-08T12:28:47.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a4effd700 1 -- 172.21.15.112:0/4001234974 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40011d20 con 0x7f3a5015a480 2023-11-08T12:28:47.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a564b5700 1 -- 172.21.15.112:0/4001234974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 msgr2=0x7f3a500cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.188+0000 7f3a564b5700 1 --2- 172.21.15.112:0/4001234974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 0x7f3a500cc290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a500c9390 tx=0x7f3a40009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:47.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.192+0000 7f3a564b5700 1 -- 172.21.15.112:0/4001234974 shutdown_connections 2023-11-08T12:28:47.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.192+0000 7f3a564b5700 1 --2- 172.21.15.112:0/4001234974 >> v2:172.21.15.112:3300/0 conn(0x7f3a500c8d10 0x7f3a500cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.192+0000 7f3a564b5700 1 --2- 172.21.15.112:0/4001234974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 0x7f3a500cc290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.192+0000 7f3a564b5700 1 -- 172.21.15.112:0/4001234974 >> 172.21.15.112:0/4001234974 conn(0x7f3a500cf350 msgr2=0x7f3a500b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.192+0000 7f3a564b5700 1 -- 172.21.15.112:0/4001234974 shutdown_connections 2023-11-08T12:28:47.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.192+0000 7f3a564b5700 1 -- 172.21.15.112:0/4001234974 wait complete. 2023-11-08T12:28:47.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.192+0000 7f3a564b5700 1 Processor -- start 2023-11-08T12:28:47.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a564b5700 1 -- start start 2023-11-08T12:28:47.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a564b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a500c8d10 0x7f3a501517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a564b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a500ccd10 0x7f3a50158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a564b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 0x7f3a5015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a564b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a501585a0 con 0x7f3a500ccd10 2023-11-08T12:28:47.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a564b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50157c70 con 0x7f3a5015a480 2023-11-08T12:28:47.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a564b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50157f50 con 0x7f3a500c8d10 2023-11-08T12:28:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a500ccd10 0x7f3a50158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a500ccd10 0x7f3a50158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40438/0 (socket says 172.21.15.112:40438) 2023-11-08T12:28:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 -- 172.21.15.112:0/1277055966 learned_addr learned my addr 172.21.15.112:0/1277055966 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a54a52700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 0x7f3a5015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4ffff700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a500c8d10 0x7f3a501517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 -- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a500c8d10 msgr2=0x7f3a501517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a500c8d10 0x7f3a501517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 -- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 msgr2=0x7f3a5015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 0x7f3a5015b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 -- 172.21.15.112:0/1277055966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440094b0 con 0x7f3a500ccd10 2023-11-08T12:28:47.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.196+0000 7f3a4f7fe700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a500ccd10 0x7f3a50158a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400ebe0 tx=0x7f3a44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:47.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.200+0000 7f3a4cff9700 1 -- 172.21.15.112:0/1277055966 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400c8b0 con 0x7f3a500ccd10 2023-11-08T12:28:47.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.200+0000 7f3a4cff9700 1 -- 172.21.15.112:0/1277055966 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400ca10 con 0x7f3a500ccd10 2023-11-08T12:28:47.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.200+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a400094b0 con 0x7f3a500ccd10 2023-11-08T12:28:47.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.200+0000 7f3a4cff9700 1 -- 172.21.15.112:0/1277055966 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400cda0 con 0x7f3a500ccd10 2023-11-08T12:28:47.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.200+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a500add50 con 0x7f3a500ccd10 2023-11-08T12:28:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.200+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a500caa30 con 0x7f3a500ccd10 2023-11-08T12:28:47.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.204+0000 7f3a4cff9700 1 -- 172.21.15.112:0/1277055966 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3a44019030 con 0x7f3a500ccd10 2023-11-08T12:28:47.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.204+0000 7f3a4cff9700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3a3c064ee0 0x7f3a3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.204+0000 7f3a4cff9700 1 -- 172.21.15.112:0/1277055966 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3a44082300 con 0x7f3a500ccd10 2023-11-08T12:28:47.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.204+0000 7f3a4ffff700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3a3c064ee0 0x7f3a3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.204+0000 7f3a4ffff700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3a3c064ee0 0x7f3a3c067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3a40000c00 tx=0x7f3a40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:47.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.212+0000 7f3a4cff9700 1 -- 172.21.15.112:0/1277055966 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3a44050080 con 0x7f3a500ccd10 2023-11-08T12:28:47.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.384+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a500ca6e0 con 0x7f3a500ccd10 2023-11-08T12:28:47.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.384+0000 7f3a4cff9700 1 -- 172.21.15.112:0/1277055966 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f3a440536a0 con 0x7f3a500ccd10 2023-11-08T12:28:47.388 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:47.388 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3a3c064ee0 msgr2=0x7f3a3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3a3c064ee0 0x7f3a3c067390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3a40000c00 tx=0x7f3a40008030 comp rx=0 tx=0).stop 2023-11-08T12:28:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a500ccd10 msgr2=0x7f3a50158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a500ccd10 0x7f3a50158a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400ebe0 tx=0x7f3a44009e30 comp rx=0 tx=0).stop 2023-11-08T12:28:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 shutdown_connections 2023-11-08T12:28:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3a3c064ee0 0x7f3a3c067390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a5015a480 0x7f3a5015b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a500ccd10 0x7f3a50158a30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 --2- 172.21.15.112:0/1277055966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a500c8d10 0x7f3a501517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 >> 172.21.15.112:0/1277055966 conn(0x7f3a500cf350 msgr2=0x7f3a500cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:47.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 shutdown_connections 2023-11-08T12:28:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.388+0000 7f3a564b5700 1 -- 172.21.15.112:0/1277055966 wait complete. 2023-11-08T12:28:47.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:47.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:47.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.596+0000 7f292d4b5700 1 Processor -- start 2023-11-08T12:28:47.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.596+0000 7f292d4b5700 1 -- start start 2023-11-08T12:28:47.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f292d4b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29280b4a10 0x7f29280ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f292d4b5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292806d030 con 0x7f29280ce560 2023-11-08T12:28:47.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f292d4b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292806a090 con 0x7f292815c6f0 2023-11-08T12:28:47.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f292d4b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292806c810 con 0x7f29280b4a10 2023-11-08T12:28:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f29277fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f29280ce560 0x7f292806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48554/0 (socket says 172.21.15.112:48554) 2023-11-08T12:28:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f29277fe700 1 -- 172.21.15.112:0/573951471 learned_addr learned my addr 172.21.15.112:0/573951471 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:47.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f29267fc700 1 --2- 172.21.15.112:0/573951471 >> v2:172.21.15.133:3300/0 conn(0x7f29280b4a10 0x7f29280ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f2925ffb700 1 -- 172.21.15.112:0/573951471 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578794341 0 0) 0x7f292806d030 con 0x7f29280ce560 2023-11-08T12:28:47.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f2925ffb700 1 -- 172.21.15.112:0/573951471 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29100035d0 con 0x7f29280ce560 2023-11-08T12:28:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f2925ffb700 1 -- 172.21.15.112:0/573951471 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415949083 0 0) 0x7f292806a090 con 0x7f292815c6f0 2023-11-08T12:28:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f2925ffb700 1 -- 172.21.15.112:0/573951471 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292806d030 con 0x7f292815c6f0 2023-11-08T12:28:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f29267fc700 1 -- 172.21.15.112:0/573951471 >> v1:172.21.15.133:6789/0 conn(0x7f292815c6f0 legacy=0x7f292806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f29267fc700 1 -- 172.21.15.112:0/573951471 >> v1:172.21.15.112:6789/0 conn(0x7f29280ce560 legacy=0x7f292806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f29267fc700 1 -- 172.21.15.112:0/573951471 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292815cac0 con 0x7f29280b4a10 2023-11-08T12:28:47.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f29267fc700 1 --2- 172.21.15.112:0/573951471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f29280ce020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f291c009850 tx=0x7f291c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5d3793266452f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:47.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f2925ffb700 1 -- 172.21.15.112:0/573951471 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c011830 con 0x7f29280b4a10 2023-11-08T12:28:47.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f2925ffb700 1 -- 172.21.15.112:0/573951471 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c011990 con 0x7f29280b4a10 2023-11-08T12:28:47.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.600+0000 7f2925ffb700 1 -- 172.21.15.112:0/573951471 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c011d00 con 0x7f29280b4a10 2023-11-08T12:28:47.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 -- 172.21.15.112:0/573951471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 msgr2=0x7f29280ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 --2- 172.21.15.112:0/573951471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f29280ce020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f291c009850 tx=0x7f291c009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:47.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 -- 172.21.15.112:0/573951471 shutdown_connections 2023-11-08T12:28:47.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 --2- 172.21.15.112:0/573951471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f29280ce020 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 -- 172.21.15.112:0/573951471 >> 172.21.15.112:0/573951471 conn(0x7f29280d3830 msgr2=0x7f29280cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:47.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 -- 172.21.15.112:0/573951471 shutdown_connections 2023-11-08T12:28:47.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 -- 172.21.15.112:0/573951471 wait complete. 2023-11-08T12:28:47.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 Processor -- start 2023-11-08T12:28:47.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.604+0000 7f292d4b5700 1 -- start start 2023-11-08T12:28:47.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f292815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29280ce560 0x7f2928146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f292815c6f0 0x7f2928144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928147e30 con 0x7f292815c6f0 2023-11-08T12:28:47.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29280c8a50 con 0x7f29280b4a10 2023-11-08T12:28:47.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2928145340 con 0x7f29280ce560 2023-11-08T12:28:47.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f292815c6f0 0x7f2928144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f292815c6f0 0x7f2928144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40442/0 (socket says 172.21.15.112:40442) 2023-11-08T12:28:47.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 -- 172.21.15.112:0/792035723 learned_addr learned my addr 172.21.15.112:0/792035723 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:47.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29267fc700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29280ce560 0x7f2928146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f2926ffd700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f292815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 -- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29280ce560 msgr2=0x7f2928146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29280ce560 0x7f2928146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 -- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 msgr2=0x7f292815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f292815f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 -- 172.21.15.112:0/792035723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0094b0 con 0x7f292815c6f0 2023-11-08T12:28:47.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f2926ffd700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f292815f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:47.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29267fc700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29280ce560 0x7f2928146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:47.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f29277fe700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f292815c6f0 0x7f2928144e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f292000cba0 tx=0x7f292000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:47.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f290f7fe700 1 -- 172.21.15.112:0/792035723 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000a980 con 0x7f292815c6f0 2023-11-08T12:28:47.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292806ca70 con 0x7f292815c6f0 2023-11-08T12:28:47.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f290f7fe700 1 -- 172.21.15.112:0/792035723 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292000aae0 con 0x7f292815c6f0 2023-11-08T12:28:47.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f290f7fe700 1 -- 172.21.15.112:0/792035723 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000ae70 con 0x7f292815c6f0 2023-11-08T12:28:47.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29280ce960 con 0x7f292815c6f0 2023-11-08T12:28:47.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.608+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292806cd50 con 0x7f292815c6f0 2023-11-08T12:28:47.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.612+0000 7f290f7fe700 1 -- 172.21.15.112:0/792035723 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2920019030 con 0x7f292815c6f0 2023-11-08T12:28:47.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.612+0000 7f290f7fe700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2914064ee0 0x7f2914067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:47.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.612+0000 7f290f7fe700 1 -- 172.21.15.112:0/792035723 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2920081bf0 con 0x7f292815c6f0 2023-11-08T12:28:47.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.612+0000 7f2926ffd700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2914064ee0 0x7f2914067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:47.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.616+0000 7f2926ffd700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2914064ee0 0x7f2914067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29180011e0 tx=0x7f2918009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:47.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.620+0000 7f290f7fe700 1 -- 172.21.15.112:0/792035723 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f292004f9e0 con 0x7f292815c6f0 2023-11-08T12:28:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.788+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29280c8b90 con 0x7f292815c6f0 2023-11-08T12:28:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f290f7fe700 1 -- 172.21.15.112:0/792035723 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2920017020 con 0x7f292815c6f0 2023-11-08T12:28:47.794 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:47.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2914064ee0 msgr2=0x7f2914067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2914064ee0 0x7f2914067390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29180011e0 tx=0x7f2918009040 comp rx=0 tx=0).stop 2023-11-08T12:28:47.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f292815c6f0 msgr2=0x7f2928144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:47.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f292815c6f0 0x7f2928144e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f292000cba0 tx=0x7f292000cc80 comp rx=0 tx=0).stop 2023-11-08T12:28:47.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 shutdown_connections 2023-11-08T12:28:47.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2914064ee0 0x7f2914067390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f292815c6f0 0x7f2928144e00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29280ce560 0x7f2928146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 --2- 172.21.15.112:0/792035723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29280b4a10 0x7f292815f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:47.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 >> 172.21.15.112:0/792035723 conn(0x7f29280d3830 msgr2=0x7f2928160140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:47.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 shutdown_connections 2023-11-08T12:28:47.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.792+0000 7f292d4b5700 1 -- 172.21.15.112:0/792035723 wait complete. 2023-11-08T12:28:47.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:47.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.996+0000 7f526ee82700 1 Processor -- start 2023-11-08T12:28:47.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.996+0000 7f526ee82700 1 -- start start 2023-11-08T12:28:48.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.996+0000 7f526ee82700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f52680b4a10 0x7f52680ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.996+0000 7f526ee82700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52680ce560 0x7f526806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.996+0000 7f526ee82700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526806d030 con 0x7f526815c6f0 2023-11-08T12:28:48.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.996+0000 7f526ee82700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526806a090 con 0x7f52680b4a10 2023-11-08T12:28:48.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:47.996+0000 7f526ee82700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526806c810 con 0x7f52680ce560 2023-11-08T12:28:48.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526cc1e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f526815c6f0 0x7f526806c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:60628/0 (socket says 172.21.15.112:60628) 2023-11-08T12:28:48.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526cc1e700 1 -- 172.21.15.112:0/2815800819 learned_addr learned my addr 172.21.15.112:0/2815800819 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:48.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f5267fff700 1 --2- 172.21.15.112:0/2815800819 >> v2:172.21.15.112:3300/0 conn(0x7f52680b4a10 0x7f52680ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526d41f700 1 --2- 172.21.15.112:0/2815800819 >> v2:172.21.15.133:3300/0 conn(0x7f52680ce560 0x7f526806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f52677fe700 1 -- 172.21.15.112:0/2815800819 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203375049 0 0) 0x7f526806d030 con 0x7f526815c6f0 2023-11-08T12:28:48.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f52677fe700 1 -- 172.21.15.112:0/2815800819 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52580035d0 con 0x7f526815c6f0 2023-11-08T12:28:48.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f5267fff700 1 -- 172.21.15.112:0/2815800819 >> v2:172.21.15.133:3300/0 conn(0x7f52680ce560 msgr2=0x7f526806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:48.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f5267fff700 1 --2- 172.21.15.112:0/2815800819 >> v2:172.21.15.133:3300/0 conn(0x7f52680ce560 0x7f526806a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f5267fff700 1 -- 172.21.15.112:0/2815800819 >> v1:172.21.15.133:6789/0 conn(0x7f526815c6f0 legacy=0x7f526806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f5267fff700 1 -- 172.21.15.112:0/2815800819 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526815cac0 con 0x7f52680b4a10 2023-11-08T12:28:48.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526d41f700 1 --2- 172.21.15.112:0/2815800819 >> v2:172.21.15.133:3300/0 conn(0x7f52680ce560 0x7f526806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:48.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f5267fff700 1 --2- 172.21.15.112:0/2815800819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680b4a10 0x7f52680ce020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52680b5890 tx=0x7f5254009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add73769e1940226 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f52677fe700 1 -- 172.21.15.112:0/2815800819 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254011830 con 0x7f52680b4a10 2023-11-08T12:28:48.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f52677fe700 1 -- 172.21.15.112:0/2815800819 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254011990 con 0x7f52680b4a10 2023-11-08T12:28:48.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f52677fe700 1 -- 172.21.15.112:0/2815800819 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254011d20 con 0x7f52680b4a10 2023-11-08T12:28:48.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 -- 172.21.15.112:0/2815800819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680b4a10 msgr2=0x7f52680ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 --2- 172.21.15.112:0/2815800819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680b4a10 0x7f52680ce020 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52680b5890 tx=0x7f5254009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:48.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 -- 172.21.15.112:0/2815800819 shutdown_connections 2023-11-08T12:28:48.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 --2- 172.21.15.112:0/2815800819 >> v2:172.21.15.133:3300/0 conn(0x7f52680ce560 0x7f526806a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 --2- 172.21.15.112:0/2815800819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680b4a10 0x7f52680ce020 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 -- 172.21.15.112:0/2815800819 >> 172.21.15.112:0/2815800819 conn(0x7f52680d3830 msgr2=0x7f52680cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:48.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 -- 172.21.15.112:0/2815800819 shutdown_connections 2023-11-08T12:28:48.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.000+0000 7f526ee82700 1 -- 172.21.15.112:0/2815800819 wait complete. 2023-11-08T12:28:48.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 Processor -- start 2023-11-08T12:28:48.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 -- start start 2023-11-08T12:28:48.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52680b4a10 0x7f5268144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680ce560 0x7f5268158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f526815c6f0 0x7f5268158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680ccd60 con 0x7f52680ce560 2023-11-08T12:28:48.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680b71f0 con 0x7f526815c6f0 2023-11-08T12:28:48.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526ee82700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680b74d0 con 0x7f52680b4a10 2023-11-08T12:28:48.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f5267fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680ce560 0x7f5268158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f5267fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680ce560 0x7f5268158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40454/0 (socket says 172.21.15.112:40454) 2023-11-08T12:28:48.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f5267fff700 1 -- 172.21.15.112:0/1741002524 learned_addr learned my addr 172.21.15.112:0/1741002524 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:48.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526cc1e700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52680b4a10 0x7f5268144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.004+0000 7f526d41f700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f526815c6f0 0x7f5268158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f5267fff700 1 -- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52680b4a10 msgr2=0x7f5268144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f5267fff700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52680b4a10 0x7f5268144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f5267fff700 1 -- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f526815c6f0 msgr2=0x7f5268158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f5267fff700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f526815c6f0 0x7f5268158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f5267fff700 1 -- 172.21.15.112:0/1741002524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009a70 con 0x7f52680ce560 2023-11-08T12:28:48.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f5267fff700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680ce560 0x7f5268158210 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f52540090b0 tx=0x7f5254004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f52657fa700 1 -- 172.21.15.112:0/1741002524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254004340 con 0x7f52680ce560 2023-11-08T12:28:48.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f52657fa700 1 -- 172.21.15.112:0/1741002524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525401f070 con 0x7f52680ce560 2023-11-08T12:28:48.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f52657fa700 1 -- 172.21.15.112:0/1741002524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52540036c0 con 0x7f52680ce560 2023-11-08T12:28:48.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52540094b0 con 0x7f52680ce560 2023-11-08T12:28:48.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526806ca70 con 0x7f52680ce560 2023-11-08T12:28:48.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52680ce960 con 0x7f52680ce560 2023-11-08T12:28:48.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.008+0000 7f52657fa700 1 -- 172.21.15.112:0/1741002524 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f525402a020 con 0x7f52680ce560 2023-11-08T12:28:48.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.012+0000 7f52657fa700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f524c064ee0 0x7f524c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.012+0000 7f52657fa700 1 -- 172.21.15.112:0/1741002524 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5254083590 con 0x7f52680ce560 2023-11-08T12:28:48.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.012+0000 7f526cc1e700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f524c064ee0 0x7f524c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.012+0000 7f526cc1e700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f524c064ee0 0x7f524c067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f525c007fd0 tx=0x7f525c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.016+0000 7f52657fa700 1 -- 172.21.15.112:0/1741002524 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5254051400 con 0x7f52680ce560 2023-11-08T12:28:48.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.196+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f526806cd50 con 0x7f52680ce560 2023-11-08T12:28:48.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.196+0000 7f52657fa700 1 -- 172.21.15.112:0/1741002524 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5254054a20 con 0x7f52680ce560 2023-11-08T12:28:48.200 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:48.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f524c064ee0 msgr2=0x7f524c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f524c064ee0 0x7f524c067390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f525c007fd0 tx=0x7f525c007de0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680ce560 msgr2=0x7f5268158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680ce560 0x7f5268158210 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f52540090b0 tx=0x7f5254004770 comp rx=0 tx=0).stop 2023-11-08T12:28:48.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 shutdown_connections 2023-11-08T12:28:48.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f524c064ee0 0x7f524c067390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f526815c6f0 0x7f5268158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52680ce560 0x7f5268158210 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 --2- 172.21.15.112:0/1741002524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52680b4a10 0x7f5268144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 >> 172.21.15.112:0/1741002524 conn(0x7f52680d3830 msgr2=0x7f5268156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:48.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 shutdown_connections 2023-11-08T12:28:48.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.200+0000 7f526ee82700 1 -- 172.21.15.112:0/1741002524 wait complete. 2023-11-08T12:28:48.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:48.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.396+0000 7f13f12dd700 1 Processor -- start 2023-11-08T12:28:48.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.396+0000 7f13f12dd700 1 -- start start 2023-11-08T12:28:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13f12dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13ec0d1310 0x7f13ec0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13f12dd700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec0cd080 con 0x7f13ec15c310 2023-11-08T12:28:48.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13f12dd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec070a60 con 0x7f13ec070600 2023-11-08T12:28:48.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13f12dd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec06d240 con 0x7f13ec0d1310 2023-11-08T12:28:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13ebfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f13ec15c310 0x7f13ec06b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48570/0 (socket says 172.21.15.112:48570) 2023-11-08T12:28:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13ebfff700 1 -- 172.21.15.112:0/2133436759 learned_addr learned my addr 172.21.15.112:0/2133436759 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13e3fff700 1 --2- 172.21.15.112:0/2133436759 >> v2:172.21.15.133:3300/0 conn(0x7f13ec0d1310 0x7f13ec0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221117925 0 0) 0x7f13ec0cd080 con 0x7f13ec15c310 2023-11-08T12:28:48.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13d80035d0 con 0x7f13ec15c310 2023-11-08T12:28:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389489659 0 0) 0x7f13ec070a60 con 0x7f13ec070600 2023-11-08T12:28:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13ec0cd080 con 0x7f13ec070600 2023-11-08T12:28:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4087134972 0 0) 0x7f13d80035d0 con 0x7f13ec15c310 2023-11-08T12:28:48.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 >> v2:172.21.15.133:3300/0 conn(0x7f13ec0d1310 msgr2=0x7f13ec0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 --2- 172.21.15.112:0/2133436759 >> v2:172.21.15.133:3300/0 conn(0x7f13ec0d1310 0x7f13ec0700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 >> v1:172.21.15.133:6789/0 conn(0x7f13ec070600 legacy=0x7f13ec069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec0d21a0 con 0x7f13ec15c310 2023-11-08T12:28:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f13dc001670 con 0x7f13ec15c310 2023-11-08T12:28:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 >> v1:172.21.15.112:6789/0 conn(0x7f13ec15c310 legacy=0x7f13ec06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8003bb0 0x7f13d8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d8004870 0x7f13d8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d8005220 0x7f13d800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec06d240 con 0x7f13d8004870 2023-11-08T12:28:48.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d800c130 con 0x7f13d8005220 2023-11-08T12:28:48.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d800c2f0 con 0x7f13d8003bb0 2023-11-08T12:28:48.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.400+0000 7f13e3fff700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d8004870 0x7f13d8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13ebfff700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8003bb0 0x7f13d8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f0adc700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d8005220 0x7f13d800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13e3fff700 1 -- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8003bb0 msgr2=0x7f13d8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:48.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13e3fff700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8003bb0 0x7f13d8003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13e3fff700 1 -- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d8005220 msgr2=0x7f13d800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:48.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13e3fff700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d8005220 0x7f13d800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13e3fff700 1 -- 172.21.15.112:0/2133436759 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80035d0 con 0x7f13d8004870 2023-11-08T12:28:48.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f0adc700 1 -- 172.21.15.112:0/2133436759 reap_dead start 2023-11-08T12:28:48.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13e3fff700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d8004870 0x7f13d8004ce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009b40 tx=0x7f13d80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b305dcca3fb036dc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d400e6c0 con 0x7f13d8004870 2023-11-08T12:28:48.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d400e820 con 0x7f13d8004870 2023-11-08T12:28:48.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13eb7fe700 1 -- 172.21.15.112:0/2133436759 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d400eb90 con 0x7f13d8004870 2023-11-08T12:28:48.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f12dd700 1 -- 172.21.15.112:0/2133436759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d8004870 msgr2=0x7f13d8004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d8004870 0x7f13d8004ce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009b40 tx=0x7f13d80058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f12dd700 1 -- 172.21.15.112:0/2133436759 shutdown_connections 2023-11-08T12:28:48.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2133436759 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13d8004870 0x7f13d8004ce0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f12dd700 1 -- 172.21.15.112:0/2133436759 >> 172.21.15.112:0/2133436759 conn(0x7f13ec0d0140 msgr2=0x7f13ec0d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:48.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f12dd700 1 -- 172.21.15.112:0/2133436759 shutdown_connections 2023-11-08T12:28:48.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.404+0000 7f13f12dd700 1 -- 172.21.15.112:0/2133436759 wait complete. 2023-11-08T12:28:48.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 Processor -- start 2023-11-08T12:28:48.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 -- start start 2023-11-08T12:28:48.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8004870 0x7f13ec15f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ec15d510 0x7f13ec1f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13ec15d980 0x7f13ec1f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec1f21a0 con 0x7f13ec15d980 2023-11-08T12:28:48.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec1f2480 con 0x7f13ec15d510 2023-11-08T12:28:48.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f12dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec1f2760 con 0x7f13d8004870 2023-11-08T12:28:48.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f0adc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13ec15d980 0x7f13ec1f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f0adc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13ec15d980 0x7f13ec1f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40462/0 (socket says 172.21.15.112:40462) 2023-11-08T12:28:48.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.408+0000 7f13f0adc700 1 -- 172.21.15.112:0/2433722875 learned_addr learned my addr 172.21.15.112:0/2433722875 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:48.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13e3fff700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ec15d510 0x7f13ec1f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13ebfff700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8004870 0x7f13ec15f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f0adc700 1 -- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8004870 msgr2=0x7f13ec15f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f0adc700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8004870 0x7f13ec15f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f0adc700 1 -- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ec15d510 msgr2=0x7f13ec1f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f0adc700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ec15d510 0x7f13ec1f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f0adc700 1 -- 172.21.15.112:0/2433722875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec15c6e0 con 0x7f13ec15d980 2023-11-08T12:28:48.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f0adc700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13ec15d980 0x7f13ec1f5480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0d36d0 tx=0x7f13e400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13e97fa700 1 -- 172.21.15.112:0/2433722875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4003c30 con 0x7f13ec15d980 2023-11-08T12:28:48.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13e97fa700 1 -- 172.21.15.112:0/2433722875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e4003db0 con 0x7f13ec15d980 2023-11-08T12:28:48.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13e97fa700 1 -- 172.21.15.112:0/2433722875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4005310 con 0x7f13ec15d980 2023-11-08T12:28:48.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec0d1900 con 0x7f13ec15d980 2023-11-08T12:28:48.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec06d450 con 0x7f13ec15d980 2023-11-08T12:28:48.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec0b1af0 con 0x7f13ec15d980 2023-11-08T12:28:48.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.412+0000 7f13e97fa700 1 -- 172.21.15.112:0/2433722875 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f13e4005470 con 0x7f13ec15d980 2023-11-08T12:28:48.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.416+0000 7f13e97fa700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f13cc064ee0 0x7f13cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.416+0000 7f13e97fa700 1 -- 172.21.15.112:0/2433722875 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f13e40823c0 con 0x7f13ec15d980 2023-11-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.416+0000 7f13ebfff700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f13cc064ee0 0x7f13cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.416+0000 7f13ebfff700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f13cc064ee0 0x7f13cc067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13dc001eb0 tx=0x7f13dc001e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.420+0000 7f13e97fa700 1 -- 172.21.15.112:0/2433722875 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f13e4050140 con 0x7f13ec15d980 2023-11-08T12:28:48.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.596+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13ec1f2f50 con 0x7f13ec15d980 2023-11-08T12:28:48.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.596+0000 7f13e97fa700 1 -- 172.21.15.112:0/2433722875 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13e4053760 con 0x7f13ec15d980 2023-11-08T12:28:48.600 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:48.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f13cc064ee0 msgr2=0x7f13cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f13cc064ee0 0x7f13cc067390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13dc001eb0 tx=0x7f13dc001e20 comp rx=0 tx=0).stop 2023-11-08T12:28:48.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13ec15d980 msgr2=0x7f13ec1f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13ec15d980 0x7f13ec1f5480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0d36d0 tx=0x7f13e400ee70 comp rx=0 tx=0).stop 2023-11-08T12:28:48.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 shutdown_connections 2023-11-08T12:28:48.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f13cc064ee0 0x7f13cc067390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13ec15d980 0x7f13ec1f5480 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ec15d510 0x7f13ec1f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 --2- 172.21.15.112:0/2433722875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d8004870 0x7f13ec15f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 >> 172.21.15.112:0/2433722875 conn(0x7f13ec0d0140 msgr2=0x7f13ec0ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 shutdown_connections 2023-11-08T12:28:48.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.600+0000 7f13f12dd700 1 -- 172.21.15.112:0/2433722875 wait complete. 2023-11-08T12:28:48.627 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:48.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.804+0000 7fcba46c3700 1 Processor -- start 2023-11-08T12:28:48.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba46c3700 1 -- start start 2023-11-08T12:28:48.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba46c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba46c3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c0cd360 con 0x7fcb9c0b2130 2023-11-08T12:28:48.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba46c3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c160190 con 0x7fcb9c15c700 2023-11-08T12:28:48.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba46c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c160470 con 0x7fcb9c070a00 2023-11-08T12:28:48.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba1c5e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba245f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb9c15c700 0x7fcb9c0702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:60642/0 (socket says 172.21.15.112:60642) 2023-11-08T12:28:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba245f700 1 -- 172.21.15.112:0/463728783 learned_addr learned my addr 172.21.15.112:0/463728783 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.808+0000 7fcba2c60700 1 --1- 172.21.15.112:0/463728783 >> v1:172.21.15.112:6789/0 conn(0x7fcb9c0b2130 0x7fcb9c06a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48580/0 (socket says 172.21.15.112:48580) 2023-11-08T12:28:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba145d700 1 -- 172.21.15.112:0/463728783 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748407683 0 0) 0x7fcb9c0cd360 con 0x7fcb9c0b2130 2023-11-08T12:28:48.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba145d700 1 -- 172.21.15.112:0/463728783 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb880035d0 con 0x7fcb9c0b2130 2023-11-08T12:28:48.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba1c5e700 1 -- 172.21.15.112:0/463728783 >> v1:172.21.15.133:6789/0 conn(0x7fcb9c15c700 legacy=0x7fcb9c0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba1c5e700 1 -- 172.21.15.112:0/463728783 >> v1:172.21.15.112:6789/0 conn(0x7fcb9c0b2130 legacy=0x7fcb9c06a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba1c5e700 1 -- 172.21.15.112:0/463728783 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c160750 con 0x7fcb9c070a00 2023-11-08T12:28:48.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba1c5e700 1 --2- 172.21.15.112:0/463728783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c069bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009880 tx=0x7fcb8c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20c6f504c8e4c5b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba145d700 1 -- 172.21.15.112:0/463728783 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c011830 con 0x7fcb9c070a00 2023-11-08T12:28:48.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba145d700 1 -- 172.21.15.112:0/463728783 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c011990 con 0x7fcb9c070a00 2023-11-08T12:28:48.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba145d700 1 -- 172.21.15.112:0/463728783 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c011d20 con 0x7fcb9c070a00 2023-11-08T12:28:48.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba46c3700 1 -- 172.21.15.112:0/463728783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 msgr2=0x7fcb9c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba46c3700 1 --2- 172.21.15.112:0/463728783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c069bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009880 tx=0x7fcb8c009b90 comp rx=0 tx=0).stop 2023-11-08T12:28:48.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba46c3700 1 -- 172.21.15.112:0/463728783 shutdown_connections 2023-11-08T12:28:48.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba46c3700 1 --2- 172.21.15.112:0/463728783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c069bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba46c3700 1 -- 172.21.15.112:0/463728783 >> 172.21.15.112:0/463728783 conn(0x7fcb9c0d2d10 msgr2=0x7fcb9c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:48.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba46c3700 1 -- 172.21.15.112:0/463728783 shutdown_connections 2023-11-08T12:28:48.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.812+0000 7fcba46c3700 1 -- 172.21.15.112:0/463728783 wait complete. 2023-11-08T12:28:48.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.816+0000 7fcba46c3700 1 Processor -- start 2023-11-08T12:28:48.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.816+0000 7fcba46c3700 1 -- start start 2023-11-08T12:28:48.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.816+0000 7fcba46c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.816+0000 7fcba46c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c0b2130 0x7fcb9c15f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba46c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15c700 0x7fcb9c0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba46c3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c154790 con 0x7fcb9c15c700 2023-11-08T12:28:48.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba46c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c15cad0 con 0x7fcb9c0b2130 2023-11-08T12:28:48.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba46c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c15cdb0 con 0x7fcb9c070a00 2023-11-08T12:28:48.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15c700 0x7fcb9c0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba245f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15c700 0x7fcb9c0cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40468/0 (socket says 172.21.15.112:40468) 2023-11-08T12:28:48.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 -- 172.21.15.112:0/2005261019 learned_addr learned my addr 172.21.15.112:0/2005261019 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:48.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba1c5e700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c0b2130 0x7fcb9c15f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 -- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 msgr2=0x7fcb9c154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 -- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c0b2130 msgr2=0x7fcb9c15f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:48.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c0b2130 0x7fcb9c15f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:48.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 -- 172.21.15.112:0/2005261019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0094b0 con 0x7fcb9c15c700 2023-11-08T12:28:48.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba1c5e700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c0b2130 0x7fcb9c15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:48.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba2c60700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15c700 0x7fcb9c0cacb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400cc50 tx=0x7fcb9400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcb92ffd700 1 -- 172.21.15.112:0/2005261019 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400ab80 con 0x7fcb9c15c700 2023-11-08T12:28:48.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcb92ffd700 1 -- 172.21.15.112:0/2005261019 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9400ace0 con 0x7fcb9c15c700 2023-11-08T12:28:48.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c06b530 con 0x7fcb9c15c700 2023-11-08T12:28:48.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcb92ffd700 1 -- 172.21.15.112:0/2005261019 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007290 con 0x7fcb9c15c700 2023-11-08T12:28:48.828 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.820+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c160a30 con 0x7fcb9c15c700 2023-11-08T12:28:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.824+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c0b1be0 con 0x7fcb9c15c700 2023-11-08T12:28:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.824+0000 7fcb92ffd700 1 -- 172.21.15.112:0/2005261019 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcb94019030 con 0x7fcb9c15c700 2023-11-08T12:28:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.824+0000 7fcb92ffd700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcb80064ee0 0x7fcb80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:48.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.824+0000 7fcb92ffd700 1 -- 172.21.15.112:0/2005261019 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb94082060 con 0x7fcb9c15c700 2023-11-08T12:28:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.824+0000 7fcba245f700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcb80064ee0 0x7fcb80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:48.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.828+0000 7fcba245f700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcb80064ee0 0x7fcb80067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcb98005930 tx=0x7fcb98009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:48.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:48.832+0000 7fcb92ffd700 1 -- 172.21.15.112:0/2005261019 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcb9404fde0 con 0x7fcb9c15c700 2023-11-08T12:28:49.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.000+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb9c0726c0 con 0x7fcb9c15c700 2023-11-08T12:28:49.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.004+0000 7fcb92ffd700 1 -- 172.21.15.112:0/2005261019 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb94017020 con 0x7fcb9c15c700 2023-11-08T12:28:49.006 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:49.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcb80064ee0 msgr2=0x7fcb80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcb80064ee0 0x7fcb80067390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcb98005930 tx=0x7fcb98009040 comp rx=0 tx=0).stop 2023-11-08T12:28:49.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15c700 msgr2=0x7fcb9c0cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15c700 0x7fcb9c0cacb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400cc50 tx=0x7fcb9400cf60 comp rx=0 tx=0).stop 2023-11-08T12:28:49.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 shutdown_connections 2023-11-08T12:28:49.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcb80064ee0 0x7fcb80067390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15c700 0x7fcb9c0cacb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c0b2130 0x7fcb9c15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 --2- 172.21.15.112:0/2005261019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c070a00 0x7fcb9c154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 >> 172.21.15.112:0/2005261019 conn(0x7fcb9c0d2d10 msgr2=0x7fcb9c156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:49.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 shutdown_connections 2023-11-08T12:28:49.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.008+0000 7fcba46c3700 1 -- 172.21.15.112:0/2005261019 wait complete. 2023-11-08T12:28:49.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:49.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 Processor -- start 2023-11-08T12:28:49.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 -- start start 2023-11-08T12:28:49.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f971c15e190 0x7f971c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c161560 0x7f971c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f971c06ff10 0x7f971c070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c0708d0 con 0x7f971c06ff10 2023-11-08T12:28:49.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c15e560 con 0x7f971c15e190 2023-11-08T12:28:49.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9722612700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c06be80 con 0x7f971c161560 2023-11-08T12:28:49.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f971c06ff10 0x7f971c070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f971c06ff10 0x7f971c070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40470/0 (socket says 172.21.15.112:40470) 2023-11-08T12:28:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 -- 172.21.15.112:0/3659827721 learned_addr learned my addr 172.21.15.112:0/3659827721 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721610700 1 --2- 172.21.15.112:0/3659827721 >> v2:172.21.15.133:3300/0 conn(0x7f971c15e190 0x7f971c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9720e0f700 1 --2- 172.21.15.112:0/3659827721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c161560 0x7f971c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 -- 172.21.15.112:0/3659827721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c161560 msgr2=0x7f971c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 --2- 172.21.15.112:0/3659827721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c161560 0x7f971c069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 -- 172.21.15.112:0/3659827721 >> v2:172.21.15.133:3300/0 conn(0x7f971c15e190 msgr2=0x7f971c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 --2- 172.21.15.112:0/3659827721 >> v2:172.21.15.133:3300/0 conn(0x7f971c15e190 0x7f971c0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721e11700 1 -- 172.21.15.112:0/3659827721 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0ce330 con 0x7f971c06ff10 2023-11-08T12:28:49.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.208+0000 7f9721610700 1 --2- 172.21.15.112:0/3659827721 >> v2:172.21.15.133:3300/0 conn(0x7f971c15e190 0x7f971c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:49.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9721e11700 1 --2- 172.21.15.112:0/3659827721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c070390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f971c0cb9b0 tx=0x7f971400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53e9a5ded1cd5c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:49.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9713fff700 1 -- 172.21.15.112:0/3659827721 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971400e070 con 0x7f971c06ff10 2023-11-08T12:28:49.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9713fff700 1 -- 172.21.15.112:0/3659827721 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971400b9c0 con 0x7f971c06ff10 2023-11-08T12:28:49.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9713fff700 1 -- 172.21.15.112:0/3659827721 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971400bd70 con 0x7f971c06ff10 2023-11-08T12:28:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 -- 172.21.15.112:0/3659827721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 msgr2=0x7f971c070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 --2- 172.21.15.112:0/3659827721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c070390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f971c0cb9b0 tx=0x7f971400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 -- 172.21.15.112:0/3659827721 shutdown_connections 2023-11-08T12:28:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 --2- 172.21.15.112:0/3659827721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c161560 0x7f971c069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 --2- 172.21.15.112:0/3659827721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c070390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 --2- 172.21.15.112:0/3659827721 >> v2:172.21.15.133:3300/0 conn(0x7f971c15e190 0x7f971c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 -- 172.21.15.112:0/3659827721 >> 172.21.15.112:0/3659827721 conn(0x7f971c0cf280 msgr2=0x7f971c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 -- 172.21.15.112:0/3659827721 shutdown_connections 2023-11-08T12:28:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.212+0000 7f9722612700 1 -- 172.21.15.112:0/3659827721 wait complete. 2023-11-08T12:28:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 Processor -- start 2023-11-08T12:28:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 -- start start 2023-11-08T12:28:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c15e190 0x7f971c163210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f971c161560 0x7f971c163750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b35f0 con 0x7f971c06ff10 2023-11-08T12:28:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b2550 con 0x7f971c161560 2023-11-08T12:28:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9722612700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b2830 con 0x7f971c15e190 2023-11-08T12:28:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9721610700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9721610700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40478/0 (socket says 172.21.15.112:40478) 2023-11-08T12:28:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.216+0000 7f9721610700 1 -- 172.21.15.112:0/80967021 learned_addr learned my addr 172.21.15.112:0/80967021 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9720e0f700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c15e190 0x7f971c163210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9721e11700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f971c161560 0x7f971c163750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9721610700 1 -- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c15e190 msgr2=0x7f971c163210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9721610700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c15e190 0x7f971c163210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9721610700 1 -- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f971c161560 msgr2=0x7f971c163750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9721610700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f971c161560 0x7f971c163750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9721610700 1 -- 172.21.15.112:0/80967021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714009b30 con 0x7f971c06ff10 2023-11-08T12:28:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9721610700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c1575e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f971800e760 tx=0x7f971800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9711ffb700 1 -- 172.21.15.112:0/80967021 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971800c070 con 0x7f971c06ff10 2023-11-08T12:28:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9711ffb700 1 -- 172.21.15.112:0/80967021 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718004250 con 0x7f971c06ff10 2023-11-08T12:28:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9711ffb700 1 -- 172.21.15.112:0/80967021 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180036c0 con 0x7f971c06ff10 2023-11-08T12:28:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c0afc70 con 0x7f971c06ff10 2023-11-08T12:28:49.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c0af990 con 0x7f971c06ff10 2023-11-08T12:28:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.220+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c0aff50 con 0x7f971c06ff10 2023-11-08T12:28:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.224+0000 7f9711ffb700 1 -- 172.21.15.112:0/80967021 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9718019020 con 0x7f971c06ff10 2023-11-08T12:28:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.224+0000 7f9711ffb700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9700064ee0 0x7f9700067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.224+0000 7f9711ffb700 1 -- 172.21.15.112:0/80967021 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9718081f50 con 0x7f971c06ff10 2023-11-08T12:28:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.224+0000 7f9720e0f700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9700064ee0 0x7f9700067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.224+0000 7f9720e0f700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9700064ee0 0x7f9700067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f971c162e90 tx=0x7f970c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.228+0000 7f9711ffb700 1 -- 172.21.15.112:0/80967021 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f971804fcd0 con 0x7f971c06ff10 2023-11-08T12:28:49.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.396+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f971c073d20 con 0x7f971c06ff10 2023-11-08T12:28:49.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.396+0000 7f9711ffb700 1 -- 172.21.15.112:0/80967021 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97180094e0 con 0x7f971c06ff10 2023-11-08T12:28:49.400 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:49.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9700064ee0 msgr2=0x7f9700067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9700064ee0 0x7f9700067390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f971c162e90 tx=0x7f970c008040 comp rx=0 tx=0).stop 2023-11-08T12:28:49.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 msgr2=0x7f971c1575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c1575e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f971800e760 tx=0x7f971800ea70 comp rx=0 tx=0).stop 2023-11-08T12:28:49.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 shutdown_connections 2023-11-08T12:28:49.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9700064ee0 0x7f9700067390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f971c161560 0x7f971c163750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f971c15e190 0x7f971c163210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 --2- 172.21.15.112:0/80967021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c06ff10 0x7f971c1575e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 >> 172.21.15.112:0/80967021 conn(0x7f971c0cf280 msgr2=0x7f971c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:49.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 shutdown_connections 2023-11-08T12:28:49.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.400+0000 7f9722612700 1 -- 172.21.15.112:0/80967021 wait complete. 2023-11-08T12:28:49.428 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T12:28:49.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-08T12:28:49.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.608+0000 7f8da359e700 1 Processor -- start 2023-11-08T12:28:49.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.608+0000 7f8da359e700 1 -- start start 2023-11-08T12:28:49.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40b1950 0x7f8da40cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da415cde0 con 0x7f8da40cd8d0 2023-11-08T12:28:49.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da40af040 con 0x7f8da4159320 2023-11-08T12:28:49.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da40cdd70 con 0x7f8da40b1950 2023-11-08T12:28:49.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da2d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8da40cd8d0 0x7f8da406b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48584/0 (socket says 172.21.15.112:48584) 2023-11-08T12:28:49.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da2d9d700 1 -- 172.21.15.112:0/3367798550 learned_addr learned my addr 172.21.15.112:0/3367798550 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:49.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da1d9b700 1 --2- 172.21.15.112:0/3367798550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40b1950 0x7f8da40cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766934507 0 0) 0x7f8da415cde0 con 0x7f8da40cd8d0 2023-11-08T12:28:49.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.612+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d8c0057e0 con 0x7f8da40cd8d0 2023-11-08T12:28:49.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125684502 0 0) 0x7f8da40af040 con 0x7f8da4159320 2023-11-08T12:28:49.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8da415cde0 con 0x7f8da4159320 2023-11-08T12:28:49.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da1d9b700 1 -- 172.21.15.112:0/3367798550 >> v1:172.21.15.133:6789/0 conn(0x7f8da4159320 legacy=0x7f8da40b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da1d9b700 1 -- 172.21.15.112:0/3367798550 >> v1:172.21.15.112:6789/0 conn(0x7f8da40cd8d0 legacy=0x7f8da406b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4191330022 0 0) 0x7f8d8c0057e0 con 0x7f8da40cd8d0 2023-11-08T12:28:49.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da1d9b700 1 -- 172.21.15.112:0/3367798550 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da40ca7f0 con 0x7f8da40b1950 2023-11-08T12:28:49.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da1d9b700 1 --2- 172.21.15.112:0/3367798550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40b1950 0x7f8da40cd390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009880 tx=0x7f8d98009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=650f2feffbed5b48 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:49.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c0019f0 con 0x7f8da40b1950 2023-11-08T12:28:49.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98004030 con 0x7f8da40b1950 2023-11-08T12:28:49.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da159a700 1 -- 172.21.15.112:0/3367798550 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d980043a0 con 0x7f8da40b1950 2023-11-08T12:28:49.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da359e700 1 -- 172.21.15.112:0/3367798550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40b1950 msgr2=0x7f8da40cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da359e700 1 --2- 172.21.15.112:0/3367798550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40b1950 0x7f8da40cd390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009880 tx=0x7f8d98009b90 comp rx=0 tx=0).stop 2023-11-08T12:28:49.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da359e700 1 -- 172.21.15.112:0/3367798550 shutdown_connections 2023-11-08T12:28:49.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da359e700 1 --2- 172.21.15.112:0/3367798550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40b1950 0x7f8da40cd390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da359e700 1 -- 172.21.15.112:0/3367798550 >> 172.21.15.112:0/3367798550 conn(0x7f8da40cc240 msgr2=0x7f8da40cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:49.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da359e700 1 -- 172.21.15.112:0/3367798550 shutdown_connections 2023-11-08T12:28:49.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.616+0000 7f8da359e700 1 -- 172.21.15.112:0/3367798550 wait complete. 2023-11-08T12:28:49.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 Processor -- start 2023-11-08T12:28:49.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 -- start start 2023-11-08T12:28:49.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da40b1950 0x7f8da4154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40cd8d0 0x7f8da41f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8da4159320 0x7f8da41f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41f1a20 con 0x7f8da40b1950 2023-11-08T12:28:49.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da40ab900 con 0x7f8da4159320 2023-11-08T12:28:49.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da4154d80 con 0x7f8da40cd8d0 2023-11-08T12:28:49.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da40b1950 0x7f8da4154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da40b1950 0x7f8da4154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40486/0 (socket says 172.21.15.112:40486) 2023-11-08T12:28:49.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da259c700 1 -- 172.21.15.112:0/2944265719 learned_addr learned my addr 172.21.15.112:0/2944265719 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:49.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.620+0000 7f8da1d9b700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40cd8d0 0x7f8da41f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da2d9d700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8da4159320 0x7f8da41f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da1d9b700 1 -- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8da4159320 msgr2=0x7f8da41f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da1d9b700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8da4159320 0x7f8da41f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da1d9b700 1 -- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da40b1950 msgr2=0x7f8da4154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:49.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da1d9b700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da40b1950 0x7f8da4154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:49.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da1d9b700 1 -- 172.21.15.112:0/2944265719 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980094b0 con 0x7f8da40cd8d0 2023-11-08T12:28:49.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da259c700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da40b1950 0x7f8da4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:49.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da1d9b700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40cd8d0 0x7f8da41f50a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8da40c6820 tx=0x7f8d98004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8d92ffd700 1 -- 172.21.15.112:0/2944265719 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98004590 con 0x7f8da40cd8d0 2023-11-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8d92ffd700 1 -- 172.21.15.112:0/2944265719 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98003d00 con 0x7f8da40cd8d0 2023-11-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da415d030 con 0x7f8da40cd8d0 2023-11-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8d92ffd700 1 -- 172.21.15.112:0/2944265719 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98011870 con 0x7f8da40cd8d0 2023-11-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da41596f0 con 0x7f8da40cd8d0 2023-11-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.624+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da415d310 con 0x7f8da40cd8d0 2023-11-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.628+0000 7f8d92ffd700 1 -- 172.21.15.112:0/2944265719 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d9802c070 con 0x7f8da40cd8d0 2023-11-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.628+0000 7f8d92ffd700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d84064ee0 0x7f8d84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:49.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.628+0000 7f8d92ffd700 1 -- 172.21.15.112:0/2944265719 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8d98083130 con 0x7f8da40cd8d0 2023-11-08T12:28:49.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.628+0000 7f8da259c700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d84064ee0 0x7f8d84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:49.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.628+0000 7f8da259c700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d84064ee0 0x7f8d84067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8d940011e0 tx=0x7f8d94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:49.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.636+0000 7f8d92ffd700 1 -- 172.21.15.112:0/2944265719 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d98050f30 con 0x7f8da40cd8d0 2023-11-08T12:28:49.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:49.872+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f8da4073cb0 con 0x7f8da40cd8d0 2023-11-08T12:28:50.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.068+0000 7f8d92ffd700 1 -- 172.21.15.112:0/2944265719 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v74) v1 ==== 145+0+0 (secure 0 0 0) 0x7f8d98006e20 con 0x7f8da40cd8d0 2023-11-08T12:28:50.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d84064ee0 msgr2=0x7f8d84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d84064ee0 0x7f8d84067390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8d940011e0 tx=0x7f8d94009040 comp rx=0 tx=0).stop 2023-11-08T12:28:50.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40cd8d0 msgr2=0x7f8da41f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40cd8d0 0x7f8da41f50a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8da40c6820 tx=0x7f8d98004770 comp rx=0 tx=0).stop 2023-11-08T12:28:50.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 shutdown_connections 2023-11-08T12:28:50.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d84064ee0 0x7f8d84067390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8da4159320 0x7f8da41f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8da40cd8d0 0x7f8da41f50a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 --2- 172.21.15.112:0/2944265719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8da40b1950 0x7f8da4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 >> 172.21.15.112:0/2944265719 conn(0x7f8da40cc240 msgr2=0x7f8da4155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:50.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 shutdown_connections 2023-11-08T12:28:50.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.072+0000 7f8da359e700 1 -- 172.21.15.112:0/2944265719 wait complete. 2023-11-08T12:28:50.099 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T12:28:50.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.272+0000 7f5108f24700 1 Processor -- start 2023-11-08T12:28:50.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.272+0000 7f5108f24700 1 -- start start 2023-11-08T12:28:50.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.272+0000 7f5108f24700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51040c9100 0x7f510406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.272+0000 7f5108f24700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5104071dd0 con 0x7f510406c0f0 2023-11-08T12:28:50.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.272+0000 7f5108f24700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51040720b0 con 0x7f5104157c20 2023-11-08T12:28:50.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.272+0000 7f5108f24700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510406c570 con 0x7f51040c9100 2023-11-08T12:28:50.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5102ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51040c9100 0x7f510406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5102ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51040c9100 0x7f510406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40496/0 (socket says 172.21.15.112:40496) 2023-11-08T12:28:50.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5102ffd700 1 -- 172.21.15.112:0/2072315176 learned_addr learned my addr 172.21.15.112:0/2072315176 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:50.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5102ffd700 1 -- 172.21.15.112:0/2072315176 >> v1:172.21.15.133:6789/0 conn(0x7f5104157c20 legacy=0x7f510415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:50.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5102ffd700 1 -- 172.21.15.112:0/2072315176 >> v1:172.21.15.112:6789/0 conn(0x7f510406c0f0 legacy=0x7f510415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5102ffd700 1 -- 172.21.15.112:0/2072315176 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040cae40 con 0x7f51040c9100 2023-11-08T12:28:50.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f51027fc700 1 -- 172.21.15.112:0/2072315176 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169522006 0 0) 0x7f5104071dd0 con 0x7f510406c0f0 2023-11-08T12:28:50.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5102ffd700 1 --2- 172.21.15.112:0/2072315176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51040c9100 0x7f510406bbb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009910 tx=0x7f50f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40a2e2b2095157a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:50.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f51027fc700 1 -- 172.21.15.112:0/2072315176 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f800ba60 con 0x7f51040c9100 2023-11-08T12:28:50.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f51027fc700 1 -- 172.21.15.112:0/2072315176 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f800bbc0 con 0x7f51040c9100 2023-11-08T12:28:50.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f51027fc700 1 -- 172.21.15.112:0/2072315176 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8009e60 con 0x7f51040c9100 2023-11-08T12:28:50.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5108f24700 1 -- 172.21.15.112:0/2072315176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51040c9100 msgr2=0x7f510406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5108f24700 1 --2- 172.21.15.112:0/2072315176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51040c9100 0x7f510406bbb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009910 tx=0x7f50f8009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:50.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5108f24700 1 -- 172.21.15.112:0/2072315176 shutdown_connections 2023-11-08T12:28:50.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5108f24700 1 --2- 172.21.15.112:0/2072315176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51040c9100 0x7f510406bbb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5108f24700 1 -- 172.21.15.112:0/2072315176 >> 172.21.15.112:0/2072315176 conn(0x7f51040b12d0 msgr2=0x7f51040ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:50.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5108f24700 1 -- 172.21.15.112:0/2072315176 shutdown_connections 2023-11-08T12:28:50.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.276+0000 7f5108f24700 1 -- 172.21.15.112:0/2072315176 wait complete. 2023-11-08T12:28:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 Processor -- start 2023-11-08T12:28:50.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 -- start start 2023-11-08T12:28:50.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f510406c0f0 0x7f51040c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51040c9100 0x7f5104158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5104157c20 0x7f5104158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510415c8e0 con 0x7f5104157c20 2023-11-08T12:28:50.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040c5560 con 0x7f51040c9100 2023-11-08T12:28:50.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.280+0000 7f5108f24700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510415bf40 con 0x7f510406c0f0 2023-11-08T12:28:50.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5104157c20 0x7f5104158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5104157c20 0x7f5104158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40512/0 (socket says 172.21.15.112:40512) 2023-11-08T12:28:50.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 -- 172.21.15.112:0/4164998258 learned_addr learned my addr 172.21.15.112:0/4164998258 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:50.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5102ffd700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51040c9100 0x7f5104158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f51037fe700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f510406c0f0 0x7f51040c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 -- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f510406c0f0 msgr2=0x7f51040c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f510406c0f0 0x7f51040c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 -- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51040c9100 msgr2=0x7f5104158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51040c9100 0x7f5104158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 -- 172.21.15.112:0/4164998258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8009570 con 0x7f5104157c20 2023-11-08T12:28:50.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5103fff700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5104157c20 0x7f5104158dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00cc10 tx=0x7f50fc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:50.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f50ebfff700 1 -- 172.21.15.112:0/4164998258 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc003e50 con 0x7f5104157c20 2023-11-08T12:28:50.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f50ebfff700 1 -- 172.21.15.112:0/4164998258 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc00a650 con 0x7f5104157c20 2023-11-08T12:28:50.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f50ebfff700 1 -- 172.21.15.112:0/4164998258 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00aa00 con 0x7f5104157c20 2023-11-08T12:28:50.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51040caa60 con 0x7f5104157c20 2023-11-08T12:28:50.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51040cb120 con 0x7f5104157c20 2023-11-08T12:28:50.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.284+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51040cabf0 con 0x7f5104157c20 2023-11-08T12:28:50.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.288+0000 7f50ebfff700 1 -- 172.21.15.112:0/4164998258 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f50fc019030 con 0x7f5104157c20 2023-11-08T12:28:50.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.288+0000 7f50ebfff700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f0064f10 0x7f50f00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.288+0000 7f50ebfff700 1 -- 172.21.15.112:0/4164998258 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f50fc081b00 con 0x7f5104157c20 2023-11-08T12:28:50.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.288+0000 7f51037fe700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f0064f10 0x7f50f00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.288+0000 7f51037fe700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f0064f10 0x7f50f00673c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f50f4000f60 tx=0x7f50f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:50.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.296+0000 7f50ebfff700 1 -- 172.21.15.112:0/4164998258 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f50fc083e60 con 0x7f5104157c20 2023-11-08T12:28:50.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.464+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f510415ca20 con 0x7f5104157c20 2023-11-08T12:28:50.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f50ebfff700 1 -- 172.21.15.112:0/4164998258 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f510415ca20 con 0x7f5104157c20 2023-11-08T12:28:50.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f0064f10 msgr2=0x7f50f00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f0064f10 0x7f50f00673c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f50f4000f60 tx=0x7f50f4009040 comp rx=0 tx=0).stop 2023-11-08T12:28:50.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5104157c20 msgr2=0x7f5104158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5104157c20 0x7f5104158dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00cc10 tx=0x7f50fc00cf20 comp rx=0 tx=0).stop 2023-11-08T12:28:50.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 shutdown_connections 2023-11-08T12:28:50.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f0064f10 0x7f50f00673c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5104157c20 0x7f5104158dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51040c9100 0x7f5104158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 --2- 172.21.15.112:0/4164998258 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f510406c0f0 0x7f51040c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.476+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 >> 172.21.15.112:0/4164998258 conn(0x7f51040b12d0 msgr2=0x7f51040c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:50.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.480+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 shutdown_connections 2023-11-08T12:28:50.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.480+0000 7f5108f24700 1 -- 172.21.15.112:0/4164998258 wait complete. 2023-11-08T12:28:50.505 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T12:28:50.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:28:50.545 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:28:50.595 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T12:28:50.595 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:50.595 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:50.617 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:50.617 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:50.676 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:50.677 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:50.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:50.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.960+0000 7fb591ba0700 1 Processor -- start 2023-11-08T12:28:50.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb591ba0700 1 -- start start 2023-11-08T12:28:50.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb591ba0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb58c15a480 0x7fb58c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb591ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c0c8d10 0x7fb58c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb591ba0700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c15a850 con 0x7fb58c0ccd10 2023-11-08T12:28:50.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb591ba0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c0ce060 con 0x7fb58c15a480 2023-11-08T12:28:50.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb591ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0ce300 con 0x7fb58c0c8d10 2023-11-08T12:28:50.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb58c15a480 0x7fb58c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb58c0ccd10 0x7fb58c15dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48606/0 (socket says 172.21.15.112:48606) 2023-11-08T12:28:50.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58bfff700 1 -- 172.21.15.112:0/2860790209 learned_addr learned my addr 172.21.15.112:0/2860790209 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:50.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58affd700 1 --2- 172.21.15.112:0/2860790209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c0c8d10 0x7fb58c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58a7fc700 1 -- 172.21.15.112:0/2860790209 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772003554 0 0) 0x7fb58c15a850 con 0x7fb58c0ccd10 2023-11-08T12:28:50.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58a7fc700 1 -- 172.21.15.112:0/2860790209 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5740035d0 con 0x7fb58c0ccd10 2023-11-08T12:28:50.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58b7fe700 1 -- 172.21.15.112:0/2860790209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c0c8d10 msgr2=0x7fb58c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:50.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58b7fe700 1 --2- 172.21.15.112:0/2860790209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c0c8d10 0x7fb58c0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58b7fe700 1 -- 172.21.15.112:0/2860790209 >> v1:172.21.15.112:6789/0 conn(0x7fb58c0ccd10 legacy=0x7fb58c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.964+0000 7fb58b7fe700 1 -- 172.21.15.112:0/2860790209 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0cada0 con 0x7fb58c15a480 2023-11-08T12:28:50.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb58b7fe700 1 --2- 172.21.15.112:0/2860790209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c15a480 0x7fb58c0cc290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009850 tx=0x7fb57c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0d23e9932e35ae server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:50.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb58a7fc700 1 -- 172.21.15.112:0/2860790209 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c011830 con 0x7fb58c15a480 2023-11-08T12:28:50.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb58a7fc700 1 -- 172.21.15.112:0/2860790209 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c011990 con 0x7fb58c15a480 2023-11-08T12:28:50.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb58a7fc700 1 -- 172.21.15.112:0/2860790209 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c011d40 con 0x7fb58c15a480 2023-11-08T12:28:50.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 -- 172.21.15.112:0/2860790209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c15a480 msgr2=0x7fb58c0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 --2- 172.21.15.112:0/2860790209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c15a480 0x7fb58c0cc290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009850 tx=0x7fb57c009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:50.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 -- 172.21.15.112:0/2860790209 shutdown_connections 2023-11-08T12:28:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 --2- 172.21.15.112:0/2860790209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c0c8d10 0x7fb58c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 --2- 172.21.15.112:0/2860790209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c15a480 0x7fb58c0cc290 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 -- 172.21.15.112:0/2860790209 >> 172.21.15.112:0/2860790209 conn(0x7fb58c0cf350 msgr2=0x7fb58c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 -- 172.21.15.112:0/2860790209 shutdown_connections 2023-11-08T12:28:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.968+0000 7fb591ba0700 1 -- 172.21.15.112:0/2860790209 wait complete. 2023-11-08T12:28:50.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.972+0000 7fb591ba0700 1 Processor -- start 2023-11-08T12:28:50.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.972+0000 7fb591ba0700 1 -- start start 2023-11-08T12:28:50.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0c8d10 0x7fb58c1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb58c0ccd10 0x7fb58c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c15a480 0x7fb58c0b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c151f40 con 0x7fb58c0c8d10 2023-11-08T12:28:50.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c15c9a0 con 0x7fb58c0ccd10 2023-11-08T12:28:50.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c15ac00 con 0x7fb58c15a480 2023-11-08T12:28:50.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0c8d10 0x7fb58c1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0c8d10 0x7fb58c1503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40528/0 (socket says 172.21.15.112:40528) 2023-11-08T12:28:50.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 -- 172.21.15.112:0/163654627 learned_addr learned my addr 172.21.15.112:0/163654627 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:50.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58bfff700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c15a480 0x7fb58c0b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 -- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c15a480 msgr2=0x7fb58c0b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c15a480 0x7fb58c0b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 -- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb58c0ccd10 msgr2=0x7fb58c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:50.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58affd700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb58c0ccd10 0x7fb58c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb58c0ccd10 0x7fb58c06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:50.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 -- 172.21.15.112:0/163654627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0094b0 con 0x7fb58c0c8d10 2023-11-08T12:28:50.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58affd700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb58c0ccd10 0x7fb58c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:50.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb58b7fe700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0c8d10 0x7fb58c1503e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0097a0 tx=0x7fb57c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:50.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb573fff700 1 -- 172.21.15.112:0/163654627 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0036c0 con 0x7fb58c0c8d10 2023-11-08T12:28:50.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb573fff700 1 -- 172.21.15.112:0/163654627 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c003840 con 0x7fb58c0c8d10 2023-11-08T12:28:50.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb573fff700 1 -- 172.21.15.112:0/163654627 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c003bf0 con 0x7fb58c0c8d10 2023-11-08T12:28:50.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c0add50 con 0x7fb58c0c8d10 2023-11-08T12:28:50.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c0caa30 con 0x7fb58c0c8d10 2023-11-08T12:28:50.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.976+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c0ca6e0 con 0x7fb58c0c8d10 2023-11-08T12:28:50.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.980+0000 7fb573fff700 1 -- 172.21.15.112:0/163654627 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb57c00f050 con 0x7fb58c0c8d10 2023-11-08T12:28:50.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.980+0000 7fb573fff700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb578064ee0 0x7fb578067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:50.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.980+0000 7fb573fff700 1 -- 172.21.15.112:0/163654627 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb57c0836e0 con 0x7fb58c0c8d10 2023-11-08T12:28:50.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.980+0000 7fb58affd700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb578064ee0 0x7fb578067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:50.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.980+0000 7fb58affd700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb578064ee0 0x7fb578067390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0ac910 tx=0x7fb580008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:50.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:50.988+0000 7fb573fff700 1 -- 172.21.15.112:0/163654627 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb57c0514e0 con 0x7fb58c0c8d10 2023-11-08T12:28:51.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.160+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb58c0c9a20 con 0x7fb58c0c8d10 2023-11-08T12:28:51.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.164+0000 7fb573fff700 1 -- 172.21.15.112:0/163654627 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7fb57c054b00 con 0x7fb58c0c8d10 2023-11-08T12:28:51.167 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:51.168 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:51.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb578064ee0 msgr2=0x7fb578067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb578064ee0 0x7fb578067390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0ac910 tx=0x7fb580008040 comp rx=0 tx=0).stop 2023-11-08T12:28:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0c8d10 msgr2=0x7fb58c1503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0c8d10 0x7fb58c1503e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0097a0 tx=0x7fb57c004770 comp rx=0 tx=0).stop 2023-11-08T12:28:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 shutdown_connections 2023-11-08T12:28:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb578064ee0 0x7fb578067390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb58c15a480 0x7fb58c0b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb58c0ccd10 0x7fb58c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 --2- 172.21.15.112:0/163654627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58c0c8d10 0x7fb58c1503e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 >> 172.21.15.112:0/163654627 conn(0x7fb58c0cf350 msgr2=0x7fb58c0adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 shutdown_connections 2023-11-08T12:28:51.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.168+0000 7fb591ba0700 1 -- 172.21.15.112:0/163654627 wait complete. 2023-11-08T12:28:51.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:51.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:51.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.372+0000 7f6bcead1700 1 Processor -- start 2023-11-08T12:28:51.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.372+0000 7f6bcead1700 1 -- start start 2023-11-08T12:28:51.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcead1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6bc80b3d00 0x7f6bc806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcead1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc815c520 con 0x7f6bc815c150 2023-11-08T12:28:51.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcead1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc806cc50 con 0x7f6bc8070620 2023-11-08T12:28:51.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcead1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80d2450 con 0x7f6bc80b3d00 2023-11-08T12:28:51.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6bc815c150 0x7f6bc806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48622/0 (socket says 172.21.15.112:48622) 2023-11-08T12:28:51.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 -- 172.21.15.112:0/1346873008 learned_addr learned my addr 172.21.15.112:0/1346873008 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:51.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111133373 0 0) 0x7f6bc815c520 con 0x7f6bc815c150 2023-11-08T12:28:51.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb40035d0 con 0x7f6bc815c150 2023-11-08T12:28:51.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bce2d0700 1 --2- 172.21.15.112:0/1346873008 >> v2:172.21.15.133:3300/0 conn(0x7f6bc80b3d00 0x7f6bc806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 709637841 0 0) 0x7f6bb40035d0 con 0x7f6bc815c150 2023-11-08T12:28:51.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 >> v2:172.21.15.133:3300/0 conn(0x7f6bc80b3d00 msgr2=0x7f6bc806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:51.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 --2- 172.21.15.112:0/1346873008 >> v2:172.21.15.133:3300/0 conn(0x7f6bc80b3d00 0x7f6bc806a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 >> v1:172.21.15.133:6789/0 conn(0x7f6bc8070620 legacy=0x7f6bc8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80d2730 con 0x7f6bc815c150 2023-11-08T12:28:51.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f6bc4001670 con 0x7f6bc815c150 2023-11-08T12:28:51.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 >> v1:172.21.15.112:6789/0 conn(0x7f6bc815c150 legacy=0x7f6bc806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4003a20 0x7f6bb4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bb4004870 0x7f6bb4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4005220 0x7f6bb400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80d2450 con 0x7f6bb4003a20 2023-11-08T12:28:51.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb400c1b0 con 0x7f6bb4005220 2023-11-08T12:28:51.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb400c370 con 0x7f6bb4004870 2023-11-08T12:28:51.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4003a20 0x7f6bb4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 -- 172.21.15.112:0/1346873008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bb4004870 msgr2=0x7f6bb4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:51.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bb4004870 0x7f6bb4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 -- 172.21.15.112:0/1346873008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4005220 msgr2=0x7f6bb400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:51.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4005220 0x7f6bb400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bcdacf700 1 -- 172.21.15.112:0/1346873008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40035d0 con 0x7f6bb4003a20 2023-11-08T12:28:51.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.376+0000 7f6bce2d0700 1 -- 172.21.15.112:0/1346873008 reap_dead start 2023-11-08T12:28:51.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcdacf700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4003a20 0x7f6bb4003e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c2f0 tx=0x7f6bb40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a804bad2fd0ba06 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:51.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4007c30 con 0x7f6bb4003a20 2023-11-08T12:28:51.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400ce50 con 0x7f6bb4003a20 2023-11-08T12:28:51.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bccacd700 1 -- 172.21.15.112:0/1346873008 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4005bc0 con 0x7f6bb4003a20 2023-11-08T12:28:51.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcead1700 1 -- 172.21.15.112:0/1346873008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4003a20 msgr2=0x7f6bb4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcead1700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4003a20 0x7f6bb4003e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c2f0 tx=0x7f6bb40058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcead1700 1 -- 172.21.15.112:0/1346873008 shutdown_connections 2023-11-08T12:28:51.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcead1700 1 --2- 172.21.15.112:0/1346873008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4003a20 0x7f6bb4003e30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcead1700 1 -- 172.21.15.112:0/1346873008 >> 172.21.15.112:0/1346873008 conn(0x7f6bc80d3680 msgr2=0x7f6bc80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:51.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcead1700 1 -- 172.21.15.112:0/1346873008 shutdown_connections 2023-11-08T12:28:51.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.380+0000 7f6bcead1700 1 -- 172.21.15.112:0/1346873008 wait complete. 2023-11-08T12:28:51.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 Processor -- start 2023-11-08T12:28:51.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 -- start start 2023-11-08T12:28:51.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4003a20 0x7f6bc80c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bc81534c0 0x7f6bc8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc806a130 0x7f6bc80ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80caaa0 con 0x7f6bc806a130 2023-11-08T12:28:51.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc806a5a0 con 0x7f6bb4003a20 2023-11-08T12:28:51.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80c9e20 con 0x7f6bc81534c0 2023-11-08T12:28:51.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc806a130 0x7f6bc80ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc806a130 0x7f6bc80ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40544/0 (socket says 172.21.15.112:40544) 2023-11-08T12:28:51.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 -- 172.21.15.112:0/3408398129 learned_addr learned my addr 172.21.15.112:0/3408398129 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:51.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcdacf700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4003a20 0x7f6bc80c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcd2ce700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bc81534c0 0x7f6bc8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 -- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bc81534c0 msgr2=0x7f6bc8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bc81534c0 0x7f6bc8069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 -- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4003a20 msgr2=0x7f6bc80c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4003a20 0x7f6bc80c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 -- 172.21.15.112:0/3408398129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80d2140 con 0x7f6bc806a130 2023-11-08T12:28:51.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcd2ce700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bc81534c0 0x7f6bc8069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:51.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bce2d0700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc806a130 0x7f6bc80ce100 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8072f20 tx=0x7f6bc000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:51.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bbe7fc700 1 -- 172.21.15.112:0/3408398129 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000eba0 con 0x7f6bc806a130 2023-11-08T12:28:51.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bbe7fc700 1 -- 172.21.15.112:0/3408398129 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000ed20 con 0x7f6bc806a130 2023-11-08T12:28:51.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc80d05e0 con 0x7f6bc806a130 2023-11-08T12:28:51.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.384+0000 7f6bbe7fc700 1 -- 172.21.15.112:0/3408398129 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0014660 con 0x7f6bc806a130 2023-11-08T12:28:51.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.388+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc8070cd0 con 0x7f6bc806a130 2023-11-08T12:28:51.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.388+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc8073d20 con 0x7f6bc806a130 2023-11-08T12:28:51.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.388+0000 7f6bbe7fc700 1 -- 172.21.15.112:0/3408398129 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6bc0012050 con 0x7f6bc806a130 2023-11-08T12:28:51.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.392+0000 7f6bbe7fc700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6bac064ee0 0x7f6bac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.392+0000 7f6bbe7fc700 1 -- 172.21.15.112:0/3408398129 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6bc0082510 con 0x7f6bc806a130 2023-11-08T12:28:51.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.392+0000 7f6bcdacf700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6bac064ee0 0x7f6bac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.392+0000 7f6bcdacf700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6bac064ee0 0x7f6bac067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4000c00 tx=0x7f6bc4007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:51.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.396+0000 7f6bbe7fc700 1 -- 172.21.15.112:0/3408398129 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6bc0050290 con 0x7f6bc806a130 2023-11-08T12:28:51.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.568+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bc80ccd30 con 0x7f6bc806a130 2023-11-08T12:28:51.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.568+0000 7f6bbe7fc700 1 -- 172.21.15.112:0/3408398129 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bc00538b0 con 0x7f6bc806a130 2023-11-08T12:28:51.573 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:51.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6bac064ee0 msgr2=0x7f6bac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6bac064ee0 0x7f6bac067390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4000c00 tx=0x7f6bc4007000 comp rx=0 tx=0).stop 2023-11-08T12:28:51.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc806a130 msgr2=0x7f6bc80ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc806a130 0x7f6bc80ce100 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8072f20 tx=0x7f6bc000e3c0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 shutdown_connections 2023-11-08T12:28:51.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6bac064ee0 0x7f6bac067390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bc806a130 0x7f6bc80ce100 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bc81534c0 0x7f6bc8069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 --2- 172.21.15.112:0/3408398129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bb4003a20 0x7f6bc80c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 >> 172.21.15.112:0/3408398129 conn(0x7f6bc80d3680 msgr2=0x7f6bc8159740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:51.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 shutdown_connections 2023-11-08T12:28:51.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.572+0000 7f6bcead1700 1 -- 172.21.15.112:0/3408398129 wait complete. 2023-11-08T12:28:51.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:51.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.772+0000 7feb5af3e700 1 Processor -- start 2023-11-08T12:28:51.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.772+0000 7feb5af3e700 1 -- start start 2023-11-08T12:28:51.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5af3e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb54070620 0x7feb540b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5af3e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54069bf0 0x7feb5406a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5af3e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5415c520 con 0x7feb5415c150 2023-11-08T12:28:51.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5af3e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb540b4240 con 0x7feb54070620 2023-11-08T12:28:51.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5af3e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5406cc50 con 0x7feb54069bf0 2023-11-08T12:28:51.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5973b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb54070620 0x7feb540b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb59f3c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feb5415c150 0x7feb5406ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:60686/0 (socket says 172.21.15.112:60686) 2023-11-08T12:28:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb59f3c700 1 -- 172.21.15.112:0/3843893619 learned_addr learned my addr 172.21.15.112:0/3843893619 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5a73d700 1 --2- 172.21.15.112:0/3843893619 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54069bf0 0x7feb5406a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb58f3a700 1 -- 172.21.15.112:0/3843893619 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775259912 0 0) 0x7feb5415c520 con 0x7feb5415c150 2023-11-08T12:28:51.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb58f3a700 1 -- 172.21.15.112:0/3843893619 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb400035d0 con 0x7feb5415c150 2023-11-08T12:28:51.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5973b700 1 -- 172.21.15.112:0/3843893619 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54069bf0 msgr2=0x7feb5406a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:51.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5973b700 1 --2- 172.21.15.112:0/3843893619 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54069bf0 0x7feb5406a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5973b700 1 -- 172.21.15.112:0/3843893619 >> v1:172.21.15.133:6789/0 conn(0x7feb5415c150 legacy=0x7feb5406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.776+0000 7feb5973b700 1 -- 172.21.15.112:0/3843893619 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb540d2450 con 0x7feb54070620 2023-11-08T12:28:51.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5973b700 1 --2- 172.21.15.112:0/3843893619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54070620 0x7feb540b3d00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feb44009840 tx=0x7feb44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93a1fc1e910d2fa server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:51.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb58f3a700 1 -- 172.21.15.112:0/3843893619 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44011830 con 0x7feb54070620 2023-11-08T12:28:51.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb58f3a700 1 -- 172.21.15.112:0/3843893619 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb44011990 con 0x7feb54070620 2023-11-08T12:28:51.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb58f3a700 1 -- 172.21.15.112:0/3843893619 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44011d20 con 0x7feb54070620 2023-11-08T12:28:51.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 -- 172.21.15.112:0/3843893619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54070620 msgr2=0x7feb540b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 --2- 172.21.15.112:0/3843893619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54070620 0x7feb540b3d00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feb44009840 tx=0x7feb44009b50 comp rx=0 tx=0).stop 2023-11-08T12:28:51.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 -- 172.21.15.112:0/3843893619 shutdown_connections 2023-11-08T12:28:51.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 --2- 172.21.15.112:0/3843893619 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54069bf0 0x7feb5406a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 --2- 172.21.15.112:0/3843893619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54070620 0x7feb540b3d00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 -- 172.21.15.112:0/3843893619 >> 172.21.15.112:0/3843893619 conn(0x7feb540d3680 msgr2=0x7feb540cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:51.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 -- 172.21.15.112:0/3843893619 shutdown_connections 2023-11-08T12:28:51.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.780+0000 7feb5af3e700 1 -- 172.21.15.112:0/3843893619 wait complete. 2023-11-08T12:28:51.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 Processor -- start 2023-11-08T12:28:51.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 -- start start 2023-11-08T12:28:51.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54069bf0 0x7feb540cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54070620 0x7feb541443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb5415c150 0x7feb540b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5414afe0 con 0x7feb54069bf0 2023-11-08T12:28:51.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb54157fe0 con 0x7feb5415c150 2023-11-08T12:28:51.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5af3e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb541582c0 con 0x7feb54070620 2023-11-08T12:28:51.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54069bf0 0x7feb540cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54069bf0 0x7feb540cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40560/0 (socket says 172.21.15.112:40560) 2023-11-08T12:28:51.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 -- 172.21.15.112:0/335584602 learned_addr learned my addr 172.21.15.112:0/335584602 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:51.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5a73d700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb5415c150 0x7feb540b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5973b700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54070620 0x7feb541443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 -- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54070620 msgr2=0x7feb541443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54070620 0x7feb541443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 -- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb5415c150 msgr2=0x7feb540b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb5415c150 0x7feb540b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb59f3c700 1 -- 172.21.15.112:0/335584602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb44009450 con 0x7feb54069bf0 2023-11-08T12:28:51.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5973b700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54070620 0x7feb541443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:51.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.784+0000 7feb5a73d700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb5415c150 0x7feb540b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:51.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.788+0000 7feb59f3c700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54069bf0 0x7feb540cf8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c4d0 tx=0x7feb5000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:51.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.788+0000 7feb4a7fc700 1 -- 172.21.15.112:0/335584602 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50005d90 con 0x7feb54069bf0 2023-11-08T12:28:51.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.788+0000 7feb4a7fc700 1 -- 172.21.15.112:0/335584602 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb500070d0 con 0x7feb54069bf0 2023-11-08T12:28:51.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.788+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb540d05e0 con 0x7feb54069bf0 2023-11-08T12:28:51.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.788+0000 7feb4a7fc700 1 -- 172.21.15.112:0/335584602 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50007480 con 0x7feb54069bf0 2023-11-08T12:28:51.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.788+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb540d2730 con 0x7feb54069bf0 2023-11-08T12:28:51.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.788+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb540d2140 con 0x7feb54069bf0 2023-11-08T12:28:51.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.792+0000 7feb4a7fc700 1 -- 172.21.15.112:0/335584602 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb50019030 con 0x7feb54069bf0 2023-11-08T12:28:51.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.792+0000 7feb4a7fc700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb38064ee0 0x7feb38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:51.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.792+0000 7feb4a7fc700 1 -- 172.21.15.112:0/335584602 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb500816a0 con 0x7feb54069bf0 2023-11-08T12:28:51.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.792+0000 7feb5973b700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb38064ee0 0x7feb38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:51.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.796+0000 7feb5973b700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb38064ee0 0x7feb38067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb54070a10 tx=0x7feb44008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:51.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.800+0000 7feb4a7fc700 1 -- 172.21.15.112:0/335584602 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb5004f420 con 0x7feb54069bf0 2023-11-08T12:28:51.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.972+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb54073d20 con 0x7feb54069bf0 2023-11-08T12:28:51.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.972+0000 7feb4a7fc700 1 -- 172.21.15.112:0/335584602 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb50052a40 con 0x7feb54069bf0 2023-11-08T12:28:51.975 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:51.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb38064ee0 msgr2=0x7feb38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb38064ee0 0x7feb38067390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb54070a10 tx=0x7feb44008030 comp rx=0 tx=0).stop 2023-11-08T12:28:51.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54069bf0 msgr2=0x7feb540cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:51.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54069bf0 0x7feb540cf8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c4d0 tx=0x7feb5000c890 comp rx=0 tx=0).stop 2023-11-08T12:28:51.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 shutdown_connections 2023-11-08T12:28:51.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb38064ee0 0x7feb38067390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb5415c150 0x7feb540b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb54070620 0x7feb541443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 --2- 172.21.15.112:0/335584602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb54069bf0 0x7feb540cf8f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:51.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 >> 172.21.15.112:0/335584602 conn(0x7feb540d3680 msgr2=0x7feb54157270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:51.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 shutdown_connections 2023-11-08T12:28:51.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:51.976+0000 7feb5af3e700 1 -- 172.21.15.112:0/335584602 wait complete. 2023-11-08T12:28:52.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:52.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.192+0000 7ff1e5ba8700 1 Processor -- start 2023-11-08T12:28:52.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.192+0000 7ff1e5ba8700 1 -- start start 2023-11-08T12:28:52.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e5ba8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff1e015e190 0x7ff1e00cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e5ba8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e5ba8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e015e560 con 0x7ff1e006ff10 2023-11-08T12:28:52.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e5ba8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e006be80 con 0x7ff1e015e190 2023-11-08T12:28:52.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e5ba8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00ce330 con 0x7ff1e0161560 2023-11-08T12:28:52.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e4ba6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff1e015e190 0x7ff1e00cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e0069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:55464/0 (socket says 172.21.15.112:55464) 2023-11-08T12:28:52.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 -- 172.21.15.112:0/1282228074 learned_addr learned my addr 172.21.15.112:0/1282228074 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:52.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 -- 172.21.15.112:0/1282228074 >> v2:172.21.15.112:3300/0 conn(0x7ff1e015e190 msgr2=0x7ff1e00cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:52.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 --2- 172.21.15.112:0/1282228074 >> v2:172.21.15.112:3300/0 conn(0x7ff1e015e190 0x7ff1e00cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 -- 172.21.15.112:0/1282228074 >> v1:172.21.15.133:6789/0 conn(0x7ff1e006ff10 legacy=0x7ff1e006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 -- 172.21.15.112:0/1282228074 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00af990 con 0x7ff1e0161560 2023-11-08T12:28:52.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1dffff700 1 --2- 172.21.15.112:0/1282228074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e0069bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009910 tx=0x7ff1cc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fcba1dd04b19535 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:52.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1df7fe700 1 -- 172.21.15.112:0/1282228074 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc011830 con 0x7ff1e0161560 2023-11-08T12:28:52.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1df7fe700 1 -- 172.21.15.112:0/1282228074 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc011990 con 0x7ff1e0161560 2023-11-08T12:28:52.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1df7fe700 1 -- 172.21.15.112:0/1282228074 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc011d40 con 0x7ff1e0161560 2023-11-08T12:28:52.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1282228074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 msgr2=0x7ff1e0069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.196+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1282228074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e0069bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009910 tx=0x7ff1cc009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:52.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.200+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1282228074 shutdown_connections 2023-11-08T12:28:52.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.200+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1282228074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e0069bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.200+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1282228074 >> v2:172.21.15.112:3300/0 conn(0x7ff1e015e190 0x7ff1e00cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.200+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1282228074 >> 172.21.15.112:0/1282228074 conn(0x7ff1e00cf280 msgr2=0x7ff1e00cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:52.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.200+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1282228074 shutdown_connections 2023-11-08T12:28:52.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.200+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1282228074 wait complete. 2023-11-08T12:28:52.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.200+0000 7ff1e5ba8700 1 Processor -- start 2023-11-08T12:28:52.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e5ba8700 1 -- start start 2023-11-08T12:28:52.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e5ba8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006ff10 0x7ff1e00ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e5ba8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e015e190 0x7ff1e01f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e5ba8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e00c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e5ba8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e01619b0 con 0x7ff1e015e190 2023-11-08T12:28:52.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e5ba8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0162530 con 0x7ff1e006ff10 2023-11-08T12:28:52.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e5ba8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e01f5bd0 con 0x7ff1e0161560 2023-11-08T12:28:52.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1dffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e015e190 0x7ff1e01f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e4ba6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006ff10 0x7ff1e00ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1e53a7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e00c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1dffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e015e190 0x7ff1e01f5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40582/0 (socket says 172.21.15.112:40582) 2023-11-08T12:28:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1dffff700 1 -- 172.21.15.112:0/1011628573 learned_addr learned my addr 172.21.15.112:0/1011628573 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.204+0000 7ff1dffff700 1 -- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 msgr2=0x7ff1e00c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dffff700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e00c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dffff700 1 -- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006ff10 msgr2=0x7ff1e00ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dffff700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006ff10 0x7ff1e00ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dffff700 1 -- 172.21.15.112:0/1011628573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc009570 con 0x7ff1e015e190 2023-11-08T12:28:52.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1e53a7700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e00c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:52.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1e4ba6700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006ff10 0x7ff1e00ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:52.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dffff700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e015e190 0x7ff1e01f5690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009f70 tx=0x7ff1cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:52.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dd7fa700 1 -- 172.21.15.112:0/1011628573 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc004510 con 0x7ff1e015e190 2023-11-08T12:28:52.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dd7fa700 1 -- 172.21.15.112:0/1011628573 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc01e070 con 0x7ff1e015e190 2023-11-08T12:28:52.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1dd7fa700 1 -- 172.21.15.112:0/1011628573 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc003900 con 0x7ff1e015e190 2023-11-08T12:28:52.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e00aff50 con 0x7ff1e015e190 2023-11-08T12:28:52.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e00afc70 con 0x7ff1e015e190 2023-11-08T12:28:52.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.208+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e006a130 con 0x7ff1e015e190 2023-11-08T12:28:52.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.212+0000 7ff1dd7fa700 1 -- 172.21.15.112:0/1011628573 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff1cc00f050 con 0x7ff1e015e190 2023-11-08T12:28:52.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.212+0000 7ff1dd7fa700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff1c4064f10 0x7ff1c40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.212+0000 7ff1dd7fa700 1 -- 172.21.15.112:0/1011628573 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff1cc082cb0 con 0x7ff1e015e190 2023-11-08T12:28:52.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.212+0000 7ff1e4ba6700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff1c4064f10 0x7ff1c40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.212+0000 7ff1e4ba6700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff1c4064f10 0x7ff1c40673c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40112c0 tx=0x7ff1d4009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:52.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.220+0000 7ff1dd7fa700 1 -- 172.21.15.112:0/1011628573 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff1cc050b20 con 0x7ff1e015e190 2023-11-08T12:28:52.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.400+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1e01626a0 con 0x7ff1e015e190 2023-11-08T12:28:52.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.400+0000 7ff1dd7fa700 1 -- 172.21.15.112:0/1011628573 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1cc020020 con 0x7ff1e015e190 2023-11-08T12:28:52.406 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:52.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff1c4064f10 msgr2=0x7ff1c40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff1c4064f10 0x7ff1c40673c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40112c0 tx=0x7ff1d4009240 comp rx=0 tx=0).stop 2023-11-08T12:28:52.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e015e190 msgr2=0x7ff1e01f5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e015e190 0x7ff1e01f5690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009f70 tx=0x7ff1cc004770 comp rx=0 tx=0).stop 2023-11-08T12:28:52.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 shutdown_connections 2023-11-08T12:28:52.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff1c4064f10 0x7ff1c40673c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1e0161560 0x7ff1e00c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e015e190 0x7ff1e01f5690 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 --2- 172.21.15.112:0/1011628573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e006ff10 0x7ff1e00ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 >> 172.21.15.112:0/1011628573 conn(0x7ff1e00cf280 msgr2=0x7ff1e006c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:52.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 shutdown_connections 2023-11-08T12:28:52.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.408+0000 7ff1e5ba8700 1 -- 172.21.15.112:0/1011628573 wait complete. 2023-11-08T12:28:52.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:52.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.612+0000 7eff4e57f700 1 Processor -- start 2023-11-08T12:28:52.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.612+0000 7eff4e57f700 1 -- start start 2023-11-08T12:28:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4e57f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff480701b0 0x7eff480ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4e57f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4806f110 con 0x7eff480cd4d0 2023-11-08T12:28:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4e57f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4806f3f0 con 0x7eff4815a6d0 2023-11-08T12:28:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4e57f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4806fd90 con 0x7eff480701b0 2023-11-08T12:28:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff47fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7eff480cd4d0 0x7eff480cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48634/0 (socket says 172.21.15.112:48634) 2023-11-08T12:28:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff47fff700 1 -- 172.21.15.112:0/2882670223 learned_addr learned my addr 172.21.15.112:0/2882670223 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4cb1c700 1 --2- 172.21.15.112:0/2882670223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff480701b0 0x7eff480ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff46ffd700 1 -- 172.21.15.112:0/2882670223 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667574497 0 0) 0x7eff4806f110 con 0x7eff480cd4d0 2023-11-08T12:28:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff46ffd700 1 -- 172.21.15.112:0/2882670223 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff300035d0 con 0x7eff480cd4d0 2023-11-08T12:28:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff46ffd700 1 -- 172.21.15.112:0/2882670223 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921152230 0 0) 0x7eff4806f3f0 con 0x7eff4815a6d0 2023-11-08T12:28:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff46ffd700 1 -- 172.21.15.112:0/2882670223 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4806f110 con 0x7eff4815a6d0 2023-11-08T12:28:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4cb1c700 1 -- 172.21.15.112:0/2882670223 >> v1:172.21.15.133:6789/0 conn(0x7eff4815a6d0 legacy=0x7eff480ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4cb1c700 1 -- 172.21.15.112:0/2882670223 >> v1:172.21.15.112:6789/0 conn(0x7eff480cd4d0 legacy=0x7eff480cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4cb1c700 1 -- 172.21.15.112:0/2882670223 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4806f6d0 con 0x7eff480701b0 2023-11-08T12:28:52.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff4cb1c700 1 --2- 172.21.15.112:0/2882670223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff480701b0 0x7eff480ced10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff40009dc0 tx=0x7eff4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df21c6fc489a2fdb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:52.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff46ffd700 1 -- 172.21.15.112:0/2882670223 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000e070 con 0x7eff480701b0 2023-11-08T12:28:52.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff46ffd700 1 -- 172.21.15.112:0/2882670223 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4000bb20 con 0x7eff480701b0 2023-11-08T12:28:52.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.616+0000 7eff46ffd700 1 -- 172.21.15.112:0/2882670223 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000be90 con 0x7eff480701b0 2023-11-08T12:28:52.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.620+0000 7eff4e57f700 1 -- 172.21.15.112:0/2882670223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff480701b0 msgr2=0x7eff480ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.620+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2882670223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff480701b0 0x7eff480ced10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff40009dc0 tx=0x7eff4000b330 comp rx=0 tx=0).stop 2023-11-08T12:28:52.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.620+0000 7eff4e57f700 1 -- 172.21.15.112:0/2882670223 shutdown_connections 2023-11-08T12:28:52.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.620+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2882670223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff480701b0 0x7eff480ced10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.620+0000 7eff4e57f700 1 -- 172.21.15.112:0/2882670223 >> 172.21.15.112:0/2882670223 conn(0x7eff4808a050 msgr2=0x7eff4808a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:52.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.620+0000 7eff4e57f700 1 -- 172.21.15.112:0/2882670223 shutdown_connections 2023-11-08T12:28:52.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.620+0000 7eff4e57f700 1 -- 172.21.15.112:0/2882670223 wait complete. 2023-11-08T12:28:52.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 Processor -- start 2023-11-08T12:28:52.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 -- start start 2023-11-08T12:28:52.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff480701b0 0x7eff480d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff480cd4d0 0x7eff4814bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff4815a6d0 0x7eff4814c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48156670 con 0x7eff480701b0 2023-11-08T12:28:52.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4814c540 con 0x7eff480cd4d0 2023-11-08T12:28:52.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4e57f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480b14b0 con 0x7eff4815a6d0 2023-11-08T12:28:52.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff47fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff480701b0 0x7eff480d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff47fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff480701b0 0x7eff480d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40594/0 (socket says 172.21.15.112:40594) 2023-11-08T12:28:52.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff47fff700 1 -- 172.21.15.112:0/2358605669 learned_addr learned my addr 172.21.15.112:0/2358605669 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:52.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff4cb1c700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff4815a6d0 0x7eff4814c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.624+0000 7eff477fe700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff480cd4d0 0x7eff4814bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff47fff700 1 -- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff4815a6d0 msgr2=0x7eff4814c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff47fff700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff4815a6d0 0x7eff4814c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff47fff700 1 -- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff480cd4d0 msgr2=0x7eff4814bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff47fff700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff480cd4d0 0x7eff4814bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff47fff700 1 -- 172.21.15.112:0/2358605669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40009a70 con 0x7eff480701b0 2023-11-08T12:28:52.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff477fe700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff480cd4d0 0x7eff4814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:52.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff47fff700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff480701b0 0x7eff480d0a90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c4d0 tx=0x7eff3800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:52.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff44ff9700 1 -- 172.21.15.112:0/2358605669 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800cea0 con 0x7eff480701b0 2023-11-08T12:28:52.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff44ff9700 1 -- 172.21.15.112:0/2358605669 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380074e0 con 0x7eff480701b0 2023-11-08T12:28:52.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff48165040 con 0x7eff480701b0 2023-11-08T12:28:52.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff44ff9700 1 -- 172.21.15.112:0/2358605669 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38005850 con 0x7eff480701b0 2023-11-08T12:28:52.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4806f9b0 con 0x7eff480701b0 2023-11-08T12:28:52.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.628+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff481651d0 con 0x7eff480701b0 2023-11-08T12:28:52.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.632+0000 7eff44ff9700 1 -- 172.21.15.112:0/2358605669 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7eff38019030 con 0x7eff480701b0 2023-11-08T12:28:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.632+0000 7eff44ff9700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7eff34064ee0 0x7eff34067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:52.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.632+0000 7eff44ff9700 1 -- 172.21.15.112:0/2358605669 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7eff380814d0 con 0x7eff480701b0 2023-11-08T12:28:52.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.632+0000 7eff477fe700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7eff34064ee0 0x7eff34067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:52.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.636+0000 7eff477fe700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7eff34064ee0 0x7eff34067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff48157080 tx=0x7eff3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:52.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.636+0000 7eff44ff9700 1 -- 172.21.15.112:0/2358605669 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7eff3804f2c0 con 0x7eff480701b0 2023-11-08T12:28:52.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.808+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff480726c0 con 0x7eff480701b0 2023-11-08T12:28:52.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.812+0000 7eff44ff9700 1 -- 172.21.15.112:0/2358605669 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff38017020 con 0x7eff480701b0 2023-11-08T12:28:52.814 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7eff34064ee0 msgr2=0x7eff34067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7eff34064ee0 0x7eff34067390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff48157080 tx=0x7eff3c009040 comp rx=0 tx=0).stop 2023-11-08T12:28:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff480701b0 msgr2=0x7eff480d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff480701b0 0x7eff480d0a90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c4d0 tx=0x7eff3800c7e0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 shutdown_connections 2023-11-08T12:28:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7eff34064ee0 0x7eff34067390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff4815a6d0 0x7eff4814c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff480cd4d0 0x7eff4814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 --2- 172.21.15.112:0/2358605669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff480701b0 0x7eff480d0a90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 >> 172.21.15.112:0/2358605669 conn(0x7eff4808a050 msgr2=0x7eff480aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 shutdown_connections 2023-11-08T12:28:52.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:52.816+0000 7eff4e57f700 1 -- 172.21.15.112:0/2358605669 wait complete. 2023-11-08T12:28:52.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:53.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc3795e700 1 Processor -- start 2023-11-08T12:28:53.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc3795e700 1 -- start start 2023-11-08T12:28:53.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc3795e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc300b4280 0x7fbc300aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc3795e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc300adb20 0x7fbc300af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc3795e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3006c040 con 0x7fbc3006ae10 2023-11-08T12:28:53.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc3795e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3015a920 con 0x7fbc300adb20 2023-11-08T12:28:53.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc3795e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015eac0 con 0x7fbc300b4280 2023-11-08T12:28:53.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc35efb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbc3006ae10 0x7fbc30069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48648/0 (socket says 172.21.15.112:48648) 2023-11-08T12:28:53.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc35efb700 1 -- 172.21.15.112:0/3917872583 learned_addr learned my addr 172.21.15.112:0/3917872583 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:53.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc356fa700 1 --2- 172.21.15.112:0/3917872583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc300b4280 0x7fbc300aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.024+0000 7fbc34ef9700 1 --2- 172.21.15.112:0/3917872583 >> v2:172.21.15.133:3300/0 conn(0x7fbc300adb20 0x7fbc300af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc356fa700 1 -- 172.21.15.112:0/3917872583 >> v2:172.21.15.133:3300/0 conn(0x7fbc300adb20 msgr2=0x7fbc300af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:53.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc356fa700 1 --2- 172.21.15.112:0/3917872583 >> v2:172.21.15.133:3300/0 conn(0x7fbc300adb20 0x7fbc300af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc356fa700 1 -- 172.21.15.112:0/3917872583 >> v1:172.21.15.112:6789/0 conn(0x7fbc3006ae10 legacy=0x7fbc30069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc27fff700 1 -- 172.21.15.112:0/3917872583 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905994668 0 0) 0x7fbc3006c040 con 0x7fbc3006ae10 2023-11-08T12:28:53.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc356fa700 1 -- 172.21.15.112:0/3917872583 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3006d4e0 con 0x7fbc300b4280 2023-11-08T12:28:53.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc356fa700 1 --2- 172.21.15.112:0/3917872583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc300b4280 0x7fbc300aef40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009d90 tx=0x7fbc2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ff8d30f11ee536e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:53.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc27fff700 1 -- 172.21.15.112:0/3917872583 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00e070 con 0x7fbc300b4280 2023-11-08T12:28:53.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc27fff700 1 -- 172.21.15.112:0/3917872583 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c00bb20 con 0x7fbc300b4280 2023-11-08T12:28:53.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc27fff700 1 -- 172.21.15.112:0/3917872583 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c012430 con 0x7fbc300b4280 2023-11-08T12:28:53.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 -- 172.21.15.112:0/3917872583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc300b4280 msgr2=0x7fbc300aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 --2- 172.21.15.112:0/3917872583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc300b4280 0x7fbc300aef40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009d90 tx=0x7fbc2c00b330 comp rx=0 tx=0).stop 2023-11-08T12:28:53.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 -- 172.21.15.112:0/3917872583 shutdown_connections 2023-11-08T12:28:53.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 --2- 172.21.15.112:0/3917872583 >> v2:172.21.15.133:3300/0 conn(0x7fbc300adb20 0x7fbc300af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 --2- 172.21.15.112:0/3917872583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc300b4280 0x7fbc300aef40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 -- 172.21.15.112:0/3917872583 >> 172.21.15.112:0/3917872583 conn(0x7fbc300cf580 msgr2=0x7fbc300cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:53.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 -- 172.21.15.112:0/3917872583 shutdown_connections 2023-11-08T12:28:53.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.028+0000 7fbc3795e700 1 -- 172.21.15.112:0/3917872583 wait complete. 2023-11-08T12:28:53.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 Processor -- start 2023-11-08T12:28:53.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 -- start start 2023-11-08T12:28:53.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc3006ae10 0x7fbc301583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc300adb20 0x7fbc300c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc300b4280 0x7fbc300c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300ad230 con 0x7fbc300adb20 2023-11-08T12:28:53.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015bbd0 con 0x7fbc300b4280 2023-11-08T12:28:53.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc3795e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300ac6b0 con 0x7fbc3006ae10 2023-11-08T12:28:53.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.032+0000 7fbc34ef9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc300adb20 0x7fbc300c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc300adb20 0x7fbc300c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40608/0 (socket says 172.21.15.112:40608) 2023-11-08T12:28:53.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 -- 172.21.15.112:0/279143019 learned_addr learned my addr 172.21.15.112:0/279143019 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:53.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc356fa700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc3006ae10 0x7fbc301583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc35efb700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc300b4280 0x7fbc300c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 -- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc3006ae10 msgr2=0x7fbc301583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc3006ae10 0x7fbc301583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 -- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc300b4280 msgr2=0x7fbc300c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc300b4280 0x7fbc300c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 -- 172.21.15.112:0/279143019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009a70 con 0x7fbc300adb20 2023-11-08T12:28:53.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc34ef9700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc300adb20 0x7fbc300c7370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000e9a0 tx=0x7fbc2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:53.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc25ffb700 1 -- 172.21.15.112:0/279143019 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20009720 con 0x7fbc300adb20 2023-11-08T12:28:53.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc25ffb700 1 -- 172.21.15.112:0/279143019 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2000c690 con 0x7fbc300adb20 2023-11-08T12:28:53.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc25ffb700 1 -- 172.21.15.112:0/279143019 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000ca40 con 0x7fbc300adb20 2023-11-08T12:28:53.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3015ed60 con 0x7fbc300adb20 2023-11-08T12:28:53.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.036+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc300b4650 con 0x7fbc300adb20 2023-11-08T12:28:53.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.040+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc300b1350 con 0x7fbc300adb20 2023-11-08T12:28:53.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.040+0000 7fbc25ffb700 1 -- 172.21.15.112:0/279143019 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc20019030 con 0x7fbc300adb20 2023-11-08T12:28:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.040+0000 7fbc25ffb700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc14064ee0 0x7fbc14067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.040+0000 7fbc25ffb700 1 -- 172.21.15.112:0/279143019 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc20082120 con 0x7fbc300adb20 2023-11-08T12:28:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.040+0000 7fbc356fa700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc14064ee0 0x7fbc14067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.044+0000 7fbc356fa700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc14064ee0 0x7fbc14067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c014040 tx=0x7fbc2c011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:53.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.048+0000 7fbc25ffb700 1 -- 172.21.15.112:0/279143019 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc2004fea0 con 0x7fbc300adb20 2023-11-08T12:28:53.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.216+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbc300726c0 con 0x7fbc300adb20 2023-11-08T12:28:53.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.220+0000 7fbc25ffb700 1 -- 172.21.15.112:0/279143019 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbc200534c0 con 0x7fbc300adb20 2023-11-08T12:28:53.223 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:53.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.220+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc14064ee0 msgr2=0x7fbc14067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.220+0000 7fbc3795e700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc14064ee0 0x7fbc14067390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c014040 tx=0x7fbc2c011000 comp rx=0 tx=0).stop 2023-11-08T12:28:53.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.220+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc300adb20 msgr2=0x7fbc300c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.220+0000 7fbc3795e700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc300adb20 0x7fbc300c7370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000e9a0 tx=0x7fbc2000ecb0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 shutdown_connections 2023-11-08T12:28:53.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc14064ee0 0x7fbc14067390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc300b4280 0x7fbc300c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc300adb20 0x7fbc300c7370 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 --2- 172.21.15.112:0/279143019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc3006ae10 0x7fbc301583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 >> 172.21.15.112:0/279143019 conn(0x7fbc300cf580 msgr2=0x7fbc30060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:53.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 shutdown_connections 2023-11-08T12:28:53.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.224+0000 7fbc3795e700 1 -- 172.21.15.112:0/279143019 wait complete. 2023-11-08T12:28:53.247 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:28:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.420+0000 7f10dc04a700 1 Processor -- start 2023-11-08T12:28:53.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.420+0000 7f10dc04a700 1 -- start start 2023-11-08T12:28:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10dc04a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10d40c8d10 0x7f10d40cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10dc04a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d415a850 con 0x7f10d415a480 2023-11-08T12:28:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10dc04a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d40cada0 con 0x7f10d4069d60 2023-11-08T12:28:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10dc04a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d40ce060 con 0x7f10d40c8d10 2023-11-08T12:28:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d9de6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f10d415a480 0x7f10d40cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48662/0 (socket says 172.21.15.112:48662) 2023-11-08T12:28:53.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d9de6700 1 -- 172.21.15.112:0/3458906208 learned_addr learned my addr 172.21.15.112:0/3458906208 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:53.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d95e5700 1 --2- 172.21.15.112:0/3458906208 >> v2:172.21.15.133:3300/0 conn(0x7f10d40c8d10 0x7f10d40cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758594987 0 0) 0x7f10d415a850 con 0x7f10d415a480 2023-11-08T12:28:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c00035d0 con 0x7f10d415a480 2023-11-08T12:28:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314225795 0 0) 0x7f10c00035d0 con 0x7f10d415a480 2023-11-08T12:28:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 >> v2:172.21.15.133:3300/0 conn(0x7f10d40c8d10 msgr2=0x7f10d40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:53.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 --2- 172.21.15.112:0/3458906208 >> v2:172.21.15.133:3300/0 conn(0x7f10d40c8d10 0x7f10d40cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 >> v1:172.21.15.133:6789/0 conn(0x7f10d4069d60 legacy=0x7f10d406a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40ce300 con 0x7f10d415a480 2023-11-08T12:28:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f10d0001670 con 0x7f10d415a480 2023-11-08T12:28:53.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 >> v1:172.21.15.112:6789/0 conn(0x7f10d415a480 legacy=0x7f10d40cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0003a20 0x7f10c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0004870 0x7f10c0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c0005220 0x7f10c000fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40ce060 con 0x7f10c0004870 2023-11-08T12:28:53.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00104b0 con 0x7f10c0005220 2023-11-08T12:28:53.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c0010670 con 0x7f10c0003a20 2023-11-08T12:28:53.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d95e5700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0004870 0x7f10c0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d9de6700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0003a20 0x7f10c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d95e5700 1 -- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0003a20 msgr2=0x7f10c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:53.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d95e5700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0003a20 0x7f10c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10da5e7700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c0005220 0x7f10c000fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d95e5700 1 -- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c0005220 msgr2=0x7f10c000fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:53.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d95e5700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c0005220 0x7f10c000fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d95e5700 1 -- 172.21.15.112:0/3458906208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00035d0 con 0x7f10c0004870 2023-11-08T12:28:53.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10d9de6700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0003a20 0x7f10c0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:53.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10da5e7700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c0005220 0x7f10c000fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:53.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.424+0000 7f10da5e7700 1 -- 172.21.15.112:0/3458906208 reap_dead start 2023-11-08T12:28:53.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10d95e5700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0004870 0x7f10c0004ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009b70 tx=0x7f10c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaf3d57ad0f3545 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:53.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400e6c0 con 0x7f10c0004870 2023-11-08T12:28:53.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400e820 con 0x7f10c0004870 2023-11-08T12:28:53.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10d8de4700 1 -- 172.21.15.112:0/3458906208 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400eb90 con 0x7f10c0004870 2023-11-08T12:28:53.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10dc04a700 1 -- 172.21.15.112:0/3458906208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0004870 msgr2=0x7f10c0004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10dc04a700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0004870 0x7f10c0004ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009b70 tx=0x7f10c00058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10dc04a700 1 -- 172.21.15.112:0/3458906208 shutdown_connections 2023-11-08T12:28:53.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10dc04a700 1 --2- 172.21.15.112:0/3458906208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c0004870 0x7f10c0004ce0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10dc04a700 1 -- 172.21.15.112:0/3458906208 >> 172.21.15.112:0/3458906208 conn(0x7f10d40cf350 msgr2=0x7f10d40b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:53.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10dc04a700 1 -- 172.21.15.112:0/3458906208 shutdown_connections 2023-11-08T12:28:53.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.428+0000 7f10dc04a700 1 -- 172.21.15.112:0/3458906208 wait complete. 2023-11-08T12:28:53.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 Processor -- start 2023-11-08T12:28:53.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 -- start start 2023-11-08T12:28:53.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0004870 0x7f10d4155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d40c5eb0 0x7f10d40c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d40c6c70 0x7f10d40c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40c7b00 con 0x7f10d40c6c70 2023-11-08T12:28:53.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4154360 con 0x7f10d40c5eb0 2023-11-08T12:28:53.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10dc04a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4154c00 con 0x7f10c0004870 2023-11-08T12:28:53.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10da5e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d40c6c70 0x7f10d40c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10da5e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d40c6c70 0x7f10d40c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40614/0 (socket says 172.21.15.112:40614) 2023-11-08T12:28:53.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.432+0000 7f10da5e7700 1 -- 172.21.15.112:0/343095105 learned_addr learned my addr 172.21.15.112:0/343095105 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:53.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10d9de6700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0004870 0x7f10d4155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10d95e5700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d40c5eb0 0x7f10d40c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10da5e7700 1 -- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0004870 msgr2=0x7f10d4155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10da5e7700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0004870 0x7f10d4155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10da5e7700 1 -- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d40c5eb0 msgr2=0x7f10d40c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10da5e7700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d40c5eb0 0x7f10d40c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10da5e7700 1 -- 172.21.15.112:0/343095105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40add50 con 0x7f10d40c6c70 2023-11-08T12:28:53.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10da5e7700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d40c6c70 0x7f10d40c70f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f10d40700c0 tx=0x7f10cc00de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:53.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10ca7fc700 1 -- 172.21.15.112:0/343095105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc003e30 con 0x7f10d40c6c70 2023-11-08T12:28:53.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d40caa30 con 0x7f10d40c6c70 2023-11-08T12:28:53.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10ca7fc700 1 -- 172.21.15.112:0/343095105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc005070 con 0x7f10d40c6c70 2023-11-08T12:28:53.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10ca7fc700 1 -- 172.21.15.112:0/343095105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc005420 con 0x7f10d40c6c70 2023-11-08T12:28:53.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d40ca6e0 con 0x7f10d40c6c70 2023-11-08T12:28:53.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.436+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d4154d90 con 0x7f10d40c6c70 2023-11-08T12:28:53.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.440+0000 7f10ca7fc700 1 -- 172.21.15.112:0/343095105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f10cc01a030 con 0x7f10d40c6c70 2023-11-08T12:28:53.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.440+0000 7f10ca7fc700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f10b8064f10 0x7f10b80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:53.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.440+0000 7f10ca7fc700 1 -- 172.21.15.112:0/343095105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f10cc081ca0 con 0x7f10d40c6c70 2023-11-08T12:28:53.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.440+0000 7f10d9de6700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f10b8064f10 0x7f10b80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:53.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.440+0000 7f10d9de6700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f10b8064f10 0x7f10b80673c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10d0001200 tx=0x7f10d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:53.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.444+0000 7f10ca7fc700 1 -- 172.21.15.112:0/343095105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f10cc04f9a0 con 0x7f10d40c6c70 2023-11-08T12:28:53.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.632+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10d40726c0 con 0x7f10d40c6c70 2023-11-08T12:28:53.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.632+0000 7f10ca7fc700 1 -- 172.21.15.112:0/343095105 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f10cc018020 con 0x7f10d40c6c70 2023-11-08T12:28:53.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f10b8064f10 msgr2=0x7f10b80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f10b8064f10 0x7f10b80673c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10d0001200 tx=0x7f10d0009040 comp rx=0 tx=0).stop 2023-11-08T12:28:53.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d40c6c70 msgr2=0x7f10d40c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:53.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d40c6c70 0x7f10d40c70f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f10d40700c0 tx=0x7f10cc00de70 comp rx=0 tx=0).stop 2023-11-08T12:28:53.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 shutdown_connections 2023-11-08T12:28:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f10b8064f10 0x7f10b80673c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10d40c6c70 0x7f10d40c70f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d40c5eb0 0x7f10d40c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 --2- 172.21.15.112:0/343095105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10c0004870 0x7f10d4155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 >> 172.21.15.112:0/343095105 conn(0x7f10d40cf350 msgr2=0x7f10d40ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:53.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 shutdown_connections 2023-11-08T12:28:53.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:53.636+0000 7f10dc04a700 1 -- 172.21.15.112:0/343095105 wait complete. 2023-11-08T12:28:53.641 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:28:53.663 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T12:28:53.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:53.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-08T12:28:53.714 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:28:53.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:53.715 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T12:28:53.779 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:28:53.779 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:53.797 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:28:53.798 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:53.858 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:28:53.858 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:53.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:54.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.096+0000 7f4d34db4700 1 Processor -- start 2023-11-08T12:28:54.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.096+0000 7f4d34db4700 1 -- start start 2023-11-08T12:28:54.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.096+0000 7f4d34db4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300b1640 0x7f4d30070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.096+0000 7f4d34db4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3015a550 con 0x7f4d300b43a0 2023-11-08T12:28:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.096+0000 7f4d34db4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3006b0a0 con 0x7f4d300c9040 2023-11-08T12:28:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.096+0000 7f4d34db4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300caac0 con 0x7f4d300b1640 2023-11-08T12:28:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2f7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4d300b43a0 0x7f4d3015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48674/0 (socket says 172.21.15.112:48674) 2023-11-08T12:28:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2f7fe700 1 -- 172.21.15.112:0/2498976866 learned_addr learned my addr 172.21.15.112:0/2498976866 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d26ffd700 1 --2- 172.21.15.112:0/2498976866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300b1640 0x7f4d30070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2effd700 1 -- 172.21.15.112:0/2498976866 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483947649 0 0) 0x7f4d20001110 con 0x7f4d300b43a0 2023-11-08T12:28:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2effd700 1 -- 172.21.15.112:0/2498976866 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d1c0035d0 con 0x7f4d300b43a0 2023-11-08T12:28:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2effd700 1 -- 172.21.15.112:0/2498976866 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031102767 0 0) 0x7f4d3006b0a0 con 0x7f4d300c9040 2023-11-08T12:28:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2effd700 1 -- 172.21.15.112:0/2498976866 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d20001110 con 0x7f4d300c9040 2023-11-08T12:28:54.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d26ffd700 1 -- 172.21.15.112:0/2498976866 >> v1:172.21.15.133:6789/0 conn(0x7f4d300c9040 legacy=0x7f4d3006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d26ffd700 1 -- 172.21.15.112:0/2498976866 >> v1:172.21.15.112:6789/0 conn(0x7f4d300b43a0 legacy=0x7f4d3015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d26ffd700 1 -- 172.21.15.112:0/2498976866 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300cada0 con 0x7f4d300b1640 2023-11-08T12:28:54.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d26ffd700 1 --2- 172.21.15.112:0/2498976866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300b1640 0x7f4d30070080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009880 tx=0x7f4d18009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ec0e6c819ddbdd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2effd700 1 -- 172.21.15.112:0/2498976866 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18011830 con 0x7f4d300b1640 2023-11-08T12:28:54.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2effd700 1 -- 172.21.15.112:0/2498976866 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18011990 con 0x7f4d300b1640 2023-11-08T12:28:54.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d2effd700 1 -- 172.21.15.112:0/2498976866 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18011d20 con 0x7f4d300b1640 2023-11-08T12:28:54.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d34db4700 1 -- 172.21.15.112:0/2498976866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300b1640 msgr2=0x7f4d30070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.100+0000 7f4d34db4700 1 --2- 172.21.15.112:0/2498976866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300b1640 0x7f4d30070080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009880 tx=0x7f4d18009b90 comp rx=0 tx=0).stop 2023-11-08T12:28:54.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 -- 172.21.15.112:0/2498976866 shutdown_connections 2023-11-08T12:28:54.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 --2- 172.21.15.112:0/2498976866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300b1640 0x7f4d30070080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 -- 172.21.15.112:0/2498976866 >> 172.21.15.112:0/2498976866 conn(0x7f4d300b0f80 msgr2=0x7f4d300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:54.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 -- 172.21.15.112:0/2498976866 shutdown_connections 2023-11-08T12:28:54.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 -- 172.21.15.112:0/2498976866 wait complete. 2023-11-08T12:28:54.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 Processor -- start 2023-11-08T12:28:54.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 -- start start 2023-11-08T12:28:54.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.104+0000 7f4d34db4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d300b1640 0x7f4d30154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d34db4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d300b43a0 0x7f4d30151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d34db4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300c9040 0x7f4d300c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d34db4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30150bb0 con 0x7f4d300b1640 2023-11-08T12:28:54.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d34db4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30154870 con 0x7f4d300b43a0 2023-11-08T12:28:54.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d34db4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300c5040 con 0x7f4d300c9040 2023-11-08T12:28:54.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d2f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d300b1640 0x7f4d30154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d2f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d300b1640 0x7f4d30154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40622/0 (socket says 172.21.15.112:40622) 2023-11-08T12:28:54.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d2f7fe700 1 -- 172.21.15.112:0/3083380982 learned_addr learned my addr 172.21.15.112:0/3083380982 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:54.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d26ffd700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d300b43a0 0x7f4d30151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d2ffff700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300c9040 0x7f4d300c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d26ffd700 1 -- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300c9040 msgr2=0x7f4d300c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d26ffd700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300c9040 0x7f4d300c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d26ffd700 1 -- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d300b1640 msgr2=0x7f4d30154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d26ffd700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d300b1640 0x7f4d30154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d26ffd700 1 -- 172.21.15.112:0/3083380982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d180094b0 con 0x7f4d300b43a0 2023-11-08T12:28:54.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d26ffd700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d300b43a0 0x7f4d30151040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d18015000 tx=0x7f4d18004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d2cff9700 1 -- 172.21.15.112:0/3083380982 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1801a8c0 con 0x7f4d300b43a0 2023-11-08T12:28:54.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d2cff9700 1 -- 172.21.15.112:0/3083380982 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1801e070 con 0x7f4d300b43a0 2023-11-08T12:28:54.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d2cff9700 1 -- 172.21.15.112:0/3083380982 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1801ac80 con 0x7f4d300b43a0 2023-11-08T12:28:54.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3006b5d0 con 0x7f4d300b43a0 2023-11-08T12:28:54.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.108+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3006b2f0 con 0x7f4d300b43a0 2023-11-08T12:28:54.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.112+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300ca7b0 con 0x7f4d300b43a0 2023-11-08T12:28:54.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.112+0000 7f4d2cff9700 1 -- 172.21.15.112:0/3083380982 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4d1800f050 con 0x7f4d300b43a0 2023-11-08T12:28:54.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.112+0000 7f4d2cff9700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4d10064f10 0x7f4d100673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.112+0000 7f4d2cff9700 1 -- 172.21.15.112:0/3083380982 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4d18082fe0 con 0x7f4d300b43a0 2023-11-08T12:28:54.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.116+0000 7f4d2f7fe700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4d10064f10 0x7f4d100673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.116+0000 7f4d2f7fe700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4d10064f10 0x7f4d100673c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.120+0000 7f4d2cff9700 1 -- 172.21.15.112:0/3083380982 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4d18050d60 con 0x7f4d300b43a0 2023-11-08T12:28:54.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.300+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d300c5560 con 0x7f4d300b43a0 2023-11-08T12:28:54.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d2cff9700 1 -- 172.21.15.112:0/3083380982 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f4d300c5560 con 0x7f4d300b43a0 2023-11-08T12:28:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:54.307 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:54.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4d10064f10 msgr2=0x7f4d100673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4d10064f10 0x7f4d100673c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20007ec0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d300b43a0 msgr2=0x7f4d30151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d300b43a0 0x7f4d30151040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d18015000 tx=0x7f4d18004770 comp rx=0 tx=0).stop 2023-11-08T12:28:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 shutdown_connections 2023-11-08T12:28:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4d10064f10 0x7f4d100673c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d300c9040 0x7f4d300c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d300b43a0 0x7f4d30151040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 --2- 172.21.15.112:0/3083380982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d300b1640 0x7f4d30154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.304+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 >> 172.21.15.112:0/3083380982 conn(0x7f4d300b0f80 msgr2=0x7f4d3006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.308+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 shutdown_connections 2023-11-08T12:28:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.308+0000 7f4d34db4700 1 -- 172.21.15.112:0/3083380982 wait complete. 2023-11-08T12:28:54.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:54.333 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:54.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.508+0000 7f6869984700 1 Processor -- start 2023-11-08T12:28:54.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.508+0000 7f6869984700 1 -- start start 2023-11-08T12:28:54.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.508+0000 7f6869984700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f686415c360 0x7f68640ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.508+0000 7f6869984700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f686406c590 0x7f68640c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6869984700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68640cd110 con 0x7f686406cbc0 2023-11-08T12:28:54.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6869984700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640c9a40 con 0x7f686415c360 2023-11-08T12:28:54.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6869984700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640cc4a0 con 0x7f686406c590 2023-11-08T12:28:54.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6868982700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f686415c360 0x7f68640ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6863fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f686406cbc0 0x7f686406be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48682/0 (socket says 172.21.15.112:48682) 2023-11-08T12:28:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6863fff700 1 -- 172.21.15.112:0/1033630250 learned_addr learned my addr 172.21.15.112:0/1033630250 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6869183700 1 --2- 172.21.15.112:0/1033630250 >> v2:172.21.15.133:3300/0 conn(0x7f686406c590 0x7f68640c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f68637fe700 1 -- 172.21.15.112:0/1033630250 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214161000 0 0) 0x7f68640cd110 con 0x7f686406cbc0 2023-11-08T12:28:54.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f68637fe700 1 -- 172.21.15.112:0/1033630250 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68540057e0 con 0x7f686406cbc0 2023-11-08T12:28:54.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6868982700 1 -- 172.21.15.112:0/1033630250 >> v2:172.21.15.133:3300/0 conn(0x7f686406c590 msgr2=0x7f68640c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:54.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6868982700 1 --2- 172.21.15.112:0/1033630250 >> v2:172.21.15.133:3300/0 conn(0x7f686406c590 0x7f68640c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6868982700 1 -- 172.21.15.112:0/1033630250 >> v1:172.21.15.112:6789/0 conn(0x7f686406cbc0 legacy=0x7f686406be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6868982700 1 -- 172.21.15.112:0/1033630250 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640cd340 con 0x7f686415c360 2023-11-08T12:28:54.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6868982700 1 --2- 172.21.15.112:0/1033630250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686415c360 0x7f68640ccbd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f68640b01e0 tx=0x7f6858009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7953d6110ec9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f68637fe700 1 -- 172.21.15.112:0/1033630250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858011830 con 0x7f686415c360 2023-11-08T12:28:54.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f68637fe700 1 -- 172.21.15.112:0/1033630250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858011990 con 0x7f686415c360 2023-11-08T12:28:54.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f68637fe700 1 -- 172.21.15.112:0/1033630250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858011d20 con 0x7f686415c360 2023-11-08T12:28:54.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6869984700 1 -- 172.21.15.112:0/1033630250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686415c360 msgr2=0x7f68640ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.512+0000 7f6869984700 1 --2- 172.21.15.112:0/1033630250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686415c360 0x7f68640ccbd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f68640b01e0 tx=0x7f6858009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:54.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 -- 172.21.15.112:0/1033630250 shutdown_connections 2023-11-08T12:28:54.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 --2- 172.21.15.112:0/1033630250 >> v2:172.21.15.133:3300/0 conn(0x7f686406c590 0x7f68640c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 --2- 172.21.15.112:0/1033630250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686415c360 0x7f68640ccbd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 -- 172.21.15.112:0/1033630250 >> 172.21.15.112:0/1033630250 conn(0x7f68640cf280 msgr2=0x7f68640cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:54.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 -- 172.21.15.112:0/1033630250 shutdown_connections 2023-11-08T12:28:54.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 -- 172.21.15.112:0/1033630250 wait complete. 2023-11-08T12:28:54.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 Processor -- start 2023-11-08T12:28:54.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.516+0000 7f6869984700 1 -- start start 2023-11-08T12:28:54.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f686406c590 0x7f68640af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686406cbc0 0x7f68641493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686415c360 0x7f68640acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640abcc0 con 0x7f686406cbc0 2023-11-08T12:28:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640abfa0 con 0x7f686415c360 2023-11-08T12:28:54.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68640ac280 con 0x7f686406c590 2023-11-08T12:28:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686406cbc0 0x7f68641493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686406cbc0 0x7f68641493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40638/0 (socket says 172.21.15.112:40638) 2023-11-08T12:28:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 -- 172.21.15.112:0/2703496287 learned_addr learned my addr 172.21.15.112:0/2703496287 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6868982700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f686406c590 0x7f68640af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869183700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686415c360 0x7f68640acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 -- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f686406c590 msgr2=0x7f68640af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f686406c590 0x7f68640af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 -- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686415c360 msgr2=0x7f68640acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686415c360 0x7f68640acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 -- 172.21.15.112:0/2703496287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580094b0 con 0x7f686406cbc0 2023-11-08T12:28:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869183700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686415c360 0x7f68640acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:28:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6863fff700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686406cbc0 0x7f68641493d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f685000c4d0 tx=0x7f685000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f68617fa700 1 -- 172.21.15.112:0/2703496287 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850005d90 con 0x7f686406cbc0 2023-11-08T12:28:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f68617fa700 1 -- 172.21.15.112:0/2703496287 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68500070d0 con 0x7f686406cbc0 2023-11-08T12:28:54.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68640c9660 con 0x7f686406cbc0 2023-11-08T12:28:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f68617fa700 1 -- 172.21.15.112:0/2703496287 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850007480 con 0x7f686406cbc0 2023-11-08T12:28:54.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68640cd620 con 0x7f686406cbc0 2023-11-08T12:28:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.520+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686415c730 con 0x7f686406cbc0 2023-11-08T12:28:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.524+0000 7f68617fa700 1 -- 172.21.15.112:0/2703496287 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6850019030 con 0x7f686406cbc0 2023-11-08T12:28:54.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.524+0000 7f68617fa700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6848064ee0 0x7f6848067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.524+0000 7f68617fa700 1 -- 172.21.15.112:0/2703496287 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f68500815b0 con 0x7f686406cbc0 2023-11-08T12:28:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.524+0000 7f6868982700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6848064ee0 0x7f6848067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.524+0000 7f6868982700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6848064ee0 0x7f6848067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6858000c00 tx=0x7f6858008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.528+0000 7f68617fa700 1 -- 172.21.15.112:0/2703496287 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f685004f420 con 0x7f686406cbc0 2023-11-08T12:28:54.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.708+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6864073d20 con 0x7f686406cbc0 2023-11-08T12:28:54.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.708+0000 7f68617fa700 1 -- 172.21.15.112:0/2703496287 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6850052a40 con 0x7f686406cbc0 2023-11-08T12:28:54.712 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:54.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6848064ee0 msgr2=0x7f6848067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6848064ee0 0x7f6848067390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6858000c00 tx=0x7f6858008030 comp rx=0 tx=0).stop 2023-11-08T12:28:54.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686406cbc0 msgr2=0x7f68641493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686406cbc0 0x7f68641493d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f685000c4d0 tx=0x7f685000c890 comp rx=0 tx=0).stop 2023-11-08T12:28:54.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 shutdown_connections 2023-11-08T12:28:54.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6848064ee0 0x7f6848067390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686415c360 0x7f68640acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686406cbc0 0x7f68641493d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 --2- 172.21.15.112:0/2703496287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f686406c590 0x7f68640af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 >> 172.21.15.112:0/2703496287 conn(0x7f68640cf280 msgr2=0x7f68640c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:54.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 shutdown_connections 2023-11-08T12:28:54.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.712+0000 7f6869984700 1 -- 172.21.15.112:0/2703496287 wait complete. 2023-11-08T12:28:54.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:54.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 Processor -- start 2023-11-08T12:28:54.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 -- start start 2023-11-08T12:28:54.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ab015c700 0x7f7ab00702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ab00b2130 0x7f7ab0070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b1be0 0x7f7ab006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00cd360 con 0x7f7ab00b2130 2023-11-08T12:28:54.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab0160190 con 0x7f7ab015c700 2023-11-08T12:28:54.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7ab65d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0160470 con 0x7f7ab00b1be0 2023-11-08T12:28:54.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.908+0000 7f7aa77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ab00b2130 0x7f7ab0070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7ab00b2130 0x7f7ab0070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40652/0 (socket says 172.21.15.112:40652) 2023-11-08T12:28:54.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 -- 172.21.15.112:0/1908269993 learned_addr learned my addr 172.21.15.112:0/1908269993 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:54.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aaffff700 1 --2- 172.21.15.112:0/1908269993 >> v2:172.21.15.133:3300/0 conn(0x7f7ab015c700 0x7f7ab00702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab4b76700 1 --2- 172.21.15.112:0/1908269993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b1be0 0x7f7ab006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 -- 172.21.15.112:0/1908269993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b1be0 msgr2=0x7f7ab006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:54.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 --2- 172.21.15.112:0/1908269993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b1be0 0x7f7ab006c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 -- 172.21.15.112:0/1908269993 >> v2:172.21.15.133:3300/0 conn(0x7f7ab015c700 msgr2=0x7f7ab00702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:54.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 --2- 172.21.15.112:0/1908269993 >> v2:172.21.15.133:3300/0 conn(0x7f7ab015c700 0x7f7ab00702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 -- 172.21.15.112:0/1908269993 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0160750 con 0x7f7ab00b2130 2023-11-08T12:28:54.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aaffff700 1 --2- 172.21.15.112:0/1908269993 >> v2:172.21.15.133:3300/0 conn(0x7f7ab015c700 0x7f7ab00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:54.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aa77fe700 1 --2- 172.21.15.112:0/1908269993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00b2130 0x7f7ab0070830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0071c30 tx=0x7f7a98009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94aae8866e666e6b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aaf7fe700 1 -- 172.21.15.112:0/1908269993 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800b8a0 con 0x7f7ab00b2130 2023-11-08T12:28:54.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aaf7fe700 1 -- 172.21.15.112:0/1908269993 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800ba00 con 0x7f7ab00b2130 2023-11-08T12:28:54.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7aaf7fe700 1 -- 172.21.15.112:0/1908269993 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800bd90 con 0x7f7ab00b2130 2023-11-08T12:28:54.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 -- 172.21.15.112:0/1908269993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00b2130 msgr2=0x7f7ab0070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/1908269993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00b2130 0x7f7ab0070830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0071c30 tx=0x7f7a98009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 -- 172.21.15.112:0/1908269993 shutdown_connections 2023-11-08T12:28:54.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/1908269993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b1be0 0x7f7ab006c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/1908269993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00b2130 0x7f7ab0070830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/1908269993 >> v2:172.21.15.133:3300/0 conn(0x7f7ab015c700 0x7f7ab00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 -- 172.21.15.112:0/1908269993 >> 172.21.15.112:0/1908269993 conn(0x7f7ab00d2d10 msgr2=0x7f7ab00d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 -- 172.21.15.112:0/1908269993 shutdown_connections 2023-11-08T12:28:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.912+0000 7f7ab65d9700 1 -- 172.21.15.112:0/1908269993 wait complete. 2023-11-08T12:28:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 Processor -- start 2023-11-08T12:28:54.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 -- start start 2023-11-08T12:28:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ab00b1be0 0x7f7ab01f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b2130 0x7f7ab01562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab015c700 0x7f7ab00cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00c7880 con 0x7f7ab015c700 2023-11-08T12:28:54.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab01f6690 con 0x7f7ab00b1be0 2023-11-08T12:28:54.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab65d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00c8150 con 0x7f7ab00b2130 2023-11-08T12:28:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab015c700 0x7f7ab00cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7aa77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b2130 0x7f7ab01562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab015c700 0x7f7ab00cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40656/0 (socket says 172.21.15.112:40656) 2023-11-08T12:28:54.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 -- 172.21.15.112:0/2352419961 learned_addr learned my addr 172.21.15.112:0/2352419961 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:54.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7aaffff700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ab00b1be0 0x7f7ab01f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 -- 172.21.15.112:0/2352419961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b2130 msgr2=0x7f7ab01562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b2130 0x7f7ab01562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 -- 172.21.15.112:0/2352419961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ab00b1be0 msgr2=0x7f7ab01f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ab00b1be0 0x7f7ab01f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 -- 172.21.15.112:0/2352419961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009570 con 0x7f7ab015c700 2023-11-08T12:28:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.916+0000 7f7ab4b76700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab015c700 0x7f7ab00cd4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800e810 tx=0x7f7aa800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.920+0000 7f7aad7fa700 1 -- 172.21.15.112:0/2352419961 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800c070 con 0x7f7ab015c700 2023-11-08T12:28:54.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.920+0000 7f7aad7fa700 1 -- 172.21.15.112:0/2352419961 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa8013630 con 0x7f7ab015c700 2023-11-08T12:28:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.920+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab006b530 con 0x7f7ab015c700 2023-11-08T12:28:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.920+0000 7f7aad7fa700 1 -- 172.21.15.112:0/2352419961 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80139e0 con 0x7f7ab015c700 2023-11-08T12:28:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.920+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab0160a30 con 0x7f7ab015c700 2023-11-08T12:28:54.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.920+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab006c620 con 0x7f7ab015c700 2023-11-08T12:28:54.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.920+0000 7f7aad7fa700 1 -- 172.21.15.112:0/2352419961 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7aa8023070 con 0x7f7ab015c700 2023-11-08T12:28:54.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.924+0000 7f7aad7fa700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a90064ee0 0x7f7a90067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:54.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.924+0000 7f7aad7fa700 1 -- 172.21.15.112:0/2352419961 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7aa8081ea0 con 0x7f7ab015c700 2023-11-08T12:28:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.924+0000 7f7aaffff700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a90064ee0 0x7f7a90067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:54.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.924+0000 7f7aaffff700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a90064ee0 0x7f7a90067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009fd0 tx=0x7f7aa00097f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:54.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:54.928+0000 7f7aad7fa700 1 -- 172.21.15.112:0/2352419961 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7aa804fd10 con 0x7f7ab015c700 2023-11-08T12:28:55.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.096+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7ab00b5b40 con 0x7f7ab015c700 2023-11-08T12:28:55.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7aad7fa700 1 -- 172.21.15.112:0/2352419961 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ab00b5b40 con 0x7f7ab015c700 2023-11-08T12:28:55.102 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:55.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a90064ee0 msgr2=0x7f7a90067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a90064ee0 0x7f7a90067390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009fd0 tx=0x7f7aa00097f0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab015c700 msgr2=0x7f7ab00cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab015c700 0x7f7ab00cd4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800e810 tx=0x7f7aa800eb20 comp rx=0 tx=0).stop 2023-11-08T12:28:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 shutdown_connections 2023-11-08T12:28:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a90064ee0 0x7f7a90067390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab015c700 0x7f7ab00cd4a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7ab00b2130 0x7f7ab01562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 --2- 172.21.15.112:0/2352419961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ab00b1be0 0x7f7ab01f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 >> 172.21.15.112:0/2352419961 conn(0x7f7ab00d2d10 msgr2=0x7f7ab0157550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 shutdown_connections 2023-11-08T12:28:55.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.100+0000 7f7ab65d9700 1 -- 172.21.15.112:0/2352419961 wait complete. 2023-11-08T12:28:55.124 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:55.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.288+0000 7f0ca2384700 1 Processor -- start 2023-11-08T12:28:55.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.292+0000 7f0ca2384700 1 -- start start 2023-11-08T12:28:55.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.292+0000 7f0ca2384700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c9c15e190 0x7f0c9c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.292+0000 7f0ca2384700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c06ff10 0x7f0c9c070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.292+0000 7f0ca2384700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c15e560 con 0x7f0c9c161560 2023-11-08T12:28:55.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.292+0000 7f0ca2384700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c0708d0 con 0x7f0c9c15e190 2023-11-08T12:28:55.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca2384700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c06be80 con 0x7f0c9c06ff10 2023-11-08T12:28:55.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1b83700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c06ff10 0x7f0c9c070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c9c15e190 0x7f0c9c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c9c15e190 0x7f0c9c0cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38758/0 (socket says 172.21.15.112:38758) 2023-11-08T12:28:55.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1b83700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c06ff10 0x7f0c9c070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51530/0 (socket says 172.21.15.112:51530) 2023-11-08T12:28:55.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 -- 172.21.15.112:0/1338648668 learned_addr learned my addr 172.21.15.112:0/1338648668 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:55.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca0b81700 1 --1- 172.21.15.112:0/1338648668 >> v1:172.21.15.133:6789/0 conn(0x7f0c9c161560 0x7f0c9c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40704/0 (socket says 172.21.15.112:40704) 2023-11-08T12:28:55.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 -- 172.21.15.112:0/1338648668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c06ff10 msgr2=0x7f0c9c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:55.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 --2- 172.21.15.112:0/1338648668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c06ff10 0x7f0c9c070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 -- 172.21.15.112:0/1338648668 >> v1:172.21.15.133:6789/0 conn(0x7f0c9c161560 legacy=0x7f0c9c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 -- 172.21.15.112:0/1338648668 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0ce330 con 0x7f0c9c15e190 2023-11-08T12:28:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca1382700 1 --2- 172.21.15.112:0/1338648668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c15e190 0x7f0c9c0cdc50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009910 tx=0x7f0c98009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc8be2b995788cf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0c93fff700 1 -- 172.21.15.112:0/1338648668 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98011830 con 0x7f0c9c15e190 2023-11-08T12:28:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0c93fff700 1 -- 172.21.15.112:0/1338648668 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98011990 con 0x7f0c9c15e190 2023-11-08T12:28:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0c93fff700 1 -- 172.21.15.112:0/1338648668 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98011d40 con 0x7f0c9c15e190 2023-11-08T12:28:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca2384700 1 -- 172.21.15.112:0/1338648668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c15e190 msgr2=0x7f0c9c0cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1338648668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c15e190 0x7f0c9c0cdc50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009910 tx=0x7f0c98009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca2384700 1 -- 172.21.15.112:0/1338648668 shutdown_connections 2023-11-08T12:28:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1338648668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c06ff10 0x7f0c9c070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1338648668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c15e190 0x7f0c9c0cdc50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.296+0000 7f0ca2384700 1 -- 172.21.15.112:0/1338648668 >> 172.21.15.112:0/1338648668 conn(0x7f0c9c0cf280 msgr2=0x7f0c9c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:55.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.300+0000 7f0ca2384700 1 -- 172.21.15.112:0/1338648668 shutdown_connections 2023-11-08T12:28:55.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.300+0000 7f0ca2384700 1 -- 172.21.15.112:0/1338648668 wait complete. 2023-11-08T12:28:55.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 Processor -- start 2023-11-08T12:28:55.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 -- start start 2023-11-08T12:28:55.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c9c06ff10 0x7f0c9c150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c15e190 0x7f0c9c1623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c161560 0x7f0c9c158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0c7c90 con 0x7f0c9c06ff10 2023-11-08T12:28:55.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1f5a80 con 0x7f0c9c161560 2023-11-08T12:28:55.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0c7080 con 0x7f0c9c15e190 2023-11-08T12:28:55.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c9c06ff10 0x7f0c9c150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c9c06ff10 0x7f0c9c150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44512/0 (socket says 172.21.15.112:44512) 2023-11-08T12:28:55.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 -- 172.21.15.112:0/1146839697 learned_addr learned my addr 172.21.15.112:0/1146839697 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1b83700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c161560 0x7f0c9c158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca0b81700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c15e190 0x7f0c9c1623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 -- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c15e190 msgr2=0x7f0c9c1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c15e190 0x7f0c9c1623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 -- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c161560 msgr2=0x7f0c9c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c161560 0x7f0c9c158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 -- 172.21.15.112:0/1146839697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c98009570 con 0x7f0c9c06ff10 2023-11-08T12:28:55.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca1382700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c9c06ff10 0x7f0c9c150470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0c98000c00 tx=0x7f0c98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:55.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0c91ffb700 1 -- 172.21.15.112:0/1146839697 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98004610 con 0x7f0c9c06ff10 2023-11-08T12:28:55.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0c91ffb700 1 -- 172.21.15.112:0/1146839697 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c980036c0 con 0x7f0c9c06ff10 2023-11-08T12:28:55.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c0afc70 con 0x7f0c9c06ff10 2023-11-08T12:28:55.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.304+0000 7f0c91ffb700 1 -- 172.21.15.112:0/1146839697 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98003a50 con 0x7f0c9c06ff10 2023-11-08T12:28:55.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.308+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c0af990 con 0x7f0c9c06ff10 2023-11-08T12:28:55.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.308+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0aff50 con 0x7f0c9c06ff10 2023-11-08T12:28:55.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.308+0000 7f0c91ffb700 1 -- 172.21.15.112:0/1146839697 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0c9802d070 con 0x7f0c9c06ff10 2023-11-08T12:28:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.312+0000 7f0c91ffb700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0c80064ee0 0x7f0c80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.312+0000 7f0c91ffb700 1 -- 172.21.15.112:0/1146839697 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c98021030 con 0x7f0c9c06ff10 2023-11-08T12:28:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.312+0000 7f0ca0b81700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0c80064ee0 0x7f0c80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.312+0000 7f0ca0b81700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0c80064ee0 0x7f0c80067390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c06d120 tx=0x7f0c8c007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:55.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.320+0000 7f0c91ffb700 1 -- 172.21.15.112:0/1146839697 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0c98051740 con 0x7f0c9c06ff10 2023-11-08T12:28:55.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.488+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c9c073d20 con 0x7f0c9c06ff10 2023-11-08T12:28:55.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.488+0000 7f0c91ffb700 1 -- 172.21.15.112:0/1146839697 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c98015020 con 0x7f0c9c06ff10 2023-11-08T12:28:55.493 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:55.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0c80064ee0 msgr2=0x7f0c80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0c80064ee0 0x7f0c80067390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c06d120 tx=0x7f0c8c007d30 comp rx=0 tx=0).stop 2023-11-08T12:28:55.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c9c06ff10 msgr2=0x7f0c9c150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c9c06ff10 0x7f0c9c150470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0c98000c00 tx=0x7f0c98004770 comp rx=0 tx=0).stop 2023-11-08T12:28:55.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 shutdown_connections 2023-11-08T12:28:55.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0c80064ee0 0x7f0c80067390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c161560 0x7f0c9c158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c9c15e190 0x7f0c9c1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 --2- 172.21.15.112:0/1146839697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c9c06ff10 0x7f0c9c150470 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 >> 172.21.15.112:0/1146839697 conn(0x7f0c9c0cf280 msgr2=0x7f0c9c06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:55.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 shutdown_connections 2023-11-08T12:28:55.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.492+0000 7f0ca2384700 1 -- 172.21.15.112:0/1146839697 wait complete. 2023-11-08T12:28:55.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:55.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.704+0000 7f3c7579a700 1 Processor -- start 2023-11-08T12:28:55.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.708+0000 7f3c7579a700 1 -- start start 2023-11-08T12:28:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.708+0000 7f3c7579a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015c150 0x7f3c700b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.708+0000 7f3c7579a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c7006ff10 0x7f3c70070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.708+0000 7f3c7579a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7015c520 con 0x7f3c7015fc30 2023-11-08T12:28:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.708+0000 7f3c7579a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700b4240 con 0x7f3c7006ff10 2023-11-08T12:28:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.708+0000 7f3c7579a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700708a0 con 0x7f3c7015c150 2023-11-08T12:28:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c74f99700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3c7015fc30 0x7f3c701600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35076/0 (socket says 172.21.15.112:35076) 2023-11-08T12:28:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c74f99700 1 -- 172.21.15.112:0/400848473 learned_addr learned my addr 172.21.15.112:0/400848473 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:55.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6ffff700 1 --2- 172.21.15.112:0/400848473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015c150 0x7f3c700b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c67fff700 1 --2- 172.21.15.112:0/400848473 >> v2:172.21.15.133:3300/0 conn(0x7f3c7006ff10 0x7f3c70070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6f7fe700 1 -- 172.21.15.112:0/400848473 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170510717 0 0) 0x7f3c7015c520 con 0x7f3c7015fc30 2023-11-08T12:28:55.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6f7fe700 1 -- 172.21.15.112:0/400848473 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c5c0035d0 con 0x7f3c7015fc30 2023-11-08T12:28:55.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6f7fe700 1 -- 172.21.15.112:0/400848473 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18066225 0 0) 0x7f3c5c0035d0 con 0x7f3c7015fc30 2023-11-08T12:28:55.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6ffff700 1 -- 172.21.15.112:0/400848473 >> v2:172.21.15.133:3300/0 conn(0x7f3c7006ff10 msgr2=0x7f3c70070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:55.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6ffff700 1 --2- 172.21.15.112:0/400848473 >> v2:172.21.15.133:3300/0 conn(0x7f3c7006ff10 0x7f3c70070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6ffff700 1 -- 172.21.15.112:0/400848473 >> v1:172.21.15.112:6789/0 conn(0x7f3c7015fc30 legacy=0x7f3c701600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6ffff700 1 -- 172.21.15.112:0/400848473 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7006ac00 con 0x7f3c7015c150 2023-11-08T12:28:55.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c67fff700 1 --2- 172.21.15.112:0/400848473 >> v2:172.21.15.133:3300/0 conn(0x7f3c7006ff10 0x7f3c70070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:55.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6ffff700 1 --2- 172.21.15.112:0/400848473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015c150 0x7f3c700b3d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009850 tx=0x7f3c60009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cde6624068f47da server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:55.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6f7fe700 1 -- 172.21.15.112:0/400848473 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680019f0 con 0x7f3c7015c150 2023-11-08T12:28:55.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6f7fe700 1 -- 172.21.15.112:0/400848473 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60004030 con 0x7f3c7015c150 2023-11-08T12:28:55.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.712+0000 7f3c6f7fe700 1 -- 172.21.15.112:0/400848473 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c600043e0 con 0x7f3c7015c150 2023-11-08T12:28:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- 172.21.15.112:0/400848473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015c150 msgr2=0x7f3c700b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 --2- 172.21.15.112:0/400848473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015c150 0x7f3c700b3d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009850 tx=0x7f3c60009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- 172.21.15.112:0/400848473 shutdown_connections 2023-11-08T12:28:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 --2- 172.21.15.112:0/400848473 >> v2:172.21.15.133:3300/0 conn(0x7f3c7006ff10 0x7f3c70070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 --2- 172.21.15.112:0/400848473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015c150 0x7f3c700b3d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- 172.21.15.112:0/400848473 >> 172.21.15.112:0/400848473 conn(0x7f3c700d3680 msgr2=0x7f3c700cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- 172.21.15.112:0/400848473 shutdown_connections 2023-11-08T12:28:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- 172.21.15.112:0/400848473 wait complete. 2023-11-08T12:28:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 Processor -- start 2023-11-08T12:28:55.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- start start 2023-11-08T12:28:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c7006ff10 0x7f3c700cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c7015c150 0x7f3c700ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015fc30 0x7f3c701f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700cd780 con 0x7f3c7006ff10 2023-11-08T12:28:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700cd4e0 con 0x7f3c7015c150 2023-11-08T12:28:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.716+0000 7f3c7579a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700cf850 con 0x7f3c7015fc30 2023-11-08T12:28:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c7006ff10 0x7f3c700cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c7006ff10 0x7f3c700cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44522/0 (socket says 172.21.15.112:44522) 2023-11-08T12:28:55.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 -- 172.21.15.112:0/1701030783 learned_addr learned my addr 172.21.15.112:0/1701030783 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:55.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c74f99700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015fc30 0x7f3c701f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c67fff700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c7015c150 0x7f3c700ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 -- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015fc30 msgr2=0x7f3c701f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015fc30 0x7f3c701f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 -- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c7015c150 msgr2=0x7f3c700ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c7015c150 0x7f3c700ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 -- 172.21.15.112:0/1701030783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58009450 con 0x7f3c7006ff10 2023-11-08T12:28:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6ffff700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c7006ff10 0x7f3c700cc5e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c600090b0 tx=0x7f3c60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6d7fa700 1 -- 172.21.15.112:0/1701030783 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60003d10 con 0x7f3c7006ff10 2023-11-08T12:28:55.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6d7fa700 1 -- 172.21.15.112:0/1701030783 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6001f070 con 0x7f3c7006ff10 2023-11-08T12:28:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c6d7fa700 1 -- 172.21.15.112:0/1701030783 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60011870 con 0x7f3c7006ff10 2023-11-08T12:28:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c600094b0 con 0x7f3c7006ff10 2023-11-08T12:28:55.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.720+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c700d2450 con 0x7f3c7006ff10 2023-11-08T12:28:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.724+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7006cc50 con 0x7f3c7006ff10 2023-11-08T12:28:55.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.724+0000 7f3c6d7fa700 1 -- 172.21.15.112:0/1701030783 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3c60017020 con 0x7f3c7006ff10 2023-11-08T12:28:55.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.724+0000 7f3c6d7fa700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3c50064ee0 0x7f3c50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:55.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.724+0000 7f3c6d7fa700 1 -- 172.21.15.112:0/1701030783 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3c60021070 con 0x7f3c7006ff10 2023-11-08T12:28:55.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.724+0000 7f3c67fff700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3c50064ee0 0x7f3c50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:55.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.724+0000 7f3c67fff700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3c50064ee0 0x7f3c50067390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3c7006d460 tx=0x7f3c580091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:55.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.732+0000 7f3c6d7fa700 1 -- 172.21.15.112:0/1701030783 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3c600517c0 con 0x7f3c7006ff10 2023-11-08T12:28:55.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.900+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c700d2730 con 0x7f3c7006ff10 2023-11-08T12:28:55.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.904+0000 7f3c6d7fa700 1 -- 172.21.15.112:0/1701030783 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c6002b0a0 con 0x7f3c7006ff10 2023-11-08T12:28:55.907 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:55.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3c50064ee0 msgr2=0x7f3c50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3c50064ee0 0x7f3c50067390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3c7006d460 tx=0x7f3c580091c0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c7006ff10 msgr2=0x7f3c700cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:55.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c7006ff10 0x7f3c700cc5e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c600090b0 tx=0x7f3c60004770 comp rx=0 tx=0).stop 2023-11-08T12:28:55.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 shutdown_connections 2023-11-08T12:28:55.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3c50064ee0 0x7f3c50067390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3c7015fc30 0x7f3c701f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c7015c150 0x7f3c700ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 --2- 172.21.15.112:0/1701030783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c7006ff10 0x7f3c700cc5e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:55.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 >> 172.21.15.112:0/1701030783 conn(0x7f3c700d3680 msgr2=0x7f3c700c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:55.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 shutdown_connections 2023-11-08T12:28:55.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:55.908+0000 7f3c7579a700 1 -- 172.21.15.112:0/1701030783 wait complete. 2023-11-08T12:28:55.935 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:56.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.104+0000 7fdbe2612700 1 Processor -- start 2023-11-08T12:28:56.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe2612700 1 -- start start 2023-11-08T12:28:56.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe2612700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdbdc15e190 0x7fdbdc0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe2612700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc161560 0x7fdbdc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe2612700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc15e560 con 0x7fdbdc06ff10 2023-11-08T12:28:56.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe2612700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc06be80 con 0x7fdbdc15e190 2023-11-08T12:28:56.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe2612700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0ce330 con 0x7fdbdc161560 2023-11-08T12:28:56.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe1610700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdbdc15e190 0x7fdbdc0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe0e0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc161560 0x7fdbdc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe1610700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdbdc15e190 0x7fdbdc0cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44530/0 (socket says 172.21.15.112:44530) 2023-11-08T12:28:56.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.108+0000 7fdbe1610700 1 -- 172.21.15.112:0/311675367 learned_addr learned my addr 172.21.15.112:0/311675367 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:56.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe1610700 1 -- 172.21.15.112:0/311675367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc161560 msgr2=0x7fdbdc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:56.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe1610700 1 --2- 172.21.15.112:0/311675367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc161560 0x7fdbdc069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe1610700 1 -- 172.21.15.112:0/311675367 >> v1:172.21.15.133:6789/0 conn(0x7fdbdc06ff10 legacy=0x7fdbdc06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe1610700 1 -- 172.21.15.112:0/311675367 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0af990 con 0x7fdbdc15e190 2023-11-08T12:28:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe0e0f700 1 --2- 172.21.15.112:0/311675367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc161560 0x7fdbdc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe1610700 1 --2- 172.21.15.112:0/311675367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15e190 0x7fdbdc0cdc50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009910 tx=0x7fdbd8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c710a2ad0e2b952 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbd3fff700 1 -- 172.21.15.112:0/311675367 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8011830 con 0x7fdbdc15e190 2023-11-08T12:28:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbd3fff700 1 -- 172.21.15.112:0/311675367 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8011990 con 0x7fdbdc15e190 2023-11-08T12:28:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbd3fff700 1 -- 172.21.15.112:0/311675367 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8011d40 con 0x7fdbdc15e190 2023-11-08T12:28:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 -- 172.21.15.112:0/311675367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15e190 msgr2=0x7fdbdc0cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 --2- 172.21.15.112:0/311675367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15e190 0x7fdbdc0cdc50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009910 tx=0x7fdbd8009c20 comp rx=0 tx=0).stop 2023-11-08T12:28:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 -- 172.21.15.112:0/311675367 shutdown_connections 2023-11-08T12:28:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 --2- 172.21.15.112:0/311675367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc161560 0x7fdbdc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 --2- 172.21.15.112:0/311675367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc15e190 0x7fdbdc0cdc50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 -- 172.21.15.112:0/311675367 >> 172.21.15.112:0/311675367 conn(0x7fdbdc0cf280 msgr2=0x7fdbdc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 -- 172.21.15.112:0/311675367 shutdown_connections 2023-11-08T12:28:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.112+0000 7fdbe2612700 1 -- 172.21.15.112:0/311675367 wait complete. 2023-11-08T12:28:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 Processor -- start 2023-11-08T12:28:56.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 -- start start 2023-11-08T12:28:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbdc06ff10 0x7fdbdc0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc15e190 0x7fdbdc0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc161560 0x7fdbdc0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0b4390 con 0x7fdbdc161560 2023-11-08T12:28:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc1f6ba0 con 0x7fdbdc06ff10 2023-11-08T12:28:56.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.116+0000 7fdbe2612700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc1f95e0 con 0x7fdbdc15e190 2023-11-08T12:28:56.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc161560 0x7fdbdc0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1610700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbdc06ff10 0x7fdbdc0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc161560 0x7fdbdc0ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44532/0 (socket says 172.21.15.112:44532) 2023-11-08T12:28:56.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 -- 172.21.15.112:0/2253592000 learned_addr learned my addr 172.21.15.112:0/2253592000 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe0e0f700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc15e190 0x7fdbdc0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 -- 172.21.15.112:0/2253592000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc15e190 msgr2=0x7fdbdc0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc15e190 0x7fdbdc0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 -- 172.21.15.112:0/2253592000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbdc06ff10 msgr2=0x7fdbdc0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbdc06ff10 0x7fdbdc0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 -- 172.21.15.112:0/2253592000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc0094b0 con 0x7fdbdc161560 2023-11-08T12:28:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe1e11700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc161560 0x7fdbdc0ca120 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400cc50 tx=0x7fdbd400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbd1ffb700 1 -- 172.21.15.112:0/2253592000 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4003c20 con 0x7fdbdc161560 2023-11-08T12:28:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbd1ffb700 1 -- 172.21.15.112:0/2253592000 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd4003d80 con 0x7fdbdc161560 2023-11-08T12:28:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd8009570 con 0x7fdbdc161560 2023-11-08T12:28:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbd1ffb700 1 -- 172.21.15.112:0/2253592000 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400aab0 con 0x7fdbdc161560 2023-11-08T12:28:56.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc0aff50 con 0x7fdbdc161560 2023-11-08T12:28:56.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.120+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc0afc70 con 0x7fdbdc161560 2023-11-08T12:28:56.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.124+0000 7fdbd1ffb700 1 -- 172.21.15.112:0/2253592000 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdbd4010050 con 0x7fdbdc161560 2023-11-08T12:28:56.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.124+0000 7fdbd1ffb700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdbc0064ee0 0x7fdbc0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.124+0000 7fdbd1ffb700 1 -- 172.21.15.112:0/2253592000 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdbd4081f90 con 0x7fdbdc161560 2023-11-08T12:28:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.124+0000 7fdbe1610700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdbc0064ee0 0x7fdbc0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.128+0000 7fdbe1610700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdbc0064ee0 0x7fdbc0067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8000c00 tx=0x7fdbd8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:56.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.132+0000 7fdbd1ffb700 1 -- 172.21.15.112:0/2253592000 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdbd404fd10 con 0x7fdbdc161560 2023-11-08T12:28:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.304+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdbdc06a130 con 0x7fdbdc161560 2023-11-08T12:28:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.304+0000 7fdbd1ffb700 1 -- 172.21.15.112:0/2253592000 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdbd4053330 con 0x7fdbdc161560 2023-11-08T12:28:56.308 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdbc0064ee0 msgr2=0x7fdbc0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdbc0064ee0 0x7fdbc0067390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8000c00 tx=0x7fdbd8008030 comp rx=0 tx=0).stop 2023-11-08T12:28:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc161560 msgr2=0x7fdbdc0ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc161560 0x7fdbdc0ca120 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400cc50 tx=0x7fdbd400cf60 comp rx=0 tx=0).stop 2023-11-08T12:28:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 shutdown_connections 2023-11-08T12:28:56.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdbc0064ee0 0x7fdbc0067390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbdc161560 0x7fdbdc0ca120 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbdc15e190 0x7fdbdc0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 --2- 172.21.15.112:0/2253592000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbdc06ff10 0x7fdbdc0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 >> 172.21.15.112:0/2253592000 conn(0x7fdbdc0cf280 msgr2=0x7fdbdc0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 shutdown_connections 2023-11-08T12:28:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.308+0000 7fdbe2612700 1 -- 172.21.15.112:0/2253592000 wait complete. 2023-11-08T12:28:56.331 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:28:56.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea935d700 1 Processor -- start 2023-11-08T12:28:56.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea935d700 1 -- start start 2023-11-08T12:28:56.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea935d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ea40b43a0 0x7f8ea415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea935d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea4070790 0x7f8ea406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea935d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea415a550 con 0x7f8ea40b1640 2023-11-08T12:28:56.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea935d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea406b0a0 con 0x7f8ea40b43a0 2023-11-08T12:28:56.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea935d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40caac0 con 0x7f8ea4070790 2023-11-08T12:28:56.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8e9bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8ea40b1640 0x7f8ea4070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35088/0 (socket says 172.21.15.112:35088) 2023-11-08T12:28:56.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8e9bfff700 1 -- 172.21.15.112:0/2921434097 learned_addr learned my addr 172.21.15.112:0/2921434097 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:56.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea37fe700 1 --2- 172.21.15.112:0/2921434097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea4070790 0x7f8ea406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea2ffd700 1 --2- 172.21.15.112:0/2921434097 >> v2:172.21.15.133:3300/0 conn(0x7f8ea40b43a0 0x7f8ea415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea27fc700 1 -- 172.21.15.112:0/2921434097 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423036292 0 0) 0x7f8e8c001110 con 0x7f8ea40b1640 2023-11-08T12:28:56.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea27fc700 1 -- 172.21.15.112:0/2921434097 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e900035d0 con 0x7f8ea40b1640 2023-11-08T12:28:56.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea37fe700 1 -- 172.21.15.112:0/2921434097 >> v2:172.21.15.133:3300/0 conn(0x7f8ea40b43a0 msgr2=0x7f8ea415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:56.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea37fe700 1 --2- 172.21.15.112:0/2921434097 >> v2:172.21.15.133:3300/0 conn(0x7f8ea40b43a0 0x7f8ea415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea37fe700 1 -- 172.21.15.112:0/2921434097 >> v1:172.21.15.112:6789/0 conn(0x7f8ea40b1640 legacy=0x7f8ea4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.504+0000 7f8ea37fe700 1 -- 172.21.15.112:0/2921434097 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40cada0 con 0x7f8ea4070790 2023-11-08T12:28:56.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea37fe700 1 --2- 172.21.15.112:0/2921434097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea4070790 0x7f8ea406bfd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009d90 tx=0x7f8e9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ef1c6fa0b0271 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:56.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea27fc700 1 -- 172.21.15.112:0/2921434097 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00e070 con 0x7f8ea4070790 2023-11-08T12:28:56.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea27fc700 1 -- 172.21.15.112:0/2921434097 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c00bb20 con 0x7f8ea4070790 2023-11-08T12:28:56.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea27fc700 1 -- 172.21.15.112:0/2921434097 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00be90 con 0x7f8ea4070790 2023-11-08T12:28:56.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 -- 172.21.15.112:0/2921434097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea4070790 msgr2=0x7f8ea406bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 --2- 172.21.15.112:0/2921434097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea4070790 0x7f8ea406bfd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009d90 tx=0x7f8e9c00b330 comp rx=0 tx=0).stop 2023-11-08T12:28:56.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 -- 172.21.15.112:0/2921434097 shutdown_connections 2023-11-08T12:28:56.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 --2- 172.21.15.112:0/2921434097 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea4070790 0x7f8ea406bfd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 --2- 172.21.15.112:0/2921434097 >> v2:172.21.15.133:3300/0 conn(0x7f8ea40b43a0 0x7f8ea415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 -- 172.21.15.112:0/2921434097 >> 172.21.15.112:0/2921434097 conn(0x7f8ea40b0f80 msgr2=0x7f8ea40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:56.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 -- 172.21.15.112:0/2921434097 shutdown_connections 2023-11-08T12:28:56.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.508+0000 7f8ea935d700 1 -- 172.21.15.112:0/2921434097 wait complete. 2023-11-08T12:28:56.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 Processor -- start 2023-11-08T12:28:56.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 -- start start 2023-11-08T12:28:56.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ea4070790 0x7f8ea40ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea40b1640 0x7f8ea41f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea40b43a0 0x7f8ea41f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41f19a0 con 0x7f8ea4070790 2023-11-08T12:28:56.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c6870 con 0x7f8ea40b1640 2023-11-08T12:28:56.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea935d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40ac7e0 con 0x7f8ea40b43a0 2023-11-08T12:28:56.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ea4070790 0x7f8ea40ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ea4070790 0x7f8ea40ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44538/0 (socket says 172.21.15.112:44538) 2023-11-08T12:28:56.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3964262766 learned_addr learned my addr 172.21.15.112:0/3964262766 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:56.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8ea37fe700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea40b43a0 0x7f8ea41f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.512+0000 7f8e9bfff700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea40b1640 0x7f8ea41f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea40b43a0 msgr2=0x7f8ea41f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea2ffd700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea40b43a0 0x7f8ea41f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea40b1640 msgr2=0x7f8ea41f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea2ffd700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea40b1640 0x7f8ea41f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea2ffd700 1 -- 172.21.15.112:0/3964262766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009a70 con 0x7f8ea4070790 2023-11-08T12:28:56.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea2ffd700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ea4070790 0x7f8ea40ccbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400e840 tx=0x7f8e9400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:56.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8e9b7fe700 1 -- 172.21.15.112:0/3964262766 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940095a0 con 0x7f8ea4070790 2023-11-08T12:28:56.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8e9b7fe700 1 -- 172.21.15.112:0/3964262766 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94013680 con 0x7f8ea4070790 2023-11-08T12:28:56.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea406b5d0 con 0x7f8ea4070790 2023-11-08T12:28:56.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8e9b7fe700 1 -- 172.21.15.112:0/3964262766 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940139f0 con 0x7f8ea4070790 2023-11-08T12:28:56.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea406b2f0 con 0x7f8ea4070790 2023-11-08T12:28:56.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.516+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea415eb10 con 0x7f8ea4070790 2023-11-08T12:28:56.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.520+0000 7f8e9b7fe700 1 -- 172.21.15.112:0/3964262766 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8e94019030 con 0x7f8ea4070790 2023-11-08T12:28:56.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.520+0000 7f8e9b7fe700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8e84064ee0 0x7f8e84067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:56.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.520+0000 7f8e9b7fe700 1 -- 172.21.15.112:0/3964262766 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e94081f40 con 0x7f8ea4070790 2023-11-08T12:28:56.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.520+0000 7f8e9bfff700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8e84064ee0 0x7f8e84067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:56.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.520+0000 7f8e9bfff700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8e84064ee0 0x7f8e84067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005930 tx=0x7f8e8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:56.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.524+0000 7f8e9b7fe700 1 -- 172.21.15.112:0/3964262766 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8e9404fd50 con 0x7f8ea4070790 2023-11-08T12:28:56.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.708+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8ea4073cb0 con 0x7f8ea4070790 2023-11-08T12:28:56.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8e9b7fe700 1 -- 172.21.15.112:0/3964262766 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8e94053370 con 0x7f8ea4070790 2023-11-08T12:28:56.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8e84064ee0 msgr2=0x7f8e84067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8e84064ee0 0x7f8e84067390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005930 tx=0x7f8e8c009040 comp rx=0 tx=0).stop 2023-11-08T12:28:56.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ea4070790 msgr2=0x7f8ea40ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:56.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ea4070790 0x7f8ea40ccbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400e840 tx=0x7f8e9400eb50 comp rx=0 tx=0).stop 2023-11-08T12:28:56.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 shutdown_connections 2023-11-08T12:28:56.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8e84064ee0 0x7f8e84067390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8ea40b43a0 0x7f8ea41f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea40b1640 0x7f8ea41f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 --2- 172.21.15.112:0/3964262766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ea4070790 0x7f8ea40ccbf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:56.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 >> 172.21.15.112:0/3964262766 conn(0x7f8ea40b0f80 msgr2=0x7f8ea4159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:56.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 shutdown_connections 2023-11-08T12:28:56.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:56.712+0000 7f8ea935d700 1 -- 172.21.15.112:0/3964262766 wait complete. 2023-11-08T12:28:56.719 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:28:56.736 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-08T12:28:56.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:56.736 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-08T12:28:56.792 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:28:56.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:56.793 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-08T12:28:56.827 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:56.828 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:56.848 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:56.849 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:56.906 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:28:56.907 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:56.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:28:57.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.196+0000 7f9a34bd2700 1 Processor -- start 2023-11-08T12:28:57.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.196+0000 7f9a34bd2700 1 -- start start 2023-11-08T12:28:57.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.196+0000 7f9a34bd2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9a300b43a0 0x7f9a3015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.196+0000 7f9a34bd2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a300b1640 0x7f9a30070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3015a550 con 0x7f9a300c9040 2023-11-08T12:28:57.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3006b0a0 con 0x7f9a300b43a0 2023-11-08T12:28:57.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a300caac0 con 0x7f9a300b1640 2023-11-08T12:28:57.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9a300c9040 0x7f9a30069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35104/0 (socket says 172.21.15.112:35104) 2023-11-08T12:28:57.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2ffff700 1 -- 172.21.15.112:0/1420942962 learned_addr learned my addr 172.21.15.112:0/1420942962 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:57.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2f7fe700 1 --2- 172.21.15.112:0/1420942962 >> v2:172.21.15.112:3300/0 conn(0x7f9a300b43a0 0x7f9a3015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2effd700 1 --2- 172.21.15.112:0/1420942962 >> v2:172.21.15.133:3300/0 conn(0x7f9a300b1640 0x7f9a30070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2e7fc700 1 -- 172.21.15.112:0/1420942962 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051905936 0 0) 0x7f9a28001490 con 0x7f9a300c9040 2023-11-08T12:28:57.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2e7fc700 1 -- 172.21.15.112:0/1420942962 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a180035d0 con 0x7f9a300c9040 2023-11-08T12:28:57.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2effd700 1 -- 172.21.15.112:0/1420942962 >> v2:172.21.15.112:3300/0 conn(0x7f9a300b43a0 msgr2=0x7f9a3015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:57.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2effd700 1 --2- 172.21.15.112:0/1420942962 >> v2:172.21.15.112:3300/0 conn(0x7f9a300b43a0 0x7f9a3015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2effd700 1 -- 172.21.15.112:0/1420942962 >> v1:172.21.15.112:6789/0 conn(0x7f9a300c9040 legacy=0x7f9a30069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2effd700 1 -- 172.21.15.112:0/1420942962 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300cada0 con 0x7f9a300b1640 2023-11-08T12:28:57.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2f7fe700 1 --2- 172.21.15.112:0/1420942962 >> v2:172.21.15.112:3300/0 conn(0x7f9a300b43a0 0x7f9a3015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:57.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2effd700 1 --2- 172.21.15.112:0/1420942962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a30070080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a30072d40 tx=0x7f9a24009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16134e9042c8ff91 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:57.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2e7fc700 1 -- 172.21.15.112:0/1420942962 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24011830 con 0x7f9a300b1640 2023-11-08T12:28:57.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2e7fc700 1 -- 172.21.15.112:0/1420942962 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24011990 con 0x7f9a300b1640 2023-11-08T12:28:57.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a2e7fc700 1 -- 172.21.15.112:0/1420942962 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24011d20 con 0x7f9a300b1640 2023-11-08T12:28:57.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 -- 172.21.15.112:0/1420942962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 msgr2=0x7f9a30070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/1420942962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a30070080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a30072d40 tx=0x7f9a24009b30 comp rx=0 tx=0).stop 2023-11-08T12:28:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 -- 172.21.15.112:0/1420942962 shutdown_connections 2023-11-08T12:28:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/1420942962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a30070080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/1420942962 >> v2:172.21.15.112:3300/0 conn(0x7f9a300b43a0 0x7f9a3015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.200+0000 7f9a34bd2700 1 -- 172.21.15.112:0/1420942962 >> 172.21.15.112:0/1420942962 conn(0x7f9a300b0f80 msgr2=0x7f9a300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:57.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.204+0000 7f9a34bd2700 1 -- 172.21.15.112:0/1420942962 shutdown_connections 2023-11-08T12:28:57.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.204+0000 7f9a34bd2700 1 -- 172.21.15.112:0/1420942962 wait complete. 2023-11-08T12:28:57.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.204+0000 7f9a34bd2700 1 Processor -- start 2023-11-08T12:28:57.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.204+0000 7f9a34bd2700 1 -- start start 2023-11-08T12:28:57.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a3015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a300b43a0 0x7f9a300c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a300c9040 0x7f9a300c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3015d680 con 0x7f9a300c9040 2023-11-08T12:28:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3015ca70 con 0x7f9a300b1640 2023-11-08T12:28:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3015cd50 con 0x7f9a300b43a0 2023-11-08T12:28:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a300c9040 0x7f9a300c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2effd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a300b43a0 0x7f9a300c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a300c9040 0x7f9a300c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44542/0 (socket says 172.21.15.112:44542) 2023-11-08T12:28:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2ffff700 1 -- 172.21.15.112:0/2270604421 learned_addr learned my addr 172.21.15.112:0/2270604421 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2f7fe700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a3015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2effd700 1 -- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 msgr2=0x7f9a3015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2effd700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a3015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2effd700 1 -- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a300c9040 msgr2=0x7f9a300c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2effd700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a300c9040 0x7f9a300c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2effd700 1 -- 172.21.15.112:0/2270604421 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200094b0 con 0x7f9a300b43a0 2023-11-08T12:28:57.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2f7fe700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a3015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:57.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2ffff700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a300c9040 0x7f9a300c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:57.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a2effd700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a300b43a0 0x7f9a300c7d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a3006fe30 tx=0x7f9a24004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:57.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a17fff700 1 -- 172.21.15.112:0/2270604421 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24004510 con 0x7f9a300b43a0 2023-11-08T12:28:57.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a17fff700 1 -- 172.21.15.112:0/2270604421 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2401e070 con 0x7f9a300b43a0 2023-11-08T12:28:57.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a240094b0 con 0x7f9a300b43a0 2023-11-08T12:28:57.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a17fff700 1 -- 172.21.15.112:0/2270604421 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24003900 con 0x7f9a300b43a0 2023-11-08T12:28:57.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.208+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3006b5d0 con 0x7f9a300b43a0 2023-11-08T12:28:57.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.212+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3006b2f0 con 0x7f9a300b43a0 2023-11-08T12:28:57.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.212+0000 7f9a17fff700 1 -- 172.21.15.112:0/2270604421 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9a2400f050 con 0x7f9a300b43a0 2023-11-08T12:28:57.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.212+0000 7f9a17fff700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9a1c064ee0 0x7f9a1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.216+0000 7f9a17fff700 1 -- 172.21.15.112:0/2270604421 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9a24020070 con 0x7f9a300b43a0 2023-11-08T12:28:57.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.216+0000 7f9a2f7fe700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9a1c064ee0 0x7f9a1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.216+0000 7f9a2f7fe700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9a1c064ee0 0x7f9a1c067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a300c88b0 tx=0x7f9a20009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:57.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.220+0000 7f9a17fff700 1 -- 172.21.15.112:0/2270604421 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9a24051690 con 0x7f9a300b43a0 2023-11-08T12:28:57.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.396+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a3015eb10 con 0x7f9a300b43a0 2023-11-08T12:28:57.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.400+0000 7f9a17fff700 1 -- 172.21.15.112:0/2270604421 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f9a24054cb0 con 0x7f9a300b43a0 2023-11-08T12:28:57.403 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:28:57.403 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:28:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9a1c064ee0 msgr2=0x7f9a1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9a1c064ee0 0x7f9a1c067390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a300c88b0 tx=0x7f9a20009240 comp rx=0 tx=0).stop 2023-11-08T12:28:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a300b43a0 msgr2=0x7f9a300c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a300b43a0 0x7f9a300c7d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a3006fe30 tx=0x7f9a24004770 comp rx=0 tx=0).stop 2023-11-08T12:28:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 shutdown_connections 2023-11-08T12:28:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9a1c064ee0 0x7f9a1c067390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a300c9040 0x7f9a300c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a300b43a0 0x7f9a300c7d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 --2- 172.21.15.112:0/2270604421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a300b1640 0x7f9a3015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 >> 172.21.15.112:0/2270604421 conn(0x7f9a300b0f80 msgr2=0x7f9a3006c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:57.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 shutdown_connections 2023-11-08T12:28:57.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.404+0000 7f9a34bd2700 1 -- 172.21.15.112:0/2270604421 wait complete. 2023-11-08T12:28:57.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:28:57.436 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:28:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.604+0000 7f1f36701700 1 Processor -- start 2023-11-08T12:28:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.604+0000 7f1f36701700 1 -- start start 2023-11-08T12:28:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f36701700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f300b4280 0x7f1f300aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f36701700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f3006ae10 0x7f1f300af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f36701700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3006c040 con 0x7f1f300adb20 2023-11-08T12:28:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f36701700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3015a920 con 0x7f1f300b4280 2023-11-08T12:28:57.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f36701700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3015eac0 con 0x7f1f3006ae10 2023-11-08T12:28:57.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f300b4280 0x7f1f300aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f300b4280 0x7f1f300aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44546/0 (socket says 172.21.15.112:44546) 2023-11-08T12:28:57.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 -- 172.21.15.112:0/1101336540 learned_addr learned my addr 172.21.15.112:0/1101336540 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:57.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f34c9e700 1 --2- 172.21.15.112:0/1101336540 >> v2:172.21.15.133:3300/0 conn(0x7f1f3006ae10 0x7f1f300af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 -- 172.21.15.112:0/1101336540 >> v2:172.21.15.133:3300/0 conn(0x7f1f3006ae10 msgr2=0x7f1f300af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 --2- 172.21.15.112:0/1101336540 >> v2:172.21.15.133:3300/0 conn(0x7f1f3006ae10 0x7f1f300af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 -- 172.21.15.112:0/1101336540 >> v1:172.21.15.133:6789/0 conn(0x7f1f300adb20 legacy=0x7f1f30069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 -- 172.21.15.112:0/1101336540 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3006d4e0 con 0x7f1f300b4280 2023-11-08T12:28:57.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2ffff700 1 --2- 172.21.15.112:0/1101336540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300b4280 0x7f1f300aef40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1f300ae760 tx=0x7f1f20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ee2943182e9a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.608+0000 7f1f2f7fe700 1 -- 172.21.15.112:0/1101336540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000b8a0 con 0x7f1f300b4280 2023-11-08T12:28:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f2f7fe700 1 -- 172.21.15.112:0/1101336540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2000ba00 con 0x7f1f300b4280 2023-11-08T12:28:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f2f7fe700 1 -- 172.21.15.112:0/1101336540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000bd90 con 0x7f1f300b4280 2023-11-08T12:28:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 -- 172.21.15.112:0/1101336540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300b4280 msgr2=0x7f1f300aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 --2- 172.21.15.112:0/1101336540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300b4280 0x7f1f300aef40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1f300ae760 tx=0x7f1f20009bf0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 -- 172.21.15.112:0/1101336540 shutdown_connections 2023-11-08T12:28:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 --2- 172.21.15.112:0/1101336540 >> v2:172.21.15.133:3300/0 conn(0x7f1f3006ae10 0x7f1f300af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 --2- 172.21.15.112:0/1101336540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f300b4280 0x7f1f300aef40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 -- 172.21.15.112:0/1101336540 >> 172.21.15.112:0/1101336540 conn(0x7f1f300cf580 msgr2=0x7f1f300cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:57.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 -- 172.21.15.112:0/1101336540 shutdown_connections 2023-11-08T12:28:57.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.612+0000 7f1f36701700 1 -- 172.21.15.112:0/1101336540 wait complete. 2023-11-08T12:28:57.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 Processor -- start 2023-11-08T12:28:57.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 -- start start 2023-11-08T12:28:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3006ae10 0x7f1f301575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f300adb20 0x7f1f30157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f300b4280 0x7f1f3015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300ac200 con 0x7f1f3006ae10 2023-11-08T12:28:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300ad1d0 con 0x7f1f300adb20 2023-11-08T12:28:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.616+0000 7f1f36701700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3015d870 con 0x7f1f300b4280 2023-11-08T12:28:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3006ae10 0x7f1f301575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3006ae10 0x7f1f301575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44558/0 (socket says 172.21.15.112:44558) 2023-11-08T12:28:57.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 -- 172.21.15.112:0/598235888 learned_addr learned my addr 172.21.15.112:0/598235888 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f277fe700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f300adb20 0x7f1f30157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f34c9e700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f300b4280 0x7f1f3015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 -- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f300b4280 msgr2=0x7f1f3015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f300b4280 0x7f1f3015cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 -- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f300adb20 msgr2=0x7f1f30157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f300adb20 0x7f1f30157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 -- 172.21.15.112:0/598235888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20009570 con 0x7f1f3006ae10 2023-11-08T12:28:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f277fe700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f300adb20 0x7f1f30157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:57.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2ffff700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3006ae10 0x7f1f301575e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f20000c00 tx=0x7f1f20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2d7fa700 1 -- 172.21.15.112:0/598235888 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200038c0 con 0x7f1f3006ae10 2023-11-08T12:28:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2d7fa700 1 -- 172.21.15.112:0/598235888 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2001e070 con 0x7f1f3006ae10 2023-11-08T12:28:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f2d7fa700 1 -- 172.21.15.112:0/598235888 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20003c80 con 0x7f1f3006ae10 2023-11-08T12:28:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3015ed60 con 0x7f1f3006ae10 2023-11-08T12:28:57.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f300b4650 con 0x7f1f3006ae10 2023-11-08T12:28:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.620+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f300b1350 con 0x7f1f3006ae10 2023-11-08T12:28:57.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.624+0000 7f1f2d7fa700 1 -- 172.21.15.112:0/598235888 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1f2000f050 con 0x7f1f3006ae10 2023-11-08T12:28:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.624+0000 7f1f2d7fa700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f10064ee0 0x7f1f10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.624+0000 7f1f2d7fa700 1 -- 172.21.15.112:0/598235888 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f20020070 con 0x7f1f3006ae10 2023-11-08T12:28:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.624+0000 7f1f277fe700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f10064ee0 0x7f1f10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:57.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.624+0000 7f1f277fe700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f10064ee0 0x7f1f10067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1f300c8620 tx=0x7f1f18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:57.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.628+0000 7f1f2d7fa700 1 -- 172.21.15.112:0/598235888 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1f200519b0 con 0x7f1f3006ae10 2023-11-08T12:28:57.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.800+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f300ac340 con 0x7f1f3006ae10 2023-11-08T12:28:57.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.800+0000 7f1f2d7fa700 1 -- 172.21.15.112:0/598235888 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f300ac340 con 0x7f1f3006ae10 2023-11-08T12:28:57.806 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:28:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f10064ee0 msgr2=0x7f1f10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f10064ee0 0x7f1f10067390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1f300c8620 tx=0x7f1f18009040 comp rx=0 tx=0).stop 2023-11-08T12:28:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3006ae10 msgr2=0x7f1f301575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3006ae10 0x7f1f301575e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f20000c00 tx=0x7f1f20004770 comp rx=0 tx=0).stop 2023-11-08T12:28:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 shutdown_connections 2023-11-08T12:28:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f10064ee0 0x7f1f10067390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f300b4280 0x7f1f3015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f300adb20 0x7f1f30157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 --2- 172.21.15.112:0/598235888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3006ae10 0x7f1f301575e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 >> 172.21.15.112:0/598235888 conn(0x7f1f300cf580 msgr2=0x7f1f30159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 shutdown_connections 2023-11-08T12:28:57.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:57.808+0000 7f1f36701700 1 -- 172.21.15.112:0/598235888 wait complete. 2023-11-08T12:28:57.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:28:58.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.008+0000 7ffb86d69700 1 Processor -- start 2023-11-08T12:28:58.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.008+0000 7ffb86d69700 1 -- start start 2023-11-08T12:28:58.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86d69700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb800cdc50 0x7ffb80069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86d69700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffb8006ff10 0x7ffb80070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86d69700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb800708b0 con 0x7ffb8015e190 2023-11-08T12:28:58.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86d69700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8015e560 con 0x7ffb8006ff10 2023-11-08T12:28:58.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86d69700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8006be80 con 0x7ffb800cdc50 2023-11-08T12:28:58.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffb8006ff10 0x7ffb80070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb85566700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb800cdc50 0x7ffb80069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffb8006ff10 0x7ffb80070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44568/0 (socket says 172.21.15.112:44568) 2023-11-08T12:28:58.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb85566700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb800cdc50 0x7ffb80069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38858/0 (socket says 172.21.15.112:38858) 2023-11-08T12:28:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 -- 172.21.15.112:0/889303530 learned_addr learned my addr 172.21.15.112:0/889303530 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 -- 172.21.15.112:0/889303530 >> v2:172.21.15.133:3300/0 conn(0x7ffb800cdc50 msgr2=0x7ffb80069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 --2- 172.21.15.112:0/889303530 >> v2:172.21.15.133:3300/0 conn(0x7ffb800cdc50 0x7ffb80069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 -- 172.21.15.112:0/889303530 >> v1:172.21.15.133:6789/0 conn(0x7ffb8015e190 legacy=0x7ffb80161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 -- 172.21.15.112:0/889303530 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800ce0a0 con 0x7ffb8006ff10 2023-11-08T12:28:58.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86568700 1 --2- 172.21.15.112:0/889303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb8006ff10 0x7ffb80070370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb800c55a0 tx=0x7ffb7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f699dc2e0442e4e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb84d65700 1 -- 172.21.15.112:0/889303530 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800e070 con 0x7ffb8006ff10 2023-11-08T12:28:58.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb84d65700 1 -- 172.21.15.112:0/889303530 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7800b910 con 0x7ffb8006ff10 2023-11-08T12:28:58.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb84d65700 1 -- 172.21.15.112:0/889303530 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800bcc0 con 0x7ffb8006ff10 2023-11-08T12:28:58.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86d69700 1 -- 172.21.15.112:0/889303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb8006ff10 msgr2=0x7ffb80070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.012+0000 7ffb86d69700 1 --2- 172.21.15.112:0/889303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb8006ff10 0x7ffb80070370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb800c55a0 tx=0x7ffb7800b330 comp rx=0 tx=0).stop 2023-11-08T12:28:58.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 -- 172.21.15.112:0/889303530 shutdown_connections 2023-11-08T12:28:58.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 --2- 172.21.15.112:0/889303530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb8006ff10 0x7ffb80070370 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 --2- 172.21.15.112:0/889303530 >> v2:172.21.15.133:3300/0 conn(0x7ffb800cdc50 0x7ffb80069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 -- 172.21.15.112:0/889303530 >> 172.21.15.112:0/889303530 conn(0x7ffb800cf280 msgr2=0x7ffb800cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:58.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 -- 172.21.15.112:0/889303530 shutdown_connections 2023-11-08T12:28:58.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 -- 172.21.15.112:0/889303530 wait complete. 2023-11-08T12:28:58.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 Processor -- start 2023-11-08T12:28:58.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.016+0000 7ffb86d69700 1 -- start start 2023-11-08T12:28:58.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb8006ff10 0x7ffb8015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb800cdc50 0x7ffb8015e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8015e190 0x7ffb8014a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015f1c0 con 0x7ffb800cdc50 2023-11-08T12:28:58.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c9bf0 con 0x7ffb8015e190 2023-11-08T12:28:58.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c9ed0 con 0x7ffb8006ff10 2023-11-08T12:28:58.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb800cdc50 0x7ffb8015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb800cdc50 0x7ffb8015e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44580/0 (socket says 172.21.15.112:44580) 2023-11-08T12:28:58.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 -- 172.21.15.112:0/3776945238 learned_addr learned my addr 172.21.15.112:0/3776945238 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:58.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86568700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8015e190 0x7ffb8014a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85d67700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb8006ff10 0x7ffb8015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 -- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb8006ff10 msgr2=0x7ffb8015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb8006ff10 0x7ffb8015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 -- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8015e190 msgr2=0x7ffb8014a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8015e190 0x7ffb8014a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 -- 172.21.15.112:0/3776945238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78009b30 con 0x7ffb800cdc50 2023-11-08T12:28:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86568700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8015e190 0x7ffb8014a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb85566700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb800cdc50 0x7ffb8015e700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000e9d0 tx=0x7ffb7000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb767fc700 1 -- 172.21.15.112:0/3776945238 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70009720 con 0x7ffb800cdc50 2023-11-08T12:28:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb767fc700 1 -- 172.21.15.112:0/3776945238 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000c850 con 0x7ffb800cdc50 2023-11-08T12:28:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb767fc700 1 -- 172.21.15.112:0/3776945238 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000cbc0 con 0x7ffb800cdc50 2023-11-08T12:28:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb800af990 con 0x7ffb800cdc50 2023-11-08T12:28:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb800ce330 con 0x7ffb800cdc50 2023-11-08T12:28:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.020+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb800afc70 con 0x7ffb800cdc50 2023-11-08T12:28:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.024+0000 7ffb767fc700 1 -- 172.21.15.112:0/3776945238 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ffb70019030 con 0x7ffb800cdc50 2023-11-08T12:28:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.024+0000 7ffb767fc700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ffb64064ee0 0x7ffb64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.024+0000 7ffb767fc700 1 -- 172.21.15.112:0/3776945238 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffb700822e0 con 0x7ffb800cdc50 2023-11-08T12:28:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.024+0000 7ffb85d67700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ffb64064ee0 0x7ffb64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.028+0000 7ffb85d67700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ffb64064ee0 0x7ffb64067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c001640 tx=0x7ffb7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.032+0000 7ffb767fc700 1 -- 172.21.15.112:0/3776945238 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ffb70050060 con 0x7ffb800cdc50 2023-11-08T12:28:58.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.204+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffb80073d20 con 0x7ffb800cdc50 2023-11-08T12:28:58.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb767fc700 1 -- 172.21.15.112:0/3776945238 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffb70053680 con 0x7ffb800cdc50 2023-11-08T12:28:58.210 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:28:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ffb64064ee0 msgr2=0x7ffb64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ffb64064ee0 0x7ffb64067390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c001640 tx=0x7ffb7c009040 comp rx=0 tx=0).stop 2023-11-08T12:28:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb800cdc50 msgr2=0x7ffb8015e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb800cdc50 0x7ffb8015e700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000e9d0 tx=0x7ffb7000ed90 comp rx=0 tx=0).stop 2023-11-08T12:28:58.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 shutdown_connections 2023-11-08T12:28:58.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ffb64064ee0 0x7ffb64067390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8015e190 0x7ffb8014a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb800cdc50 0x7ffb8015e700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 --2- 172.21.15.112:0/3776945238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb8006ff10 0x7ffb8015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 >> 172.21.15.112:0/3776945238 conn(0x7ffb800cf280 msgr2=0x7ffb80060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:58.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 shutdown_connections 2023-11-08T12:28:58.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.208+0000 7ffb86d69700 1 -- 172.21.15.112:0/3776945238 wait complete. 2023-11-08T12:28:58.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:28:58.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.404+0000 7f62f8a6d700 1 Processor -- start 2023-11-08T12:28:58.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.404+0000 7f62f8a6d700 1 -- start start 2023-11-08T12:28:58.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.404+0000 7f62f8a6d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f415c150 0x7f62f40b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.404+0000 7f62f8a6d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f4070360 0x7f62f4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f8a6d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f415c520 con 0x7f62f406ff10 2023-11-08T12:28:58.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f8a6d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40b4240 con 0x7f62f4070360 2023-11-08T12:28:58.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f8a6d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f406ac00 con 0x7f62f415c150 2023-11-08T12:28:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f4070360 0x7f62f4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f4070360 0x7f62f4160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38884/0 (socket says 172.21.15.112:38884) 2023-11-08T12:28:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 -- 172.21.15.112:0/2461288429 learned_addr learned my addr 172.21.15.112:0/2461288429 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f37fe700 1 --2- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f415c150 0x7f62f40b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 -- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f415c150 msgr2=0x7f62f40b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 --2- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f415c150 0x7f62f40b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 -- 172.21.15.112:0/2461288429 >> v1:172.21.15.133:6789/0 conn(0x7f62f406ff10 legacy=0x7f62f415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 -- 172.21.15.112:0/2461288429 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f406cc50 con 0x7f62f4070360 2023-11-08T12:28:58.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f3fff700 1 --2- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f4070360 0x7f62f4160340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009e50 tx=0x7f62ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d7ad57960ead9c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f27fc700 1 -- 172.21.15.112:0/2461288429 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00e070 con 0x7f62f4070360 2023-11-08T12:28:58.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f27fc700 1 -- 172.21.15.112:0/2461288429 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec00b910 con 0x7f62f4070360 2023-11-08T12:28:58.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f27fc700 1 -- 172.21.15.112:0/2461288429 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00bcc0 con 0x7f62f4070360 2023-11-08T12:28:58.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f8a6d700 1 -- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f4070360 msgr2=0x7f62f4160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f4070360 0x7f62f4160340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009e50 tx=0x7f62ec00b330 comp rx=0 tx=0).stop 2023-11-08T12:28:58.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f8a6d700 1 -- 172.21.15.112:0/2461288429 shutdown_connections 2023-11-08T12:28:58.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.408+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f4070360 0x7f62f4160340 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.412+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/2461288429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f415c150 0x7f62f40b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.412+0000 7f62f8a6d700 1 -- 172.21.15.112:0/2461288429 >> 172.21.15.112:0/2461288429 conn(0x7f62f40d3680 msgr2=0x7f62f40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:58.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.412+0000 7f62f8a6d700 1 -- 172.21.15.112:0/2461288429 shutdown_connections 2023-11-08T12:28:58.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.412+0000 7f62f8a6d700 1 -- 172.21.15.112:0/2461288429 wait complete. 2023-11-08T12:28:58.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.412+0000 7f62f8a6d700 1 Processor -- start 2023-11-08T12:28:58.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 -- start start 2023-11-08T12:28:58.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f406ff10 0x7f62f414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f4070360 0x7f62f40ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f415c150 0x7f62f40cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41503e0 con 0x7f62f415c150 2023-11-08T12:28:58.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40cd040 con 0x7f62f406ff10 2023-11-08T12:28:58.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40cd320 con 0x7f62f4070360 2023-11-08T12:28:58.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f415c150 0x7f62f40cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f406ff10 0x7f62f414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f415c150 0x7f62f40cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44590/0 (socket says 172.21.15.112:44590) 2023-11-08T12:28:58.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f406ff10 0x7f62f414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38892/0 (socket says 172.21.15.112:38892) 2023-11-08T12:28:58.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 -- 172.21.15.112:0/1700520950 learned_addr learned my addr 172.21.15.112:0/1700520950 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:58.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f2ffd700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f4070360 0x7f62f40ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 -- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f4070360 msgr2=0x7f62f40ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f4070360 0x7f62f40ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 -- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f406ff10 msgr2=0x7f62f414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f406ff10 0x7f62f414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 -- 172.21.15.112:0/1700520950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec009b30 con 0x7f62f415c150 2023-11-08T12:28:58.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f37fe700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f406ff10 0x7f62f414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:58.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f2ffd700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f4070360 0x7f62f40ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:28:58.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f3fff700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f415c150 0x7f62f40cbde0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f62f4073200 tx=0x7f62ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62dbfff700 1 -- 172.21.15.112:0/1700520950 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0048b0 con 0x7f62f415c150 2023-11-08T12:28:58.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62dbfff700 1 -- 172.21.15.112:0/1700520950 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec0099b0 con 0x7f62f415c150 2023-11-08T12:28:58.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40d2730 con 0x7f62f415c150 2023-11-08T12:28:58.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.416+0000 7f62dbfff700 1 -- 172.21.15.112:0/1700520950 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec01c680 con 0x7f62f415c150 2023-11-08T12:28:58.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.420+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40d2450 con 0x7f62f415c150 2023-11-08T12:28:58.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.420+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f40d05e0 con 0x7f62f415c150 2023-11-08T12:28:58.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.420+0000 7f62dbfff700 1 -- 172.21.15.112:0/1700520950 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f62ec02c070 con 0x7f62f415c150 2023-11-08T12:28:58.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.424+0000 7f62dbfff700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f62e0064ee0 0x7f62e0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.424+0000 7f62dbfff700 1 -- 172.21.15.112:0/1700520950 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f62ec083d30 con 0x7f62f415c150 2023-11-08T12:28:58.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.424+0000 7f62f37fe700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f62e0064ee0 0x7f62e0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.424+0000 7f62f37fe700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f62e0064ee0 0x7f62e0067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009f40 tx=0x7f62e4009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.428+0000 7f62dbfff700 1 -- 172.21.15.112:0/1700520950 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f62ec051ba0 con 0x7f62f415c150 2023-11-08T12:28:58.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.600+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62f4073d20 con 0x7f62f415c150 2023-11-08T12:28:58.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.604+0000 7f62dbfff700 1 -- 172.21.15.112:0/1700520950 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62ec0551c0 con 0x7f62f415c150 2023-11-08T12:28:58.606 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:58.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f62e0064ee0 msgr2=0x7f62e0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f62e0064ee0 0x7f62e0067390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009f40 tx=0x7f62e4009240 comp rx=0 tx=0).stop 2023-11-08T12:28:58.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f415c150 msgr2=0x7f62f40cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f415c150 0x7f62f40cbde0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f62f4073200 tx=0x7f62ec004af0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 shutdown_connections 2023-11-08T12:28:58.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f62e0064ee0 0x7f62e0067390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62f415c150 0x7f62f40cbde0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62f4070360 0x7f62f40ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 --2- 172.21.15.112:0/1700520950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f406ff10 0x7f62f414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 >> 172.21.15.112:0/1700520950 conn(0x7f62f40d3680 msgr2=0x7f62f40c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:58.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 shutdown_connections 2023-11-08T12:28:58.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.608+0000 7f62f8a6d700 1 -- 172.21.15.112:0/1700520950 wait complete. 2023-11-08T12:28:58.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:28:58.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.812+0000 7f5261c76700 1 Processor -- start 2023-11-08T12:28:58.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.812+0000 7f5261c76700 1 -- start start 2023-11-08T12:28:58.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.812+0000 7f5261c76700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f525c15c150 0x7f525c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.812+0000 7f5261c76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c070360 0x7f525c160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.812+0000 7f5261c76700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525c15c520 con 0x7f525c06ff10 2023-11-08T12:28:58.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.812+0000 7f5261c76700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c0b4240 con 0x7f525c15c150 2023-11-08T12:28:58.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.812+0000 7f5261c76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c06ac00 con 0x7f525c070360 2023-11-08T12:28:58.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5260c74700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f525c15c150 0x7f525c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f525bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f525c06ff10 0x7f525c15fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40742/0 (socket says 172.21.15.112:40742) 2023-11-08T12:28:58.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f525bfff700 1 -- 172.21.15.112:0/224704092 learned_addr learned my addr 172.21.15.112:0/224704092 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:58.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5261475700 1 --2- 172.21.15.112:0/224704092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c070360 0x7f525c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f525b7fe700 1 -- 172.21.15.112:0/224704092 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682333383 0 0) 0x7f525c15c520 con 0x7f525c06ff10 2023-11-08T12:28:58.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5260c74700 1 -- 172.21.15.112:0/224704092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c070360 msgr2=0x7f525c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:58.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5260c74700 1 --2- 172.21.15.112:0/224704092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c070360 0x7f525c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5260c74700 1 -- 172.21.15.112:0/224704092 >> v1:172.21.15.133:6789/0 conn(0x7f525c06ff10 legacy=0x7f525c15fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5260c74700 1 -- 172.21.15.112:0/224704092 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c06cc50 con 0x7f525c15c150 2023-11-08T12:28:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5260c74700 1 --2- 172.21.15.112:0/224704092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c0b3d00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5250009850 tx=0x7f5250009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b05e0a671b45d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f525b7fe700 1 -- 172.21.15.112:0/224704092 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250011830 con 0x7f525c15c150 2023-11-08T12:28:58.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f525b7fe700 1 -- 172.21.15.112:0/224704092 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250011990 con 0x7f525c15c150 2023-11-08T12:28:58.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f525b7fe700 1 -- 172.21.15.112:0/224704092 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250011d40 con 0x7f525c15c150 2023-11-08T12:28:58.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5261c76700 1 -- 172.21.15.112:0/224704092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 msgr2=0x7f525c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.816+0000 7f5261c76700 1 --2- 172.21.15.112:0/224704092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c0b3d00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5250009850 tx=0x7f5250009b60 comp rx=0 tx=0).stop 2023-11-08T12:28:58.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 -- 172.21.15.112:0/224704092 shutdown_connections 2023-11-08T12:28:58.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 --2- 172.21.15.112:0/224704092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c070360 0x7f525c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 --2- 172.21.15.112:0/224704092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c0b3d00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 -- 172.21.15.112:0/224704092 >> 172.21.15.112:0/224704092 conn(0x7f525c0d3680 msgr2=0x7f525c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:58.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 -- 172.21.15.112:0/224704092 shutdown_connections 2023-11-08T12:28:58.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 -- 172.21.15.112:0/224704092 wait complete. 2023-11-08T12:28:58.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 Processor -- start 2023-11-08T12:28:58.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.820+0000 7f5261c76700 1 -- start start 2023-11-08T12:28:58.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c06ff10 0x7f525c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f525c070360 0x7f525c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0cb970 con 0x7f525c15c150 2023-11-08T12:28:58.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0caa90 con 0x7f525c070360 2023-11-08T12:28:58.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0cad60 con 0x7f525c06ff10 2023-11-08T12:28:58.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44616/0 (socket says 172.21.15.112:44616) 2023-11-08T12:28:58.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 -- 172.21.15.112:0/2841103142 learned_addr learned my addr 172.21.15.112:0/2841103142 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5260c74700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c06ff10 0x7f525c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f525bfff700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f525c070360 0x7f525c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 -- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c06ff10 msgr2=0x7f525c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c06ff10 0x7f525c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 -- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f525c070360 msgr2=0x7f525c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f525c070360 0x7f525c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 -- 172.21.15.112:0/2841103142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500094b0 con 0x7f525c15c150 2023-11-08T12:28:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261475700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c15acc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f525400efc0 tx=0x7f525400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f52597fa700 1 -- 172.21.15.112:0/2841103142 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254009ea0 con 0x7f525c15c150 2023-11-08T12:28:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f52597fa700 1 -- 172.21.15.112:0/2841103142 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525400f040 con 0x7f525c15c150 2023-11-08T12:28:58.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f52597fa700 1 -- 172.21.15.112:0/2841103142 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254014480 con 0x7f525c15c150 2023-11-08T12:28:58.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c0d2730 con 0x7f525c15c150 2023-11-08T12:28:58.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.824+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c0d2450 con 0x7f525c15c150 2023-11-08T12:28:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.828+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c0d05e0 con 0x7f525c15c150 2023-11-08T12:28:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.828+0000 7f52597fa700 1 -- 172.21.15.112:0/2841103142 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f52540145e0 con 0x7f525c15c150 2023-11-08T12:28:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.828+0000 7f52597fa700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5240064ee0 0x7f5240067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.828+0000 7f52597fa700 1 -- 172.21.15.112:0/2841103142 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5254082ee0 con 0x7f525c15c150 2023-11-08T12:28:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.828+0000 7f5260c74700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5240064ee0 0x7f5240067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.832+0000 7f5260c74700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5240064ee0 0x7f5240067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52500090b0 tx=0x7f525001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:58.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:58.832+0000 7f52597fa700 1 -- 172.21.15.112:0/2841103142 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5254050d50 con 0x7f525c15c150 2023-11-08T12:28:59.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.004+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f525c073d20 con 0x7f525c15c150 2023-11-08T12:28:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.004+0000 7f52597fa700 1 -- 172.21.15.112:0/2841103142 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52540180a0 con 0x7f525c15c150 2023-11-08T12:28:59.009 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:28:59.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.008+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5240064ee0 msgr2=0x7f5240067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.008+0000 7f5261c76700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5240064ee0 0x7f5240067390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52500090b0 tx=0x7f525001c040 comp rx=0 tx=0).stop 2023-11-08T12:28:59.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.008+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 msgr2=0x7f525c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.008+0000 7f5261c76700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c15acc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f525400efc0 tx=0x7f525400c3a0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 shutdown_connections 2023-11-08T12:28:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5240064ee0 0x7f5240067390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f525c15c150 0x7f525c15acc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f525c070360 0x7f525c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 --2- 172.21.15.112:0/2841103142 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f525c06ff10 0x7f525c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 >> 172.21.15.112:0/2841103142 conn(0x7f525c0d3680 msgr2=0x7f525c0cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:59.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 shutdown_connections 2023-11-08T12:28:59.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.012+0000 7f5261c76700 1 -- 172.21.15.112:0/2841103142 wait complete. 2023-11-08T12:28:59.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:28:59.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.216+0000 7fe79759e700 1 Processor -- start 2023-11-08T12:28:59.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.216+0000 7fe79759e700 1 -- start start 2023-11-08T12:28:59.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe798070620 0x7fe7980cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe798069e00 con 0x7fe7981585b0 2023-11-08T12:28:59.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79806a0e0 con 0x7fe7980c8bb0 2023-11-08T12:28:59.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7980cd0b0 con 0x7fe798070620 2023-11-08T12:28:59.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe7981585b0 0x7fe7980cb780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35114/0 (socket says 172.21.15.112:35114) 2023-11-08T12:28:59.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79659c700 1 -- 172.21.15.112:0/4062188327 learned_addr learned my addr 172.21.15.112:0/4062188327 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:59.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe796d9d700 1 --2- 172.21.15.112:0/4062188327 >> v2:172.21.15.133:3300/0 conn(0x7fe798070620 0x7fe7980cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267236155 0 0) 0x7fe798069e00 con 0x7fe7981585b0 2023-11-08T12:28:59.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7800035d0 con 0x7fe7981585b0 2023-11-08T12:28:59.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2983421377 0 0) 0x7fe7800035d0 con 0x7fe7981585b0 2023-11-08T12:28:59.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 >> v2:172.21.15.133:3300/0 conn(0x7fe798070620 msgr2=0x7fe7980cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:59.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 --2- 172.21.15.112:0/4062188327 >> v2:172.21.15.133:3300/0 conn(0x7fe798070620 0x7fe7980cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 >> v1:172.21.15.133:6789/0 conn(0x7fe7980c8bb0 legacy=0x7fe79806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79806a3c0 con 0x7fe7981585b0 2023-11-08T12:28:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fe788001670 con 0x7fe7981585b0 2023-11-08T12:28:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 >> v1:172.21.15.112:6789/0 conn(0x7fe7981585b0 legacy=0x7fe7980cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780003a20 0x7fe780003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe780004870 0x7fe780004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe780005420 0x7fe78000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980cd0b0 con 0x7fe780004870 2023-11-08T12:28:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78000c2a0 con 0x7fe780005420 2023-11-08T12:28:59.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78000c460 con 0x7fe780003a20 2023-11-08T12:28:59.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe795d9b700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe780004870 0x7fe780004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe79659c700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780003a20 0x7fe780003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.220+0000 7fe796d9d700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe780005420 0x7fe78000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe795d9b700 1 -- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780003a20 msgr2=0x7fe780003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:59.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe795d9b700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780003a20 0x7fe780003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe795d9b700 1 -- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe780005420 msgr2=0x7fe78000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:59.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe795d9b700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe780005420 0x7fe78000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe795d9b700 1 -- 172.21.15.112:0/4062188327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800035d0 con 0x7fe780004870 2023-11-08T12:28:59.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79659c700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780003a20 0x7fe780003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:59.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe796d9d700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe780005420 0x7fe78000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:59.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe796d9d700 1 -- 172.21.15.112:0/4062188327 reap_dead start 2023-11-08T12:28:59.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe795d9b700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe780004870 0x7fe780004ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0017e0 tx=0x7fe7800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2a83faa3d6bae6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:59.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0052d0 con 0x7fe780004870 2023-11-08T12:28:59.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c005450 con 0x7fe780004870 2023-11-08T12:28:59.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79559a700 1 -- 172.21.15.112:0/4062188327 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0038e0 con 0x7fe780004870 2023-11-08T12:28:59.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79759e700 1 -- 172.21.15.112:0/4062188327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe780004870 msgr2=0x7fe780004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79759e700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe780004870 0x7fe780004ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0017e0 tx=0x7fe7800058a0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79759e700 1 -- 172.21.15.112:0/4062188327 shutdown_connections 2023-11-08T12:28:59.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79759e700 1 --2- 172.21.15.112:0/4062188327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe780004870 0x7fe780004ce0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79759e700 1 -- 172.21.15.112:0/4062188327 >> 172.21.15.112:0/4062188327 conn(0x7fe7980cf280 msgr2=0x7fe7980cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:59.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79759e700 1 -- 172.21.15.112:0/4062188327 shutdown_connections 2023-11-08T12:28:59.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.224+0000 7fe79759e700 1 -- 172.21.15.112:0/4062188327 wait complete. 2023-11-08T12:28:59.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 Processor -- start 2023-11-08T12:28:59.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 -- start start 2023-11-08T12:28:59.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780004870 0x7fe798155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7981675e0 0x7fe7980c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7980c3ae0 0x7fe798139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798138740 con 0x7fe7980c3ae0 2023-11-08T12:28:59.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798167b80 con 0x7fe7981675e0 2023-11-08T12:28:59.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe798167e60 con 0x7fe780004870 2023-11-08T12:28:59.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7980c3ae0 0x7fe798139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7980c3ae0 0x7fe798139190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44642/0 (socket says 172.21.15.112:44642) 2023-11-08T12:28:59.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 -- 172.21.15.112:0/3328713128 learned_addr learned my addr 172.21.15.112:0/3328713128 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:59.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe79659c700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780004870 0x7fe798155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe795d9b700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7981675e0 0x7fe7980c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 -- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780004870 msgr2=0x7fe798155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780004870 0x7fe798155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 -- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7981675e0 msgr2=0x7fe7980c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7981675e0 0x7fe7980c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.228+0000 7fe796d9d700 1 -- 172.21.15.112:0/3328713128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980c9010 con 0x7fe7980c3ae0 2023-11-08T12:28:59.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.232+0000 7fe796d9d700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7980c3ae0 0x7fe798139190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe79806bbd0 tx=0x7fe790007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:59.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.232+0000 7fe786ffd700 1 -- 172.21.15.112:0/3328713128 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790007ca0 con 0x7fe7980c3ae0 2023-11-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.232+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79806a6a0 con 0x7fe7980c3ae0 2023-11-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.232+0000 7fe786ffd700 1 -- 172.21.15.112:0/3328713128 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe790007e00 con 0x7fe7980c3ae0 2023-11-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.232+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe798158980 con 0x7fe7980c3ae0 2023-11-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.232+0000 7fe786ffd700 1 -- 172.21.15.112:0/3328713128 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790015620 con 0x7fe7980c3ae0 2023-11-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.232+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79806d2c0 con 0x7fe7980c3ae0 2023-11-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.236+0000 7fe786ffd700 1 -- 172.21.15.112:0/3328713128 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe790015780 con 0x7fe7980c3ae0 2023-11-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.236+0000 7fe786ffd700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe778064f10 0x7fe7780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.236+0000 7fe786ffd700 1 -- 172.21.15.112:0/3328713128 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe7900829b0 con 0x7fe7980c3ae0 2023-11-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.236+0000 7fe79659c700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe778064f10 0x7fe7780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.236+0000 7fe79659c700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe778064f10 0x7fe7780673c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe788001200 tx=0x7fe788009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.240+0000 7fe786ffd700 1 -- 172.21.15.112:0/3328713128 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe7900507a0 con 0x7fe7980c3ae0 2023-11-08T12:28:59.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.416+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe798073d20 con 0x7fe7980c3ae0 2023-11-08T12:28:59.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.416+0000 7fe786ffd700 1 -- 172.21.15.112:0/3328713128 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe790053dc0 con 0x7fe7980c3ae0 2023-11-08T12:28:59.420 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:28:59.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe778064f10 msgr2=0x7fe7780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe778064f10 0x7fe7780673c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe788001200 tx=0x7fe788009040 comp rx=0 tx=0).stop 2023-11-08T12:28:59.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7980c3ae0 msgr2=0x7fe798139190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7980c3ae0 0x7fe798139190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe79806bbd0 tx=0x7fe790007610 comp rx=0 tx=0).stop 2023-11-08T12:28:59.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 shutdown_connections 2023-11-08T12:28:59.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe778064f10 0x7fe7780673c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7980c3ae0 0x7fe798139190 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7981675e0 0x7fe7980c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 --2- 172.21.15.112:0/3328713128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe780004870 0x7fe798155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 >> 172.21.15.112:0/3328713128 conn(0x7fe7980cf280 msgr2=0x7fe7980b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:59.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 shutdown_connections 2023-11-08T12:28:59.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.420+0000 7fe79759e700 1 -- 172.21.15.112:0/3328713128 wait complete. 2023-11-08T12:28:59.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:28:59.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.628+0000 7f3531a0a700 1 Processor -- start 2023-11-08T12:28:59.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.628+0000 7f3531a0a700 1 -- start start 2023-11-08T12:28:59.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f3531a0a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f352c160710 0x7f352c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f3531a0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f3531a0a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0ad6c0 con 0x7f352c0cc860 2023-11-08T12:28:59.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f3531a0a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c06b1c0 con 0x7f352c160710 2023-11-08T12:28:59.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f3531a0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0adc60 con 0x7f352c070790 2023-11-08T12:28:59.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f3523fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f352c0cc860 0x7f352c070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35116/0 (socket says 172.21.15.112:35116) 2023-11-08T12:28:59.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f3523fff700 1 -- 172.21.15.112:0/2983920400 learned_addr learned my addr 172.21.15.112:0/2983920400 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:28:59.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352b7fe700 1 --2- 172.21.15.112:0/2983920400 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352affd700 1 --2- 172.21.15.112:0/2983920400 >> v2:172.21.15.133:3300/0 conn(0x7f352c160710 0x7f352c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352a7fc700 1 -- 172.21.15.112:0/2983920400 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609854573 0 0) 0x7f352c0ad6c0 con 0x7f352c0cc860 2023-11-08T12:28:59.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352a7fc700 1 -- 172.21.15.112:0/2983920400 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35180035d0 con 0x7f352c0cc860 2023-11-08T12:28:59.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352b7fe700 1 -- 172.21.15.112:0/2983920400 >> v2:172.21.15.133:3300/0 conn(0x7f352c160710 msgr2=0x7f352c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:28:59.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352b7fe700 1 --2- 172.21.15.112:0/2983920400 >> v2:172.21.15.133:3300/0 conn(0x7f352c160710 0x7f352c0cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352b7fe700 1 -- 172.21.15.112:0/2983920400 >> v1:172.21.15.112:6789/0 conn(0x7f352c0cc860 legacy=0x7f352c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352b7fe700 1 -- 172.21.15.112:0/2983920400 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c06b3d0 con 0x7f352c070790 2023-11-08T12:28:59.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352affd700 1 --2- 172.21.15.112:0/2983920400 >> v2:172.21.15.133:3300/0 conn(0x7f352c160710 0x7f352c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:28:59.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352b7fe700 1 --2- 172.21.15.112:0/2983920400 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c164250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3524009d90 tx=0x7f352400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d56ea8cd52615f52 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:59.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352a7fc700 1 -- 172.21.15.112:0/2983920400 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400e070 con 0x7f352c070790 2023-11-08T12:28:59.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352a7fc700 1 -- 172.21.15.112:0/2983920400 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400bb20 con 0x7f352c070790 2023-11-08T12:28:59.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.632+0000 7f352a7fc700 1 -- 172.21.15.112:0/2983920400 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524012430 con 0x7f352c070790 2023-11-08T12:28:59.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 -- 172.21.15.112:0/2983920400 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 msgr2=0x7f352c164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 --2- 172.21.15.112:0/2983920400 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c164250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3524009d90 tx=0x7f352400b330 comp rx=0 tx=0).stop 2023-11-08T12:28:59.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 -- 172.21.15.112:0/2983920400 shutdown_connections 2023-11-08T12:28:59.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 --2- 172.21.15.112:0/2983920400 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c164250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 --2- 172.21.15.112:0/2983920400 >> v2:172.21.15.133:3300/0 conn(0x7f352c160710 0x7f352c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 -- 172.21.15.112:0/2983920400 >> 172.21.15.112:0/2983920400 conn(0x7f352c0b0f80 msgr2=0x7f352c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:59.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 -- 172.21.15.112:0/2983920400 shutdown_connections 2023-11-08T12:28:59.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 -- 172.21.15.112:0/2983920400 wait complete. 2023-11-08T12:28:59.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 Processor -- start 2023-11-08T12:28:59.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.636+0000 7f3531a0a700 1 -- start start 2023-11-08T12:28:59.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f352c0cc860 0x7f352c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f352c160710 0x7f352c0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0b34a0 con 0x7f352c0cc860 2023-11-08T12:28:59.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0b3740 con 0x7f352c160710 2023-11-08T12:28:59.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0b3a20 con 0x7f352c070790 2023-11-08T12:28:59.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f352c0cc860 0x7f352c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f352c0cc860 0x7f352c15d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44648/0 (socket says 172.21.15.112:44648) 2023-11-08T12:28:59.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 -- 172.21.15.112:0/1659163266 learned_addr learned my addr 172.21.15.112:0/1659163266 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:28:59.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f352b7fe700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f352c160710 0x7f352c0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f352affd700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 -- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 msgr2=0x7f352c15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 -- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f352c160710 msgr2=0x7f352c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f352c160710 0x7f352c0c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 -- 172.21.15.112:0/1659163266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c0094b0 con 0x7f352c0cc860 2023-11-08T12:28:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3523fff700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f352c0cc860 0x7f352c15d4d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f351400c700 tx=0x7f351400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3528ff9700 1 -- 172.21.15.112:0/1659163266 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514005d90 con 0x7f352c0cc860 2023-11-08T12:28:59.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3528ff9700 1 -- 172.21.15.112:0/1659163266 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35140070d0 con 0x7f352c0cc860 2023-11-08T12:28:59.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3528ff9700 1 -- 172.21.15.112:0/1659163266 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514007480 con 0x7f352c0cc860 2023-11-08T12:28:59.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3524009a70 con 0x7f352c0cc860 2023-11-08T12:28:59.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.640+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c0ad8f0 con 0x7f352c0cc860 2023-11-08T12:28:59.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.644+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c06b6b0 con 0x7f352c0cc860 2023-11-08T12:28:59.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.644+0000 7f3528ff9700 1 -- 172.21.15.112:0/1659163266 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3514019030 con 0x7f352c0cc860 2023-11-08T12:28:59.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.648+0000 7f3528ff9700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f350c064ee0 0x7f350c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:28:59.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.648+0000 7f3528ff9700 1 -- 172.21.15.112:0/1659163266 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3514081620 con 0x7f352c0cc860 2023-11-08T12:28:59.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.648+0000 7f352affd700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f350c064ee0 0x7f350c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:28:59.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.648+0000 7f352affd700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f350c064ee0 0x7f350c067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f352c0af570 tx=0x7f351c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:28:59.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.652+0000 7f3528ff9700 1 -- 172.21.15.112:0/1659163266 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f351404f320 con 0x7f352c0cc860 2023-11-08T12:28:59.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.840+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f352c160ae0 con 0x7f352c0cc860 2023-11-08T12:28:59.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.840+0000 7f3528ff9700 1 -- 172.21.15.112:0/1659163266 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3514017080 con 0x7f352c0cc860 2023-11-08T12:28:59.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f350c064ee0 msgr2=0x7f350c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f350c064ee0 0x7f350c067390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f352c0af570 tx=0x7f351c009240 comp rx=0 tx=0).stop 2023-11-08T12:28:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f352c0cc860 msgr2=0x7f352c15d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:28:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f352c0cc860 0x7f352c15d4d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f351400c700 tx=0x7f351400ca10 comp rx=0 tx=0).stop 2023-11-08T12:28:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 shutdown_connections 2023-11-08T12:28:59.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f350c064ee0 0x7f350c067390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f352c160710 0x7f352c0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f352c0cc860 0x7f352c15d4d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 --2- 172.21.15.112:0/1659163266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f352c070790 0x7f352c15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:28:59.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 >> 172.21.15.112:0/1659163266 conn(0x7f352c0b0f80 msgr2=0x7f352c0aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:28:59.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 shutdown_connections 2023-11-08T12:28:59.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:28:59.844+0000 7f3531a0a700 1 -- 172.21.15.112:0/1659163266 wait complete. 2023-11-08T12:28:59.849 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:28:59.871 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-08T12:28:59.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:59.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-08T12:28:59.913 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:28:59.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:28:59.913 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-08T12:28:59.972 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:28:59.973 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:28:59.991 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:28:59.992 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:00.055 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:29:00.055 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:00.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:00.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.292+0000 7f98e3e37700 1 Processor -- start 2023-11-08T12:29:00.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.292+0000 7f98e3e37700 1 -- start start 2023-11-08T12:29:00.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.292+0000 7f98e3e37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98dc0b60e0 0x7f98dc15e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccb50 0x7f98dc0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98dc0ccf80 0x7f98dc0b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0ce5e0 con 0x7f98dc0ccf80 2023-11-08T12:29:00.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0d07d0 con 0x7f98dc0b60e0 2023-11-08T12:29:00.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0b64b0 con 0x7f98dc0ccb50 2023-11-08T12:29:00.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e23d4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98dc0ccf80 0x7f98dc0b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98dc0b60e0 0x7f98dc15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98dc0b60e0 0x7f98dc15e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38958/0 (socket says 172.21.15.112:38958) 2023-11-08T12:29:00.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 -- 172.21.15.112:0/3500034261 learned_addr learned my addr 172.21.15.112:0/3500034261 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:00.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e13d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccb50 0x7f98dc0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 -- 172.21.15.112:0/3500034261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccb50 msgr2=0x7f98dc0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:00.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 --2- 172.21.15.112:0/3500034261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccb50 0x7f98dc0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 -- 172.21.15.112:0/3500034261 >> v2:172.21.15.112:3300/0 conn(0x7f98dc0ccf80 msgr2=0x7f98dc0b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:00.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 --2- 172.21.15.112:0/3500034261 >> v2:172.21.15.112:3300/0 conn(0x7f98dc0ccf80 0x7f98dc0b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 -- 172.21.15.112:0/3500034261 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc15ed60 con 0x7f98dc0b60e0 2023-11-08T12:29:00.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e23d4700 1 --2- 172.21.15.112:0/3500034261 >> v2:172.21.15.112:3300/0 conn(0x7f98dc0ccf80 0x7f98dc0b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e1bd3700 1 --2- 172.21.15.112:0/3500034261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0b60e0 0x7f98dc15e820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0ce590 tx=0x7f98d8009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28294698bb0f1e13 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:00.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e0bd1700 1 -- 172.21.15.112:0/3500034261 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8011830 con 0x7f98dc0b60e0 2023-11-08T12:29:00.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e0bd1700 1 -- 172.21.15.112:0/3500034261 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d8011990 con 0x7f98dc0b60e0 2023-11-08T12:29:00.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e0bd1700 1 -- 172.21.15.112:0/3500034261 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8011d20 con 0x7f98dc0b60e0 2023-11-08T12:29:00.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 -- 172.21.15.112:0/3500034261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0b60e0 msgr2=0x7f98dc15e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 --2- 172.21.15.112:0/3500034261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0b60e0 0x7f98dc15e820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0ce590 tx=0x7f98d8009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 -- 172.21.15.112:0/3500034261 shutdown_connections 2023-11-08T12:29:00.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 --2- 172.21.15.112:0/3500034261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccb50 0x7f98dc0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 --2- 172.21.15.112:0/3500034261 >> v2:172.21.15.112:3300/0 conn(0x7f98dc0ccf80 0x7f98dc0b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 --2- 172.21.15.112:0/3500034261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0b60e0 0x7f98dc15e820 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.296+0000 7f98e3e37700 1 -- 172.21.15.112:0/3500034261 >> 172.21.15.112:0/3500034261 conn(0x7f98dc069bf0 msgr2=0x7f98dc069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.300+0000 7f98e3e37700 1 -- 172.21.15.112:0/3500034261 shutdown_connections 2023-11-08T12:29:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.300+0000 7f98e3e37700 1 -- 172.21.15.112:0/3500034261 wait complete. 2023-11-08T12:29:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.300+0000 7f98e3e37700 1 Processor -- start 2023-11-08T12:29:00.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.300+0000 7f98e3e37700 1 -- start start 2023-11-08T12:29:00.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.300+0000 7f98e3e37700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98dc0b60e0 0x7f98dc1f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.300+0000 7f98e3e37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0ccb50 0x7f98dc157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.300+0000 7f98e3e37700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccf80 0x7f98dc0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e3e37700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc1f6210 con 0x7f98dc0b60e0 2023-11-08T12:29:00.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e3e37700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc1584d0 con 0x7f98dc0ccb50 2023-11-08T12:29:00.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e3e37700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c7fc0 con 0x7f98dc0ccf80 2023-11-08T12:29:00.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98dc0b60e0 0x7f98dc1f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98dc0b60e0 0x7f98dc1f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44668/0 (socket says 172.21.15.112:44668) 2023-11-08T12:29:00.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 -- 172.21.15.112:0/450421924 learned_addr learned my addr 172.21.15.112:0/450421924 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:00.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e23d4700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccf80 0x7f98dc0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e13d2700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0ccb50 0x7f98dc157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 -- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccf80 msgr2=0x7f98dc0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccf80 0x7f98dc0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 -- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0ccb50 msgr2=0x7f98dc157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0ccb50 0x7f98dc157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 -- 172.21.15.112:0/450421924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009a70 con 0x7f98dc0b60e0 2023-11-08T12:29:00.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e23d4700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccf80 0x7f98dc0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:00.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e13d2700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0ccb50 0x7f98dc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:00.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e1bd3700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98dc0b60e0 0x7f98dc1f5cd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f98dc071f00 tx=0x7f98d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:00.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98d27fc700 1 -- 172.21.15.112:0/450421924 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d80044d0 con 0x7f98dc0b60e0 2023-11-08T12:29:00.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98d27fc700 1 -- 172.21.15.112:0/450421924 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d801f070 con 0x7f98dc0b60e0 2023-11-08T12:29:00.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98d27fc700 1 -- 172.21.15.112:0/450421924 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8003900 con 0x7f98dc0b60e0 2023-11-08T12:29:00.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d8009570 con 0x7f98dc0b60e0 2023-11-08T12:29:00.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.304+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc0cb200 con 0x7f98dc0b60e0 2023-11-08T12:29:00.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.308+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc0d04f0 con 0x7f98dc0b60e0 2023-11-08T12:29:00.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.308+0000 7f98d27fc700 1 -- 172.21.15.112:0/450421924 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f98d800f050 con 0x7f98dc0b60e0 2023-11-08T12:29:00.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.308+0000 7f98d27fc700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98c0064ee0 0x7f98c0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.308+0000 7f98d27fc700 1 -- 172.21.15.112:0/450421924 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f98d8021070 con 0x7f98dc0b60e0 2023-11-08T12:29:00.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.308+0000 7f98e13d2700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98c0064ee0 0x7f98c0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.312+0000 7f98e13d2700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98c0064ee0 0x7f98c0067390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0b17a0 tx=0x7f98cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:00.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.312+0000 7f98d27fc700 1 -- 172.21.15.112:0/450421924 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f98d8051340 con 0x7f98dc0b60e0 2023-11-08T12:29:00.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.484+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98dc0cb4e0 con 0x7f98dc0b60e0 2023-11-08T12:29:00.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98d27fc700 1 -- 172.21.15.112:0/450421924 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f98d8054960 con 0x7f98dc0b60e0 2023-11-08T12:29:00.491 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:00.491 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:00.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98c0064ee0 msgr2=0x7f98c0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98c0064ee0 0x7f98c0067390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0b17a0 tx=0x7f98cc008040 comp rx=0 tx=0).stop 2023-11-08T12:29:00.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98dc0b60e0 msgr2=0x7f98dc1f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98dc0b60e0 0x7f98dc1f5cd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f98dc071f00 tx=0x7f98d8004770 comp rx=0 tx=0).stop 2023-11-08T12:29:00.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 shutdown_connections 2023-11-08T12:29:00.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98c0064ee0 0x7f98c0067390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98dc0ccf80 0x7f98dc0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98dc0ccb50 0x7f98dc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 --2- 172.21.15.112:0/450421924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98dc0b60e0 0x7f98dc1f5cd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.488+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 >> 172.21.15.112:0/450421924 conn(0x7f98dc069bf0 msgr2=0x7f98dc0b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.492+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 shutdown_connections 2023-11-08T12:29:00.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.492+0000 7f98e3e37700 1 -- 172.21.15.112:0/450421924 wait complete. 2023-11-08T12:29:00.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:29:00.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:29:00.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.700+0000 7fb9fd812700 1 Processor -- start 2023-11-08T12:29:00.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.700+0000 7fb9fd812700 1 -- start start 2023-11-08T12:29:00.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fd812700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9f8070620 0x7fb9f80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fd812700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f815c520 con 0x7fb9f815c150 2023-11-08T12:29:00.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fd812700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f806cc50 con 0x7fb9f8069bf0 2023-11-08T12:29:00.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fd812700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80b4240 con 0x7fb9f8070620 2023-11-08T12:29:00.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fc810700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb9f815c150 0x7fb9f806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35122/0 (socket says 172.21.15.112:35122) 2023-11-08T12:29:00.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fc810700 1 -- 172.21.15.112:0/3511079901 learned_addr learned my addr 172.21.15.112:0/3511079901 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:00.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f7fff700 1 --2- 172.21.15.112:0/3511079901 >> v2:172.21.15.133:3300/0 conn(0x7fb9f8070620 0x7fb9f80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597601158 0 0) 0x7fb9f815c520 con 0x7fb9f815c150 2023-11-08T12:29:00.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e80035d0 con 0x7fb9f815c150 2023-11-08T12:29:00.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547742496 0 0) 0x7fb9e80035d0 con 0x7fb9f815c150 2023-11-08T12:29:00.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 >> v2:172.21.15.133:3300/0 conn(0x7fb9f8070620 msgr2=0x7fb9f80b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:00.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 --2- 172.21.15.112:0/3511079901 >> v2:172.21.15.133:3300/0 conn(0x7fb9f8070620 0x7fb9f80b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 >> v1:172.21.15.133:6789/0 conn(0x7fb9f8069bf0 legacy=0x7fb9f8069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80d2450 con 0x7fb9f815c150 2023-11-08T12:29:00.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fb9ec001670 con 0x7fb9f815c150 2023-11-08T12:29:00.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 >> v1:172.21.15.112:6789/0 conn(0x7fb9f815c150 legacy=0x7fb9f806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e8003a20 0x7fb9e8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8004870 0x7fb9e8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e8005220 0x7fb9e800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80b4240 con 0x7fb9e8005220 2023-11-08T12:29:00.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e800c0a0 con 0x7fb9e8004870 2023-11-08T12:29:00.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e800c260 con 0x7fb9e8003a20 2023-11-08T12:29:00.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fd011700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e8005220 0x7fb9e800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9fc810700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e8003a20 0x7fb9e8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.704+0000 7fb9f7fff700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8004870 0x7fb9e8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd011700 1 -- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e8003a20 msgr2=0x7fb9e8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:00.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd011700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9e8003a20 0x7fb9e8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd011700 1 -- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8004870 msgr2=0x7fb9e8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:00.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd011700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8004870 0x7fb9e8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd011700 1 -- 172.21.15.112:0/3511079901 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80035d0 con 0x7fb9e8005220 2023-11-08T12:29:00.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd011700 1 -- 172.21.15.112:0/3511079901 reap_dead start 2023-11-08T12:29:00.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd011700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e8005220 0x7fb9e800ba30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c190 tx=0x7fb9e80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1989b2fb5864cb0c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:00.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0001db0 con 0x7fb9e8005220 2023-11-08T12:29:00.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f000ccf0 con 0x7fb9e8005220 2023-11-08T12:29:00.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9f77fe700 1 -- 172.21.15.112:0/3511079901 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0003c60 con 0x7fb9e8005220 2023-11-08T12:29:00.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd812700 1 -- 172.21.15.112:0/3511079901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e8005220 msgr2=0x7fb9e800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd812700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e8005220 0x7fb9e800ba30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c190 tx=0x7fb9e80058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd812700 1 -- 172.21.15.112:0/3511079901 shutdown_connections 2023-11-08T12:29:00.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd812700 1 --2- 172.21.15.112:0/3511079901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e8005220 0x7fb9e800ba30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd812700 1 -- 172.21.15.112:0/3511079901 >> 172.21.15.112:0/3511079901 conn(0x7fb9f80d3680 msgr2=0x7fb9f80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:00.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd812700 1 -- 172.21.15.112:0/3511079901 shutdown_connections 2023-11-08T12:29:00.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.708+0000 7fb9fd812700 1 -- 172.21.15.112:0/3511079901 wait complete. 2023-11-08T12:29:00.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.712+0000 7fb9fd812700 1 Processor -- start 2023-11-08T12:29:00.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.712+0000 7fb9fd812700 1 -- start start 2023-11-08T12:29:00.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.712+0000 7fb9fd812700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8005220 0x7fb9f80cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9f8150d00 0x7fb9f81511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f80cfa00 0x7fb9f8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80ce460 con 0x7fb9f80cfa00 2023-11-08T12:29:00.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80ce700 con 0x7fb9e8005220 2023-11-08T12:29:00.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80ce9e0 con 0x7fb9f8150d00 2023-11-08T12:29:00.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f80cfa00 0x7fb9f8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f80cfa00 0x7fb9f8151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44688/0 (socket says 172.21.15.112:44688) 2023-11-08T12:29:00.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 -- 172.21.15.112:0/674263559 learned_addr learned my addr 172.21.15.112:0/674263559 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:00.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fc810700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8005220 0x7fb9f80cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9f7fff700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9f8150d00 0x7fb9f81511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 -- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9f8150d00 msgr2=0x7fb9f81511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9f8150d00 0x7fb9f81511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 -- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8005220 msgr2=0x7fb9f80cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8005220 0x7fb9f80cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 -- 172.21.15.112:0/674263559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80d05e0 con 0x7fb9f80cfa00 2023-11-08T12:29:00.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd011700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f80cfa00 0x7fb9f8151720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8160cd0 tx=0x7fb9f00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:00.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9f57fa700 1 -- 172.21.15.112:0/674263559 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0005070 con 0x7fb9f80cfa00 2023-11-08T12:29:00.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9f57fa700 1 -- 172.21.15.112:0/674263559 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f00051d0 con 0x7fb9f80cfa00 2023-11-08T12:29:00.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9f57fa700 1 -- 172.21.15.112:0/674263559 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0005560 con 0x7fb9f80cfa00 2023-11-08T12:29:00.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f80d2730 con 0x7fb9f80cfa00 2023-11-08T12:29:00.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f80d2140 con 0x7fb9f80cfa00 2023-11-08T12:29:00.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.716+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f8073d20 con 0x7fb9f80cfa00 2023-11-08T12:29:00.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.720+0000 7fb9f57fa700 1 -- 172.21.15.112:0/674263559 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb9f0019040 con 0x7fb9f80cfa00 2023-11-08T12:29:00.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.720+0000 7fb9f57fa700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb9dc064ee0 0x7fb9dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:00.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.720+0000 7fb9f57fa700 1 -- 172.21.15.112:0/674263559 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb9f00834e0 con 0x7fb9f80cfa00 2023-11-08T12:29:00.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.720+0000 7fb9fc810700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb9dc064ee0 0x7fb9dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:00.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.720+0000 7fb9fc810700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb9dc064ee0 0x7fb9dc067390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000c00 tx=0x7fb9ec000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:00.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.728+0000 7fb9f57fa700 1 -- 172.21.15.112:0/674263559 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb9f0051200 con 0x7fb9f80cfa00 2023-11-08T12:29:00.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.900+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9f80cff00 con 0x7fb9f80cfa00 2023-11-08T12:29:00.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.900+0000 7fb9f57fa700 1 -- 172.21.15.112:0/674263559 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9f0054820 con 0x7fb9f80cfa00 2023-11-08T12:29:00.904 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:29:00.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb9dc064ee0 msgr2=0x7fb9dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb9dc064ee0 0x7fb9dc067390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000c00 tx=0x7fb9ec000ed0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f80cfa00 msgr2=0x7fb9f8151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:00.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f80cfa00 0x7fb9f8151720 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8160cd0 tx=0x7fb9f00014a0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 shutdown_connections 2023-11-08T12:29:00.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb9dc064ee0 0x7fb9dc067390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9f80cfa00 0x7fb9f8151720 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9f8150d00 0x7fb9f81511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 --2- 172.21.15.112:0/674263559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e8005220 0x7fb9f80cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:00.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 >> 172.21.15.112:0/674263559 conn(0x7fb9f80d3680 msgr2=0x7fb9f80c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:00.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 shutdown_connections 2023-11-08T12:29:00.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:00.904+0000 7fb9fd812700 1 -- 172.21.15.112:0/674263559 wait complete. 2023-11-08T12:29:00.925 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:29:01.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.100+0000 7f48ee4b1700 1 Processor -- start 2023-11-08T12:29:01.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.100+0000 7f48ee4b1700 1 -- start start 2023-11-08T12:29:01.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48e815c150 0x7f48e80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48e8070360 0x7f48e8160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e815c520 con 0x7f48e806ff10 2023-11-08T12:29:01.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e80b4240 con 0x7f48e815c150 2023-11-08T12:29:01.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e806ac00 con 0x7f48e8070360 2023-11-08T12:29:01.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48e815c150 0x7f48e80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f48e815c150 0x7f48e80b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44702/0 (socket says 172.21.15.112:44702) 2023-11-08T12:29:01.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 -- 172.21.15.112:0/4148166232 learned_addr learned my addr 172.21.15.112:0/4148166232 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:01.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48edcb0700 1 --2- 172.21.15.112:0/4148166232 >> v2:172.21.15.133:3300/0 conn(0x7f48e8070360 0x7f48e8160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 -- 172.21.15.112:0/4148166232 >> v2:172.21.15.133:3300/0 conn(0x7f48e8070360 msgr2=0x7f48e8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:01.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 --2- 172.21.15.112:0/4148166232 >> v2:172.21.15.133:3300/0 conn(0x7f48e8070360 0x7f48e8160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 -- 172.21.15.112:0/4148166232 >> v1:172.21.15.112:6789/0 conn(0x7f48e806ff10 legacy=0x7f48e815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:01.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 -- 172.21.15.112:0/4148166232 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e806cc50 con 0x7f48e815c150 2023-11-08T12:29:01.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ed4af700 1 --2- 172.21.15.112:0/4148166232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e815c150 0x7f48e80b3d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f48e806de90 tx=0x7f48e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea0825f7d2002f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48dffff700 1 -- 172.21.15.112:0/4148166232 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4004230 con 0x7f48e815c150 2023-11-08T12:29:01.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48dffff700 1 -- 172.21.15.112:0/4148166232 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e4004390 con 0x7f48e815c150 2023-11-08T12:29:01.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48dffff700 1 -- 172.21.15.112:0/4148166232 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40036c0 con 0x7f48e815c150 2023-11-08T12:29:01.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 -- 172.21.15.112:0/4148166232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e815c150 msgr2=0x7f48e80b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/4148166232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e815c150 0x7f48e80b3d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f48e806de90 tx=0x7f48e4009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 -- 172.21.15.112:0/4148166232 shutdown_connections 2023-11-08T12:29:01.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/4148166232 >> v2:172.21.15.133:3300/0 conn(0x7f48e8070360 0x7f48e8160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/4148166232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e815c150 0x7f48e80b3d00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.104+0000 7f48ee4b1700 1 -- 172.21.15.112:0/4148166232 >> 172.21.15.112:0/4148166232 conn(0x7f48e80d3680 msgr2=0x7f48e80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:01.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.108+0000 7f48ee4b1700 1 -- 172.21.15.112:0/4148166232 shutdown_connections 2023-11-08T12:29:01.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.108+0000 7f48ee4b1700 1 -- 172.21.15.112:0/4148166232 wait complete. 2023-11-08T12:29:01.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.108+0000 7f48ee4b1700 1 Processor -- start 2023-11-08T12:29:01.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.108+0000 7f48ee4b1700 1 -- start start 2023-11-08T12:29:01.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e806ff10 0x7f48e815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e8070360 0x7f48e8149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48e815c150 0x7f48e815eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8149ad0 con 0x7f48e8070360 2023-11-08T12:29:01.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e815f330 con 0x7f48e806ff10 2023-11-08T12:29:01.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e815f610 con 0x7f48e815c150 2023-11-08T12:29:01.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e8070360 0x7f48e8149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e8070360 0x7f48e8149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44704/0 (socket says 172.21.15.112:44704) 2023-11-08T12:29:01.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 -- 172.21.15.112:0/3193199809 learned_addr learned my addr 172.21.15.112:0/3193199809 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:01.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ed4af700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e806ff10 0x7f48e815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48edcb0700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48e815c150 0x7f48e815eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 -- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48e815c150 msgr2=0x7f48e815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48e815c150 0x7f48e815eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 -- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e806ff10 msgr2=0x7f48e815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e806ff10 0x7f48e815b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 -- 172.21.15.112:0/3193199809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009570 con 0x7f48e8070360 2023-11-08T12:29:01.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ed4af700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e806ff10 0x7f48e815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:01.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48eccae700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e8070360 0x7f48e8149590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c4d0 tx=0x7f48d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ddffb700 1 -- 172.21.15.112:0/3193199809 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80054e0 con 0x7f48e8070360 2023-11-08T12:29:01.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ddffb700 1 -- 172.21.15.112:0/3193199809 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d80036a0 con 0x7f48e8070360 2023-11-08T12:29:01.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ddffb700 1 -- 172.21.15.112:0/3193199809 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8003a50 con 0x7f48e8070360 2023-11-08T12:29:01.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e80d2730 con 0x7f48e8070360 2023-11-08T12:29:01.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.112+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e80d2450 con 0x7f48e8070360 2023-11-08T12:29:01.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.116+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e80d05e0 con 0x7f48e8070360 2023-11-08T12:29:01.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.116+0000 7f48ddffb700 1 -- 172.21.15.112:0/3193199809 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f48d8010070 con 0x7f48e8070360 2023-11-08T12:29:01.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.116+0000 7f48ddffb700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f48cc064ee0 0x7f48cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.116+0000 7f48ddffb700 1 -- 172.21.15.112:0/3193199809 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f48d8081140 con 0x7f48e8070360 2023-11-08T12:29:01.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.116+0000 7f48ed4af700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f48cc064ee0 0x7f48cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.120+0000 7f48ed4af700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f48cc064ee0 0x7f48cc067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f48e806de90 tx=0x7f48e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.124+0000 7f48ddffb700 1 -- 172.21.15.112:0/3193199809 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f48d804efb0 con 0x7f48e8070360 2023-11-08T12:29:01.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.308+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f48e8073d20 con 0x7f48e8070360 2023-11-08T12:29:01.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.308+0000 7f48ddffb700 1 -- 172.21.15.112:0/3193199809 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48d80525d0 con 0x7f48e8070360 2023-11-08T12:29:01.312 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:29:01.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f48cc064ee0 msgr2=0x7f48cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f48cc064ee0 0x7f48cc067390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f48e806de90 tx=0x7f48e4008030 comp rx=0 tx=0).stop 2023-11-08T12:29:01.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e8070360 msgr2=0x7f48e8149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e8070360 0x7f48e8149590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c4d0 tx=0x7f48d800c890 comp rx=0 tx=0).stop 2023-11-08T12:29:01.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 shutdown_connections 2023-11-08T12:29:01.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f48cc064ee0 0x7f48cc067390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f48e815c150 0x7f48e815eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48e8070360 0x7f48e8149590 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 --2- 172.21.15.112:0/3193199809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e806ff10 0x7f48e815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 >> 172.21.15.112:0/3193199809 conn(0x7f48e80d3680 msgr2=0x7f48e80b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:01.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 shutdown_connections 2023-11-08T12:29:01.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.312+0000 7f48ee4b1700 1 -- 172.21.15.112:0/3193199809 wait complete. 2023-11-08T12:29:01.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:29:01.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.516+0000 7f1bfb59e700 1 Processor -- start 2023-11-08T12:29:01.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.516+0000 7f1bfb59e700 1 -- start start 2023-11-08T12:29:01.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.516+0000 7f1bfb59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1bfc070a90 0x7f1bfc0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.516+0000 7f1bfb59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc070600 con 0x7f1bfc15a9f0 2023-11-08T12:29:01.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.516+0000 7f1bfb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc15adf0 con 0x7f1bfc159f10 2023-11-08T12:29:01.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.516+0000 7f1bfb59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0afcc0 con 0x7f1bfc070a90 2023-11-08T12:29:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bfad9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1bfc15a9f0 0x7f1bfc06be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35150/0 (socket says 172.21.15.112:35150) 2023-11-08T12:29:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bfad9d700 1 -- 172.21.15.112:0/2628453378 learned_addr learned my addr 172.21.15.112:0/2628453378 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf9d9b700 1 --2- 172.21.15.112:0/2628453378 >> v2:172.21.15.112:3300/0 conn(0x7f1bfc070a90 0x7f1bfc0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf959a700 1 -- 172.21.15.112:0/2628453378 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678077757 0 0) 0x7f1bfc070600 con 0x7f1bfc15a9f0 2023-11-08T12:29:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf959a700 1 -- 172.21.15.112:0/2628453378 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be40035d0 con 0x7f1bfc15a9f0 2023-11-08T12:29:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf959a700 1 -- 172.21.15.112:0/2628453378 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812771923 0 0) 0x7f1bfc15adf0 con 0x7f1bfc159f10 2023-11-08T12:29:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf959a700 1 -- 172.21.15.112:0/2628453378 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bfc070600 con 0x7f1bfc159f10 2023-11-08T12:29:01.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf9d9b700 1 -- 172.21.15.112:0/2628453378 >> v1:172.21.15.133:6789/0 conn(0x7f1bfc159f10 legacy=0x7f1bfc15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf9d9b700 1 -- 172.21.15.112:0/2628453378 >> v1:172.21.15.112:6789/0 conn(0x7f1bfc15a9f0 legacy=0x7f1bfc06be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf9d9b700 1 -- 172.21.15.112:0/2628453378 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc06ffb0 con 0x7f1bfc070a90 2023-11-08T12:29:01.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf9d9b700 1 --2- 172.21.15.112:0/2628453378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc0c8c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009850 tx=0x7f1bf0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6802dab586bfcbe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf959a700 1 -- 172.21.15.112:0/2628453378 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40019f0 con 0x7f1bfc070a90 2023-11-08T12:29:01.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf959a700 1 -- 172.21.15.112:0/2628453378 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0010590 con 0x7f1bfc070a90 2023-11-08T12:29:01.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bf959a700 1 -- 172.21.15.112:0/2628453378 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0010940 con 0x7f1bfc070a90 2023-11-08T12:29:01.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2628453378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 msgr2=0x7f1bfc0c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.520+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2628453378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc0c8c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009850 tx=0x7f1bf0009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:01.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.524+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2628453378 shutdown_connections 2023-11-08T12:29:01.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.524+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2628453378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc0c8c90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.524+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2628453378 >> 172.21.15.112:0/2628453378 conn(0x7f1bfc0cf280 msgr2=0x7f1bfc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:01.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.524+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2628453378 shutdown_connections 2023-11-08T12:29:01.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.524+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2628453378 wait complete. 2023-11-08T12:29:01.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.524+0000 7f1bfb59e700 1 Processor -- start 2023-11-08T12:29:01.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.524+0000 7f1bfb59e700 1 -- start start 2023-11-08T12:29:01.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bfc159f10 0x7f1bfc0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc15a9f0 0x7f1bfc0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc155420 con 0x7f1bfc070a90 2023-11-08T12:29:01.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b4380 con 0x7f1bfc15a9f0 2023-11-08T12:29:01.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0ccb10 con 0x7f1bfc159f10 2023-11-08T12:29:01.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44730/0 (socket says 172.21.15.112:44730) 2023-11-08T12:29:01.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 -- 172.21.15.112:0/2200486838 learned_addr learned my addr 172.21.15.112:0/2200486838 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:01.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfad9d700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc15a9f0 0x7f1bfc0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bf9d9b700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bfc159f10 0x7f1bfc0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 -- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bfc159f10 msgr2=0x7f1bfc0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bfc159f10 0x7f1bfc0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 -- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc15a9f0 msgr2=0x7f1bfc0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc15a9f0 0x7f1bfc0b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 -- 172.21.15.112:0/2200486838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00094b0 con 0x7f1bfc070a90 2023-11-08T12:29:01.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfad9d700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc15a9f0 0x7f1bfc0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:01.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfa59c700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc154ee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c730 tx=0x7f1bec00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1beaffd700 1 -- 172.21.15.112:0/2200486838 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0052d0 con 0x7f1bfc070a90 2023-11-08T12:29:01.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1beaffd700 1 -- 172.21.15.112:0/2200486838 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec005430 con 0x7f1bfc070a90 2023-11-08T12:29:01.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc0affa0 con 0x7f1bfc070a90 2023-11-08T12:29:01.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1beaffd700 1 -- 172.21.15.112:0/2200486838 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0055a0 con 0x7f1bfc070a90 2023-11-08T12:29:01.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.528+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc070290 con 0x7f1bfc070a90 2023-11-08T12:29:01.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.532+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc06b300 con 0x7f1bfc070a90 2023-11-08T12:29:01.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.532+0000 7f1beaffd700 1 -- 172.21.15.112:0/2200486838 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1bec019030 con 0x7f1bfc070a90 2023-11-08T12:29:01.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.536+0000 7f1beaffd700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1bdc064ee0 0x7f1bdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.536+0000 7f1beaffd700 1 -- 172.21.15.112:0/2200486838 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1bec0816e0 con 0x7f1bfc070a90 2023-11-08T12:29:01.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.536+0000 7f1bf9d9b700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1bdc064ee0 0x7f1bdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.536+0000 7f1bf9d9b700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1bdc064ee0 0x7f1bdc067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0013040 tx=0x7f1bf0008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.540+0000 7f1beaffd700 1 -- 172.21.15.112:0/2200486838 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1bec04f400 con 0x7f1bfc070a90 2023-11-08T12:29:01.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.716+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bfc06cf30 con 0x7f1bfc070a90 2023-11-08T12:29:01.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.716+0000 7f1beaffd700 1 -- 172.21.15.112:0/2200486838 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bec052a20 con 0x7f1bfc070a90 2023-11-08T12:29:01.721 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:29:01.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1bdc064ee0 msgr2=0x7f1bdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1bdc064ee0 0x7f1bdc067390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0013040 tx=0x7f1bf0008000 comp rx=0 tx=0).stop 2023-11-08T12:29:01.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 msgr2=0x7f1bfc154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc154ee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c730 tx=0x7f1bec00caf0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 shutdown_connections 2023-11-08T12:29:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1bdc064ee0 0x7f1bdc067390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc15a9f0 0x7f1bfc0b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bfc159f10 0x7f1bfc0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 --2- 172.21.15.112:0/2200486838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1bfc070a90 0x7f1bfc154ee0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 >> 172.21.15.112:0/2200486838 conn(0x7f1bfc0cf280 msgr2=0x7f1bfc0ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:01.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 shutdown_connections 2023-11-08T12:29:01.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.720+0000 7f1bfb59e700 1 -- 172.21.15.112:0/2200486838 wait complete. 2023-11-08T12:29:01.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:29:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.928+0000 7f0f3359e700 1 Processor -- start 2023-11-08T12:29:01.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.928+0000 7f0f3359e700 1 -- start start 2023-11-08T12:29:01.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f3359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3415c310 0x7f0f340d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f3359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f3406b830 0x7f0f340700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f3359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f34070600 0x7f0f3415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f3359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3406d240 con 0x7f0f34070600 2023-11-08T12:29:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f3359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f34070a80 con 0x7f0f3406b830 2023-11-08T12:29:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f3359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340cd080 con 0x7f0f3415c310 2023-11-08T12:29:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f32d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f34070600 0x7f0f3415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f2bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f3406b830 0x7f0f340700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f3259c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3415c310 0x7f0f340d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f32d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f34070600 0x7f0f3415fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44734/0 (socket says 172.21.15.112:44734) 2023-11-08T12:29:01.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.932+0000 7f0f32d9d700 1 -- 172.21.15.112:0/908550575 learned_addr learned my addr 172.21.15.112:0/908550575 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:01.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f32d9d700 1 -- 172.21.15.112:0/908550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3415c310 msgr2=0x7f0f340d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:01.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f32d9d700 1 --2- 172.21.15.112:0/908550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3415c310 0x7f0f340d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f32d9d700 1 -- 172.21.15.112:0/908550575 >> v2:172.21.15.133:3300/0 conn(0x7f0f3406b830 msgr2=0x7f0f340700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:01.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f32d9d700 1 --2- 172.21.15.112:0/908550575 >> v2:172.21.15.133:3300/0 conn(0x7f0f3406b830 0x7f0f340700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f32d9d700 1 -- 172.21.15.112:0/908550575 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340d21a0 con 0x7f0f34070600 2023-11-08T12:29:01.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f2bfff700 1 --2- 172.21.15.112:0/908550575 >> v2:172.21.15.133:3300/0 conn(0x7f0f3406b830 0x7f0f340700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f32d9d700 1 --2- 172.21.15.112:0/908550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f34070600 0x7f0f3415fdd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f34072e30 tx=0x7f0f2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee92dc041d43049 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f31d9b700 1 -- 172.21.15.112:0/908550575 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00e070 con 0x7f0f34070600 2023-11-08T12:29:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f31d9b700 1 -- 172.21.15.112:0/908550575 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00b910 con 0x7f0f34070600 2023-11-08T12:29:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f31d9b700 1 -- 172.21.15.112:0/908550575 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00bcc0 con 0x7f0f34070600 2023-11-08T12:29:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 -- 172.21.15.112:0/908550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f34070600 msgr2=0x7f0f3415fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 --2- 172.21.15.112:0/908550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f34070600 0x7f0f3415fdd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f34072e30 tx=0x7f0f2c00b330 comp rx=0 tx=0).stop 2023-11-08T12:29:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 -- 172.21.15.112:0/908550575 shutdown_connections 2023-11-08T12:29:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 --2- 172.21.15.112:0/908550575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f34070600 0x7f0f3415fdd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 --2- 172.21.15.112:0/908550575 >> v2:172.21.15.133:3300/0 conn(0x7f0f3406b830 0x7f0f340700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 --2- 172.21.15.112:0/908550575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f3415c310 0x7f0f340d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 -- 172.21.15.112:0/908550575 >> 172.21.15.112:0/908550575 conn(0x7f0f340d0140 msgr2=0x7f0f340d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 -- 172.21.15.112:0/908550575 shutdown_connections 2023-11-08T12:29:01.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.936+0000 7f0f3359e700 1 -- 172.21.15.112:0/908550575 wait complete. 2023-11-08T12:29:01.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.940+0000 7f0f3359e700 1 Processor -- start 2023-11-08T12:29:01.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.940+0000 7f0f3359e700 1 -- start start 2023-11-08T12:29:01.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f3406b830 0x7f0f34155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f34070600 0x7f0f340cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3415c310 0x7f0f340cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340b60d0 con 0x7f0f3406b830 2023-11-08T12:29:01.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340c6560 con 0x7f0f3415c310 2023-11-08T12:29:01.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340b7230 con 0x7f0f34070600 2023-11-08T12:29:01.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f3406b830 0x7f0f34155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f3406b830 0x7f0f34155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44742/0 (socket says 172.21.15.112:44742) 2023-11-08T12:29:01.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 -- 172.21.15.112:0/901354236 learned_addr learned my addr 172.21.15.112:0/901354236 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:01.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f32d9d700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3415c310 0x7f0f340cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f2bfff700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f34070600 0x7f0f340cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 -- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f34070600 msgr2=0x7f0f340cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f34070600 0x7f0f340cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 -- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3415c310 msgr2=0x7f0f340cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:01.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3415c310 0x7f0f340cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:01.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 -- 172.21.15.112:0/901354236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0094b0 con 0x7f0f3406b830 2023-11-08T12:29:01.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f2bfff700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f34070600 0x7f0f340cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:01.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3259c700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f3406b830 0x7f0f34155db0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ea00 tx=0x7f0f2400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f2affd700 1 -- 172.21.15.112:0/901354236 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24009720 con 0x7f0f3406b830 2023-11-08T12:29:01.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f2affd700 1 -- 172.21.15.112:0/901354236 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2400c850 con 0x7f0f3406b830 2023-11-08T12:29:01.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2c009b30 con 0x7f0f3406b830 2023-11-08T12:29:01.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f2affd700 1 -- 172.21.15.112:0/901354236 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400cbc0 con 0x7f0f3406b830 2023-11-08T12:29:01.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.944+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3415c6e0 con 0x7f0f3406b830 2023-11-08T12:29:01.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.948+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f340d1900 con 0x7f0f3406b830 2023-11-08T12:29:01.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.948+0000 7f0f2affd700 1 -- 172.21.15.112:0/901354236 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0f24019030 con 0x7f0f3406b830 2023-11-08T12:29:01.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.948+0000 7f0f2affd700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f14064ee0 0x7f0f14067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:01.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.952+0000 7f0f2affd700 1 -- 172.21.15.112:0/901354236 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f24082090 con 0x7f0f3406b830 2023-11-08T12:29:01.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.952+0000 7f0f2bfff700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f14064ee0 0x7f0f14067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:01.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.952+0000 7f0f2bfff700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f14064ee0 0x7f0f14067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0f340705d0 tx=0x7f0f1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:01.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:01.956+0000 7f0f2affd700 1 -- 172.21.15.112:0/901354236 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0f2404ff00 con 0x7f0f3406b830 2023-11-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.128+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f3406d450 con 0x7f0f3406b830 2023-11-08T12:29:02.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.128+0000 7f0f2affd700 1 -- 172.21.15.112:0/901354236 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f24053520 con 0x7f0f3406b830 2023-11-08T12:29:02.133 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:29:02.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f14064ee0 msgr2=0x7f0f14067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f14064ee0 0x7f0f14067390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0f340705d0 tx=0x7f0f1c008040 comp rx=0 tx=0).stop 2023-11-08T12:29:02.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f3406b830 msgr2=0x7f0f34155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f3406b830 0x7f0f34155db0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ea00 tx=0x7f0f2400ed10 comp rx=0 tx=0).stop 2023-11-08T12:29:02.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 shutdown_connections 2023-11-08T12:29:02.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f14064ee0 0x7f0f14067390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3415c310 0x7f0f340cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f34070600 0x7f0f340cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 --2- 172.21.15.112:0/901354236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f3406b830 0x7f0f34155db0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 >> 172.21.15.112:0/901354236 conn(0x7f0f340d0140 msgr2=0x7f0f340ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:02.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 shutdown_connections 2023-11-08T12:29:02.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.132+0000 7f0f3359e700 1 -- 172.21.15.112:0/901354236 wait complete. 2023-11-08T12:29:02.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:29:02.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.340+0000 7fb98e045700 1 Processor -- start 2023-11-08T12:29:02.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.340+0000 7fb98e045700 1 -- start start 2023-11-08T12:29:02.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98e045700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb988159f10 0x7fb988070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98e045700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb98815a9f0 0x7fb98806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98e045700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb988070600 con 0x7fb9880c8c90 2023-11-08T12:29:02.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98e045700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9880c9130 con 0x7fb988159f10 2023-11-08T12:29:02.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98e045700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98806b840 con 0x7fb98815a9f0 2023-11-08T12:29:02.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb9880c8c90 0x7fb98815a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35158/0 (socket says 172.21.15.112:35158) 2023-11-08T12:29:02.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 -- 172.21.15.112:0/1984326181 learned_addr learned my addr 172.21.15.112:0/1984326181 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:02.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98d043700 1 --2- 172.21.15.112:0/1984326181 >> v2:172.21.15.112:3300/0 conn(0x7fb988159f10 0x7fb988070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98d844700 1 --2- 172.21.15.112:0/1984326181 >> v2:172.21.15.133:3300/0 conn(0x7fb98815a9f0 0x7fb98806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682652503 0 0) 0x7fb988070600 con 0x7fb9880c8c90 2023-11-08T12:29:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9740035d0 con 0x7fb9880c8c90 2023-11-08T12:29:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1123359106 0 0) 0x7fb9740035d0 con 0x7fb9880c8c90 2023-11-08T12:29:02.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 >> v2:172.21.15.133:3300/0 conn(0x7fb98815a9f0 msgr2=0x7fb98806b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 --2- 172.21.15.112:0/1984326181 >> v2:172.21.15.133:3300/0 conn(0x7fb98815a9f0 0x7fb98806b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 >> v2:172.21.15.112:3300/0 conn(0x7fb988159f10 msgr2=0x7fb988070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 --2- 172.21.15.112:0/1984326181 >> v2:172.21.15.112:3300/0 conn(0x7fb988159f10 0x7fb988070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98815adf0 con 0x7fb9880c8c90 2023-11-08T12:29:02.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fb978001670 con 0x7fb9880c8c90 2023-11-08T12:29:02.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 >> v1:172.21.15.112:6789/0 conn(0x7fb9880c8c90 legacy=0x7fb98815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb974003a20 0x7fb974003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb974004870 0x7fb974004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974005220 0x7fb97400fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880c9130 con 0x7fb974004870 2023-11-08T12:29:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98806b840 con 0x7fb974003a20 2023-11-08T12:29:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974010460 con 0x7fb974005220 2023-11-08T12:29:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb974004870 0x7fb974004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98d043700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb974003a20 0x7fb974003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98d844700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974005220 0x7fb97400fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 -- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974005220 msgr2=0x7fb97400fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974005220 0x7fb97400fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 -- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb974003a20 msgr2=0x7fb974003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb974003a20 0x7fb974003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98c842700 1 -- 172.21.15.112:0/1984326181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740035d0 con 0x7fb974004870 2023-11-08T12:29:02.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98d043700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb974003a20 0x7fb974003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98d844700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974005220 0x7fb97400fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.344+0000 7fb98d844700 1 -- 172.21.15.112:0/1984326181 reap_dead start 2023-11-08T12:29:02.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98c842700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb974004870 0x7fb974004ce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb978001eb0 tx=0x7fb9740058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f312ddaaeb0c124 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800ce00 con 0x7fb974004870 2023-11-08T12:29:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978005980 con 0x7fb974004870 2023-11-08T12:29:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb97ffff700 1 -- 172.21.15.112:0/1984326181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978005d30 con 0x7fb974004870 2023-11-08T12:29:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98e045700 1 -- 172.21.15.112:0/1984326181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb974004870 msgr2=0x7fb974004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98e045700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb974004870 0x7fb974004ce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb978001eb0 tx=0x7fb9740058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98e045700 1 -- 172.21.15.112:0/1984326181 shutdown_connections 2023-11-08T12:29:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98e045700 1 --2- 172.21.15.112:0/1984326181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb974004870 0x7fb974004ce0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98e045700 1 -- 172.21.15.112:0/1984326181 >> 172.21.15.112:0/1984326181 conn(0x7fb9880cf280 msgr2=0x7fb9880cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98e045700 1 -- 172.21.15.112:0/1984326181 shutdown_connections 2023-11-08T12:29:02.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.348+0000 7fb98e045700 1 -- 172.21.15.112:0/1984326181 wait complete. 2023-11-08T12:29:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 Processor -- start 2023-11-08T12:29:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 -- start start 2023-11-08T12:29:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974004870 0x7fb98814cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb98814d440 0x7fb988150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb988157830 0x7fb988157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988158210 con 0x7fb98814d440 2023-11-08T12:29:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9881518a0 con 0x7fb988157830 2023-11-08T12:29:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98e045700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb988151b80 con 0x7fb974004870 2023-11-08T12:29:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb98814d440 0x7fb988150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb98814d440 0x7fb988150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44778/0 (socket says 172.21.15.112:44778) 2023-11-08T12:29:02.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 -- 172.21.15.112:0/1768096683 learned_addr learned my addr 172.21.15.112:0/1768096683 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 -- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974004870 msgr2=0x7fb98814cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98d043700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974004870 0x7fb98814cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974004870 0x7fb98814cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 -- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb988157830 msgr2=0x7fb988157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb988157830 0x7fb988157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 -- 172.21.15.112:0/1768096683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98806ffb0 con 0x7fb98814d440 2023-11-08T12:29:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98d043700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974004870 0x7fb98814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.352+0000 7fb98c842700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb98814d440 0x7fb988150fc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb978015040 tx=0x7fb988070fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb97dffb700 1 -- 172.21.15.112:0/1768096683 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978000ed0 con 0x7fb98814d440 2023-11-08T12:29:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb97dffb700 1 -- 172.21.15.112:0/1768096683 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978004aa0 con 0x7fb98814d440 2023-11-08T12:29:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb97dffb700 1 -- 172.21.15.112:0/1768096683 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978004e10 con 0x7fb98814d440 2023-11-08T12:29:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9880afcc0 con 0x7fb98814d440 2023-11-08T12:29:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb988070290 con 0x7fb98814d440 2023-11-08T12:29:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98806cf30 con 0x7fb98814d440 2023-11-08T12:29:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb97dffb700 1 -- 172.21.15.112:0/1768096683 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb97802d070 con 0x7fb98814d440 2023-11-08T12:29:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb97dffb700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb96c064f10 0x7fb96c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.356+0000 7fb97dffb700 1 -- 172.21.15.112:0/1768096683 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb978083300 con 0x7fb98814d440 2023-11-08T12:29:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.360+0000 7fb98d043700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb96c064f10 0x7fb96c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.360+0000 7fb98d043700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb96c064f10 0x7fb96c0673c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb984009bb0 tx=0x7fb984008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:02.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.364+0000 7fb97dffb700 1 -- 172.21.15.112:0/1768096683 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb978050fa0 con 0x7fb98814d440 2023-11-08T12:29:02.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.540+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb988073d20 con 0x7fb98814d440 2023-11-08T12:29:02.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.540+0000 7fb97dffb700 1 -- 172.21.15.112:0/1768096683 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb9780545c0 con 0x7fb98814d440 2023-11-08T12:29:02.544 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:29:02.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb96c064f10 msgr2=0x7fb96c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb96c064f10 0x7fb96c0673c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb984009bb0 tx=0x7fb984008040 comp rx=0 tx=0).stop 2023-11-08T12:29:02.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb98814d440 msgr2=0x7fb988150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb98814d440 0x7fb988150fc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb978015040 tx=0x7fb988070fd0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 shutdown_connections 2023-11-08T12:29:02.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb96c064f10 0x7fb96c0673c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb988157830 0x7fb988157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb98814d440 0x7fb988150fc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 --2- 172.21.15.112:0/1768096683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb974004870 0x7fb98814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 >> 172.21.15.112:0/1768096683 conn(0x7fb9880cf280 msgr2=0x7fb98815a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:02.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 shutdown_connections 2023-11-08T12:29:02.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.544+0000 7fb98e045700 1 -- 172.21.15.112:0/1768096683 wait complete. 2023-11-08T12:29:02.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:29:02.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.740+0000 7fdeff3aa700 1 Processor -- start 2023-11-08T12:29:02.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.740+0000 7fdeff3aa700 1 -- start start 2023-11-08T12:29:02.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeff3aa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdef8163cb0 0x7fdef8164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeff3aa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef8164080 con 0x7fdef806d4c0 2023-11-08T12:29:02.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeff3aa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef8069bf0 con 0x7fdef80cdfb0 2023-11-08T12:29:02.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeff3aa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80cc290 con 0x7fdef8163cb0 2023-11-08T12:29:02.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdefd947700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdef806d4c0 0x7fdef806a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35170/0 (socket says 172.21.15.112:35170) 2023-11-08T12:29:02.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdefd947700 1 -- 172.21.15.112:0/1536034540 learned_addr learned my addr 172.21.15.112:0/1536034540 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:02.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdefd146700 1 --2- 172.21.15.112:0/1536034540 >> v2:172.21.15.112:3300/0 conn(0x7fdef8163cb0 0x7fdef8164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdefd146700 1 -- 172.21.15.112:0/1536034540 >> v1:172.21.15.133:6789/0 conn(0x7fdef80cdfb0 legacy=0x7fdef806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdefd146700 1 -- 172.21.15.112:0/1536034540 >> v1:172.21.15.112:6789/0 conn(0x7fdef806d4c0 legacy=0x7fdef806a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdefd146700 1 -- 172.21.15.112:0/1536034540 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef81651f0 con 0x7fdef8163cb0 2023-11-08T12:29:02.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdefd146700 1 --2- 172.21.15.112:0/1536034540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef8164cb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009850 tx=0x7fdef4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92414533ad49bcf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:02.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeeffff700 1 -- 172.21.15.112:0/1536034540 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4011830 con 0x7fdef8163cb0 2023-11-08T12:29:02.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeeffff700 1 -- 172.21.15.112:0/1536034540 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4011990 con 0x7fdef8163cb0 2023-11-08T12:29:02.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeeffff700 1 -- 172.21.15.112:0/1536034540 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4011d20 con 0x7fdef8163cb0 2023-11-08T12:29:02.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeff3aa700 1 -- 172.21.15.112:0/1536034540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 msgr2=0x7fdef8164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.744+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/1536034540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef8164cb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009850 tx=0x7fdef4009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:02.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.748+0000 7fdeff3aa700 1 -- 172.21.15.112:0/1536034540 shutdown_connections 2023-11-08T12:29:02.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.748+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/1536034540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef8164cb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.748+0000 7fdeff3aa700 1 -- 172.21.15.112:0/1536034540 >> 172.21.15.112:0/1536034540 conn(0x7fdef80cf350 msgr2=0x7fdef80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:02.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.748+0000 7fdeff3aa700 1 -- 172.21.15.112:0/1536034540 shutdown_connections 2023-11-08T12:29:02.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.748+0000 7fdeff3aa700 1 -- 172.21.15.112:0/1536034540 wait complete. 2023-11-08T12:29:02.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.748+0000 7fdeff3aa700 1 Processor -- start 2023-11-08T12:29:02.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.748+0000 7fdeff3aa700 1 -- start start 2023-11-08T12:29:02.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef806d4c0 0x7fdef8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef80cdfb0 0x7fdef80aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef80af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8158130 con 0x7fdef8163cb0 2023-11-08T12:29:02.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c5910 con 0x7fdef80cdfb0 2023-11-08T12:29:02.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c5bf0 con 0x7fdef806d4c0 2023-11-08T12:29:02.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef806d4c0 0x7fdef8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefc945700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef80cdfb0 0x7fdef80aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd947700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef80af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef806d4c0 0x7fdef8157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:51778/0 (socket says 172.21.15.112:51778) 2023-11-08T12:29:02.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 -- 172.21.15.112:0/4173304686 learned_addr learned my addr 172.21.15.112:0/4173304686 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:02.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefc945700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef80cdfb0 0x7fdef80aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:39086/0 (socket says 172.21.15.112:39086) 2023-11-08T12:29:02.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 -- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef80cdfb0 msgr2=0x7fdef80aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef80cdfb0 0x7fdef80aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 -- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 msgr2=0x7fdef80af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef80af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 -- 172.21.15.112:0/4173304686 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40094b0 con 0x7fdef806d4c0 2023-11-08T12:29:02.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefc945700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef80cdfb0 0x7fdef80aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:02.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd947700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef80af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:02.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdefd146700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef806d4c0 0x7fdef8157bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdef806f6f0 tx=0x7fdef4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:02.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeedffb700 1 -- 172.21.15.112:0/4173304686 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef40036c0 con 0x7fdef806d4c0 2023-11-08T12:29:02.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeedffb700 1 -- 172.21.15.112:0/4173304686 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4003820 con 0x7fdef806d4c0 2023-11-08T12:29:02.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80cc780 con 0x7fdef806d4c0 2023-11-08T12:29:02.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeedffb700 1 -- 172.21.15.112:0/4173304686 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4003bd0 con 0x7fdef806d4c0 2023-11-08T12:29:02.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.752+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef80cc4a0 con 0x7fdef806d4c0 2023-11-08T12:29:02.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.756+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef8069e40 con 0x7fdef806d4c0 2023-11-08T12:29:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.756+0000 7fdeedffb700 1 -- 172.21.15.112:0/4173304686 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdef402d070 con 0x7fdef806d4c0 2023-11-08T12:29:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.756+0000 7fdeedffb700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdedc064ee0 0x7fdedc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:02.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.760+0000 7fdeedffb700 1 -- 172.21.15.112:0/4173304686 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdef4021030 con 0x7fdef806d4c0 2023-11-08T12:29:02.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.760+0000 7fdefc945700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdedc064ee0 0x7fdedc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:02.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.760+0000 7fdefc945700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdedc064ee0 0x7fdedc067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdef80b26e0 tx=0x7fdee8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:02.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.768+0000 7fdeedffb700 1 -- 172.21.15.112:0/4173304686 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdef40517a0 con 0x7fdef806d4c0 2023-11-08T12:29:02.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.956+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdef80c5d30 con 0x7fdef806d4c0 2023-11-08T12:29:02.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.956+0000 7fdeedffb700 1 -- 172.21.15.112:0/4173304686 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdef80c5d30 con 0x7fdef806d4c0 2023-11-08T12:29:02.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdedc064ee0 msgr2=0x7fdedc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdedc064ee0 0x7fdedc067390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdef80b26e0 tx=0x7fdee8009040 comp rx=0 tx=0).stop 2023-11-08T12:29:02.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef806d4c0 msgr2=0x7fdef8157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:02.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef806d4c0 0x7fdef8157bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdef806f6f0 tx=0x7fdef4004770 comp rx=0 tx=0).stop 2023-11-08T12:29:02.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 shutdown_connections 2023-11-08T12:29:02.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdedc064ee0 0x7fdedc067390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdef8163cb0 0x7fdef80af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdef80cdfb0 0x7fdef80aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 --2- 172.21.15.112:0/4173304686 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdef806d4c0 0x7fdef8157bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:02.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.960+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 >> 172.21.15.112:0/4173304686 conn(0x7fdef80cf350 msgr2=0x7fdef81619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.964+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 shutdown_connections 2023-11-08T12:29:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:02.964+0000 7fdeff3aa700 1 -- 172.21.15.112:0/4173304686 wait complete. 2023-11-08T12:29:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:29:02.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-08T12:29:02.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:02.989 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-08T12:29:03.037 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:29:03.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:03.038 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-08T12:29:03.104 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T12:29:03.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:03.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.292+0000 7fb2e9d1e700 1 Processor -- start 2023-11-08T12:29:03.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.292+0000 7fb2e9d1e700 1 -- start start 2023-11-08T12:29:03.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.292+0000 7fb2e9d1e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2e4163cb0 0x7fb2e4164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.292+0000 7fb2e9d1e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e4164080 con 0x7fb2e406d2f0 2023-11-08T12:29:03.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40cc290 con 0x7fb2e4163cb0 2023-11-08T12:29:03.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e406d770 con 0x7fb2e40cdfb0 2023-11-08T12:29:03.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e37fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb2e4163cb0 0x7fb2e4164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb2e406d2f0 0x7fb2e406bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40796/0 (socket says 172.21.15.112:40796) 2023-11-08T12:29:03.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e3fff700 1 -- 172.21.15.112:0/2261324214 learned_addr learned my addr 172.21.15.112:0/2261324214 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:03.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e37fe700 1 -- 172.21.15.112:0/2261324214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 msgr2=0x7fb2e406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:03.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e37fe700 1 --2- 172.21.15.112:0/2261324214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e37fe700 1 -- 172.21.15.112:0/2261324214 >> v1:172.21.15.133:6789/0 conn(0x7fb2e406d2f0 legacy=0x7fb2e406bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e37fe700 1 -- 172.21.15.112:0/2261324214 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4069bf0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e37fe700 1 --2- 172.21.15.112:0/2261324214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e4164cb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009850 tx=0x7fb2d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f19187414f7f80 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:03.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e27fc700 1 -- 172.21.15.112:0/2261324214 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011830 con 0x7fb2e4163cb0 2023-11-08T12:29:03.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e27fc700 1 -- 172.21.15.112:0/2261324214 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4011990 con 0x7fb2e4163cb0 2023-11-08T12:29:03.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e27fc700 1 -- 172.21.15.112:0/2261324214 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011d40 con 0x7fb2e4163cb0 2023-11-08T12:29:03.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/2261324214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 msgr2=0x7fb2e4164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/2261324214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e4164cb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009850 tx=0x7fb2d4009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:03.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/2261324214 shutdown_connections 2023-11-08T12:29:03.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/2261324214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/2261324214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e4164cb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/2261324214 >> 172.21.15.112:0/2261324214 conn(0x7fb2e40cf350 msgr2=0x7fb2e40b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:03.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/2261324214 shutdown_connections 2023-11-08T12:29:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.296+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/2261324214 wait complete. 2023-11-08T12:29:03.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 Processor -- start 2023-11-08T12:29:03.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 -- start start 2023-11-08T12:29:03.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e406d2f0 0x7fb2e41f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e40b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c33c0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e406aff0 con 0x7fb2e406d2f0 2023-11-08T12:29:03.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e9d1e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41fa2a0 con 0x7fb2e40cdfb0 2023-11-08T12:29:03.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e40b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e40b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44822/0 (socket says 172.21.15.112:44822) 2023-11-08T12:29:03.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e406d2f0 0x7fb2e41f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3808064756 learned_addr learned my addr 172.21.15.112:0/3808064756 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:03.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.300+0000 7fb2e2ffd700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3808064756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 msgr2=0x7fb2e406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3808064756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e406d2f0 msgr2=0x7fb2e41f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e406d2f0 0x7fb2e41f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e3fff700 1 -- 172.21.15.112:0/3808064756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40094b0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e3fff700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e40b2a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00ca20 tx=0x7fb2dc00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:03.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2cbfff700 1 -- 172.21.15.112:0/3808064756 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0074e0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2cbfff700 1 -- 172.21.15.112:0/3808064756 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc007640 con 0x7fb2e4163cb0 2023-11-08T12:29:03.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2cbfff700 1 -- 172.21.15.112:0/3808064756 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0079d0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e40cc4a0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e41651f0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.304+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e40cc780 con 0x7fb2e4163cb0 2023-11-08T12:29:03.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.308+0000 7fb2cbfff700 1 -- 172.21.15.112:0/3808064756 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb2dc019030 con 0x7fb2e4163cb0 2023-11-08T12:29:03.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.308+0000 7fb2cbfff700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb2d0064ee0 0x7fb2d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.308+0000 7fb2cbfff700 1 -- 172.21.15.112:0/3808064756 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb2dc081a20 con 0x7fb2e4163cb0 2023-11-08T12:29:03.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.308+0000 7fb2e37fe700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb2d0064ee0 0x7fb2d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.308+0000 7fb2e37fe700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb2d0064ee0 0x7fb2d0067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40090b0 tx=0x7fb2d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:03.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.316+0000 7fb2cbfff700 1 -- 172.21.15.112:0/3808064756 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb2dc04f7a0 con 0x7fb2e4163cb0 2023-11-08T12:29:03.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.524+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2e40c3500 con 0x7fb2e4163cb0 2023-11-08T12:29:03.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.524+0000 7fb2cbfff700 1 -- 172.21.15.112:0/3808064756 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7fb2dc017020 con 0x7fb2e4163cb0 2023-11-08T12:29:03.528 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:03.529 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:28:19.810915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T12:29:03.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb2d0064ee0 msgr2=0x7fb2d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb2d0064ee0 0x7fb2d0067390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40090b0 tx=0x7fb2d4008030 comp rx=0 tx=0).stop 2023-11-08T12:29:03.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 msgr2=0x7fb2e40b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e40b2a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00ca20 tx=0x7fb2dc00ca50 comp rx=0 tx=0).stop 2023-11-08T12:29:03.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 shutdown_connections 2023-11-08T12:29:03.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb2d0064ee0 0x7fb2d0067390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2e4163cb0 0x7fb2e40b2a40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2e40cdfb0 0x7fb2e406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 --2- 172.21.15.112:0/3808064756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e406d2f0 0x7fb2e41f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 >> 172.21.15.112:0/3808064756 conn(0x7fb2e40cf350 msgr2=0x7fb2e4162fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 shutdown_connections 2023-11-08T12:29:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.528+0000 7fb2e9d1e700 1 -- 172.21.15.112:0/3808064756 wait complete. 2023-11-08T12:29:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-11-08T12:29:03.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:03.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.720+0000 7f7266453700 1 Processor -- start 2023-11-08T12:29:03.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7266453700 1 -- start start 2023-11-08T12:29:03.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7266453700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7260069e00 0x7f726006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7266453700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726006c600 con 0x7f726015c640 2023-11-08T12:29:03.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7266453700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72600722f0 con 0x7f7260071aa0 2023-11-08T12:29:03.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7266453700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726006cef0 con 0x7f7260069e00 2023-11-08T12:29:03.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7265451700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f726015c640 0x7f72600d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35186/0 (socket says 172.21.15.112:35186) 2023-11-08T12:29:03.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7265451700 1 -- 172.21.15.112:0/2643673946 learned_addr learned my addr 172.21.15.112:0/2643673946 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:03.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7265c52700 1 --2- 172.21.15.112:0/2643673946 >> v2:172.21.15.112:3300/0 conn(0x7f7260069e00 0x7f726006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7257fff700 1 -- 172.21.15.112:0/2643673946 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913691190 0 0) 0x7f726006c600 con 0x7f726015c640 2023-11-08T12:29:03.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7257fff700 1 -- 172.21.15.112:0/2643673946 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f724c0035d0 con 0x7f726015c640 2023-11-08T12:29:03.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7257fff700 1 -- 172.21.15.112:0/2643673946 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969334293 0 0) 0x7f72600722f0 con 0x7f7260071aa0 2023-11-08T12:29:03.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7257fff700 1 -- 172.21.15.112:0/2643673946 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726006c600 con 0x7f7260071aa0 2023-11-08T12:29:03.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7265c52700 1 -- 172.21.15.112:0/2643673946 >> v1:172.21.15.133:6789/0 conn(0x7f7260071aa0 legacy=0x7f726006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7265c52700 1 -- 172.21.15.112:0/2643673946 >> v1:172.21.15.112:6789/0 conn(0x7f726015c640 legacy=0x7f72600d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7265c52700 1 -- 172.21.15.112:0/2643673946 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726006da20 con 0x7f7260069e00 2023-11-08T12:29:03.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.724+0000 7f7265c52700 1 --2- 172.21.15.112:0/2643673946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f726006a280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7258009850 tx=0x7f7258009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba87a069527fac5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:03.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7257fff700 1 -- 172.21.15.112:0/2643673946 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011830 con 0x7f7260069e00 2023-11-08T12:29:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7257fff700 1 -- 172.21.15.112:0/2643673946 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258011990 con 0x7f7260069e00 2023-11-08T12:29:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7257fff700 1 -- 172.21.15.112:0/2643673946 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011d40 con 0x7f7260069e00 2023-11-08T12:29:03.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 -- 172.21.15.112:0/2643673946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 msgr2=0x7f726006a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 --2- 172.21.15.112:0/2643673946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f726006a280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7258009850 tx=0x7f7258009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 -- 172.21.15.112:0/2643673946 shutdown_connections 2023-11-08T12:29:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 --2- 172.21.15.112:0/2643673946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f726006a280 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 -- 172.21.15.112:0/2643673946 >> 172.21.15.112:0/2643673946 conn(0x7f72600b6520 msgr2=0x7f7260071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:03.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 -- 172.21.15.112:0/2643673946 shutdown_connections 2023-11-08T12:29:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 -- 172.21.15.112:0/2643673946 wait complete. 2023-11-08T12:29:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 Processor -- start 2023-11-08T12:29:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.728+0000 7f7266453700 1 -- start start 2023-11-08T12:29:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f72601f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7260071aa0 0x7f72600c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f726015c640 0x7f72600c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600d38f0 con 0x7f7260069e00 2023-11-08T12:29:03.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726014a820 con 0x7f7260071aa0 2023-11-08T12:29:03.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c64e0 con 0x7f726015c640 2023-11-08T12:29:03.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f72601f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f72601f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44838/0 (socket says 172.21.15.112:44838) 2023-11-08T12:29:03.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 -- 172.21.15.112:0/884473444 learned_addr learned my addr 172.21.15.112:0/884473444 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:03.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265c52700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f726015c640 0x7f72600c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7264c50700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7260071aa0 0x7f72600c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 -- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f726015c640 msgr2=0x7f72600c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f726015c640 0x7f72600c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 -- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7260071aa0 msgr2=0x7f72600c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7260071aa0 0x7f72600c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 -- 172.21.15.112:0/884473444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580094b0 con 0x7f7260069e00 2023-11-08T12:29:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7265451700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f72601f1750 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f725c00cbc0 tx=0x7f725c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7255ffb700 1 -- 172.21.15.112:0/884473444 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c00a770 con 0x7f7260069e00 2023-11-08T12:29:03.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7255ffb700 1 -- 172.21.15.112:0/884473444 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00a8f0 con 0x7f7260069e00 2023-11-08T12:29:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7260072010 con 0x7f7260069e00 2023-11-08T12:29:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7255ffb700 1 -- 172.21.15.112:0/884473444 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c00aca0 con 0x7f7260069e00 2023-11-08T12:29:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.732+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726015ca10 con 0x7f7260069e00 2023-11-08T12:29:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.736+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726006c830 con 0x7f7260069e00 2023-11-08T12:29:03.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.736+0000 7f7255ffb700 1 -- 172.21.15.112:0/884473444 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f725c019030 con 0x7f7260069e00 2023-11-08T12:29:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.736+0000 7f7255ffb700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7244064ee0 0x7f7244067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.740+0000 7f7255ffb700 1 -- 172.21.15.112:0/884473444 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f725c081b80 con 0x7f7260069e00 2023-11-08T12:29:03.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.740+0000 7f7264c50700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7244064ee0 0x7f7244067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.740+0000 7f7264c50700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7244064ee0 0x7f7244067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7260157800 tx=0x7f7250009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:03.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.744+0000 7f7255ffb700 1 -- 172.21.15.112:0/884473444 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f725c04f900 con 0x7f7260069e00 2023-11-08T12:29:03.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.916+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f726014aa10 con 0x7f7260069e00 2023-11-08T12:29:03.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.916+0000 7f7255ffb700 1 -- 172.21.15.112:0/884473444 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f725c052f20 con 0x7f7260069e00 2023-11-08T12:29:03.920 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:03.920 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:03.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7244064ee0 msgr2=0x7f7244067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7244064ee0 0x7f7244067390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7260157800 tx=0x7f7250009040 comp rx=0 tx=0).stop 2023-11-08T12:29:03.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 msgr2=0x7f72601f1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:03.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f72601f1750 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f725c00cbc0 tx=0x7f725c00cbf0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 shutdown_connections 2023-11-08T12:29:03.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7244064ee0 0x7f7244067390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f726015c640 0x7f72600c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7260071aa0 0x7f72600c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 --2- 172.21.15.112:0/884473444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7260069e00 0x7f72601f1750 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:03.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 >> 172.21.15.112:0/884473444 conn(0x7f72600b6520 msgr2=0x7f72600b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:03.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 shutdown_connections 2023-11-08T12:29:03.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:03.920+0000 7f7266453700 1 -- 172.21.15.112:0/884473444 wait complete. 2023-11-08T12:29:03.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:27:52.300142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:27:53.065492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-08T12:27:56.152657+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-08T12:29:03.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:29:04.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.132+0000 7fbc97837700 1 Processor -- start 2023-11-08T12:29:04.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.132+0000 7fbc97837700 1 -- start start 2023-11-08T12:29:04.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc97837700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc9015c700 0x7fbc900702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc97837700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc900b2130 0x7fbc90070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc97837700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbc900b1be0 0x7fbc9006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc97837700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900cd360 con 0x7fbc900b1be0 2023-11-08T12:29:04.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc97837700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc90160190 con 0x7fbc9015c700 2023-11-08T12:29:04.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc97837700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90160470 con 0x7fbc900b2130 2023-11-08T12:29:04.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbc900b1be0 0x7fbc9006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbc900b1be0 0x7fbc9006c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44850/0 (socket says 172.21.15.112:44850) 2023-11-08T12:29:04.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 -- 172.21.15.112:0/1253434044 learned_addr learned my addr 172.21.15.112:0/1253434044 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:04.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc94dd2700 1 --2- 172.21.15.112:0/1253434044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc900b2130 0x7fbc90070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc955d3700 1 --2- 172.21.15.112:0/1253434044 >> v2:172.21.15.133:3300/0 conn(0x7fbc9015c700 0x7fbc900702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 -- 172.21.15.112:0/1253434044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc900b2130 msgr2=0x7fbc90070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 --2- 172.21.15.112:0/1253434044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc900b2130 0x7fbc90070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 -- 172.21.15.112:0/1253434044 >> v2:172.21.15.133:3300/0 conn(0x7fbc9015c700 msgr2=0x7fbc900702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 --2- 172.21.15.112:0/1253434044 >> v2:172.21.15.133:3300/0 conn(0x7fbc9015c700 0x7fbc900702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 -- 172.21.15.112:0/1253434044 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90160750 con 0x7fbc900b1be0 2023-11-08T12:29:04.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc95dd4700 1 --2- 172.21.15.112:0/1253434044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc9006c0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbc90071c30 tx=0x7fbc8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3150a21685ee1a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc87fff700 1 -- 172.21.15.112:0/1253434044 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800e070 con 0x7fbc900b1be0 2023-11-08T12:29:04.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc87fff700 1 -- 172.21.15.112:0/1253434044 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800b9c0 con 0x7fbc900b1be0 2023-11-08T12:29:04.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.136+0000 7fbc87fff700 1 -- 172.21.15.112:0/1253434044 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bd70 con 0x7fbc900b1be0 2023-11-08T12:29:04.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 -- 172.21.15.112:0/1253434044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 msgr2=0x7fbc9006c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 --2- 172.21.15.112:0/1253434044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc9006c0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbc90071c30 tx=0x7fbc8800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:04.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 -- 172.21.15.112:0/1253434044 shutdown_connections 2023-11-08T12:29:04.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 --2- 172.21.15.112:0/1253434044 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc900b2130 0x7fbc90070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 --2- 172.21.15.112:0/1253434044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc9006c0e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 --2- 172.21.15.112:0/1253434044 >> v2:172.21.15.133:3300/0 conn(0x7fbc9015c700 0x7fbc900702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 -- 172.21.15.112:0/1253434044 >> 172.21.15.112:0/1253434044 conn(0x7fbc900d2d10 msgr2=0x7fbc900d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:04.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 -- 172.21.15.112:0/1253434044 shutdown_connections 2023-11-08T12:29:04.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.140+0000 7fbc97837700 1 -- 172.21.15.112:0/1253434044 wait complete. 2023-11-08T12:29:04.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 Processor -- start 2023-11-08T12:29:04.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 -- start start 2023-11-08T12:29:04.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc90156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc900b2130 0x7fbc901f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc9015c700 0x7fbc900cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc901566b0 con 0x7fbc900b1be0 2023-11-08T12:29:04.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc901f29b0 con 0x7fbc900b2130 2023-11-08T12:29:04.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc901f2c90 con 0x7fbc9015c700 2023-11-08T12:29:04.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc90156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc90156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44860/0 (socket says 172.21.15.112:44860) 2023-11-08T12:29:04.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 -- 172.21.15.112:0/4104352639 learned_addr learned my addr 172.21.15.112:0/4104352639 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc94dd2700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc900b2130 0x7fbc901f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc95dd4700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc9015c700 0x7fbc900cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 -- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc9015c700 msgr2=0x7fbc900cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc9015c700 0x7fbc900cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 -- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc900b2130 msgr2=0x7fbc901f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc900b2130 0x7fbc901f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 -- 172.21.15.112:0/4104352639 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc88009b30 con 0x7fbc900b1be0 2023-11-08T12:29:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc95dd4700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc9015c700 0x7fbc900cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc955d3700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc90156170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00d800 tx=0x7fbc8c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc85ffb700 1 -- 172.21.15.112:0/4104352639 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0125f0 con 0x7fbc900b1be0 2023-11-08T12:29:04.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc85ffb700 1 -- 172.21.15.112:0/4104352639 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c012750 con 0x7fbc900b1be0 2023-11-08T12:29:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9006b530 con 0x7fbc900b1be0 2023-11-08T12:29:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc85ffb700 1 -- 172.21.15.112:0/4104352639 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c012ac0 con 0x7fbc900b1be0 2023-11-08T12:29:04.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.144+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc90160a30 con 0x7fbc900b1be0 2023-11-08T12:29:04.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.148+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9006c620 con 0x7fbc900b1be0 2023-11-08T12:29:04.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.148+0000 7fbc85ffb700 1 -- 172.21.15.112:0/4104352639 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc8c012c20 con 0x7fbc900b1be0 2023-11-08T12:29:04.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.148+0000 7fbc85ffb700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc74064ee0 0x7fbc74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.152+0000 7fbc85ffb700 1 -- 172.21.15.112:0/4104352639 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc8c0826e0 con 0x7fbc900b1be0 2023-11-08T12:29:04.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.152+0000 7fbc94dd2700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc74064ee0 0x7fbc74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.152+0000 7fbc94dd2700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc74064ee0 0x7fbc74067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc90157560 tx=0x7fbc80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.156+0000 7fbc85ffb700 1 -- 172.21.15.112:0/4104352639 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc8c050550 con 0x7fbc900b1be0 2023-11-08T12:29:04.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.332+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc900726c0 con 0x7fbc900b1be0 2023-11-08T12:29:04.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.332+0000 7fbc85ffb700 1 -- 172.21.15.112:0/4104352639 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc8c059070 con 0x7fbc900b1be0 2023-11-08T12:29:04.337 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:29:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc74064ee0 msgr2=0x7fbc74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc74064ee0 0x7fbc74067390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc90157560 tx=0x7fbc80008040 comp rx=0 tx=0).stop 2023-11-08T12:29:04.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 msgr2=0x7fbc90156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc90156170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00d800 tx=0x7fbc8c00dbc0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 shutdown_connections 2023-11-08T12:29:04.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc74064ee0 0x7fbc74067390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc9015c700 0x7fbc900cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc900b2130 0x7fbc901f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 --2- 172.21.15.112:0/4104352639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc900b1be0 0x7fbc90156170 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 >> 172.21.15.112:0/4104352639 conn(0x7fbc900d2d10 msgr2=0x7fbc900b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:04.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 shutdown_connections 2023-11-08T12:29:04.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.340+0000 7fbc97837700 1 -- 172.21.15.112:0/4104352639 wait complete. 2023-11-08T12:29:04.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:29:04.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f30749f2700 1 Processor -- start 2023-11-08T12:29:04.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f30749f2700 1 -- start start 2023-11-08T12:29:04.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f30749f2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30700ada10 0x7f3070160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f30749f2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f30700c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f30749f2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700ca3b0 con 0x7f307006c040 2023-11-08T12:29:04.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f30749f2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30701608b0 con 0x7f30700ada10 2023-11-08T12:29:04.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f30749f2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30701601f0 con 0x7f307006b220 2023-11-08T12:29:04.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f306e59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30700ada10 0x7f3070160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f306dd9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f30700c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f306ed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f307006c040 0x7f3070069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40822/0 (socket says 172.21.15.112:40822) 2023-11-08T12:29:04.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.536+0000 7f306ed9d700 1 -- 172.21.15.112:0/1320402945 learned_addr learned my addr 172.21.15.112:0/1320402945 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:04.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306dd9b700 1 -- 172.21.15.112:0/1320402945 >> v2:172.21.15.112:3300/0 conn(0x7f30700ada10 msgr2=0x7f3070160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:04.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306dd9b700 1 --2- 172.21.15.112:0/1320402945 >> v2:172.21.15.112:3300/0 conn(0x7f30700ada10 0x7f3070160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306dd9b700 1 -- 172.21.15.112:0/1320402945 >> v1:172.21.15.133:6789/0 conn(0x7f307006c040 legacy=0x7f3070069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306dd9b700 1 -- 172.21.15.112:0/1320402945 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30701604d0 con 0x7f307006b220 2023-11-08T12:29:04.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306dd9b700 1 --2- 172.21.15.112:0/1320402945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f30700c9b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3064009850 tx=0x7f3064009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f1676c7fb470f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306d59a700 1 -- 172.21.15.112:0/1320402945 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064011830 con 0x7f307006b220 2023-11-08T12:29:04.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306d59a700 1 -- 172.21.15.112:0/1320402945 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3064011990 con 0x7f307006b220 2023-11-08T12:29:04.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f306d59a700 1 -- 172.21.15.112:0/1320402945 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064011d40 con 0x7f307006b220 2023-11-08T12:29:04.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 -- 172.21.15.112:0/1320402945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 msgr2=0x7f30700c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 --2- 172.21.15.112:0/1320402945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f30700c9b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3064009850 tx=0x7f3064009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:04.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 -- 172.21.15.112:0/1320402945 shutdown_connections 2023-11-08T12:29:04.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 --2- 172.21.15.112:0/1320402945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f30700c9b80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 --2- 172.21.15.112:0/1320402945 >> v2:172.21.15.112:3300/0 conn(0x7f30700ada10 0x7f3070160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 -- 172.21.15.112:0/1320402945 >> 172.21.15.112:0/1320402945 conn(0x7f30700cf580 msgr2=0x7f30700cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:04.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 -- 172.21.15.112:0/1320402945 shutdown_connections 2023-11-08T12:29:04.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.540+0000 7f30749f2700 1 -- 172.21.15.112:0/1320402945 wait complete. 2023-11-08T12:29:04.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.544+0000 7f30749f2700 1 Processor -- start 2023-11-08T12:29:04.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.544+0000 7f30749f2700 1 -- start start 2023-11-08T12:29:04.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f307014aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f307006c040 0x7f30700b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700ada10 0x7f30700708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307015cb20 con 0x7f30700ada10 2023-11-08T12:29:04.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307015d980 con 0x7f307006c040 2023-11-08T12:29:04.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307015de10 con 0x7f307006b220 2023-11-08T12:29:04.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700ada10 0x7f30700708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700ada10 0x7f30700708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44880/0 (socket says 172.21.15.112:44880) 2023-11-08T12:29:04.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 -- 172.21.15.112:0/2374088758 learned_addr learned my addr 172.21.15.112:0/2374088758 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:04.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306e59c700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f307014aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306dd9b700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f307006c040 0x7f30700b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 -- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 msgr2=0x7f307014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f307014aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 -- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f307006c040 msgr2=0x7f30700b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f307006c040 0x7f30700b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 -- 172.21.15.112:0/2374088758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640094b0 con 0x7f30700ada10 2023-11-08T12:29:04.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306e59c700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f307014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:04.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306dd9b700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f307006c040 0x7f30700b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:04.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f306ed9d700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700ada10 0x7f30700708e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f306800cab0 tx=0x7f306800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f305effd700 1 -- 172.21.15.112:0/2374088758 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800a770 con 0x7f30700ada10 2023-11-08T12:29:04.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f305effd700 1 -- 172.21.15.112:0/2374088758 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800a8d0 con 0x7f30700ada10 2023-11-08T12:29:04.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f305effd700 1 -- 172.21.15.112:0/2374088758 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800ac40 con 0x7f30700ada10 2023-11-08T12:29:04.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30700ca690 con 0x7f30700ada10 2023-11-08T12:29:04.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.548+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30700ca0c0 con 0x7f30700ada10 2023-11-08T12:29:04.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.552+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30700adde0 con 0x7f30700ada10 2023-11-08T12:29:04.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.552+0000 7f305effd700 1 -- 172.21.15.112:0/2374088758 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3068019030 con 0x7f30700ada10 2023-11-08T12:29:04.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.552+0000 7f305effd700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3050064ee0 0x7f3050067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.552+0000 7f305effd700 1 -- 172.21.15.112:0/2374088758 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3068081a30 con 0x7f30700ada10 2023-11-08T12:29:04.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.552+0000 7f306e59c700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3050064ee0 0x7f3050067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.552+0000 7f306e59c700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3050064ee0 0x7f3050067390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3060009ba0 tx=0x7f3060008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.560+0000 7f305effd700 1 -- 172.21.15.112:0/2374088758 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f306804a400 con 0x7f30700ada10 2023-11-08T12:29:04.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.728+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30700726c0 con 0x7f30700ada10 2023-11-08T12:29:04.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.728+0000 7f305effd700 1 -- 172.21.15.112:0/2374088758 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3068017020 con 0x7f30700ada10 2023-11-08T12:29:04.733 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:29:04.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3050064ee0 msgr2=0x7f3050067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3050064ee0 0x7f3050067390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3060009ba0 tx=0x7f3060008040 comp rx=0 tx=0).stop 2023-11-08T12:29:04.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700ada10 msgr2=0x7f30700708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700ada10 0x7f30700708e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f306800cab0 tx=0x7f306800cb90 comp rx=0 tx=0).stop 2023-11-08T12:29:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 shutdown_connections 2023-11-08T12:29:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3050064ee0 0x7f3050067390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30700ada10 0x7f30700708e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f307006c040 0x7f30700b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 --2- 172.21.15.112:0/2374088758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f307006b220 0x7f307014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 >> 172.21.15.112:0/2374088758 conn(0x7f30700cf580 msgr2=0x7f307006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 shutdown_connections 2023-11-08T12:29:04.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.732+0000 7f30749f2700 1 -- 172.21.15.112:0/2374088758 wait complete. 2023-11-08T12:29:04.756 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:29:04.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.924+0000 7f63eb59e700 1 Processor -- start 2023-11-08T12:29:04.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.924+0000 7f63eb59e700 1 -- start start 2023-11-08T12:29:04.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63eb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b3d00 0x7f63ec06a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63eb59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec15c520 con 0x7f63ec070620 2023-11-08T12:29:04.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63eb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec06cc50 con 0x7f63ec15c150 2023-11-08T12:29:04.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63eb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0d2450 con 0x7f63ec0b3d00 2023-11-08T12:29:04.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63e9d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f63ec070620 0x7f63ec069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35200/0 (socket says 172.21.15.112:35200) 2023-11-08T12:29:04.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63e9d9b700 1 -- 172.21.15.112:0/1802182838 learned_addr learned my addr 172.21.15.112:0/1802182838 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:04.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63ead9d700 1 --2- 172.21.15.112:0/1802182838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b3d00 0x7f63ec06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63e959a700 1 -- 172.21.15.112:0/1802182838 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617564720 0 0) 0x7f63ec15c520 con 0x7f63ec070620 2023-11-08T12:29:04.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63e959a700 1 -- 172.21.15.112:0/1802182838 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d40035d0 con 0x7f63ec070620 2023-11-08T12:29:04.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63e959a700 1 -- 172.21.15.112:0/1802182838 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395941710 0 0) 0x7f63ec06cc50 con 0x7f63ec15c150 2023-11-08T12:29:04.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63e959a700 1 -- 172.21.15.112:0/1802182838 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ec15c520 con 0x7f63ec15c150 2023-11-08T12:29:04.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63ead9d700 1 -- 172.21.15.112:0/1802182838 >> v1:172.21.15.133:6789/0 conn(0x7f63ec15c150 legacy=0x7f63ec06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63ead9d700 1 -- 172.21.15.112:0/1802182838 >> v1:172.21.15.112:6789/0 conn(0x7f63ec070620 legacy=0x7f63ec069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.928+0000 7f63ead9d700 1 -- 172.21.15.112:0/1802182838 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0d2730 con 0x7f63ec0b3d00 2023-11-08T12:29:04.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63ead9d700 1 --2- 172.21.15.112:0/1802182838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b3d00 0x7f63ec06a300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009dc0 tx=0x7f63e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89a342d654672c95 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63e959a700 1 -- 172.21.15.112:0/1802182838 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400e070 con 0x7f63ec0b3d00 2023-11-08T12:29:04.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63e959a700 1 -- 172.21.15.112:0/1802182838 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400bb20 con 0x7f63ec0b3d00 2023-11-08T12:29:04.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63e959a700 1 -- 172.21.15.112:0/1802182838 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4012430 con 0x7f63ec0b3d00 2023-11-08T12:29:04.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63eb59e700 1 -- 172.21.15.112:0/1802182838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b3d00 msgr2=0x7f63ec06a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1802182838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b3d00 0x7f63ec06a300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009dc0 tx=0x7f63e400b330 comp rx=0 tx=0).stop 2023-11-08T12:29:04.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63eb59e700 1 -- 172.21.15.112:0/1802182838 shutdown_connections 2023-11-08T12:29:04.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1802182838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec0b3d00 0x7f63ec06a300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63eb59e700 1 -- 172.21.15.112:0/1802182838 >> 172.21.15.112:0/1802182838 conn(0x7f63ec0d3680 msgr2=0x7f63ec0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:04.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63eb59e700 1 -- 172.21.15.112:0/1802182838 shutdown_connections 2023-11-08T12:29:04.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.932+0000 7f63eb59e700 1 -- 172.21.15.112:0/1802182838 wait complete. 2023-11-08T12:29:04.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 Processor -- start 2023-11-08T12:29:04.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 -- start start 2023-11-08T12:29:04.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec070620 0x7f63ec151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b3d00 0x7f63ec0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec15c150 0x7f63ec0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec147dc0 con 0x7f63ec15c150 2023-11-08T12:29:04.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec153290 con 0x7f63ec0b3d00 2023-11-08T12:29:04.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63eb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec152680 con 0x7f63ec070620 2023-11-08T12:29:04.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.936+0000 7f63ead9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec15c150 0x7f63ec0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec15c150 0x7f63ec0b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44888/0 (socket says 172.21.15.112:44888) 2023-11-08T12:29:04.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 -- 172.21.15.112:0/1491499129 learned_addr learned my addr 172.21.15.112:0/1491499129 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:04.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ea59c700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec070620 0x7f63ec151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63e9d9b700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b3d00 0x7f63ec0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 -- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec070620 msgr2=0x7f63ec151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec070620 0x7f63ec151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 -- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b3d00 msgr2=0x7f63ec0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b3d00 0x7f63ec0cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 -- 172.21.15.112:0/1491499129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009a70 con 0x7f63ec15c150 2023-11-08T12:29:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63ead9d700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec15c150 0x7f63ec0b5b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b370 tx=0x7f63e4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63daffd700 1 -- 172.21.15.112:0/1491499129 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e401b810 con 0x7f63ec15c150 2023-11-08T12:29:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63daffd700 1 -- 172.21.15.112:0/1491499129 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4020070 con 0x7f63ec15c150 2023-11-08T12:29:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63daffd700 1 -- 172.21.15.112:0/1491499129 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e401bbb0 con 0x7f63ec15c150 2023-11-08T12:29:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec0d2140 con 0x7f63ec15c150 2023-11-08T12:29:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec0d05e0 con 0x7f63ec15c150 2023-11-08T12:29:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.940+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec070cd0 con 0x7f63ec15c150 2023-11-08T12:29:04.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.944+0000 7f63daffd700 1 -- 172.21.15.112:0/1491499129 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f63e402e070 con 0x7f63ec15c150 2023-11-08T12:29:04.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.944+0000 7f63daffd700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63cc064ee0 0x7f63cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:04.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.944+0000 7f63daffd700 1 -- 172.21.15.112:0/1491499129 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f63e4022070 con 0x7f63ec15c150 2023-11-08T12:29:04.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.944+0000 7f63ea59c700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63cc064ee0 0x7f63cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:04.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.948+0000 7f63ea59c700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63cc064ee0 0x7f63cc067390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0011e0 tx=0x7f63dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:04.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:04.952+0000 7f63daffd700 1 -- 172.21.15.112:0/1491499129 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63e4051f50 con 0x7f63ec15c150 2023-11-08T12:29:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.124+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63ec153400 con 0x7f63ec15c150 2023-11-08T12:29:05.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.124+0000 7f63daffd700 1 -- 172.21.15.112:0/1491499129 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63e4055570 con 0x7f63ec15c150 2023-11-08T12:29:05.129 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:29:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63cc064ee0 msgr2=0x7f63cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63cc064ee0 0x7f63cc067390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0011e0 tx=0x7f63dc009040 comp rx=0 tx=0).stop 2023-11-08T12:29:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec15c150 msgr2=0x7f63ec0b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec15c150 0x7f63ec0b5b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63e400b370 tx=0x7f63e4004af0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 shutdown_connections 2023-11-08T12:29:05.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63cc064ee0 0x7f63cc067390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63ec15c150 0x7f63ec0b5b60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ec0b3d00 0x7f63ec0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 --2- 172.21.15.112:0/1491499129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ec070620 0x7f63ec151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.128+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 >> 172.21.15.112:0/1491499129 conn(0x7f63ec0d3680 msgr2=0x7f63ec06ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:05.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.132+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 shutdown_connections 2023-11-08T12:29:05.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.132+0000 7f63eb59e700 1 -- 172.21.15.112:0/1491499129 wait complete. 2023-11-08T12:29:05.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:29:05.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.328+0000 7f6813fff700 1 Processor -- start 2023-11-08T12:29:05.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.328+0000 7f6813fff700 1 -- start start 2023-11-08T12:29:05.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f681415c0f0 0x7f68140d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68140b85f0 0x7f68140b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f681406bbe0 0x7f681406c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68140b8c40 con 0x7f68140b85f0 2023-11-08T12:29:05.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681406c5c0 con 0x7f681415c0f0 2023-11-08T12:29:05.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68140b8a40 con 0x7f681406bbe0 2023-11-08T12:29:05.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68140b85f0 0x7f68140b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68140b85f0 0x7f68140b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47822/0 (socket says 172.21.15.112:47822) 2023-11-08T12:29:05.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 -- 172.21.15.112:0/2996896185 learned_addr learned my addr 172.21.15.112:0/2996896185 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:05.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6812ffd700 1 --2- 172.21.15.112:0/2996896185 >> v2:172.21.15.133:3300/0 conn(0x7f681415c0f0 0x7f68140d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68137fe700 1 --2- 172.21.15.112:0/2996896185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f681406bbe0 0x7f681406c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 -- 172.21.15.112:0/2996896185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f681406bbe0 msgr2=0x7f681406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:05.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 --2- 172.21.15.112:0/2996896185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f681406bbe0 0x7f681406c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 -- 172.21.15.112:0/2996896185 >> v2:172.21.15.133:3300/0 conn(0x7f681415c0f0 msgr2=0x7f68140d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:05.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 --2- 172.21.15.112:0/2996896185 >> v2:172.21.15.133:3300/0 conn(0x7f681415c0f0 0x7f68140d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 -- 172.21.15.112:0/2996896185 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140b65c0 con 0x7f68140b85f0 2023-11-08T12:29:05.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f68127fc700 1 --2- 172.21.15.112:0/2996896185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68140b85f0 0x7f68140b6a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f68140b8db0 tx=0x7f6808009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776eb7ffae2af2c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:05.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6811ffb700 1 -- 172.21.15.112:0/2996896185 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680800ba20 con 0x7f68140b85f0 2023-11-08T12:29:05.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6811ffb700 1 -- 172.21.15.112:0/2996896185 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680800bb80 con 0x7f68140b85f0 2023-11-08T12:29:05.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6811ffb700 1 -- 172.21.15.112:0/2996896185 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808009e60 con 0x7f68140b85f0 2023-11-08T12:29:05.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 -- 172.21.15.112:0/2996896185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68140b85f0 msgr2=0x7f68140b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 --2- 172.21.15.112:0/2996896185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68140b85f0 0x7f68140b6a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f68140b8db0 tx=0x7f6808009c20 comp rx=0 tx=0).stop 2023-11-08T12:29:05.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 -- 172.21.15.112:0/2996896185 shutdown_connections 2023-11-08T12:29:05.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 --2- 172.21.15.112:0/2996896185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f681406bbe0 0x7f681406c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 --2- 172.21.15.112:0/2996896185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68140b85f0 0x7f68140b6a50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 --2- 172.21.15.112:0/2996896185 >> v2:172.21.15.133:3300/0 conn(0x7f681415c0f0 0x7f68140d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.332+0000 7f6813fff700 1 -- 172.21.15.112:0/2996896185 >> 172.21.15.112:0/2996896185 conn(0x7f68140d01d0 msgr2=0x7f68140d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:05.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.336+0000 7f6813fff700 1 -- 172.21.15.112:0/2996896185 shutdown_connections 2023-11-08T12:29:05.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.336+0000 7f6813fff700 1 -- 172.21.15.112:0/2996896185 wait complete. 2023-11-08T12:29:05.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.336+0000 7f6813fff700 1 Processor -- start 2023-11-08T12:29:05.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.336+0000 7f6813fff700 1 -- start start 2023-11-08T12:29:05.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.336+0000 7f6813fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f681406bbe0 0x7f6814141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6813fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68140b85f0 0x7f68141e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6813fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f681415c0f0 0x7f68141e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6813fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68141e61a0 con 0x7f681415c0f0 2023-11-08T12:29:05.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6813fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68141e3f40 con 0x7f681406bbe0 2023-11-08T12:29:05.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6813fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68141e5590 con 0x7f68140b85f0 2023-11-08T12:29:05.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f681415c0f0 0x7f68141e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f681415c0f0 0x7f68141e4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47834/0 (socket says 172.21.15.112:47834) 2023-11-08T12:29:05.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 -- 172.21.15.112:0/253212111 learned_addr learned my addr 172.21.15.112:0/253212111 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:05.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68127fc700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68140b85f0 0x7f68141e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6812ffd700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f681406bbe0 0x7f6814141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 -- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68140b85f0 msgr2=0x7f68141e3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68140b85f0 0x7f68141e3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 -- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f681406bbe0 msgr2=0x7f6814141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f681406bbe0 0x7f6814141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 -- 172.21.15.112:0/253212111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808009570 con 0x7f681415c0f0 2023-11-08T12:29:05.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f68137fe700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f681415c0f0 0x7f68141e4af0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f680c007e40 tx=0x7f680c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:05.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f67fb7fe700 1 -- 172.21.15.112:0/253212111 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c00ed30 con 0x7f681415c0f0 2023-11-08T12:29:05.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f67fb7fe700 1 -- 172.21.15.112:0/253212111 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c014420 con 0x7f681415c0f0 2023-11-08T12:29:05.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68140b5f70 con 0x7f681415c0f0 2023-11-08T12:29:05.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f67fb7fe700 1 -- 172.21.15.112:0/253212111 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0147d0 con 0x7f681415c0f0 2023-11-08T12:29:05.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.340+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68140b5c90 con 0x7f681415c0f0 2023-11-08T12:29:05.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.344+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68140b6250 con 0x7f681415c0f0 2023-11-08T12:29:05.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.344+0000 7f67fb7fe700 1 -- 172.21.15.112:0/253212111 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f680c012050 con 0x7f681415c0f0 2023-11-08T12:29:05.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.348+0000 7f67fb7fe700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6800064ee0 0x7f6800067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.348+0000 7f67fb7fe700 1 -- 172.21.15.112:0/253212111 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f680c0826f0 con 0x7f681415c0f0 2023-11-08T12:29:05.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.348+0000 7f6812ffd700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6800064ee0 0x7f6800067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.348+0000 7f6812ffd700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6800064ee0 0x7f6800067390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68040079e0 tx=0x7f6804008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:05.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.352+0000 7f67fb7fe700 1 -- 172.21.15.112:0/253212111 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f680c050560 con 0x7f681415c0f0 2023-11-08T12:29:05.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.520+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6814073cb0 con 0x7f681415c0f0 2023-11-08T12:29:05.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.520+0000 7f67fb7fe700 1 -- 172.21.15.112:0/253212111 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f680c053b80 con 0x7f681415c0f0 2023-11-08T12:29:05.525 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:29:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6800064ee0 msgr2=0x7f6800067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6800064ee0 0x7f6800067390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68040079e0 tx=0x7f6804008040 comp rx=0 tx=0).stop 2023-11-08T12:29:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f681415c0f0 msgr2=0x7f68141e4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f681415c0f0 0x7f68141e4af0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f680c007e40 tx=0x7f680c00e3c0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 shutdown_connections 2023-11-08T12:29:05.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6800064ee0 0x7f6800067390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f681415c0f0 0x7f68141e4af0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68140b85f0 0x7f68141e3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 --2- 172.21.15.112:0/253212111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f681406bbe0 0x7f6814141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 >> 172.21.15.112:0/253212111 conn(0x7f68140d01d0 msgr2=0x7f6814069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:05.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 shutdown_connections 2023-11-08T12:29:05.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.524+0000 7f6813fff700 1 -- 172.21.15.112:0/253212111 wait complete. 2023-11-08T12:29:05.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-08T12:29:05.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b985f9700 1 Processor -- start 2023-11-08T12:29:05.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b985f9700 1 -- start start 2023-11-08T12:29:05.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b985f9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b9015c6f0 0x7f9b9006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b985f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b900ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b985f9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9006d030 con 0x7f9b900ce560 2023-11-08T12:29:05.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b985f9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9006a090 con 0x7f9b9015c6f0 2023-11-08T12:29:05.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b985f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9015cac0 con 0x7f9b900b4a10 2023-11-08T12:29:05.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b96b96700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9b900ce560 0x7f9b901601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34772/0 (socket says 172.21.15.112:34772) 2023-11-08T12:29:05.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.728+0000 7f9b96b96700 1 -- 172.21.15.112:0/2460452775 learned_addr learned my addr 172.21.15.112:0/2460452775 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:05.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b96395700 1 --2- 172.21.15.112:0/2460452775 >> v2:172.21.15.112:3300/0 conn(0x7f9b9015c6f0 0x7f9b9006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95b94700 1 --2- 172.21.15.112:0/2460452775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b900ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95393700 1 -- 172.21.15.112:0/2460452775 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517380527 0 0) 0x7f9b9006d030 con 0x7f9b900ce560 2023-11-08T12:29:05.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95393700 1 -- 172.21.15.112:0/2460452775 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b7c0035d0 con 0x7f9b900ce560 2023-11-08T12:29:05.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95b94700 1 -- 172.21.15.112:0/2460452775 >> v2:172.21.15.112:3300/0 conn(0x7f9b9015c6f0 msgr2=0x7f9b9006c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:05.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95b94700 1 --2- 172.21.15.112:0/2460452775 >> v2:172.21.15.112:3300/0 conn(0x7f9b9015c6f0 0x7f9b9006c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95b94700 1 -- 172.21.15.112:0/2460452775 >> v1:172.21.15.112:6789/0 conn(0x7f9b900ce560 legacy=0x7f9b901601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95b94700 1 -- 172.21.15.112:0/2460452775 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900ce960 con 0x7f9b900b4a10 2023-11-08T12:29:05.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b96395700 1 --2- 172.21.15.112:0/2460452775 >> v2:172.21.15.112:3300/0 conn(0x7f9b9015c6f0 0x7f9b9006c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:05.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95b94700 1 --2- 172.21.15.112:0/2460452775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b900ce020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009850 tx=0x7f9b80009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4b0f3aac7da3a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:05.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95393700 1 -- 172.21.15.112:0/2460452775 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80011830 con 0x7f9b900b4a10 2023-11-08T12:29:05.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95393700 1 -- 172.21.15.112:0/2460452775 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80011990 con 0x7f9b900b4a10 2023-11-08T12:29:05.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b95393700 1 -- 172.21.15.112:0/2460452775 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80011d40 con 0x7f9b900b4a10 2023-11-08T12:29:05.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 -- 172.21.15.112:0/2460452775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 msgr2=0x7f9b900ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2460452775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b900ce020 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009850 tx=0x7f9b80009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:05.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 -- 172.21.15.112:0/2460452775 shutdown_connections 2023-11-08T12:29:05.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2460452775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b900ce020 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2460452775 >> v2:172.21.15.112:3300/0 conn(0x7f9b9015c6f0 0x7f9b9006c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 -- 172.21.15.112:0/2460452775 >> 172.21.15.112:0/2460452775 conn(0x7f9b900d3830 msgr2=0x7f9b900cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:05.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 -- 172.21.15.112:0/2460452775 shutdown_connections 2023-11-08T12:29:05.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.732+0000 7f9b985f9700 1 -- 172.21.15.112:0/2460452775 wait complete. 2023-11-08T12:29:05.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 Processor -- start 2023-11-08T12:29:05.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 -- start start 2023-11-08T12:29:05.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b9015f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b900ce560 0x7f9b900d1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b9015c6f0 0x7f9b900d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b90159190 con 0x7f9b900ce560 2023-11-08T12:29:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b901582a0 con 0x7f9b9015c6f0 2023-11-08T12:29:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b985f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b90158580 con 0x7f9b900b4a10 2023-11-08T12:29:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b95b94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b900ce560 0x7f9b900d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b95b94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b900ce560 0x7f9b900d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47864/0 (socket says 172.21.15.112:47864) 2023-11-08T12:29:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b95b94700 1 -- 172.21.15.112:0/2766663217 learned_addr learned my addr 172.21.15.112:0/2766663217 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b96395700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b9015f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b95b94700 1 -- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 msgr2=0x7f9b9015f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b95b94700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b9015f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b95b94700 1 -- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b9015c6f0 msgr2=0x7f9b900d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.736+0000 7f9b96b96700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b9015c6f0 0x7f9b900d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b95b94700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b9015c6f0 0x7f9b900d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b95b94700 1 -- 172.21.15.112:0/2766663217 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c0094b0 con 0x7f9b900ce560 2023-11-08T12:29:05.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b96b96700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b9015c6f0 0x7f9b900d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:05.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b95b94700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b900ce560 0x7f9b900d1560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b800090b0 tx=0x7f9b80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:05.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b86ffd700 1 -- 172.21.15.112:0/2766663217 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80004480 con 0x7f9b900ce560 2023-11-08T12:29:05.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b86ffd700 1 -- 172.21.15.112:0/2766663217 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8001f070 con 0x7f9b900ce560 2023-11-08T12:29:05.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800094b0 con 0x7f9b900ce560 2023-11-08T12:29:05.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b86ffd700 1 -- 172.21.15.112:0/2766663217 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80003900 con 0x7f9b900ce560 2023-11-08T12:29:05.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9006cd50 con 0x7f9b900ce560 2023-11-08T12:29:05.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9006ca70 con 0x7f9b900ce560 2023-11-08T12:29:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.740+0000 7f9b86ffd700 1 -- 172.21.15.112:0/2766663217 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9b8002a020 con 0x7f9b900ce560 2023-11-08T12:29:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.744+0000 7f9b86ffd700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9b74064ee0 0x7f9b74067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.744+0000 7f9b86ffd700 1 -- 172.21.15.112:0/2766663217 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b80083670 con 0x7f9b900ce560 2023-11-08T12:29:05.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.744+0000 7f9b96395700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9b74064ee0 0x7f9b74067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:05.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.744+0000 7f9b96395700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9b74064ee0 0x7f9b74067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009c70 tx=0x7f9b8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:05.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.752+0000 7f9b86ffd700 1 -- 172.21.15.112:0/2766663217 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9b800514e0 con 0x7f9b900ce560 2023-11-08T12:29:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.932+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9b90069d20 con 0x7f9b900ce560 2023-11-08T12:29:05.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.936+0000 7f9b86ffd700 1 -- 172.21.15.112:0/2766663217 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b800150a0 con 0x7f9b900ce560 2023-11-08T12:29:05.938 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:29:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9b74064ee0 msgr2=0x7f9b74067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9b74064ee0 0x7f9b74067390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009c70 tx=0x7f9b8c008040 comp rx=0 tx=0).stop 2023-11-08T12:29:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b900ce560 msgr2=0x7f9b900d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b900ce560 0x7f9b900d1560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b800090b0 tx=0x7f9b80004770 comp rx=0 tx=0).stop 2023-11-08T12:29:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 shutdown_connections 2023-11-08T12:29:05.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9b74064ee0 0x7f9b74067390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b9015c6f0 0x7f9b900d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b900ce560 0x7f9b900d1560 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 --2- 172.21.15.112:0/2766663217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900b4a10 0x7f9b9015f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:05.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 >> 172.21.15.112:0/2766663217 conn(0x7f9b900d3830 msgr2=0x7f9b9006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:05.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 shutdown_connections 2023-11-08T12:29:05.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:05.940+0000 7f9b985f9700 1 -- 172.21.15.112:0/2766663217 wait complete. 2023-11-08T12:29:05.967 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:06.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.136+0000 7f9ad5948700 1 Processor -- start 2023-11-08T12:29:06.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.136+0000 7f9ad5948700 1 -- start start 2023-11-08T12:29:06.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5948700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ad00715d0 0x7f9ad0160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5948700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c590 0x7f9ad015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5948700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad00ccfd0 con 0x7f9ad015c1c0 2023-11-08T12:29:06.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5948700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad00cca50 con 0x7f9ad00715d0 2023-11-08T12:29:06.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5948700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00cc2a0 con 0x7f9ad015c590 2023-11-08T12:29:06.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad4946700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9ad015c1c0 0x7f9ad015fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34780/0 (socket says 172.21.15.112:34780) 2023-11-08T12:29:06.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad4946700 1 -- 172.21.15.112:0/863735803 learned_addr learned my addr 172.21.15.112:0/863735803 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:06.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9acffff700 1 --2- 172.21.15.112:0/863735803 >> v2:172.21.15.112:3300/0 conn(0x7f9ad00715d0 0x7f9ad0160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5147700 1 --2- 172.21.15.112:0/863735803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c590 0x7f9ad015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9acf7fe700 1 -- 172.21.15.112:0/863735803 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644212496 0 0) 0x7f9ad00ccfd0 con 0x7f9ad015c1c0 2023-11-08T12:29:06.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9acf7fe700 1 -- 172.21.15.112:0/863735803 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac00035d0 con 0x7f9ad015c1c0 2023-11-08T12:29:06.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5147700 1 -- 172.21.15.112:0/863735803 >> v2:172.21.15.112:3300/0 conn(0x7f9ad00715d0 msgr2=0x7f9ad0160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:06.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5147700 1 --2- 172.21.15.112:0/863735803 >> v2:172.21.15.112:3300/0 conn(0x7f9ad00715d0 0x7f9ad0160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5147700 1 -- 172.21.15.112:0/863735803 >> v1:172.21.15.112:6789/0 conn(0x7f9ad015c1c0 legacy=0x7f9ad015fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5147700 1 -- 172.21.15.112:0/863735803 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00cc580 con 0x7f9ad015c590 2023-11-08T12:29:06.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9acffff700 1 --2- 172.21.15.112:0/863735803 >> v2:172.21.15.112:3300/0 conn(0x7f9ad00715d0 0x7f9ad0160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:06.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5147700 1 --2- 172.21.15.112:0/863735803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c590 0x7f9ad015c9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009d90 tx=0x7f9ac800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82edddbb913b5c8b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:06.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9acf7fe700 1 -- 172.21.15.112:0/863735803 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800e070 con 0x7f9ad015c590 2023-11-08T12:29:06.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9acf7fe700 1 -- 172.21.15.112:0/863735803 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac800bb20 con 0x7f9ad015c590 2023-11-08T12:29:06.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9acf7fe700 1 -- 172.21.15.112:0/863735803 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8012430 con 0x7f9ad015c590 2023-11-08T12:29:06.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5948700 1 -- 172.21.15.112:0/863735803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c590 msgr2=0x7f9ad015c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.140+0000 7f9ad5948700 1 --2- 172.21.15.112:0/863735803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c590 0x7f9ad015c9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009d90 tx=0x7f9ac800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:06.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.144+0000 7f9ad5948700 1 -- 172.21.15.112:0/863735803 shutdown_connections 2023-11-08T12:29:06.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.144+0000 7f9ad5948700 1 --2- 172.21.15.112:0/863735803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c590 0x7f9ad015c9d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.144+0000 7f9ad5948700 1 --2- 172.21.15.112:0/863735803 >> v2:172.21.15.112:3300/0 conn(0x7f9ad00715d0 0x7f9ad0160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.144+0000 7f9ad5948700 1 -- 172.21.15.112:0/863735803 >> 172.21.15.112:0/863735803 conn(0x7f9ad006c790 msgr2=0x7f9ad006cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:06.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.144+0000 7f9ad5948700 1 -- 172.21.15.112:0/863735803 shutdown_connections 2023-11-08T12:29:06.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.144+0000 7f9ad5948700 1 -- 172.21.15.112:0/863735803 wait complete. 2023-11-08T12:29:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.144+0000 7f9ad5948700 1 Processor -- start 2023-11-08T12:29:06.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 -- start start 2023-11-08T12:29:06.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ad00715d0 0x7f9ad0150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c1c0 0x7f9ad015df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad015c590 0x7f9ad015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00b1e50 con 0x7f9ad00715d0 2023-11-08T12:29:06.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00b2130 con 0x7f9ad015c590 2023-11-08T12:29:06.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00b2410 con 0x7f9ad015c1c0 2023-11-08T12:29:06.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ad00715d0 0x7f9ad0150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ad00715d0 0x7f9ad0150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47890/0 (socket says 172.21.15.112:47890) 2023-11-08T12:29:06.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9acffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c1c0 0x7f9ad015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 -- 172.21.15.112:0/2541694676 learned_addr learned my addr 172.21.15.112:0/2541694676 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:06.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5147700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad015c590 0x7f9ad015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 -- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c1c0 msgr2=0x7f9ad015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c1c0 0x7f9ad015df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 -- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad015c590 msgr2=0x7f9ad015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad015c590 0x7f9ad015e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 -- 172.21.15.112:0/2541694676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0094b0 con 0x7f9ad00715d0 2023-11-08T12:29:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9acffff700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c1c0 0x7f9ad015df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad4946700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ad00715d0 0x7f9ad0150430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c700 tx=0x7f9ac400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9acd7fa700 1 -- 172.21.15.112:0/2541694676 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4005d90 con 0x7f9ad00715d0 2023-11-08T12:29:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9acd7fa700 1 -- 172.21.15.112:0/2541694676 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac40070d0 con 0x7f9ad00715d0 2023-11-08T12:29:06.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9acd7fa700 1 -- 172.21.15.112:0/2541694676 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4007480 con 0x7f9ad00715d0 2023-11-08T12:29:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.148+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac8009a70 con 0x7f9ad00715d0 2023-11-08T12:29:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.152+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad0071a50 con 0x7f9ad00715d0 2023-11-08T12:29:06.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.152+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad00ccc60 con 0x7f9ad00715d0 2023-11-08T12:29:06.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.152+0000 7f9acd7fa700 1 -- 172.21.15.112:0/2541694676 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9ac4019030 con 0x7f9ad00715d0 2023-11-08T12:29:06.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.156+0000 7f9acd7fa700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9ab4064f10 0x7f9ab40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.156+0000 7f9acd7fa700 1 -- 172.21.15.112:0/2541694676 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9ac40814c0 con 0x7f9ad00715d0 2023-11-08T12:29:06.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.156+0000 7f9acffff700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9ab4064f10 0x7f9ab40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.156+0000 7f9acffff700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9ab4064f10 0x7f9ab40673c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00b08a0 tx=0x7f9abc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:06.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.160+0000 7f9acd7fa700 1 -- 172.21.15.112:0/2541694676 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9ac404f330 con 0x7f9ad00715d0 2023-11-08T12:29:06.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.368+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ad0069bf0 con 0x7f9ad00715d0 2023-11-08T12:29:06.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.368+0000 7f9acd7fa700 1 -- 172.21.15.112:0/2541694676 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f9ac4017090 con 0x7f9ad00715d0 2023-11-08T12:29:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:06.375 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:28:19.810915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T12:29:06.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9ab4064f10 msgr2=0x7f9ab40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9ab4064f10 0x7f9ab40673c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00b08a0 tx=0x7f9abc009240 comp rx=0 tx=0).stop 2023-11-08T12:29:06.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ad00715d0 msgr2=0x7f9ad0150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ad00715d0 0x7f9ad0150430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c700 tx=0x7f9ac400ca10 comp rx=0 tx=0).stop 2023-11-08T12:29:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 shutdown_connections 2023-11-08T12:29:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9ab4064f10 0x7f9ab40673c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad015c590 0x7f9ad015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ad015c1c0 0x7f9ad015df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 --2- 172.21.15.112:0/2541694676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ad00715d0 0x7f9ad0150430 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 >> 172.21.15.112:0/2541694676 conn(0x7f9ad006c790 msgr2=0x7f9ad00cede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 shutdown_connections 2023-11-08T12:29:06.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.372+0000 7f9ad5948700 1 -- 172.21.15.112:0/2541694676 wait complete. 2023-11-08T12:29:06.380 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-11-08T12:29:06.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:06.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.576+0000 7f695d158700 1 Processor -- start 2023-11-08T12:29:06.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.576+0000 7f695d158700 1 -- start start 2023-11-08T12:29:06.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f695d158700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69580cd0d0 0x7f69580b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f695d158700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f695806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f695d158700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69580c9d40 con 0x7f695815c650 2023-11-08T12:29:06.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f695d158700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695806b140 con 0x7f69580cd0d0 2023-11-08T12:29:06.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f695d158700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580cd5d0 con 0x7f69580b1b80 2023-11-08T12:29:06.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6957fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f695815c650 0x7f695806b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34792/0 (socket says 172.21.15.112:34792) 2023-11-08T12:29:06.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6957fff700 1 -- 172.21.15.112:0/3278104227 learned_addr learned my addr 172.21.15.112:0/3278104227 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:06.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f695c957700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f695806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f69577fe700 1 --2- 172.21.15.112:0/3278104227 >> v2:172.21.15.133:3300/0 conn(0x7f69580cd0d0 0x7f69580b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227360100 0 0) 0x7f69580c9d40 con 0x7f695815c650 2023-11-08T12:29:06.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69400057e0 con 0x7f695815c650 2023-11-08T12:29:06.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132390605 0 0) 0x7f69400057e0 con 0x7f695815c650 2023-11-08T12:29:06.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 msgr2=0x7f695806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:06.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f695806bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 >> v2:172.21.15.133:3300/0 conn(0x7f69580cd0d0 msgr2=0x7f69580b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:06.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 --2- 172.21.15.112:0/3278104227 >> v2:172.21.15.133:3300/0 conn(0x7f69580cd0d0 0x7f69580b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580cd8b0 con 0x7f695815c650 2023-11-08T12:29:06.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f6948001670 con 0x7f695815c650 2023-11-08T12:29:06.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 >> v1:172.21.15.112:6789/0 conn(0x7f695815c650 legacy=0x7f695806b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6940005c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69400061b0 0x7f6940006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6940006fc0 0x7f6940007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580cd5d0 con 0x7f69400061b0 2023-11-08T12:29:06.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694000dc40 con 0x7f6940006fc0 2023-11-08T12:29:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.580+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694000dd80 con 0x7f69580b1b80 2023-11-08T12:29:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f69577fe700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69400061b0 0x7f6940006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6957fff700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6940005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695c957700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6940006fc0 0x7f6940007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6957fff700 1 -- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6940006fc0 msgr2=0x7f6940007430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:06.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6957fff700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6940006fc0 0x7f6940007430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6957fff700 1 -- 172.21.15.112:0/3278104227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69400061b0 msgr2=0x7f6940006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6957fff700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69400061b0 0x7f6940006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6957fff700 1 -- 172.21.15.112:0/3278104227 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400057e0 con 0x7f69580b1b80 2023-11-08T12:29:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f69577fe700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69400061b0 0x7f6940006a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6957fff700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6940005c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f694800c320 tx=0x7f6940007ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3566425443812400 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:06.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800ce60 con 0x7f69580b1b80 2023-11-08T12:29:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948005980 con 0x7f69580b1b80 2023-11-08T12:29:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f6956ffd700 1 -- 172.21.15.112:0/3278104227 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948005d10 con 0x7f69580b1b80 2023-11-08T12:29:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695d158700 1 -- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 msgr2=0x7f6940005c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695d158700 1 --2- 172.21.15.112:0/3278104227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6940005c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f694800c320 tx=0x7f6940007ab0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695c957700 1 -- 172.21.15.112:0/3278104227 reap_dead start 2023-11-08T12:29:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695d158700 1 -- 172.21.15.112:0/3278104227 shutdown_connections 2023-11-08T12:29:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695d158700 1 -- 172.21.15.112:0/3278104227 >> 172.21.15.112:0/3278104227 conn(0x7f69580b0f80 msgr2=0x7f69580ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695d158700 1 -- 172.21.15.112:0/3278104227 shutdown_connections 2023-11-08T12:29:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.584+0000 7f695d158700 1 -- 172.21.15.112:0/3278104227 wait complete. 2023-11-08T12:29:06.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 Processor -- start 2023-11-08T12:29:06.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 -- start start 2023-11-08T12:29:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6958156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69580c7cd0 0x7f6958158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69581ee610 0x7f69581edac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958153570 con 0x7f69580c7cd0 2023-11-08T12:29:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958157300 con 0x7f69581ee610 2023-11-08T12:29:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f695d158700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69581575e0 con 0x7f69580b1b80 2023-11-08T12:29:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.588+0000 7f69577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69580c7cd0 0x7f6958158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69580c7cd0 0x7f6958158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47918/0 (socket says 172.21.15.112:47918) 2023-11-08T12:29:06.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 -- 172.21.15.112:0/161452371 learned_addr learned my addr 172.21.15.112:0/161452371 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f6957fff700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6958156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f695c957700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69581ee610 0x7f69581edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 -- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 msgr2=0x7f6958156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6958156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 -- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69581ee610 msgr2=0x7f69581edac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69581ee610 0x7f69581edac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 -- 172.21.15.112:0/161452371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580c9680 con 0x7f69580c7cd0 2023-11-08T12:29:06.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f6957fff700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6958156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:06.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f69577fe700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69580c7cd0 0x7f6958158670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f694c011cd0 tx=0x7f694c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:06.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f6954ff9700 1 -- 172.21.15.112:0/161452371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00fab0 con 0x7f69580c7cd0 2023-11-08T12:29:06.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f6954ff9700 1 -- 172.21.15.112:0/161452371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00fc30 con 0x7f69580c7cd0 2023-11-08T12:29:06.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f6954ff9700 1 -- 172.21.15.112:0/161452371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c004020 con 0x7f69580c7cd0 2023-11-08T12:29:06.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69580c99d0 con 0x7f69580c7cd0 2023-11-08T12:29:06.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695806bed0 con 0x7f69580c7cd0 2023-11-08T12:29:06.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.592+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958073cb0 con 0x7f69580c7cd0 2023-11-08T12:29:06.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.596+0000 7f6954ff9700 1 -- 172.21.15.112:0/161452371 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f694c024070 con 0x7f69580c7cd0 2023-11-08T12:29:06.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.596+0000 7f6954ff9700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6944064ee0 0x7f6944067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.596+0000 7f6954ff9700 1 -- 172.21.15.112:0/161452371 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f694c082680 con 0x7f69580c7cd0 2023-11-08T12:29:06.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.596+0000 7f6957fff700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6944064ee0 0x7f6944067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.596+0000 7f6957fff700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6944064ee0 0x7f6944067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6948000c00 tx=0x7f694800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:06.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.604+0000 7f6954ff9700 1 -- 172.21.15.112:0/161452371 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f694c050400 con 0x7f69580c7cd0 2023-11-08T12:29:06.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.780+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69580b1940 con 0x7f69580c7cd0 2023-11-08T12:29:06.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f6954ff9700 1 -- 172.21.15.112:0/161452371 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f694c022020 con 0x7f69580c7cd0 2023-11-08T12:29:06.787 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:06.789 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:06.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6944064ee0 msgr2=0x7f6944067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6944064ee0 0x7f6944067390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6948000c00 tx=0x7f694800a000 comp rx=0 tx=0).stop 2023-11-08T12:29:06.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69580c7cd0 msgr2=0x7f6958158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69580c7cd0 0x7f6958158670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f694c011cd0 tx=0x7f694c009f00 comp rx=0 tx=0).stop 2023-11-08T12:29:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 shutdown_connections 2023-11-08T12:29:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6944064ee0 0x7f6944067390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69581ee610 0x7f69581edac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69580c7cd0 0x7f6958158670 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 --2- 172.21.15.112:0/161452371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69580b1b80 0x7f6958156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.784+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 >> 172.21.15.112:0/161452371 conn(0x7f69580b0f80 msgr2=0x7f69581597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.788+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 shutdown_connections 2023-11-08T12:29:06.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.788+0000 7f695d158700 1 -- 172.21.15.112:0/161452371 wait complete. 2023-11-08T12:29:06.814 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T12:29:06.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:06.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.984+0000 7f811359e700 1 Processor -- start 2023-11-08T12:29:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.984+0000 7f811359e700 1 -- start start 2023-11-08T12:29:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81140b43a0 0x7f811415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8114070790 0x7f811406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811415a550 con 0x7f81140b1640 2023-11-08T12:29:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811406b0a0 con 0x7f8114070790 2023-11-08T12:29:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140caac0 con 0x7f81140b43a0 2023-11-08T12:29:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8111d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f81140b1640 0x7f8114070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34800/0 (socket says 172.21.15.112:34800) 2023-11-08T12:29:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8111d9b700 1 -- 172.21.15.112:0/4138621492 learned_addr learned my addr 172.21.15.112:0/4138621492 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8112d9d700 1 --2- 172.21.15.112:0/4138621492 >> v2:172.21.15.112:3300/0 conn(0x7f8114070790 0x7f811406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811259c700 1 --2- 172.21.15.112:0/4138621492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81140b43a0 0x7f811415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811159a700 1 -- 172.21.15.112:0/4138621492 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172683105 0 0) 0x7f8108001110 con 0x7f81140b1640 2023-11-08T12:29:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8112d9d700 1 -- 172.21.15.112:0/4138621492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81140b43a0 msgr2=0x7f811415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8112d9d700 1 --2- 172.21.15.112:0/4138621492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81140b43a0 0x7f811415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8112d9d700 1 -- 172.21.15.112:0/4138621492 >> v1:172.21.15.112:6789/0 conn(0x7f81140b1640 legacy=0x7f8114070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8112d9d700 1 -- 172.21.15.112:0/4138621492 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140cada0 con 0x7f8114070790 2023-11-08T12:29:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f8112d9d700 1 --2- 172.21.15.112:0/4138621492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8114070790 0x7f811406bfd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d90 tx=0x7f810c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331256dea5c1af80 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811159a700 1 -- 172.21.15.112:0/4138621492 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c00e070 con 0x7f8114070790 2023-11-08T12:29:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811159a700 1 -- 172.21.15.112:0/4138621492 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c00bb20 con 0x7f8114070790 2023-11-08T12:29:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.988+0000 7f811159a700 1 -- 172.21.15.112:0/4138621492 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c012430 con 0x7f8114070790 2023-11-08T12:29:06.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 -- 172.21.15.112:0/4138621492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8114070790 msgr2=0x7f811406bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 --2- 172.21.15.112:0/4138621492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8114070790 0x7f811406bfd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d90 tx=0x7f810c00b330 comp rx=0 tx=0).stop 2023-11-08T12:29:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 -- 172.21.15.112:0/4138621492 shutdown_connections 2023-11-08T12:29:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 --2- 172.21.15.112:0/4138621492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8114070790 0x7f811406bfd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 --2- 172.21.15.112:0/4138621492 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81140b43a0 0x7f811415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 -- 172.21.15.112:0/4138621492 >> 172.21.15.112:0/4138621492 conn(0x7f81140b0f80 msgr2=0x7f81140ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 -- 172.21.15.112:0/4138621492 shutdown_connections 2023-11-08T12:29:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 -- 172.21.15.112:0/4138621492 wait complete. 2023-11-08T12:29:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.992+0000 7f811359e700 1 Processor -- start 2023-11-08T12:29:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 -- start start 2023-11-08T12:29:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8114070790 0x7f81140c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81140b1640 0x7f81140c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81140b43a0 0x7f81141ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140c8b80 con 0x7f81140b43a0 2023-11-08T12:29:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811415bfa0 con 0x7f81140b1640 2023-11-08T12:29:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141ef880 con 0x7f8114070790 2023-11-08T12:29:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81140b43a0 0x7f81141ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81140b43a0 0x7f81141ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47928/0 (socket says 172.21.15.112:47928) 2023-11-08T12:29:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 -- 172.21.15.112:0/3375563622 learned_addr learned my addr 172.21.15.112:0/3375563622 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811259c700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8114070790 0x7f81140c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8111d9b700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81140b1640 0x7f81140c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 -- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8114070790 msgr2=0x7f81140c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8114070790 0x7f81140c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 -- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81140b1640 msgr2=0x7f81140c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81140b1640 0x7f81140c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 -- 172.21.15.112:0/3375563622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c009a70 con 0x7f81140b43a0 2023-11-08T12:29:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811259c700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8114070790 0x7f81140c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8112d9d700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81140b43a0 0x7f81141ef340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f810c014040 tx=0x7f810c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8102ffd700 1 -- 172.21.15.112:0/3375563622 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c012430 con 0x7f81140b43a0 2023-11-08T12:29:07.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8102ffd700 1 -- 172.21.15.112:0/3375563622 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c020070 con 0x7f81140b43a0 2023-11-08T12:29:07.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811406b5d0 con 0x7f81140b43a0 2023-11-08T12:29:07.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f8102ffd700 1 -- 172.21.15.112:0/3375563622 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c004280 con 0x7f81140b43a0 2023-11-08T12:29:07.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:06.996+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811406b2f0 con 0x7f81140b43a0 2023-11-08T12:29:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.000+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811415eb10 con 0x7f81140b43a0 2023-11-08T12:29:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.000+0000 7f8102ffd700 1 -- 172.21.15.112:0/3375563622 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f810c0043e0 con 0x7f81140b43a0 2023-11-08T12:29:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.004+0000 7f8102ffd700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f80f4064ee0 0x7f80f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.004+0000 7f8102ffd700 1 -- 172.21.15.112:0/3375563622 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f810c022070 con 0x7f81140b43a0 2023-11-08T12:29:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.004+0000 7f811259c700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f80f4064ee0 0x7f80f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.004+0000 7f811259c700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f80f4064ee0 0x7f80f4067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8104009ba0 tx=0x7f8104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.008+0000 7f8102ffd700 1 -- 172.21.15.112:0/3375563622 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f810c0521b0 con 0x7f81140b43a0 2023-11-08T12:29:07.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.216+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f811415c0e0 con 0x7f81140b43a0 2023-11-08T12:29:07.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.216+0000 7f8102ffd700 1 -- 172.21.15.112:0/3375563622 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f811415c0e0 con 0x7f81140b43a0 2023-11-08T12:29:07.221 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:07.221 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:28:19.810915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T12:29:07.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f80f4064ee0 msgr2=0x7f80f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f80f4064ee0 0x7f80f4067390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8104009ba0 tx=0x7f8104008040 comp rx=0 tx=0).stop 2023-11-08T12:29:07.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81140b43a0 msgr2=0x7f81141ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81140b43a0 0x7f81141ef340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f810c014040 tx=0x7f810c004af0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 shutdown_connections 2023-11-08T12:29:07.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f80f4064ee0 0x7f80f4067390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81140b43a0 0x7f81141ef340 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81140b1640 0x7f81140c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 --2- 172.21.15.112:0/3375563622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8114070790 0x7f81140c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 >> 172.21.15.112:0/3375563622 conn(0x7f81140b0f80 msgr2=0x7f81140cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:07.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 shutdown_connections 2023-11-08T12:29:07.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.220+0000 7f811359e700 1 -- 172.21.15.112:0/3375563622 wait complete. 2023-11-08T12:29:07.229 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-11-08T12:29:07.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:07.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.420+0000 7f53f0ecb700 1 Processor -- start 2023-11-08T12:29:07.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53f0ecb700 1 -- start start 2023-11-08T12:29:07.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53f0ecb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53ec0b1640 0x7f53ec070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53f0ecb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 0x7f53ec0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53f0ecb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec15a550 con 0x7f53ec0b43a0 2023-11-08T12:29:07.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53f0ecb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec06b0a0 con 0x7f53ec0b1640 2023-11-08T12:29:07.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53f0ecb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0caac0 con 0x7f53ec0c9040 2023-11-08T12:29:07.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eb7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f53ec0b43a0 0x7f53ec15e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34804/0 (socket says 172.21.15.112:34804) 2023-11-08T12:29:07.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eb7fe700 1 -- 172.21.15.112:0/1322678339 learned_addr learned my addr 172.21.15.112:0/1322678339 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53ebfff700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 0x7f53ec0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53e3fff700 1 --2- 172.21.15.112:0/1322678339 >> v2:172.21.15.133:3300/0 conn(0x7f53ec0b1640 0x7f53ec070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125563970 0 0) 0x7f53dc001110 con 0x7f53ec0b43a0 2023-11-08T12:29:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d80035d0 con 0x7f53ec0b43a0 2023-11-08T12:29:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987880944 0 0) 0x7f53d80035d0 con 0x7f53ec0b43a0 2023-11-08T12:29:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 msgr2=0x7f53ec0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:07.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 0x7f53ec0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 >> v2:172.21.15.133:3300/0 conn(0x7f53ec0b1640 msgr2=0x7f53ec070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 --2- 172.21.15.112:0/1322678339 >> v2:172.21.15.133:3300/0 conn(0x7f53ec0b1640 0x7f53ec070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0cada0 con 0x7f53ec0b43a0 2023-11-08T12:29:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f53dc001800 con 0x7f53ec0b43a0 2023-11-08T12:29:07.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 >> v1:172.21.15.112:6789/0 conn(0x7f53ec0b43a0 legacy=0x7f53ec15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 0x7f53d8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8003fa0 0x7f53d8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.424+0000 7f53eaffd700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d8004db0 0x7f53d8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec06b0a0 con 0x7f53d8004db0 2023-11-08T12:29:07.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0caac0 con 0x7f53d8003fa0 2023-11-08T12:29:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d800ba60 con 0x7f53ec0c9040 2023-11-08T12:29:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d8004db0 0x7f53d8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53eb7fe700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 0x7f53d8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53e3fff700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8003fa0 0x7f53d8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 -- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 msgr2=0x7f53d8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:07.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0c9040 0x7f53d8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 -- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8003fa0 msgr2=0x7f53d8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:07.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8003fa0 0x7f53d8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 -- 172.21.15.112:0/1322678339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80035d0 con 0x7f53d8004db0 2023-11-08T12:29:07.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d8004db0 0x7f53d8005220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009fc0 tx=0x7f53d80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff43a106e4f6f8ff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400ebd0 con 0x7f53d8004db0 2023-11-08T12:29:07.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e400f040 con 0x7f53d8004db0 2023-11-08T12:29:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53eaffd700 1 -- 172.21.15.112:0/1322678339 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4014480 con 0x7f53d8004db0 2023-11-08T12:29:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53f0ecb700 1 -- 172.21.15.112:0/1322678339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d8004db0 msgr2=0x7f53d8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53f0ecb700 1 --2- 172.21.15.112:0/1322678339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d8004db0 0x7f53d8005220 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009fc0 tx=0x7f53d80058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53ebfff700 1 -- 172.21.15.112:0/1322678339 reap_dead start 2023-11-08T12:29:07.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53f0ecb700 1 -- 172.21.15.112:0/1322678339 shutdown_connections 2023-11-08T12:29:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53f0ecb700 1 -- 172.21.15.112:0/1322678339 >> 172.21.15.112:0/1322678339 conn(0x7f53ec0b0f80 msgr2=0x7f53ec0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53f0ecb700 1 -- 172.21.15.112:0/1322678339 shutdown_connections 2023-11-08T12:29:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.428+0000 7f53f0ecb700 1 -- 172.21.15.112:0/1322678339 wait complete. 2023-11-08T12:29:07.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 Processor -- start 2023-11-08T12:29:07.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 -- start start 2023-11-08T12:29:07.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8004db0 0x7f53ec157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0b2c50 0x7f53ec15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ec06a340 0x7f53ec06a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec06ad20 con 0x7f53ec06a340 2023-11-08T12:29:07.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec15c610 con 0x7f53d8004db0 2023-11-08T12:29:07.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.432+0000 7f53f0ecb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec15ab80 con 0x7f53ec0b2c50 2023-11-08T12:29:07.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ec06a340 0x7f53ec06a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ec06a340 0x7f53ec06a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47942/0 (socket says 172.21.15.112:47942) 2023-11-08T12:29:07.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53e3fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0b2c50 0x7f53ec15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 -- 172.21.15.112:0/4175638423 learned_addr learned my addr 172.21.15.112:0/4175638423 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:07.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53eb7fe700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8004db0 0x7f53ec157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 -- 172.21.15.112:0/4175638423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0b2c50 msgr2=0x7f53ec15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0b2c50 0x7f53ec15c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 -- 172.21.15.112:0/4175638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8004db0 msgr2=0x7f53ec157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8004db0 0x7f53ec157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 -- 172.21.15.112:0/4175638423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec06b5d0 con 0x7f53ec06a340 2023-11-08T12:29:07.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53ebfff700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ec06a340 0x7f53ec06a7e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f53e4016000 tx=0x7f53e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53e8ff9700 1 -- 172.21.15.112:0/4175638423 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4007000 con 0x7f53ec06a340 2023-11-08T12:29:07.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53e8ff9700 1 -- 172.21.15.112:0/4175638423 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e4022070 con 0x7f53ec06a340 2023-11-08T12:29:07.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53e8ff9700 1 -- 172.21.15.112:0/4175638423 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4015e30 con 0x7f53ec06a340 2023-11-08T12:29:07.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec06b2f0 con 0x7f53ec06a340 2023-11-08T12:29:07.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec0ca7b0 con 0x7f53ec06a340 2023-11-08T12:29:07.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.436+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec073cb0 con 0x7f53ec06a340 2023-11-08T12:29:07.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.440+0000 7f53e8ff9700 1 -- 172.21.15.112:0/4175638423 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f53e401e430 con 0x7f53ec06a340 2023-11-08T12:29:07.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.440+0000 7f53e8ff9700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53cc064f10 0x7f53cc0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.440+0000 7f53e8ff9700 1 -- 172.21.15.112:0/4175638423 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f53e4024070 con 0x7f53ec06a340 2023-11-08T12:29:07.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.440+0000 7f53eb7fe700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53cc064f10 0x7f53cc0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.440+0000 7f53eb7fe700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53cc064f10 0x7f53cc0673c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001270 tx=0x7f53dc007b20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.448+0000 7f53e8ff9700 1 -- 172.21.15.112:0/4175638423 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f53e4052080 con 0x7f53ec06a340 2023-11-08T12:29:07.490 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:29:07.498 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:29:07.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.652+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53ec071090 con 0x7f53ec06a340 2023-11-08T12:29:07.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.652+0000 7f53e8ff9700 1 -- 172.21.15.112:0/4175638423 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4647 (secure 0 0 0) 0x7f53e40556a0 con 0x7f53ec06a340 2023-11-08T12:29:07.657 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:07.657 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2311813821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2311813821},{"type":"v1","addr":"172.21.15.112:6837","nonce":2311813821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3264569776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3264569776},{"type":"v1","addr":"172.21.15.133:6835","nonce":3264569776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/157703836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":157703836},{"type":"v1","addr":"172.21.15.112:6836","nonce":157703836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:27:54.061640+0000","modified":"2023-11-08T12:28:19.810915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/67340016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":67340016},{"type":"v1","addr":"172.21.15.133:6833","nonce":67340016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-08T12:29:07.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53cc064f10 msgr2=0x7f53cc0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53cc064f10 0x7f53cc0673c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001270 tx=0x7f53dc007b20 comp rx=0 tx=0).stop 2023-11-08T12:29:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ec06a340 msgr2=0x7f53ec06a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ec06a340 0x7f53ec06a7e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f53e4016000 tx=0x7f53e4009750 comp rx=0 tx=0).stop 2023-11-08T12:29:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 shutdown_connections 2023-11-08T12:29:07.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53cc064f10 0x7f53cc0673c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ec06a340 0x7f53ec06a7e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53ec0b2c50 0x7f53ec15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 --2- 172.21.15.112:0/4175638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d8004db0 0x7f53ec157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 >> 172.21.15.112:0/4175638423 conn(0x7f53ec0b0f80 msgr2=0x7f53ec159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:07.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 shutdown_connections 2023-11-08T12:29:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.656+0000 7f53f0ecb700 1 -- 172.21.15.112:0/4175638423 wait complete. 2023-11-08T12:29:07.664 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 9 2023-11-08T12:29:07.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:07.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.856+0000 7f883efef700 1 Processor -- start 2023-11-08T12:29:07.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.856+0000 7f883efef700 1 -- start start 2023-11-08T12:29:07.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883efef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8838070080 0x7f88380704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883efef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f88381646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883efef700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88380ad6c0 con 0x7f8838160710 2023-11-08T12:29:07.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883efef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883806b1c0 con 0x7f8838070080 2023-11-08T12:29:07.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883efef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88380adc60 con 0x7f8838164250 2023-11-08T12:29:07.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883dfed700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8838160710 0x7f88380cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34814/0 (socket says 172.21.15.112:34814) 2023-11-08T12:29:07.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883dfed700 1 -- 172.21.15.112:0/2840975658 learned_addr learned my addr 172.21.15.112:0/2840975658 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:07.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883e7ee700 1 --2- 172.21.15.112:0/2840975658 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f88381646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883d7ec700 1 --2- 172.21.15.112:0/2840975658 >> v2:172.21.15.133:3300/0 conn(0x7f8838070080 0x7f88380704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883cfeb700 1 -- 172.21.15.112:0/2840975658 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511523739 0 0) 0x7f88380ad6c0 con 0x7f8838160710 2023-11-08T12:29:07.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883cfeb700 1 -- 172.21.15.112:0/2840975658 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88240035d0 con 0x7f8838160710 2023-11-08T12:29:07.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883e7ee700 1 -- 172.21.15.112:0/2840975658 >> v2:172.21.15.133:3300/0 conn(0x7f8838070080 msgr2=0x7f88380704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:07.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883e7ee700 1 --2- 172.21.15.112:0/2840975658 >> v2:172.21.15.133:3300/0 conn(0x7f8838070080 0x7f88380704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883e7ee700 1 -- 172.21.15.112:0/2840975658 >> v1:172.21.15.112:6789/0 conn(0x7f8838160710 legacy=0x7f88380cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.860+0000 7f883e7ee700 1 -- 172.21.15.112:0/2840975658 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380709f0 con 0x7f8838164250 2023-11-08T12:29:07.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883e7ee700 1 --2- 172.21.15.112:0/2840975658 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f88381646d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8830009d90 tx=0x7f883000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e103e0990710f02c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883cfeb700 1 -- 172.21.15.112:0/2840975658 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000e070 con 0x7f8838164250 2023-11-08T12:29:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883cfeb700 1 -- 172.21.15.112:0/2840975658 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000bb20 con 0x7f8838164250 2023-11-08T12:29:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883cfeb700 1 -- 172.21.15.112:0/2840975658 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830012430 con 0x7f8838164250 2023-11-08T12:29:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 -- 172.21.15.112:0/2840975658 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 msgr2=0x7f88381646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 --2- 172.21.15.112:0/2840975658 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f88381646d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8830009d90 tx=0x7f883000b330 comp rx=0 tx=0).stop 2023-11-08T12:29:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 -- 172.21.15.112:0/2840975658 shutdown_connections 2023-11-08T12:29:07.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 --2- 172.21.15.112:0/2840975658 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f88381646d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 --2- 172.21.15.112:0/2840975658 >> v2:172.21.15.133:3300/0 conn(0x7f8838070080 0x7f88380704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 -- 172.21.15.112:0/2840975658 >> 172.21.15.112:0/2840975658 conn(0x7f88380b0f80 msgr2=0x7f88380ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:07.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 -- 172.21.15.112:0/2840975658 shutdown_connections 2023-11-08T12:29:07.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.864+0000 7f883efef700 1 -- 172.21.15.112:0/2840975658 wait complete. 2023-11-08T12:29:07.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.868+0000 7f883efef700 1 Processor -- start 2023-11-08T12:29:07.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.868+0000 7f883efef700 1 -- start start 2023-11-08T12:29:07.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8838070080 0x7f883815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8838160710 0x7f8838160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f8838162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88381f5dc0 con 0x7f8838070080 2023-11-08T12:29:07.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380c17e0 con 0x7f8838160710 2023-11-08T12:29:07.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88380c1ac0 con 0x7f8838164250 2023-11-08T12:29:07.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8838070080 0x7f883815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8838070080 0x7f883815bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47944/0 (socket says 172.21.15.112:47944) 2023-11-08T12:29:07.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 -- 172.21.15.112:0/1884856269 learned_addr learned my addr 172.21.15.112:0/1884856269 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:07.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883e7ee700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f8838162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 -- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 msgr2=0x7f8838162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f8838162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 -- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8838160710 msgr2=0x7f8838160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:07.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8838160710 0x7f8838160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:07.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 -- 172.21.15.112:0/1884856269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009a70 con 0x7f8838070080 2023-11-08T12:29:07.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883e7ee700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f8838162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:07.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883dfed700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8838070080 0x7f883815bc30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f883400c730 tx=0x7f883400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f882e7fc700 1 -- 172.21.15.112:0/1884856269 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834005d90 con 0x7f8838070080 2023-11-08T12:29:07.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f882e7fc700 1 -- 172.21.15.112:0/1884856269 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88340070d0 con 0x7f8838070080 2023-11-08T12:29:07.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883806b3d0 con 0x7f8838070080 2023-11-08T12:29:07.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f882e7fc700 1 -- 172.21.15.112:0/1884856269 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834007460 con 0x7f8838070080 2023-11-08T12:29:07.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.872+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88380cca30 con 0x7f8838070080 2023-11-08T12:29:07.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.876+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883806b6b0 con 0x7f8838070080 2023-11-08T12:29:07.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.876+0000 7f882e7fc700 1 -- 172.21.15.112:0/1884856269 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8834019030 con 0x7f8838070080 2023-11-08T12:29:07.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.876+0000 7f882e7fc700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f881c064f10 0x7f881c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:07.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.876+0000 7f882e7fc700 1 -- 172.21.15.112:0/1884856269 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8834081680 con 0x7f8838070080 2023-11-08T12:29:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.876+0000 7f883d7ec700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f881c064f10 0x7f881c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:07.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.880+0000 7f883d7ec700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f881c064f10 0x7f881c0673c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8828006b40 tx=0x7f8828006ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:07.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:07.884+0000 7f882e7fc700 1 -- 172.21.15.112:0/1884856269 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f883404f4f0 con 0x7f8838070080 2023-11-08T12:29:08.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.064+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8838073cb0 con 0x7f8838070080 2023-11-08T12:29:08.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.064+0000 7f882e7fc700 1 -- 172.21.15.112:0/1884856269 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+19796 (secure 0 0 0) 0x7f8834052b10 con 0x7f8838070080 2023-11-08T12:29:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:08.070 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:28:35.941054+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:27:52.300142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-08T12:27:53.065492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-08T12:27:56.152657+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.27","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:08.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f881c064f10 msgr2=0x7f881c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:08.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f881c064f10 0x7f881c0673c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8828006b40 tx=0x7f8828006ad0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8838070080 msgr2=0x7f883815bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:08.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8838070080 0x7f883815bc30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f883400c730 tx=0x7f883400caf0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 shutdown_connections 2023-11-08T12:29:08.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f881c064f10 0x7f881c0673c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8838164250 0x7f8838162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8838160710 0x7f8838160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 --2- 172.21.15.112:0/1884856269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8838070080 0x7f883815bc30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.068+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 >> 172.21.15.112:0/1884856269 conn(0x7f88380b0f80 msgr2=0x7f88380af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.072+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 shutdown_connections 2023-11-08T12:29:08.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.072+0000 7f883efef700 1 -- 172.21.15.112:0/1884856269 wait complete. 2023-11-08T12:29:08.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T12:29:08.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.263+0000 7f7a35f62700 1 Processor -- start 2023-11-08T12:29:08.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.263+0000 7f7a35f62700 1 -- start start 2023-11-08T12:29:08.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35f62700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a30070080 0x7f7a300704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:08.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35f62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a301646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:08.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35f62700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a300ad6c0 con 0x7f7a30160710 2023-11-08T12:29:08.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35f62700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3006b1c0 con 0x7f7a30070080 2023-11-08T12:29:08.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35f62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300adc60 con 0x7f7a30164250 2023-11-08T12:29:08.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a34f60700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7a30160710 0x7f7a300cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34824/0 (socket says 172.21.15.112:34824) 2023-11-08T12:29:08.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a34f60700 1 -- 172.21.15.112:0/482908467 learned_addr learned my addr 172.21.15.112:0/482908467 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:08.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35761700 1 --2- 172.21.15.112:0/482908467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a301646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:08.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a27fff700 1 --2- 172.21.15.112:0/482908467 >> v2:172.21.15.133:3300/0 conn(0x7f7a30070080 0x7f7a300704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:08.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a277fe700 1 -- 172.21.15.112:0/482908467 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343248245 0 0) 0x7f7a300ad6c0 con 0x7f7a30160710 2023-11-08T12:29:08.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a277fe700 1 -- 172.21.15.112:0/482908467 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a180035d0 con 0x7f7a30160710 2023-11-08T12:29:08.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35761700 1 -- 172.21.15.112:0/482908467 >> v2:172.21.15.133:3300/0 conn(0x7f7a30070080 msgr2=0x7f7a300704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:08.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35761700 1 --2- 172.21.15.112:0/482908467 >> v2:172.21.15.133:3300/0 conn(0x7f7a30070080 0x7f7a300704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35761700 1 -- 172.21.15.112:0/482908467 >> v1:172.21.15.112:6789/0 conn(0x7f7a30160710 legacy=0x7f7a300cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:08.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a277fe700 1 -- 172.21.15.112:0/482908467 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1556087492 0 0) 0x7f7a180035d0 con 0x7f7a30160710 2023-11-08T12:29:08.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35761700 1 -- 172.21.15.112:0/482908467 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a300709f0 con 0x7f7a30164250 2023-11-08T12:29:08.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a35761700 1 --2- 172.21.15.112:0/482908467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a301646d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009850 tx=0x7f7a28009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58def8f2c9d9b100 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:08.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a277fe700 1 -- 172.21.15.112:0/482908467 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0019f0 con 0x7f7a30164250 2023-11-08T12:29:08.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a277fe700 1 -- 172.21.15.112:0/482908467 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28004030 con 0x7f7a30164250 2023-11-08T12:29:08.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.267+0000 7f7a277fe700 1 -- 172.21.15.112:0/482908467 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280043a0 con 0x7f7a30164250 2023-11-08T12:29:08.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 -- 172.21.15.112:0/482908467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 msgr2=0x7f7a301646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:08.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 --2- 172.21.15.112:0/482908467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a301646d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009850 tx=0x7f7a28009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:08.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 -- 172.21.15.112:0/482908467 shutdown_connections 2023-11-08T12:29:08.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 --2- 172.21.15.112:0/482908467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a301646d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 --2- 172.21.15.112:0/482908467 >> v2:172.21.15.133:3300/0 conn(0x7f7a30070080 0x7f7a300704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 -- 172.21.15.112:0/482908467 >> 172.21.15.112:0/482908467 conn(0x7f7a300b0f80 msgr2=0x7f7a300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:08.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 -- 172.21.15.112:0/482908467 shutdown_connections 2023-11-08T12:29:08.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.271+0000 7f7a35f62700 1 -- 172.21.15.112:0/482908467 wait complete. 2023-11-08T12:29:08.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 Processor -- start 2023-11-08T12:29:08.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 -- start start 2023-11-08T12:29:08.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a30070080 0x7f7a30150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:08.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a30160710 0x7f7a3015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:08.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a3015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:08.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300c5650 con 0x7f7a30160710 2023-11-08T12:29:08.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301511e0 con 0x7f7a30070080 2023-11-08T12:29:08.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35f62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a30161e40 con 0x7f7a30164250 2023-11-08T12:29:08.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a30160710 0x7f7a3015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:08.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a30160710 0x7f7a3015ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47956/0 (socket says 172.21.15.112:47956) 2023-11-08T12:29:08.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 -- 172.21.15.112:0/471952615 learned_addr learned my addr 172.21.15.112:0/471952615 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:08.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a35761700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a3015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:08.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a34f60700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a30070080 0x7f7a30150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:08.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 -- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 msgr2=0x7f7a3015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:08.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a3015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 -- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a30070080 msgr2=0x7f7a30150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:08.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a30070080 0x7f7a30150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:08.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 -- 172.21.15.112:0/471952615 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280094b0 con 0x7f7a30160710 2023-11-08T12:29:08.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.275+0000 7f7a27fff700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a30160710 0x7f7a3015ec90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9d0 tx=0x7f7a2000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:08.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.279+0000 7f7a257fa700 1 -- 172.21.15.112:0/471952615 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20009720 con 0x7f7a30160710 2023-11-08T12:29:08.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.279+0000 7f7a257fa700 1 -- 172.21.15.112:0/471952615 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2000c850 con 0x7f7a30160710 2023-11-08T12:29:08.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.279+0000 7f7a257fa700 1 -- 172.21.15.112:0/471952615 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2000cbc0 con 0x7f7a30160710 2023-11-08T12:29:08.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.279+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3006b3d0 con 0x7f7a30160710 2023-11-08T12:29:08.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.279+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a300cca30 con 0x7f7a30160710 2023-11-08T12:29:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.279+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3006b6b0 con 0x7f7a30160710 2023-11-08T12:29:08.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.279+0000 7f7a257fa700 1 -- 172.21.15.112:0/471952615 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a20019030 con 0x7f7a30160710 2023-11-08T12:29:08.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.283+0000 7f7a257fa700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a1c064ee0 0x7f7a1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:08.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.283+0000 7f7a257fa700 1 -- 172.21.15.112:0/471952615 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7a20082120 con 0x7f7a30160710 2023-11-08T12:29:08.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.283+0000 7f7a34f60700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a1c064ee0 0x7f7a1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:08.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.283+0000 7f7a34f60700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a1c064ee0 0x7f7a1c067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c001560 tx=0x7f7a2c0018b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:08.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.287+0000 7f7a257fa700 1 -- 172.21.15.112:0/471952615 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7a2004ff90 con 0x7f7a30160710 2023-11-08T12:29:08.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:08.491+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7a30073ce0 con 0x7f7a30160710 2023-11-08T12:29:09.189 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-11-08T12:29:09.183+0000 7f2dc63f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T12:29:09.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.199+0000 7f7a257fa700 1 -- 172.21.15.112:0/471952615 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7a200535b0 con 0x7f7a30160710 2023-11-08T12:29:09.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a1c064ee0 msgr2=0x7f7a1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:09.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a1c064ee0 0x7f7a1c067390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c001560 tx=0x7f7a2c0018b0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a30160710 msgr2=0x7f7a3015ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:09.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a30160710 0x7f7a3015ec90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9d0 tx=0x7f7a2000ece0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 shutdown_connections 2023-11-08T12:29:09.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a1c064ee0 0x7f7a1c067390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a30164250 0x7f7a3015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a30160710 0x7f7a3015ec90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 --2- 172.21.15.112:0/471952615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a30070080 0x7f7a30150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 >> 172.21.15.112:0/471952615 conn(0x7f7a300b0f80 msgr2=0x7f7a3015bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:09.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 shutdown_connections 2023-11-08T12:29:09.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.203+0000 7f7a35f62700 1 -- 172.21.15.112:0/471952615 wait complete. 2023-11-08T12:29:09.209 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T12:29:09.220 INFO:tasks.ceph.mds.b.smithi133.stderr: -5056> 2023-11-08T12:27:59.713+0000 7f519b765700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:29:09.230 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T12:29:09.282 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-11-08T12:29:09.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.407+0000 7fdb3942f700 1 Processor -- start 2023-11-08T12:29:09.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.407+0000 7fdb3942f700 1 -- start start 2023-11-08T12:29:09.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb3942f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb3415c640 0x7fdb340d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:09.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb3942f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb34071aa0 0x7fdb3406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:09.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb3942f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3406c600 con 0x7fdb34069e00 2023-11-08T12:29:09.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb3942f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3406cef0 con 0x7fdb34071aa0 2023-11-08T12:29:09.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb3942f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340722f0 con 0x7fdb3415c640 2023-11-08T12:29:09.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb38c2e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdb34069e00 0x7fdb340d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34836/0 (socket says 172.21.15.112:34836) 2023-11-08T12:29:09.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb38c2e700 1 -- 172.21.15.112:0/3895429910 learned_addr learned my addr 172.21.15.112:0/3895429910 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:09.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb2b7fe700 1 --2- 172.21.15.112:0/3895429910 >> v2:172.21.15.133:3300/0 conn(0x7fdb34071aa0 0x7fdb3406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:09.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb33fff700 1 --2- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb3415c640 0x7fdb340d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:09.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb337fe700 1 -- 172.21.15.112:0/3895429910 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353254988 0 0) 0x7fdb3406c600 con 0x7fdb34069e00 2023-11-08T12:29:09.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb337fe700 1 -- 172.21.15.112:0/3895429910 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb200035d0 con 0x7fdb34069e00 2023-11-08T12:29:09.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb2b7fe700 1 -- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb3415c640 msgr2=0x7fdb340d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:09.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb2b7fe700 1 --2- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb3415c640 0x7fdb340d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb2b7fe700 1 -- 172.21.15.112:0/3895429910 >> v1:172.21.15.112:6789/0 conn(0x7fdb34069e00 legacy=0x7fdb340d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:09.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb2b7fe700 1 -- 172.21.15.112:0/3895429910 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3415ca10 con 0x7fdb34071aa0 2023-11-08T12:29:09.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.411+0000 7fdb2b7fe700 1 --2- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34071aa0 0x7fdb3406d310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009850 tx=0x7fdb1c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7a7aa5b22cd310 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:09.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb337fe700 1 -- 172.21.15.112:0/3895429910 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c011830 con 0x7fdb34071aa0 2023-11-08T12:29:09.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb337fe700 1 -- 172.21.15.112:0/3895429910 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c011990 con 0x7fdb34071aa0 2023-11-08T12:29:09.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb337fe700 1 -- 172.21.15.112:0/3895429910 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c011d40 con 0x7fdb34071aa0 2023-11-08T12:29:09.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 -- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34071aa0 msgr2=0x7fdb3406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:09.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 --2- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34071aa0 0x7fdb3406d310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009850 tx=0x7fdb1c009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 -- 172.21.15.112:0/3895429910 shutdown_connections 2023-11-08T12:29:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 --2- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34071aa0 0x7fdb3406d310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 --2- 172.21.15.112:0/3895429910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb3415c640 0x7fdb340d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 -- 172.21.15.112:0/3895429910 >> 172.21.15.112:0/3895429910 conn(0x7fdb340b6520 msgr2=0x7fdb34071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 -- 172.21.15.112:0/3895429910 shutdown_connections 2023-11-08T12:29:09.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.415+0000 7fdb3942f700 1 -- 172.21.15.112:0/3895429910 wait complete. 2023-11-08T12:29:09.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 Processor -- start 2023-11-08T12:29:09.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 -- start start 2023-11-08T12:29:09.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34069e00 0x7fdb3409bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:09.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb34071aa0 0x7fdb3415a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:09.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb3415c640 0x7fdb3415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:09.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340d1580 con 0x7fdb3415c640 2023-11-08T12:29:09.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340c76c0 con 0x7fdb34069e00 2023-11-08T12:29:09.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb3942f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340c79a0 con 0x7fdb34071aa0 2023-11-08T12:29:09.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb38c2e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb3415c640 0x7fdb3415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb38c2e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb3415c640 0x7fdb3415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47958/0 (socket says 172.21.15.112:47958) 2023-11-08T12:29:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb38c2e700 1 -- 172.21.15.112:0/4127594029 learned_addr learned my addr 172.21.15.112:0/4127594029 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb33fff700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34069e00 0x7fdb3409bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.419+0000 7fdb2b7fe700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb34071aa0 0x7fdb3415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb38c2e700 1 -- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb34071aa0 msgr2=0x7fdb3415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:09.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb38c2e700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb34071aa0 0x7fdb3415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb38c2e700 1 -- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34069e00 msgr2=0x7fdb3409bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:09.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb38c2e700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34069e00 0x7fdb3409bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:09.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb38c2e700 1 -- 172.21.15.112:0/4127594029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c0094b0 con 0x7fdb3415c640 2023-11-08T12:29:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb38c2e700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb3415c640 0x7fdb3415a8b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00c4d0 tx=0x7fdb2c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb317fa700 1 -- 172.21.15.112:0/4127594029 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c005d90 con 0x7fdb3415c640 2023-11-08T12:29:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb317fa700 1 -- 172.21.15.112:0/4127594029 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00ce80 con 0x7fdb3415c640 2023-11-08T12:29:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3406c830 con 0x7fdb3415c640 2023-11-08T12:29:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb317fa700 1 -- 172.21.15.112:0/4127594029 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0072f0 con 0x7fdb3415c640 2023-11-08T12:29:09.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb34072010 con 0x7fdb3415c640 2023-11-08T12:29:09.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.423+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3406cb10 con 0x7fdb3415c640 2023-11-08T12:29:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.427+0000 7fdb317fa700 1 -- 172.21.15.112:0/4127594029 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdb2c019030 con 0x7fdb3415c640 2023-11-08T12:29:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.427+0000 7fdb317fa700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb14064ee0 0x7fdb14067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.427+0000 7fdb317fa700 1 -- 172.21.15.112:0/4127594029 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fdb2c081560 con 0x7fdb3415c640 2023-11-08T12:29:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.427+0000 7fdb33fff700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb14064ee0 0x7fdb14067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.427+0000 7fdb33fff700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb14064ee0 0x7fdb14067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb240113e0 tx=0x7fdb2400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:09.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.435+0000 7fdb317fa700 1 -- 172.21.15.112:0/4127594029 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdb2c04f290 con 0x7fdb3415c640 2023-11-08T12:29:09.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:09.635+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdb34073cb0 con 0x7fdb3415c640 2023-11-08T12:29:10.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.203+0000 7fdb317fa700 1 -- 172.21.15.112:0/4127594029 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb2c0528b0 con 0x7fdb3415c640 2023-11-08T12:29:10.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb14064ee0 msgr2=0x7fdb14067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb14064ee0 0x7fdb14067390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb240113e0 tx=0x7fdb2400b040 comp rx=0 tx=0).stop 2023-11-08T12:29:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb3415c640 msgr2=0x7fdb3415a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb3415c640 0x7fdb3415a8b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00c4d0 tx=0x7fdb2c00c7e0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 shutdown_connections 2023-11-08T12:29:10.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb14064ee0 0x7fdb14067390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb3415c640 0x7fdb3415a8b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb34071aa0 0x7fdb3415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 --2- 172.21.15.112:0/4127594029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb34069e00 0x7fdb3409bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 >> 172.21.15.112:0/4127594029 conn(0x7fdb340b6520 msgr2=0x7fdb340cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 shutdown_connections 2023-11-08T12:29:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.207+0000 7fdb3942f700 1 -- 172.21.15.112:0/4127594029 wait complete. 2023-11-08T12:29:10.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T12:29:10.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.415+0000 7faf67f7a700 1 Processor -- start 2023-11-08T12:29:10.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.419+0000 7faf67f7a700 1 -- start start 2023-11-08T12:29:10.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.419+0000 7faf67f7a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf60142650 0x7faf60142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.419+0000 7faf67f7a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6006b8d0 con 0x7faf6006b1c0 2023-11-08T12:29:10.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.419+0000 7faf67f7a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6006bb70 con 0x7faf600b5a00 2023-11-08T12:29:10.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.419+0000 7faf67f7a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6006be50 con 0x7faf60142650 2023-11-08T12:29:10.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf66517700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faf6006b1c0 0x7faf6006c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34852/0 (socket says 172.21.15.112:34852) 2023-11-08T12:29:10.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf66517700 1 -- 172.21.15.112:0/2175279017 learned_addr learned my addr 172.21.15.112:0/2175279017 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:10.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf60142650 0x7faf60142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416479030 0 0) 0x7faf6006b8d0 con 0x7faf6006b1c0 2023-11-08T12:29:10.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c0035d0 con 0x7faf6006b1c0 2023-11-08T12:29:10.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631547158 0 0) 0x7faf6006bb70 con 0x7faf600b5a00 2023-11-08T12:29:10.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf6006b8d0 con 0x7faf600b5a00 2023-11-08T12:29:10.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1580316288 0 0) 0x7faf4c0035d0 con 0x7faf6006b1c0 2023-11-08T12:29:10.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf60142650 msgr2=0x7faf60142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:10.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf60142650 0x7faf60142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 >> v1:172.21.15.133:6789/0 conn(0x7faf600b5a00 legacy=0x7faf6006aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:10.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6006c130 con 0x7faf6006b1c0 2023-11-08T12:29:10.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7faf58001a10 con 0x7faf6006b1c0 2023-11-08T12:29:10.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 >> v1:172.21.15.112:6789/0 conn(0x7faf6006b1c0 legacy=0x7faf6006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:10.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf4c005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf4c003810 0x7faf4c003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf4c0041c0 0x7faf4c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6006be50 con 0x7faf4c004c40 2023-11-08T12:29:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00bff0 con 0x7faf4c003810 2023-11-08T12:29:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00c1b0 con 0x7faf4c0041c0 2023-11-08T12:29:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf60142650 0x7faf60142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:10.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf4c005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65515700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf4c003810 0x7faf4c003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf66517700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf4c0041c0 0x7faf4c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 -- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf4c0041c0 msgr2=0x7faf4c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:10.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf4c0041c0 0x7faf4c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 -- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf4c003810 msgr2=0x7faf4c003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:10.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf4c003810 0x7faf4c003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 -- 172.21.15.112:0/2175279017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0035d0 con 0x7faf4c004c40 2023-11-08T12:29:10.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf66517700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf4c0041c0 0x7faf4c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:10.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf65d16700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf4c005030 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf60071b90 tx=0x7faf4c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da3ae9a33aa9cc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:10.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0096e0 con 0x7faf4c004c40 2023-11-08T12:29:10.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c004030 con 0x7faf4c004c40 2023-11-08T12:29:10.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf64d14700 1 -- 172.21.15.112:0/2175279017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0043e0 con 0x7faf4c004c40 2023-11-08T12:29:10.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf67f7a700 1 -- 172.21.15.112:0/2175279017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 msgr2=0x7faf4c005030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:10.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf67f7a700 1 --2- 172.21.15.112:0/2175279017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf4c005030 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf60071b90 tx=0x7faf4c0058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.423+0000 7faf66517700 1 -- 172.21.15.112:0/2175279017 reap_dead start 2023-11-08T12:29:10.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- 172.21.15.112:0/2175279017 shutdown_connections 2023-11-08T12:29:10.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- 172.21.15.112:0/2175279017 >> 172.21.15.112:0/2175279017 conn(0x7faf600b5390 msgr2=0x7faf600d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:10.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- 172.21.15.112:0/2175279017 shutdown_connections 2023-11-08T12:29:10.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- 172.21.15.112:0/2175279017 wait complete. 2023-11-08T12:29:10.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 Processor -- start 2023-11-08T12:29:10.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- start start 2023-11-08T12:29:10.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf60157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf60141c30 0x7faf601372a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6015b2a0 0x7faf6015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6015bc80 con 0x7faf4c004c40 2023-11-08T12:29:10.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60156020 con 0x7faf60141c30 2023-11-08T12:29:10.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf67f7a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf60156270 con 0x7faf6015b2a0 2023-11-08T12:29:10.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf65d16700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf60157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf65d16700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf60157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47982/0 (socket says 172.21.15.112:47982) 2023-11-08T12:29:10.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.427+0000 7faf65d16700 1 -- 172.21.15.112:0/462015881 learned_addr learned my addr 172.21.15.112:0/462015881 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:10.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf66517700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6015b2a0 0x7faf6015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf65515700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf60141c30 0x7faf601372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf65d16700 1 -- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6015b2a0 msgr2=0x7faf6015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:10.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf65d16700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6015b2a0 0x7faf6015b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf65d16700 1 -- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf60141c30 msgr2=0x7faf601372a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:10.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf65d16700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf60141c30 0x7faf601372a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:10.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf65d16700 1 -- 172.21.15.112:0/462015881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60142a20 con 0x7faf4c004c40 2023-11-08T12:29:10.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf65d16700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf60157310 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf5c016040 tx=0x7faf5c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:10.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf567fc700 1 -- 172.21.15.112:0/462015881 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00ead0 con 0x7faf4c004c40 2023-11-08T12:29:10.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf567fc700 1 -- 172.21.15.112:0/462015881 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00ec30 con 0x7faf4c004c40 2023-11-08T12:29:10.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf567fc700 1 -- 172.21.15.112:0/462015881 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c026470 con 0x7faf4c004c40 2023-11-08T12:29:10.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6006c410 con 0x7faf4c004c40 2023-11-08T12:29:10.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf60142fa0 con 0x7faf4c004c40 2023-11-08T12:29:10.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.431+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf600726c0 con 0x7faf4c004c40 2023-11-08T12:29:10.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.435+0000 7faf567fc700 1 -- 172.21.15.112:0/462015881 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faf5c0265d0 con 0x7faf4c004c40 2023-11-08T12:29:10.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.435+0000 7faf567fc700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf44064ee0 0x7faf44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:10.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.435+0000 7faf567fc700 1 -- 172.21.15.112:0/462015881 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7faf5c083f60 con 0x7faf4c004c40 2023-11-08T12:29:10.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.435+0000 7faf65515700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf44064ee0 0x7faf44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:10.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.435+0000 7faf65515700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf44064ee0 0x7faf44067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf60142000 tx=0x7faf50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:10.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.439+0000 7faf567fc700 1 -- 172.21.15.112:0/462015881 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faf5c0b4400 con 0x7faf4c004c40 2023-11-08T12:29:10.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:10.611+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf600d3920 con 0x7faf4c004c40 2023-11-08T12:29:11.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.215+0000 7faf567fc700 1 -- 172.21.15.112:0/462015881 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7faf5c0170d0 con 0x7faf4c004c40 2023-11-08T12:29:11.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf44064ee0 msgr2=0x7faf44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:11.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf44064ee0 0x7faf44067390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf60142000 tx=0x7faf50009040 comp rx=0 tx=0).stop 2023-11-08T12:29:11.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 msgr2=0x7faf60157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf60157310 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf5c016040 tx=0x7faf5c0047e0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 shutdown_connections 2023-11-08T12:29:11.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf44064ee0 0x7faf44067390 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf60142000 tx=0x7faf50009040 comp rx=0 tx=0).stop 2023-11-08T12:29:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf6015b2a0 0x7faf6015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf60141c30 0x7faf601372a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 --2- 172.21.15.112:0/462015881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4c004c40 0x7faf60157310 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 >> 172.21.15.112:0/462015881 conn(0x7faf600b5390 msgr2=0x7faf60060870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 shutdown_connections 2023-11-08T12:29:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.223+0000 7faf67f7a700 1 -- 172.21.15.112:0/462015881 wait complete. 2023-11-08T12:29:11.229 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2023-11-08T12:29:11.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T12:29:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.435+0000 7fa98bfff700 1 Processor -- start 2023-11-08T12:29:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.435+0000 7fa98bfff700 1 -- start start 2023-11-08T12:29:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c159e10 0x7fa98c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa98c06a1f0 0x7fa98c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa98c06ccd0 0x7fa98c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98bfff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c06ab80 con 0x7fa98c06a1f0 2023-11-08T12:29:11.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c06c2a0 con 0x7fa98c06ccd0 2023-11-08T12:29:11.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98bfff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c06b320 con 0x7fa98c159e10 2023-11-08T12:29:11.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa98c06a1f0 0x7fa98c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa98c06a1f0 0x7fa98c06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47994/0 (socket says 172.21.15.112:47994) 2023-11-08T12:29:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 -- 172.21.15.112:0/4266488613 learned_addr learned my addr 172.21.15.112:0/4266488613 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98affd700 1 --2- 172.21.15.112:0/4266488613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c159e10 0x7fa98c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98b7fe700 1 --2- 172.21.15.112:0/4266488613 >> v2:172.21.15.133:3300/0 conn(0x7fa98c06ccd0 0x7fa98c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:11.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 -- 172.21.15.112:0/4266488613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c159e10 msgr2=0x7fa98c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 --2- 172.21.15.112:0/4266488613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c159e10 0x7fa98c15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 -- 172.21.15.112:0/4266488613 >> v2:172.21.15.133:3300/0 conn(0x7fa98c06ccd0 msgr2=0x7fa98c06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 --2- 172.21.15.112:0/4266488613 >> v2:172.21.15.133:3300/0 conn(0x7fa98c06ccd0 0x7fa98c06d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 -- 172.21.15.112:0/4266488613 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c06d690 con 0x7fa98c06a1f0 2023-11-08T12:29:11.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98affd700 1 --2- 172.21.15.112:0/4266488613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c159e10 0x7fa98c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:11.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98b7fe700 1 --2- 172.21.15.112:0/4266488613 >> v2:172.21.15.133:3300/0 conn(0x7fa98c06ccd0 0x7fa98c06d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:11.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa98a7fc700 1 --2- 172.21.15.112:0/4266488613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c06a1f0 0x7fa98c06a640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa98c072440 tx=0x7fa980009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08b4c9d507b804f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:11.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa989ffb700 1 -- 172.21.15.112:0/4266488613 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98000b8a0 con 0x7fa98c06a1f0 2023-11-08T12:29:11.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa989ffb700 1 -- 172.21.15.112:0/4266488613 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98000ba00 con 0x7fa98c06a1f0 2023-11-08T12:29:11.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.439+0000 7fa989ffb700 1 -- 172.21.15.112:0/4266488613 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98000bd90 con 0x7fa98c06a1f0 2023-11-08T12:29:11.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 -- 172.21.15.112:0/4266488613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c06a1f0 msgr2=0x7fa98c06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:11.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 --2- 172.21.15.112:0/4266488613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c06a1f0 0x7fa98c06a640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa98c072440 tx=0x7fa980009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 -- 172.21.15.112:0/4266488613 shutdown_connections 2023-11-08T12:29:11.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 --2- 172.21.15.112:0/4266488613 >> v2:172.21.15.133:3300/0 conn(0x7fa98c06ccd0 0x7fa98c06d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 --2- 172.21.15.112:0/4266488613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c06a1f0 0x7fa98c06a640 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 --2- 172.21.15.112:0/4266488613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c159e10 0x7fa98c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 -- 172.21.15.112:0/4266488613 >> 172.21.15.112:0/4266488613 conn(0x7fa98c0ce5b0 msgr2=0x7fa98c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:11.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 -- 172.21.15.112:0/4266488613 shutdown_connections 2023-11-08T12:29:11.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.443+0000 7fa98bfff700 1 -- 172.21.15.112:0/4266488613 wait complete. 2023-11-08T12:29:11.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 Processor -- start 2023-11-08T12:29:11.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 -- start start 2023-11-08T12:29:11.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa98c06a1f0 0x7fa98c0978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:11.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c06ccd0 0x7fa98c0c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:11.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c159e10 0x7fa98c0c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:11.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1f1950 con 0x7fa98c159e10 2023-11-08T12:29:11.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c15ccc0 con 0x7fa98c06a1f0 2023-11-08T12:29:11.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98bfff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1f1b30 con 0x7fa98c06ccd0 2023-11-08T12:29:11.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c159e10 0x7fa98c0c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:11.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c159e10 0x7fa98c0c2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48010/0 (socket says 172.21.15.112:48010) 2023-11-08T12:29:11.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 -- 172.21.15.112:0/3818372334 learned_addr learned my addr 172.21.15.112:0/3818372334 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:11.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98affd700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa98c06a1f0 0x7fa98c0978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:11.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98a7fc700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c06ccd0 0x7fa98c0c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:11.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 -- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c06ccd0 msgr2=0x7fa98c0c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:11.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c06ccd0 0x7fa98c0c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 -- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa98c06a1f0 msgr2=0x7fa98c0978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:11.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa98c06a1f0 0x7fa98c0978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:11.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.447+0000 7fa98b7fe700 1 -- 172.21.15.112:0/3818372334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009570 con 0x7fa98c159e10 2023-11-08T12:29:11.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.451+0000 7fa98b7fe700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c159e10 0x7fa98c0c2100 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa984007ef0 tx=0x7fa98400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:11.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.451+0000 7fa9737fe700 1 -- 172.21.15.112:0/3818372334 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400dd80 con 0x7fa98c159e10 2023-11-08T12:29:11.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.451+0000 7fa9737fe700 1 -- 172.21.15.112:0/3818372334 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400f040 con 0x7fa98c159e10 2023-11-08T12:29:11.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.451+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c06ad60 con 0x7fa98c159e10 2023-11-08T12:29:11.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.451+0000 7fa9737fe700 1 -- 172.21.15.112:0/3818372334 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984003c80 con 0x7fa98c159e10 2023-11-08T12:29:11.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.451+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c15df60 con 0x7fa98c159e10 2023-11-08T12:29:11.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.451+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c06b040 con 0x7fa98c159e10 2023-11-08T12:29:11.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.455+0000 7fa9737fe700 1 -- 172.21.15.112:0/3818372334 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa98401c030 con 0x7fa98c159e10 2023-11-08T12:29:11.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.455+0000 7fa9737fe700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:11.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.455+0000 7fa9737fe700 1 -- 172.21.15.112:0/3818372334 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fa984082060 con 0x7fa98c159e10 2023-11-08T12:29:11.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.455+0000 7fa98affd700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:11.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.455+0000 7fa98affd700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa98c158820 tx=0x7fa97c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:11.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.463+0000 7fa9737fe700 1 -- 172.21.15.112:0/3818372334 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa98404fee0 con 0x7fa98c159e10 2023-11-08T12:29:11.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:11.631+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa98c073cb0 con 0x7fa98c159e10 2023-11-08T12:29:12.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.223+0000 7fa9737fe700 1 -- 172.21.15.112:0/3818372334 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa984053500 con 0x7fa98c159e10 2023-11-08T12:29:12.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 msgr2=0x7fa978067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:12.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa98c158820 tx=0x7fa97c008040 comp rx=0 tx=0).stop 2023-11-08T12:29:12.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c159e10 msgr2=0x7fa98c0c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:12.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c159e10 0x7fa98c0c2100 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa984007ef0 tx=0x7fa98400d3b0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 shutdown_connections 2023-11-08T12:29:12.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978064ee0 0x7fa978067390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa98c159e10 0x7fa98c0c2100 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa98c06ccd0 0x7fa98c0c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 --2- 172.21.15.112:0/3818372334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa98c06a1f0 0x7fa98c0978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 >> 172.21.15.112:0/3818372334 conn(0x7fa98c0ce5b0 msgr2=0x7fa98c0ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:12.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 shutdown_connections 2023-11-08T12:29:12.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.231+0000 7fa98bfff700 1 -- 172.21.15.112:0/3818372334 wait complete. 2023-11-08T12:29:12.239 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2023-11-08T12:29:12.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-08T12:29:12.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.431+0000 7fd8a759e700 1 Processor -- start 2023-11-08T12:29:12.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.431+0000 7fd8a759e700 1 -- start start 2023-11-08T12:29:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a759e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd8a8069e00 0x7fd8a806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a806c630 0x7fd8a806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a806a790 con 0x7fd8a815c6e0 2023-11-08T12:29:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a759e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80d2800 con 0x7fd8a8069e00 2023-11-08T12:29:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a815cab0 con 0x7fd8a806c630 2023-11-08T12:29:12.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd8a815c6e0 0x7fd8a8071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34858/0 (socket says 172.21.15.112:34858) 2023-11-08T12:29:12.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a659c700 1 -- 172.21.15.112:0/639524260 learned_addr learned my addr 172.21.15.112:0/639524260 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:12.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a5d9b700 1 --2- 172.21.15.112:0/639524260 >> v2:172.21.15.112:3300/0 conn(0x7fd8a8069e00 0x7fd8a806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:12.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a6d9d700 1 --2- 172.21.15.112:0/639524260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a806c630 0x7fd8a806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:12.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a559a700 1 -- 172.21.15.112:0/639524260 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522290386 0 0) 0x7fd898001110 con 0x7fd8a815c6e0 2023-11-08T12:29:12.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a559a700 1 -- 172.21.15.112:0/639524260 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8900035d0 con 0x7fd8a815c6e0 2023-11-08T12:29:12.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a5d9b700 1 -- 172.21.15.112:0/639524260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a806c630 msgr2=0x7fd8a806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:12.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a5d9b700 1 --2- 172.21.15.112:0/639524260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a806c630 0x7fd8a806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a5d9b700 1 -- 172.21.15.112:0/639524260 >> v1:172.21.15.112:6789/0 conn(0x7fd8a815c6e0 legacy=0x7fd8a8071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:12.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.435+0000 7fd8a5d9b700 1 -- 172.21.15.112:0/639524260 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80702d0 con 0x7fd8a8069e00 2023-11-08T12:29:12.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a5d9b700 1 --2- 172.21.15.112:0/639524260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a8069e00 0x7fd8a806a250 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009850 tx=0x7fd89c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a72f2eef795a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:12.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a559a700 1 -- 172.21.15.112:0/639524260 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c011830 con 0x7fd8a8069e00 2023-11-08T12:29:12.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a559a700 1 -- 172.21.15.112:0/639524260 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c011990 con 0x7fd8a8069e00 2023-11-08T12:29:12.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a559a700 1 -- 172.21.15.112:0/639524260 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c011d40 con 0x7fd8a8069e00 2023-11-08T12:29:12.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 -- 172.21.15.112:0/639524260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a8069e00 msgr2=0x7fd8a806a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 --2- 172.21.15.112:0/639524260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a8069e00 0x7fd8a806a250 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009850 tx=0x7fd89c009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 -- 172.21.15.112:0/639524260 shutdown_connections 2023-11-08T12:29:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 --2- 172.21.15.112:0/639524260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a806c630 0x7fd8a806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 --2- 172.21.15.112:0/639524260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a8069e00 0x7fd8a806a250 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 -- 172.21.15.112:0/639524260 >> 172.21.15.112:0/639524260 conn(0x7fd8a80b65b0 msgr2=0x7fd8a8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:12.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 -- 172.21.15.112:0/639524260 shutdown_connections 2023-11-08T12:29:12.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.439+0000 7fd8a759e700 1 -- 172.21.15.112:0/639524260 wait complete. 2023-11-08T12:29:12.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 Processor -- start 2023-11-08T12:29:12.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 -- start start 2023-11-08T12:29:12.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a8069e00 0x7fd8a81f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:12.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a806c630 0x7fd8a8156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:12.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a815c6e0 0x7fd8a80d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:12.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a81567d0 con 0x7fd8a806c630 2023-11-08T12:29:12.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80b5130 con 0x7fd8a8069e00 2023-11-08T12:29:12.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80b4b70 con 0x7fd8a815c6e0 2023-11-08T12:29:12.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a806c630 0x7fd8a8156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:12.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a806c630 0x7fd8a8156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48034/0 (socket says 172.21.15.112:48034) 2023-11-08T12:29:12.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 -- 172.21.15.112:0/4188378431 learned_addr learned my addr 172.21.15.112:0/4188378431 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:12.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a659c700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a8069e00 0x7fd8a81f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:12.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a6d9d700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a815c6e0 0x7fd8a80d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:12.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 -- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a815c6e0 msgr2=0x7fd8a80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:12.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a815c6e0 0x7fd8a80d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 -- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a8069e00 msgr2=0x7fd8a81f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:12.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a8069e00 0x7fd8a81f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:12.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 -- 172.21.15.112:0/4188378431 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0094b0 con 0x7fd8a806c630 2023-11-08T12:29:12.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a5d9b700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a806c630 0x7fd8a8156290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0090b0 tx=0x7fd89c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:12.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd896ffd700 1 -- 172.21.15.112:0/4188378431 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c004380 con 0x7fd8a806c630 2023-11-08T12:29:12.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd896ffd700 1 -- 172.21.15.112:0/4188378431 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c01f070 con 0x7fd8a806c630 2023-11-08T12:29:12.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a80d2cf0 con 0x7fd8a806c630 2023-11-08T12:29:12.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd896ffd700 1 -- 172.21.15.112:0/4188378431 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0036c0 con 0x7fd8a806c630 2023-11-08T12:29:12.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.443+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a80d2a10 con 0x7fd8a806c630 2023-11-08T12:29:12.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.447+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a80d2fd0 con 0x7fd8a806c630 2023-11-08T12:29:12.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.447+0000 7fd896ffd700 1 -- 172.21.15.112:0/4188378431 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd89c02a020 con 0x7fd8a806c630 2023-11-08T12:29:12.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.447+0000 7fd896ffd700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd888064ee0 0x7fd888067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:12.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.447+0000 7fd896ffd700 1 -- 172.21.15.112:0/4188378431 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fd89c0832d0 con 0x7fd8a806c630 2023-11-08T12:29:12.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.447+0000 7fd8a659c700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd888064ee0 0x7fd888067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:12.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.451+0000 7fd8a659c700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd888064ee0 0x7fd888067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd898001270 tx=0x7fd898009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:12.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.455+0000 7fd896ffd700 1 -- 172.21.15.112:0/4188378431 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd89c051390 con 0x7fd8a806c630 2023-11-08T12:29:12.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:12.627+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8a8073cb0 con 0x7fd8a806c630 2023-11-08T12:29:13.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.251+0000 7fd896ffd700 1 -- 172.21.15.112:0/4188378431 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7fd89c006ce0 con 0x7fd8a806c630 2023-11-08T12:29:13.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd888064ee0 msgr2=0x7fd888067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:13.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd888064ee0 0x7fd888067390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd898001270 tx=0x7fd898009040 comp rx=0 tx=0).stop 2023-11-08T12:29:13.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a806c630 msgr2=0x7fd8a8156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:13.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a806c630 0x7fd8a8156290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0090b0 tx=0x7fd89c004770 comp rx=0 tx=0).stop 2023-11-08T12:29:13.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 shutdown_connections 2023-11-08T12:29:13.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd888064ee0 0x7fd888067390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8a815c6e0 0x7fd8a80d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8a806c630 0x7fd8a8156290 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 --2- 172.21.15.112:0/4188378431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a8069e00 0x7fd8a81f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 >> 172.21.15.112:0/4188378431 conn(0x7fd8a80b65b0 msgr2=0x7fd8a809b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:13.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 shutdown_connections 2023-11-08T12:29:13.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.255+0000 7fd8a759e700 1 -- 172.21.15.112:0/4188378431 wait complete. 2023-11-08T12:29:13.266 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data_ec' removed 2023-11-08T12:29:13.286 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T12:29:13.287 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T12:29:13.287 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T12:29:13.288 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:29:13.288 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T12:29:13.288 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T12:29:13.289 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T12:29:13.289 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:29:13.290 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T12:29:13.290 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T12:29:13.290 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T12:29:13.291 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:29:13.291 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T12:29:13.291 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T12:29:13.291 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T12:29:13.292 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:29:13.311 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T12:29:13.311 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T12:29:13.312 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T12:29:13.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T12:29:13.315 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T12:29:13.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T12:29:13.316 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T12:29:13.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T12:29:13.361 INFO:tasks.ceph.mds.a:Started 2023-11-08T12:29:13.361 DEBUG:teuthology.parallel:result is None 2023-11-08T12:29:13.366 INFO:tasks.ceph.mds.c:Started 2023-11-08T12:29:13.366 DEBUG:teuthology.parallel:result is None 2023-11-08T12:29:13.368 INFO:tasks.ceph.mds.d:Started 2023-11-08T12:29:13.368 DEBUG:teuthology.parallel:result is None 2023-11-08T12:29:13.373 INFO:tasks.ceph.mds.b:Started 2023-11-08T12:29:13.374 DEBUG:teuthology.parallel:result is None 2023-11-08T12:29:13.374 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T12:29:13.477 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-11-08T12:29:13.479 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-11-08T12:29:13.496 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-11-08T12:29:13.501 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-11-08T12:29:13.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 Processor -- start 2023-11-08T12:29:13.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 -- start start 2023-11-08T12:29:13.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db40aed90 0x7f9db406c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:13.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9db40cd720 0x7f9db415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:13.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9db415cf10 0x7f9db4156340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:13.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db415d330 con 0x7f9db415cf10 2023-11-08T12:29:13.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db40cdc20 con 0x7f9db40cd720 2023-11-08T12:29:13.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db926d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40cdf00 con 0x7f9db40aed90 2023-11-08T12:29:13.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db40aed90 0x7f9db406c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:13.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db27fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9db40cd720 0x7f9db415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:13.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db27fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9db40cd720 0x7f9db415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:32956/0 (socket says 172.21.15.112:32956) 2023-11-08T12:29:13.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.547+0000 7f9db27fc700 1 -- 172.21.15.112:0/3019295026 learned_addr learned my addr 172.21.15.112:0/3019295026 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:13.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db37fe700 1 --2- 172.21.15.112:0/3019295026 >> v2:172.21.15.112:3300/0 conn(0x7f9db415cf10 0x7f9db4156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:13.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db27fc700 1 -- 172.21.15.112:0/3019295026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db40aed90 msgr2=0x7f9db406c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:13.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db27fc700 1 --2- 172.21.15.112:0/3019295026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db40aed90 0x7f9db406c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db27fc700 1 -- 172.21.15.112:0/3019295026 >> v2:172.21.15.112:3300/0 conn(0x7f9db415cf10 msgr2=0x7f9db4156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:13.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db27fc700 1 --2- 172.21.15.112:0/3019295026 >> v2:172.21.15.112:3300/0 conn(0x7f9db415cf10 0x7f9db4156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db27fc700 1 -- 172.21.15.112:0/3019295026 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40ce1e0 con 0x7f9db40cd720 2023-11-08T12:29:13.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db27fc700 1 --2- 172.21.15.112:0/3019295026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 0x7f9db415c9d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9db4072e90 tx=0x7f9da8009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=142b14f4602d8284 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:13.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db1ffb700 1 -- 172.21.15.112:0/3019295026 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8011830 con 0x7f9db40cd720 2023-11-08T12:29:13.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db1ffb700 1 -- 172.21.15.112:0/3019295026 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8011990 con 0x7f9db40cd720 2023-11-08T12:29:13.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db1ffb700 1 -- 172.21.15.112:0/3019295026 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8011d20 con 0x7f9db40cd720 2023-11-08T12:29:13.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 -- 172.21.15.112:0/3019295026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 msgr2=0x7f9db415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:13.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 --2- 172.21.15.112:0/3019295026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 0x7f9db415c9d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9db4072e90 tx=0x7f9da8009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 -- 172.21.15.112:0/3019295026 shutdown_connections 2023-11-08T12:29:13.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 --2- 172.21.15.112:0/3019295026 >> v2:172.21.15.112:3300/0 conn(0x7f9db415cf10 0x7f9db4156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 --2- 172.21.15.112:0/3019295026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 0x7f9db415c9d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 --2- 172.21.15.112:0/3019295026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db40aed90 0x7f9db406c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 -- 172.21.15.112:0/3019295026 >> 172.21.15.112:0/3019295026 conn(0x7f9db40d03b0 msgr2=0x7f9db40cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:13.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 -- 172.21.15.112:0/3019295026 shutdown_connections 2023-11-08T12:29:13.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.551+0000 7f9db926d700 1 -- 172.21.15.112:0/3019295026 wait complete. 2023-11-08T12:29:13.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.555+0000 7f9db926d700 1 Processor -- start 2023-11-08T12:29:13.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.555+0000 7f9db926d700 1 -- start start 2023-11-08T12:29:13.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9db40aed90 0x7f9db40ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:13.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 0x7f9db414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:13.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db415cf10 0x7f9db41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:13.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40ac310 con 0x7f9db40aed90 2023-11-08T12:29:13.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40ac5b0 con 0x7f9db40cd720 2023-11-08T12:29:13.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40ac890 con 0x7f9db415cf10 2023-11-08T12:29:13.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9db40aed90 0x7f9db40ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:13.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9db40aed90 0x7f9db40ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48060/0 (socket says 172.21.15.112:48060) 2023-11-08T12:29:13.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 -- 172.21.15.112:0/4032434524 learned_addr learned my addr 172.21.15.112:0/4032434524 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:13.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db27fc700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 0x7f9db414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:13.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db37fe700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db415cf10 0x7f9db41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:13.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 -- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db415cf10 msgr2=0x7f9db41565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:13.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db415cf10 0x7f9db41565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 -- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 msgr2=0x7f9db414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:13.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 0x7f9db414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:13.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 -- 172.21.15.112:0/4032434524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009570 con 0x7f9db40aed90 2023-11-08T12:29:13.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db2ffd700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9db40aed90 0x7f9db40ad370 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9da400ea60 tx=0x7f9da400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:13.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9d9b7fe700 1 -- 172.21.15.112:0/4032434524 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400dc50 con 0x7f9db40aed90 2023-11-08T12:29:13.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9d9b7fe700 1 -- 172.21.15.112:0/4032434524 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400ddb0 con 0x7f9db40aed90 2023-11-08T12:29:13.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40ce7a0 con 0x7f9db40aed90 2023-11-08T12:29:13.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9d9b7fe700 1 -- 172.21.15.112:0/4032434524 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4010640 con 0x7f9db40aed90 2023-11-08T12:29:13.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.559+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db40ce4c0 con 0x7f9db40aed90 2023-11-08T12:29:13.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.563+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db406c590 con 0x7f9db40aed90 2023-11-08T12:29:13.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.563+0000 7f9d9b7fe700 1 -- 172.21.15.112:0/4032434524 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9da40107a0 con 0x7f9db40aed90 2023-11-08T12:29:13.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.567+0000 7f9d9b7fe700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9da0064ee0 0x7f9da0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:13.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.567+0000 7f9d9b7fe700 1 -- 172.21.15.112:0/4032434524 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9da4082540 con 0x7f9db40aed90 2023-11-08T12:29:13.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.567+0000 7f9db27fc700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9da0064ee0 0x7f9da0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:13.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.567+0000 7f9db27fc700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9da0064ee0 0x7f9da0067390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9db4072e90 tx=0x7f9da8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:13.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.571+0000 7f9d9b7fe700 1 -- 172.21.15.112:0/4032434524 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9da4050770 con 0x7f9db40aed90 2023-11-08T12:29:13.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:13.759+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9db4073cb0 con 0x7f9db40aed90 2023-11-08T12:29:14.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.539+0000 7f9d9b7fe700 1 -- 172.21.15.112:0/4032434524 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9da4053d90 con 0x7f9db40aed90 2023-11-08T12:29:14.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9da0064ee0 msgr2=0x7f9da0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:14.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9da0064ee0 0x7f9da0067390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9db4072e90 tx=0x7f9da8008030 comp rx=0 tx=0).stop 2023-11-08T12:29:14.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9db40aed90 msgr2=0x7f9db40ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:14.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9db40aed90 0x7f9db40ad370 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9da400ea60 tx=0x7f9da400ed70 comp rx=0 tx=0).stop 2023-11-08T12:29:14.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 shutdown_connections 2023-11-08T12:29:14.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9da0064ee0 0x7f9da0067390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:14.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db415cf10 0x7f9db41565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:14.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db40cd720 0x7f9db414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:14.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 --2- 172.21.15.112:0/4032434524 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9db40aed90 0x7f9db40ad370 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:14.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 >> 172.21.15.112:0/4032434524 conn(0x7f9db40d03b0 msgr2=0x7f9db406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:14.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 shutdown_connections 2023-11-08T12:29:14.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.543+0000 7f9db926d700 1 -- 172.21.15.112:0/4032434524 wait complete. 2023-11-08T12:29:14.554 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2023-11-08T12:29:14.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T12:29:14.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23cd34f700 1 Processor -- start 2023-11-08T12:29:14.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23cd34f700 1 -- start start 2023-11-08T12:29:14.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23cd34f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f23c80b1640 0x7f23c8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:14.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23cd34f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c815a550 con 0x7f23c80b43a0 2023-11-08T12:29:14.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23cd34f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c806b0a0 con 0x7f23c80c9040 2023-11-08T12:29:14.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23cd34f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80caac0 con 0x7f23c80b1640 2023-11-08T12:29:14.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23bffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f23c80b1640 0x7f23c8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:14.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23bffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f23c80b1640 0x7f23c8070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48076/0 (socket says 172.21.15.112:48076) 2023-11-08T12:29:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.751+0000 7f23bffff700 1 -- 172.21.15.112:0/2476038663 learned_addr learned my addr 172.21.15.112:0/2476038663 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23bffff700 1 -- 172.21.15.112:0/2476038663 >> v1:172.21.15.133:6789/0 conn(0x7f23c80c9040 legacy=0x7f23c806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23bffff700 1 -- 172.21.15.112:0/2476038663 >> v1:172.21.15.112:6789/0 conn(0x7f23c80b43a0 legacy=0x7f23c815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23bffff700 1 -- 172.21.15.112:0/2476038663 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80cada0 con 0x7f23c80b1640 2023-11-08T12:29:14.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23bffff700 1 --2- 172.21.15.112:0/2476038663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80b1640 0x7f23c8070080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009910 tx=0x7f23b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ae0135e2ee6955 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:14.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23c67fc700 1 -- 172.21.15.112:0/2476038663 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0004230 con 0x7f23c80b1640 2023-11-08T12:29:14.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23c67fc700 1 -- 172.21.15.112:0/2476038663 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0004390 con 0x7f23c80b1640 2023-11-08T12:29:14.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23c67fc700 1 -- 172.21.15.112:0/2476038663 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0009e60 con 0x7f23c80b1640 2023-11-08T12:29:14.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23cd34f700 1 -- 172.21.15.112:0/2476038663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80b1640 msgr2=0x7f23c8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:14.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23cd34f700 1 --2- 172.21.15.112:0/2476038663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80b1640 0x7f23c8070080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009910 tx=0x7f23b0009c20 comp rx=0 tx=0).stop 2023-11-08T12:29:14.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23cd34f700 1 -- 172.21.15.112:0/2476038663 shutdown_connections 2023-11-08T12:29:14.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23cd34f700 1 --2- 172.21.15.112:0/2476038663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80b1640 0x7f23c8070080 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:14.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23cd34f700 1 -- 172.21.15.112:0/2476038663 >> 172.21.15.112:0/2476038663 conn(0x7f23c80b0f80 msgr2=0x7f23c80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:14.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23cd34f700 1 -- 172.21.15.112:0/2476038663 shutdown_connections 2023-11-08T12:29:14.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.755+0000 7f23cd34f700 1 -- 172.21.15.112:0/2476038663 wait complete. 2023-11-08T12:29:14.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 Processor -- start 2023-11-08T12:29:14.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 -- start start 2023-11-08T12:29:14.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80b1640 0x7f23c81f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:14.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80b43a0 0x7f23c80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:14.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80c9040 0x7f23c80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:14.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80cd830 con 0x7f23c80c9040 2023-11-08T12:29:14.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81f25f0 con 0x7f23c80b43a0 2023-11-08T12:29:14.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23cd34f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80cc790 con 0x7f23c80b1640 2023-11-08T12:29:14.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80c9040 0x7f23c80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.759+0000 7f23c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80c9040 0x7f23c80b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48078/0 (socket says 172.21.15.112:48078) 2023-11-08T12:29:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c77fe700 1 -- 172.21.15.112:0/3128149951 learned_addr learned my addr 172.21.15.112:0/3128149951 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23bffff700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80b43a0 0x7f23c80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c6ffd700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80b1640 0x7f23c81f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c77fe700 1 -- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80b1640 msgr2=0x7f23c81f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c77fe700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80b1640 0x7f23c81f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c77fe700 1 -- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80b43a0 msgr2=0x7f23c80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c77fe700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80b43a0 0x7f23c80c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c77fe700 1 -- 172.21.15.112:0/3128149951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009570 con 0x7f23c80c9040 2023-11-08T12:29:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23c77fe700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80c9040 0x7f23c80b2a80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f23c000cc50 tx=0x7f23c000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23bf7fe700 1 -- 172.21.15.112:0/3128149951 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0003c20 con 0x7f23c80c9040 2023-11-08T12:29:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23bf7fe700 1 -- 172.21.15.112:0/3128149951 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0003d80 con 0x7f23c80c9040 2023-11-08T12:29:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23bf7fe700 1 -- 172.21.15.112:0/3128149951 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000ab60 con 0x7f23c80c9040 2023-11-08T12:29:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c806b5d0 con 0x7f23c80c9040 2023-11-08T12:29:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c806b2f0 con 0x7f23c80c9040 2023-11-08T12:29:14.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.763+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c80ca7b0 con 0x7f23c80c9040 2023-11-08T12:29:14.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.767+0000 7f23bf7fe700 1 -- 172.21.15.112:0/3128149951 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f23c0010050 con 0x7f23c80c9040 2023-11-08T12:29:14.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.767+0000 7f23bf7fe700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23a8064ee0 0x7f23a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:14.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.767+0000 7f23bf7fe700 1 -- 172.21.15.112:0/3128149951 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f23c0081b80 con 0x7f23c80c9040 2023-11-08T12:29:14.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.767+0000 7f23c6ffd700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23a8064ee0 0x7f23a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:14.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.767+0000 7f23c6ffd700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23a8064ee0 0x7f23a8067390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009890 tx=0x7f23b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.771+0000 7f23bf7fe700 1 -- 172.21.15.112:0/3128149951 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23c004ff30 con 0x7f23c80c9040 2023-11-08T12:29:15.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.999+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f23c8073cb0 con 0x7f23c80c9040 2023-11-08T12:29:15.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:14.999+0000 7f23bf7fe700 1 -- 172.21.15.112:0/3128149951 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f23c0053550 con 0x7f23c80c9040 2023-11-08T12:29:15.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:15.005 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:29:15.005 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2023-11-08T12:29:15.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.006 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2023-11-08T12:29:15.006 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlRHRoFxAAyw1Nx0lpcoK2O0Mffhxa+Q==", 2023-11-08T12:29:15.006 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.007 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.007 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:29:15.007 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:29:15.007 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.008 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2023-11-08T12:29:15.008 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlJ/6NKhAA4JtSpMqfz11efoyViRsE9w==", 2023-11-08T12:29:15.008 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.008 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.009 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:29:15.009 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:29:15.009 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.010 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2023-11-08T12:29:15.010 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlxtc7IhAAMY7VdOn5spixCeT9mzaa7w==", 2023-11-08T12:29:15.010 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.011 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.011 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:29:15.011 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:29:15.014 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.015 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2023-11-08T12:29:15.015 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlk30kNhAAeSX6T/4QZc9cWY79qyTDvg==", 2023-11-08T12:29:15.015 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.015 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.016 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:29:15.016 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:29:15.016 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.016 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.017 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2023-11-08T12:29:15.017 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCEfktlLsnsJRAAFve4QGR18ZZEoiNJHRc/bg==", 2023-11-08T12:29:15.017 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.017 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.018 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.018 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.019 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2023-11-08T12:29:15.019 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCHfktlyiDmNhAAAmDd3WWs+eLtraPczzmkTA==", 2023-11-08T12:29:15.019 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.019 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.019 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.020 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.020 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2023-11-08T12:29:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCLfktl3wtACRAAjC1v7SBT82SZhX7/gihG2g==", 2023-11-08T12:29:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2023-11-08T12:29:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCOfktlD3FjFxAAIjzJfy66ntwKBw7jYTmQEQ==", 2023-11-08T12:29:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.024 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2023-11-08T12:29:15.024 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCUfktlPUqvKhAApaw64K+eVu+b7K5vRpIrzg==", 2023-11-08T12:29:15.024 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.024 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.024 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.025 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.025 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.025 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2023-11-08T12:29:15.026 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCYfktlWkjeCxAAwJdasGWtOKqaCqIooSo5+Q==", 2023-11-08T12:29:15.026 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.026 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.026 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.026 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.027 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2023-11-08T12:29:15.027 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCbfktlvK3vGRAADNtY8DuzQeaQ+lamxqnpxA==", 2023-11-08T12:29:15.027 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.028 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.028 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.028 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.029 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2023-11-08T12:29:15.029 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCefktl6KNCKRAAp5984rD5GU3VsLxxZPH9Sg==", 2023-11-08T12:29:15.029 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.029 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:29:15.030 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:29:15.030 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.031 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2023-11-08T12:29:15.031 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlKVzUARAA264fUIQ90p7D7mpBaFS5Iw==", 2023-11-08T12:29:15.031 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.031 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.031 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:29:15.032 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:29:15.032 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:29:15.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2023-11-08T12:29:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlvItzDhAAOIl7M/iJ+xzhTEWNIef+/A==", 2023-11-08T12:29:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.033 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:29:15.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:29:15.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:29:15.034 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2023-11-08T12:29:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlg7APCBAA4UD3EeuTRrU2hjW+ozVSnw==", 2023-11-08T12:29:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:29:15.035 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:29:15.036 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:29:15.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.036 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2023-11-08T12:29:15.037 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlskN+FBAA7JKk8gz0qAYvbt/9+mvqwg==", 2023-11-08T12:29:15.037 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:29:15.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:29:15.037 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:29:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:29:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.038 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2023-11-08T12:29:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB/fktljcX3JxAAlDmA6nydT/tOMoWhfxG67w==", 2023-11-08T12:29:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:29:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:29:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:29:15.039 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.040 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mds", 2023-11-08T12:29:15.040 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCvfktlHwmnOBAACYcr5zzh2Kb8sQsd6t/ksQ==", 2023-11-08T12:29:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mds" 2023-11-08T12:29:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.042 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mgr", 2023-11-08T12:29:15.042 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCvfktl8iOnOBAA3dkI1fKSKfbRr9TBF2yRiA==", 2023-11-08T12:29:15.042 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.042 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-08T12:29:15.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.043 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-osd", 2023-11-08T12:29:15.043 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCvfktlnzqnOBAAAbOzdqhK5ydnSdlpSSIE4g==", 2023-11-08T12:29:15.043 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.044 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-osd" 2023-11-08T12:29:15.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.044 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd", 2023-11-08T12:29:15.045 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCvfktlOVCnOBAAHR3jARqL9wAsRY2k5aGF9Q==", 2023-11-08T12:29:15.045 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.045 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-08T12:29:15.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.046 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-08T12:29:15.046 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCvfktlpGanOBAAQ6GsHkA8xqzlMtjdLz4DYw==", 2023-11-08T12:29:15.046 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.046 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-08T12:29:15.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.047 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rgw", 2023-11-08T12:29:15.047 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCvfktlDn2nOBAAi5Hs+c6h7f7YS5Ek3W5ezw==", 2023-11-08T12:29:15.047 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.048 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-08T12:29:15.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.048 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2023-11-08T12:29:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlRLDaDxAAlkslT/w/88ZbnIMNtISKSg==", 2023-11-08T12:29:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:29:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-11-08T12:29:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:15.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:15.050 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2023-11-08T12:29:15.050 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlutF6CRAAjM6KkWuj4y/Fl97qiak9Xw==", 2023-11-08T12:29:15.050 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:29:15.051 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:29:15.051 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-11-08T12:29:15.051 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:29:15.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:15.052 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-11-08T12:29:15.052 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:29:15.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.003+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23a8064ee0 msgr2=0x7f23a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.003+0000 7f23cd34f700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23a8064ee0 0x7f23a8067390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009890 tx=0x7f23b8008040 comp rx=0 tx=0).stop 2023-11-08T12:29:15.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.003+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80c9040 msgr2=0x7f23c80b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.003+0000 7f23cd34f700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80c9040 0x7f23c80b2a80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f23c000cc50 tx=0x7f23c000cf60 comp rx=0 tx=0).stop 2023-11-08T12:29:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 shutdown_connections 2023-11-08T12:29:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f23a8064ee0 0x7f23a8067390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c80c9040 0x7f23c80b2a80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23c80b43a0 0x7f23c80c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 --2- 172.21.15.112:0/3128149951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23c80b1640 0x7f23c81f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 >> 172.21.15.112:0/3128149951 conn(0x7f23c80b0f80 msgr2=0x7f23c80ac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:15.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 shutdown_connections 2023-11-08T12:29:15.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.007+0000 7f23cd34f700 1 -- 172.21.15.112:0/3128149951 wait complete. 2023-11-08T12:29:15.056 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-08T12:29:15.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.227+0000 7f73cdaeb700 1 Processor -- start 2023-11-08T12:29:15.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.227+0000 7f73cdaeb700 1 -- start start 2023-11-08T12:29:15.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73c80cdeb0 0x7f73c8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73c80705c0 0x7f73c806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c80709d0 con 0x7f73c815c1a0 2023-11-08T12:29:15.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c8069bf0 con 0x7f73c80cdeb0 2023-11-08T12:29:15.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c80adf90 con 0x7f73c80705c0 2023-11-08T12:29:15.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f73c80cdeb0 0x7f73c8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73ccae9700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f73c815c1a0 0x7f73c806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38946/0 (socket says 172.21.15.112:38946) 2023-11-08T12:29:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73ccae9700 1 -- 172.21.15.112:0/948062306 learned_addr learned my addr 172.21.15.112:0/948062306 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:15.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cd2ea700 1 --2- 172.21.15.112:0/948062306 >> v2:172.21.15.133:3300/0 conn(0x7f73c80705c0 0x7f73c806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c7fff700 1 -- 172.21.15.112:0/948062306 >> v2:172.21.15.133:3300/0 conn(0x7f73c80705c0 msgr2=0x7f73c806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c7fff700 1 --2- 172.21.15.112:0/948062306 >> v2:172.21.15.133:3300/0 conn(0x7f73c80705c0 0x7f73c806a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c7fff700 1 -- 172.21.15.112:0/948062306 >> v1:172.21.15.112:6789/0 conn(0x7f73c815c1a0 legacy=0x7f73c806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c7fff700 1 -- 172.21.15.112:0/948062306 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80ce370 con 0x7f73c80cdeb0 2023-11-08T12:29:15.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c7fff700 1 --2- 172.21.15.112:0/948062306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80cdeb0 0x7f73c8070080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f73c806d4f0 tx=0x7f73b4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b1e359ecc57d2b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:15.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c77fe700 1 -- 172.21.15.112:0/948062306 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4011830 con 0x7f73c80cdeb0 2023-11-08T12:29:15.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c77fe700 1 -- 172.21.15.112:0/948062306 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b4011990 con 0x7f73c80cdeb0 2023-11-08T12:29:15.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73c77fe700 1 -- 172.21.15.112:0/948062306 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4011d20 con 0x7f73c80cdeb0 2023-11-08T12:29:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- 172.21.15.112:0/948062306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80cdeb0 msgr2=0x7f73c8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/948062306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80cdeb0 0x7f73c8070080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f73c806d4f0 tx=0x7f73b4009b30 comp rx=0 tx=0).stop 2023-11-08T12:29:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- 172.21.15.112:0/948062306 shutdown_connections 2023-11-08T12:29:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/948062306 >> v2:172.21.15.133:3300/0 conn(0x7f73c80705c0 0x7f73c806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/948062306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80cdeb0 0x7f73c8070080 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- 172.21.15.112:0/948062306 >> 172.21.15.112:0/948062306 conn(0x7f73c80b0f80 msgr2=0x7f73c80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:15.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- 172.21.15.112:0/948062306 shutdown_connections 2023-11-08T12:29:15.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.231+0000 7f73cdaeb700 1 -- 172.21.15.112:0/948062306 wait complete. 2023-11-08T12:29:15.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 Processor -- start 2023-11-08T12:29:15.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 -- start start 2023-11-08T12:29:15.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80705c0 0x7f73c814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73c80cdeb0 0x7f73c80abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73c815c1a0 0x7f73c8154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80ab860 con 0x7f73c80705c0 2023-11-08T12:29:15.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80abb40 con 0x7f73c815c1a0 2023-11-08T12:29:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73cdaeb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80ad390 con 0x7f73c80cdeb0 2023-11-08T12:29:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.235+0000 7f73ccae9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80705c0 0x7f73c814bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80705c0 0x7f73c814bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49426/0 (socket says 172.21.15.112:49426) 2023-11-08T12:29:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 -- 172.21.15.112:0/1353006966 learned_addr learned my addr 172.21.15.112:0/1353006966 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:15.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73cd2ea700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73c815c1a0 0x7f73c8154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73c7fff700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73c80cdeb0 0x7f73c80abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 -- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73c80cdeb0 msgr2=0x7f73c80abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73c80cdeb0 0x7f73c80abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 -- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73c815c1a0 msgr2=0x7f73c8154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73c815c1a0 0x7f73c8154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 -- 172.21.15.112:0/1353006966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b40094b0 con 0x7f73c80705c0 2023-11-08T12:29:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73cd2ea700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73c815c1a0 0x7f73c8154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73c7fff700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73c80cdeb0 0x7f73c80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:15.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73ccae9700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80705c0 0x7f73c814bcc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c4d0 tx=0x7f73bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73c57fa700 1 -- 172.21.15.112:0/1353006966 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc005d90 con 0x7f73c80705c0 2023-11-08T12:29:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73c57fa700 1 -- 172.21.15.112:0/1353006966 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0070d0 con 0x7f73c80705c0 2023-11-08T12:29:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c80cc780 con 0x7f73c80705c0 2023-11-08T12:29:15.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73c57fa700 1 -- 172.21.15.112:0/1353006966 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc007440 con 0x7f73c80705c0 2023-11-08T12:29:15.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c80cc4a0 con 0x7f73c80705c0 2023-11-08T12:29:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.239+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c815c570 con 0x7f73c80705c0 2023-11-08T12:29:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.243+0000 7f73c57fa700 1 -- 172.21.15.112:0/1353006966 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f73bc019030 con 0x7f73c80705c0 2023-11-08T12:29:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.243+0000 7f73c57fa700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f73ac064ee0 0x7f73ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.243+0000 7f73c57fa700 1 -- 172.21.15.112:0/1353006966 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f73bc080fa0 con 0x7f73c80705c0 2023-11-08T12:29:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.243+0000 7f73c7fff700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f73ac064ee0 0x7f73ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.243+0000 7f73c7fff700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f73ac064ee0 0x7f73ac067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ce2a0 tx=0x7f73b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:15.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.247+0000 7f73c57fa700 1 -- 172.21.15.112:0/1353006966 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f73bc04a400 con 0x7f73c80705c0 2023-11-08T12:29:15.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.475+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f73c8073cb0 con 0x7f73c80705c0 2023-11-08T12:29:15.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.479+0000 7f73c57fa700 1 -- 172.21.15.112:0/1353006966 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f73bc04f310 con 0x7f73c80705c0 2023-11-08T12:29:15.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f73ac064ee0 msgr2=0x7f73ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f73ac064ee0 0x7f73ac067390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ce2a0 tx=0x7f73b4008030 comp rx=0 tx=0).stop 2023-11-08T12:29:15.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80705c0 msgr2=0x7f73c814bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80705c0 0x7f73c814bcc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00c4d0 tx=0x7f73bc00c890 comp rx=0 tx=0).stop 2023-11-08T12:29:15.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 shutdown_connections 2023-11-08T12:29:15.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f73ac064ee0 0x7f73ac067390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73c815c1a0 0x7f73c8154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73c80cdeb0 0x7f73c80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 --2- 172.21.15.112:0/1353006966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73c80705c0 0x7f73c814bcc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 >> 172.21.15.112:0/1353006966 conn(0x7f73c80b0f80 msgr2=0x7f73c806ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:15.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 shutdown_connections 2023-11-08T12:29:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.483+0000 7f73cdaeb700 1 -- 172.21.15.112:0/1353006966 wait complete. 2023-11-08T12:29:15.509 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-08T12:29:15.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.683+0000 7faf29bfc700 1 Processor -- start 2023-11-08T12:29:15.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.683+0000 7faf29bfc700 1 -- start start 2023-11-08T12:29:15.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf29bfc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 0x7faf24070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf29bfc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf240c9040 0x7faf240705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf29bfc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2415a550 con 0x7faf240b43a0 2023-11-08T12:29:15.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf29bfc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2406b0a0 con 0x7faf240c9040 2023-11-08T12:29:15.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf29bfc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240caac0 con 0x7faf240b1640 2023-11-08T12:29:15.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf293fb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf240c9040 0x7faf240705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf28bfa700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faf240b43a0 0x7faf2415e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38960/0 (socket says 172.21.15.112:38960) 2023-11-08T12:29:15.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf28bfa700 1 -- 172.21.15.112:0/4118703703 learned_addr learned my addr 172.21.15.112:0/4118703703 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:15.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf23fff700 1 --2- 172.21.15.112:0/4118703703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 0x7faf24070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf293fb700 1 -- 172.21.15.112:0/4118703703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 msgr2=0x7faf24070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:15.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf293fb700 1 --2- 172.21.15.112:0/4118703703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 0x7faf24070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf293fb700 1 -- 172.21.15.112:0/4118703703 >> v1:172.21.15.112:6789/0 conn(0x7faf240b43a0 legacy=0x7faf2415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf293fb700 1 -- 172.21.15.112:0/4118703703 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240cada0 con 0x7faf240c9040 2023-11-08T12:29:15.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf237fe700 1 -- 172.21.15.112:0/4118703703 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631967785 0 0) 0x7faf18001110 con 0x7faf240b43a0 2023-11-08T12:29:15.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf293fb700 1 --2- 172.21.15.112:0/4118703703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240c9040 0x7faf240705c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009d90 tx=0x7faf1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cacc7aeb43670d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:15.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf237fe700 1 -- 172.21.15.112:0/4118703703 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00e070 con 0x7faf240c9040 2023-11-08T12:29:15.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf237fe700 1 -- 172.21.15.112:0/4118703703 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00bbd0 con 0x7faf240c9040 2023-11-08T12:29:15.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.687+0000 7faf237fe700 1 -- 172.21.15.112:0/4118703703 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c012430 con 0x7faf240c9040 2023-11-08T12:29:15.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- 172.21.15.112:0/4118703703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240c9040 msgr2=0x7faf240705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 --2- 172.21.15.112:0/4118703703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240c9040 0x7faf240705c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009d90 tx=0x7faf1c00b330 comp rx=0 tx=0).stop 2023-11-08T12:29:15.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- 172.21.15.112:0/4118703703 shutdown_connections 2023-11-08T12:29:15.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 --2- 172.21.15.112:0/4118703703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240c9040 0x7faf240705c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 --2- 172.21.15.112:0/4118703703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 0x7faf24070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- 172.21.15.112:0/4118703703 >> 172.21.15.112:0/4118703703 conn(0x7faf240b0f80 msgr2=0x7faf240ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:15.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- 172.21.15.112:0/4118703703 shutdown_connections 2023-11-08T12:29:15.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- 172.21.15.112:0/4118703703 wait complete. 2023-11-08T12:29:15.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 Processor -- start 2023-11-08T12:29:15.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- start start 2023-11-08T12:29:15.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 0x7faf240acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240b43a0 0x7faf241f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf240c9040 0x7faf240c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2415ad50 con 0x7faf240b43a0 2023-11-08T12:29:15.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240ad150 con 0x7faf240c9040 2023-11-08T12:29:15.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.691+0000 7faf29bfc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2415a790 con 0x7faf240b1640 2023-11-08T12:29:15.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240b43a0 0x7faf241f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240b43a0 0x7faf241f1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49448/0 (socket says 172.21.15.112:49448) 2023-11-08T12:29:15.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 -- 172.21.15.112:0/935256104 learned_addr learned my addr 172.21.15.112:0/935256104 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:15.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 -- 172.21.15.112:0/935256104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 msgr2=0x7faf240acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 0x7faf240acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 -- 172.21.15.112:0/935256104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf240c9040 msgr2=0x7faf240c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf240c9040 0x7faf240c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 -- 172.21.15.112:0/935256104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009a70 con 0x7faf240b43a0 2023-11-08T12:29:15.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf23fff700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240b43a0 0x7faf241f1230 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faf1000d800 tx=0x7faf1000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:15.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf217fa700 1 -- 172.21.15.112:0/935256104 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100125f0 con 0x7faf240b43a0 2023-11-08T12:29:15.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf217fa700 1 -- 172.21.15.112:0/935256104 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf10012750 con 0x7faf240b43a0 2023-11-08T12:29:15.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf217fa700 1 -- 172.21.15.112:0/935256104 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10012ac0 con 0x7faf240b43a0 2023-11-08T12:29:15.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2406b5d0 con 0x7faf240b43a0 2023-11-08T12:29:15.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2406b2f0 con 0x7faf240b43a0 2023-11-08T12:29:15.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240ca7b0 con 0x7faf240b43a0 2023-11-08T12:29:15.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.695+0000 7faf217fa700 1 -- 172.21.15.112:0/935256104 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faf10012c20 con 0x7faf240b43a0 2023-11-08T12:29:15.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.699+0000 7faf217fa700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf08064ee0 0x7faf08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:15.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.699+0000 7faf217fa700 1 -- 172.21.15.112:0/935256104 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7faf100821f0 con 0x7faf240b43a0 2023-11-08T12:29:15.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.699+0000 7faf28bfa700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf08064ee0 0x7faf08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:15.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.699+0000 7faf28bfa700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf08064ee0 0x7faf08067390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf24070750 tx=0x7faf18001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:15.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.703+0000 7faf217fa700 1 -- 172.21.15.112:0/935256104 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faf100504b0 con 0x7faf240b43a0 2023-11-08T12:29:15.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.927+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7faf24073cb0 con 0x7faf240b43a0 2023-11-08T12:29:15.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.939+0000 7faf217fa700 1 -- 172.21.15.112:0/935256104 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7faf10053ad0 con 0x7faf240b43a0 2023-11-08T12:29:15.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.939+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf08064ee0 msgr2=0x7faf08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.939+0000 7faf29bfc700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf08064ee0 0x7faf08067390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf24070750 tx=0x7faf18001310 comp rx=0 tx=0).stop 2023-11-08T12:29:15.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.939+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240b43a0 msgr2=0x7faf241f1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:15.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.939+0000 7faf29bfc700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240b43a0 0x7faf241f1230 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faf1000d800 tx=0x7faf1000dbc0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 shutdown_connections 2023-11-08T12:29:15.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf08064ee0 0x7faf08067390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf240c9040 0x7faf240c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf240b43a0 0x7faf241f1230 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 --2- 172.21.15.112:0/935256104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf240b1640 0x7faf240acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:15.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 >> 172.21.15.112:0/935256104 conn(0x7faf240b0f80 msgr2=0x7faf240ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:15.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 shutdown_connections 2023-11-08T12:29:15.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:15.943+0000 7faf29bfc700 1 -- 172.21.15.112:0/935256104 wait complete. 2023-11-08T12:29:15.967 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-08T12:29:16.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 Processor -- start 2023-11-08T12:29:16.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 -- start start 2023-11-08T12:29:16.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a200cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a200c8d10 0x7f5a200cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5a200ccd10 0x7f5a2015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2015a850 con 0x7f5a200c8d10 2023-11-08T12:29:16.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a200cada0 con 0x7f5a200ccd10 2023-11-08T12:29:16.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a28651700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200ce060 con 0x7f5a2015a480 2023-11-08T12:29:16.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a25bec700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a200c8d10 0x7f5a200cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a25bec700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a200c8d10 0x7f5a200cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49458/0 (socket says 172.21.15.112:49458) 2023-11-08T12:29:16.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.143+0000 7f5a25bec700 1 -- 172.21.15.112:0/1995552849 learned_addr learned my addr 172.21.15.112:0/1995552849 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:16.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a263ed700 1 --2- 172.21.15.112:0/1995552849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a200cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a26bee700 1 --2- 172.21.15.112:0/1995552849 >> v2:172.21.15.133:3300/0 conn(0x7f5a200ccd10 0x7f5a2015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a25bec700 1 -- 172.21.15.112:0/1995552849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 msgr2=0x7f5a200cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:16.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a25bec700 1 --2- 172.21.15.112:0/1995552849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a200cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a25bec700 1 -- 172.21.15.112:0/1995552849 >> v2:172.21.15.133:3300/0 conn(0x7f5a200ccd10 msgr2=0x7f5a2015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:16.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a25bec700 1 --2- 172.21.15.112:0/1995552849 >> v2:172.21.15.133:3300/0 conn(0x7f5a200ccd10 0x7f5a2015dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a25bec700 1 -- 172.21.15.112:0/1995552849 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a200ce300 con 0x7f5a200c8d10 2023-11-08T12:29:16.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a263ed700 1 --2- 172.21.15.112:0/1995552849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a200cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:16.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a26bee700 1 --2- 172.21.15.112:0/1995552849 >> v2:172.21.15.133:3300/0 conn(0x7f5a200ccd10 0x7f5a2015dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:16.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a25bec700 1 --2- 172.21.15.112:0/1995552849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200c8d10 0x7f5a200cc7d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5a2015ef80 tx=0x7f5a10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b271cd39d0ecc4ff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:16.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a253eb700 1 -- 172.21.15.112:0/1995552849 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000b8a0 con 0x7f5a200c8d10 2023-11-08T12:29:16.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a253eb700 1 -- 172.21.15.112:0/1995552849 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1000ba00 con 0x7f5a200c8d10 2023-11-08T12:29:16.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a253eb700 1 -- 172.21.15.112:0/1995552849 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000bd90 con 0x7f5a200c8d10 2023-11-08T12:29:16.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 -- 172.21.15.112:0/1995552849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200c8d10 msgr2=0x7f5a200cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 --2- 172.21.15.112:0/1995552849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200c8d10 0x7f5a200cc7d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5a2015ef80 tx=0x7f5a10009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 -- 172.21.15.112:0/1995552849 shutdown_connections 2023-11-08T12:29:16.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 --2- 172.21.15.112:0/1995552849 >> v2:172.21.15.133:3300/0 conn(0x7f5a200ccd10 0x7f5a2015dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 --2- 172.21.15.112:0/1995552849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200c8d10 0x7f5a200cc7d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 --2- 172.21.15.112:0/1995552849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a200cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 -- 172.21.15.112:0/1995552849 >> 172.21.15.112:0/1995552849 conn(0x7f5a200cf350 msgr2=0x7f5a200b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 -- 172.21.15.112:0/1995552849 shutdown_connections 2023-11-08T12:29:16.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.147+0000 7f5a28651700 1 -- 172.21.15.112:0/1995552849 wait complete. 2023-11-08T12:29:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 Processor -- start 2023-11-08T12:29:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 -- start start 2023-11-08T12:29:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a200c8d10 0x7f5a201455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200ccd10 0x7f5a2015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a201f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20145ae0 con 0x7f5a200ccd10 2023-11-08T12:29:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2015d8e0 con 0x7f5a200c8d10 2023-11-08T12:29:16.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a28651700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2015aaa0 con 0x7f5a2015a480 2023-11-08T12:29:16.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a25bec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200ccd10 0x7f5a2015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a25bec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200ccd10 0x7f5a2015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49472/0 (socket says 172.21.15.112:49472) 2023-11-08T12:29:16.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.151+0000 7f5a25bec700 1 -- 172.21.15.112:0/1819749692 learned_addr learned my addr 172.21.15.112:0/1819749692 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:16.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a263ed700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a200c8d10 0x7f5a201455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a26bee700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a201f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a25bec700 1 -- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 msgr2=0x7f5a201f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a25bec700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a201f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a25bec700 1 -- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a200c8d10 msgr2=0x7f5a201455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a25bec700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a200c8d10 0x7f5a201455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a25bec700 1 -- 172.21.15.112:0/1819749692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a10009570 con 0x7f5a200ccd10 2023-11-08T12:29:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a263ed700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a200c8d10 0x7f5a201455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a25bec700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200ccd10 0x7f5a2015d040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5a10000c00 tx=0x7f5a10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a16ffd700 1 -- 172.21.15.112:0/1819749692 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100038c0 con 0x7f5a200ccd10 2023-11-08T12:29:16.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a16ffd700 1 -- 172.21.15.112:0/1819749692 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1001e070 con 0x7f5a200ccd10 2023-11-08T12:29:16.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a200add50 con 0x7f5a200ccd10 2023-11-08T12:29:16.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a16ffd700 1 -- 172.21.15.112:0/1819749692 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10003c60 con 0x7f5a200ccd10 2023-11-08T12:29:16.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a200caa30 con 0x7f5a200ccd10 2023-11-08T12:29:16.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.155+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a200ca6e0 con 0x7f5a200ccd10 2023-11-08T12:29:16.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.159+0000 7f5a16ffd700 1 -- 172.21.15.112:0/1819749692 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a1000f050 con 0x7f5a200ccd10 2023-11-08T12:29:16.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.159+0000 7f5a16ffd700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5a04064ee0 0x7f5a04067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.159+0000 7f5a16ffd700 1 -- 172.21.15.112:0/1819749692 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5a10020070 con 0x7f5a200ccd10 2023-11-08T12:29:16.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.159+0000 7f5a263ed700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5a04064ee0 0x7f5a04067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.159+0000 7f5a263ed700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5a04064ee0 0x7f5a04067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009a10 tx=0x7f5a1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:16.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.167+0000 7f5a16ffd700 1 -- 172.21.15.112:0/1819749692 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5a10051840 con 0x7f5a200ccd10 2023-11-08T12:29:16.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.395+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5a200726c0 con 0x7f5a200ccd10 2023-11-08T12:29:16.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.403+0000 7f5a16ffd700 1 -- 172.21.15.112:0/1819749692 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5a1002d350 con 0x7f5a200ccd10 2023-11-08T12:29:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5a04064ee0 msgr2=0x7f5a04067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5a04064ee0 0x7f5a04067390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009a10 tx=0x7f5a1c008040 comp rx=0 tx=0).stop 2023-11-08T12:29:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200ccd10 msgr2=0x7f5a2015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200ccd10 0x7f5a2015d040 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5a10000c00 tx=0x7f5a10004770 comp rx=0 tx=0).stop 2023-11-08T12:29:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 shutdown_connections 2023-11-08T12:29:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5a04064ee0 0x7f5a04067390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a2015a480 0x7f5a201f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a200ccd10 0x7f5a2015d040 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 --2- 172.21.15.112:0/1819749692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a200c8d10 0x7f5a201455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.407+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 >> 172.21.15.112:0/1819749692 conn(0x7f5a200cf350 msgr2=0x7f5a2015de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:16.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.411+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 shutdown_connections 2023-11-08T12:29:16.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.411+0000 7f5a28651700 1 -- 172.21.15.112:0/1819749692 wait complete. 2023-11-08T12:29:16.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-08T12:29:16.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.599+0000 7efbfd8fb700 1 Processor -- start 2023-11-08T12:29:16.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.599+0000 7efbfd8fb700 1 -- start start 2023-11-08T12:29:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbfd8fb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbfd8fb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf815a550 con 0x7efbf80c9040 2023-11-08T12:29:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbfd8fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf806b0a0 con 0x7efbf80b43a0 2023-11-08T12:29:16.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbfd8fb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80caac0 con 0x7efbf80b1640 2023-11-08T12:29:16.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbfd0fa700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efbf80c9040 0x7efbf806bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38972/0 (socket says 172.21.15.112:38972) 2023-11-08T12:29:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbfd0fa700 1 -- 172.21.15.112:0/1886350354 learned_addr learned my addr 172.21.15.112:0/1886350354 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbeffff700 1 --2- 172.21.15.112:0/1886350354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbef7fe700 1 -- 172.21.15.112:0/1886350354 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491645185 0 0) 0x7efbf0001490 con 0x7efbf80c9040 2023-11-08T12:29:16.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbef7fe700 1 -- 172.21.15.112:0/1886350354 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe00035d0 con 0x7efbf80c9040 2023-11-08T12:29:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbef7fe700 1 -- 172.21.15.112:0/1886350354 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009552526 0 0) 0x7efbf806b0a0 con 0x7efbf80b43a0 2023-11-08T12:29:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbeffff700 1 -- 172.21.15.112:0/1886350354 >> v1:172.21.15.133:6789/0 conn(0x7efbf80b43a0 legacy=0x7efbf815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbeffff700 1 -- 172.21.15.112:0/1886350354 >> v1:172.21.15.112:6789/0 conn(0x7efbf80c9040 legacy=0x7efbf806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbeffff700 1 -- 172.21.15.112:0/1886350354 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80cada0 con 0x7efbf80b1640 2023-11-08T12:29:16.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.603+0000 7efbeffff700 1 --2- 172.21.15.112:0/1886350354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf8070080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009880 tx=0x7efbe8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3896f45b9aae324b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbef7fe700 1 -- 172.21.15.112:0/1886350354 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8011830 con 0x7efbf80b1640 2023-11-08T12:29:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbef7fe700 1 -- 172.21.15.112:0/1886350354 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8011990 con 0x7efbf80b1640 2023-11-08T12:29:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbef7fe700 1 -- 172.21.15.112:0/1886350354 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8011d20 con 0x7efbf80b1640 2023-11-08T12:29:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1886350354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 msgr2=0x7efbf8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1886350354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf8070080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009880 tx=0x7efbe8009b90 comp rx=0 tx=0).stop 2023-11-08T12:29:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1886350354 shutdown_connections 2023-11-08T12:29:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1886350354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf8070080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1886350354 >> 172.21.15.112:0/1886350354 conn(0x7efbf80b0f80 msgr2=0x7efbf80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1886350354 shutdown_connections 2023-11-08T12:29:16.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.607+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1886350354 wait complete. 2023-11-08T12:29:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 Processor -- start 2023-11-08T12:29:16.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 -- start start 2023-11-08T12:29:16.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf81577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbf80b43a0 0x7efbf80c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbf80c9040 0x7efbf81590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf8157ce0 con 0x7efbf80c9040 2023-11-08T12:29:16.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80c47d0 con 0x7efbf80b43a0 2023-11-08T12:29:16.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd8fb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80cd420 con 0x7efbf80b1640 2023-11-08T12:29:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd0fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbf80c9040 0x7efbf81590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd0fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbf80c9040 0x7efbf81590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49476/0 (socket says 172.21.15.112:49476) 2023-11-08T12:29:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfd0fa700 1 -- 172.21.15.112:0/1541136771 learned_addr learned my addr 172.21.15.112:0/1541136771 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbfc8f9700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf81577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.611+0000 7efbeffff700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbf80b43a0 0x7efbf80c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd0fa700 1 -- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 msgr2=0x7efbf81577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd0fa700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf81577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd0fa700 1 -- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbf80b43a0 msgr2=0x7efbf80c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd0fa700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbf80b43a0 0x7efbf80c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd0fa700 1 -- 172.21.15.112:0/1541136771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe80094b0 con 0x7efbf80c9040 2023-11-08T12:29:16.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd0fa700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbf80c9040 0x7efbf81590c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efbf000cb10 tx=0x7efbf000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:16.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbed7fa700 1 -- 172.21.15.112:0/1541136771 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0007480 con 0x7efbf80c9040 2023-11-08T12:29:16.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbed7fa700 1 -- 172.21.15.112:0/1541136771 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf00075e0 con 0x7efbf80c9040 2023-11-08T12:29:16.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf806b5d0 con 0x7efbf80c9040 2023-11-08T12:29:16.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbed7fa700 1 -- 172.21.15.112:0/1541136771 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0007970 con 0x7efbf80c9040 2023-11-08T12:29:16.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf806b2f0 con 0x7efbf80c9040 2023-11-08T12:29:16.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf80ca7b0 con 0x7efbf80c9040 2023-11-08T12:29:16.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.615+0000 7efbed7fa700 1 -- 172.21.15.112:0/1541136771 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efbf0019030 con 0x7efbf80c9040 2023-11-08T12:29:16.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.619+0000 7efbed7fa700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efbe4064ee0 0x7efbe4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:16.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.619+0000 7efbed7fa700 1 -- 172.21.15.112:0/1541136771 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efbf0081260 con 0x7efbf80c9040 2023-11-08T12:29:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.619+0000 7efbfc8f9700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efbe4064ee0 0x7efbe4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:16.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.619+0000 7efbfc8f9700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efbe4064ee0 0x7efbe4067390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efbf4007fd0 tx=0x7efbf4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:16.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.623+0000 7efbed7fa700 1 -- 172.21.15.112:0/1541136771 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efbf004f610 con 0x7efbf80c9040 2023-11-08T12:29:16.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.859+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7efbf80c8eb0 con 0x7efbf80c9040 2023-11-08T12:29:16.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.863+0000 7efbed7fa700 1 -- 172.21.15.112:0/1541136771 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7efbf00170a0 con 0x7efbf80c9040 2023-11-08T12:29:16.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efbe4064ee0 msgr2=0x7efbe4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efbe4064ee0 0x7efbe4067390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efbf4007fd0 tx=0x7efbf4009040 comp rx=0 tx=0).stop 2023-11-08T12:29:16.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbf80c9040 msgr2=0x7efbf81590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:16.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbf80c9040 0x7efbf81590c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efbf000cb10 tx=0x7efbf000cb40 comp rx=0 tx=0).stop 2023-11-08T12:29:16.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 shutdown_connections 2023-11-08T12:29:16.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efbe4064ee0 0x7efbe4067390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbf80c9040 0x7efbf81590c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbf80b43a0 0x7efbf80c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 --2- 172.21.15.112:0/1541136771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efbf80b1640 0x7efbf81577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:16.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 >> 172.21.15.112:0/1541136771 conn(0x7efbf80b0f80 msgr2=0x7efbf8070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:16.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 shutdown_connections 2023-11-08T12:29:16.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:16.871+0000 7efbfd8fb700 1 -- 172.21.15.112:0/1541136771 wait complete. 2023-11-08T12:29:16.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-08T12:29:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.067+0000 7f6ec19cb700 1 Processor -- start 2023-11-08T12:29:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.067+0000 7f6ec19cb700 1 -- start start 2023-11-08T12:29:17.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6ec19cb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ebc158840 0x7f6ebc0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6ec19cb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ebc15c3b0 0x7f6ebc070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6ec19cb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc06b090 con 0x7f6ebc0c8da0 2023-11-08T12:29:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6ec19cb700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc069bf0 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6ec19cb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc15c890 con 0x7f6ebc158840 2023-11-08T12:29:17.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ebc15c3b0 0x7f6ebc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ebc15c3b0 0x7f6ebc070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49490/0 (socket says 172.21.15.112:49490) 2023-11-08T12:29:17.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 -- 172.21.15.112:0/2152914387 learned_addr learned my addr 172.21.15.112:0/2152914387 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:17.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6ebaffd700 1 --2- 172.21.15.112:0/2152914387 >> v2:172.21.15.133:3300/0 conn(0x7f6ebc158840 0x7f6ebc0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 -- 172.21.15.112:0/2152914387 >> v2:172.21.15.133:3300/0 conn(0x7f6ebc158840 msgr2=0x7f6ebc0ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:17.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 --2- 172.21.15.112:0/2152914387 >> v2:172.21.15.133:3300/0 conn(0x7f6ebc158840 0x7f6ebc0ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 -- 172.21.15.112:0/2152914387 >> v1:172.21.15.133:6789/0 conn(0x7f6ebc0c8da0 legacy=0x7f6ebc06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 -- 172.21.15.112:0/2152914387 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc15cb70 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eb27fc700 1 --2- 172.21.15.112:0/2152914387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc070080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc06d000 tx=0x7f6ea400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4971cf2977e9706e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:17.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eba7fc700 1 -- 172.21.15.112:0/2152914387 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400bb10 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eba7fc700 1 -- 172.21.15.112:0/2152914387 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400bc70 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.071+0000 7f6eba7fc700 1 -- 172.21.15.112:0/2152914387 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4011460 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 -- 172.21.15.112:0/2152914387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 msgr2=0x7f6ebc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/2152914387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc070080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc06d000 tx=0x7f6ea400b330 comp rx=0 tx=0).stop 2023-11-08T12:29:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 -- 172.21.15.112:0/2152914387 shutdown_connections 2023-11-08T12:29:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/2152914387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc070080 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/2152914387 >> v2:172.21.15.133:3300/0 conn(0x7f6ebc158840 0x7f6ebc0ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 -- 172.21.15.112:0/2152914387 >> 172.21.15.112:0/2152914387 conn(0x7f6ebc0b0f80 msgr2=0x7f6ebc0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 -- 172.21.15.112:0/2152914387 shutdown_connections 2023-11-08T12:29:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.075+0000 7f6ec19cb700 1 -- 172.21.15.112:0/2152914387 wait complete. 2023-11-08T12:29:17.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 Processor -- start 2023-11-08T12:29:17.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 -- start start 2023-11-08T12:29:17.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ebc0c8da0 0x7f6ebc1ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ebc158840 0x7f6ebc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0c7e60 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc15bca0 con 0x7f6ebc158840 2023-11-08T12:29:17.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.079+0000 7f6ec19cb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc1ed630 con 0x7f6ebc0c8da0 2023-11-08T12:29:17.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc15b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49492/0 (socket says 172.21.15.112:49492) 2023-11-08T12:29:17.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 -- 172.21.15.112:0/1103431916 learned_addr learned my addr 172.21.15.112:0/1103431916 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:17.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6eb27fc700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ebc158840 0x7f6ebc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebaffd700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ebc0c8da0 0x7f6ebc1ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 -- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ebc0c8da0 msgr2=0x7f6ebc1ecf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ebc0c8da0 0x7f6ebc1ecf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 -- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ebc158840 msgr2=0x7f6ebc0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ebc158840 0x7f6ebc0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 -- 172.21.15.112:0/1103431916 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009b30 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebaffd700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ebc0c8da0 0x7f6ebc1ecf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ebb7fe700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc15b760 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400c480 tx=0x7f6eb400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6eb8ff9700 1 -- 172.21.15.112:0/1103431916 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40052d0 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6eb8ff9700 1 -- 172.21.15.112:0/1103431916 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4005430 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc15d130 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6eb8ff9700 1 -- 172.21.15.112:0/1103431916 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40055a0 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc15ce50 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.083+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc158c10 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.087+0000 7f6eb8ff9700 1 -- 172.21.15.112:0/1103431916 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6eb4019030 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.087+0000 7f6eb8ff9700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e9c064ee0 0x7f6e9c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.087+0000 7f6eb8ff9700 1 -- 172.21.15.112:0/1103431916 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6eb4080d50 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.087+0000 7f6ebaffd700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e9c064ee0 0x7f6e9c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.087+0000 7f6ebaffd700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e9c064ee0 0x7f6e9c067390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0ca230 tx=0x7f6eac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:17.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.095+0000 7f6eb8ff9700 1 -- 172.21.15.112:0/1103431916 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6eb404f0a0 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.327+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6ebc06b090 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.335+0000 7f6eb8ff9700 1 -- 172.21.15.112:0/1103431916 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6ebc06b090 con 0x7f6ebc15c3b0 2023-11-08T12:29:17.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e9c064ee0 msgr2=0x7f6e9c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e9c064ee0 0x7f6e9c067390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0ca230 tx=0x7f6eac008040 comp rx=0 tx=0).stop 2023-11-08T12:29:17.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 msgr2=0x7f6ebc15b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc15b760 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400c480 tx=0x7f6eb400c790 comp rx=0 tx=0).stop 2023-11-08T12:29:17.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 shutdown_connections 2023-11-08T12:29:17.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e9c064ee0 0x7f6e9c067390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ebc15c3b0 0x7f6ebc15b760 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ebc158840 0x7f6ebc0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 --2- 172.21.15.112:0/1103431916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ebc0c8da0 0x7f6ebc1ecf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 >> 172.21.15.112:0/1103431916 conn(0x7f6ebc0b0f80 msgr2=0x7f6ebc06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 shutdown_connections 2023-11-08T12:29:17.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.339+0000 7f6ec19cb700 1 -- 172.21.15.112:0/1103431916 wait complete. 2023-11-08T12:29:17.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-08T12:29:17.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.535+0000 7f75d0dd2700 1 Processor -- start 2023-11-08T12:29:17.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.535+0000 7f75d0dd2700 1 -- start start 2023-11-08T12:29:17.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75d0dd2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f75cc0b1640 0x7f75cc070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75d0dd2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75d0dd2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc15a550 con 0x7f75cc0b43a0 2023-11-08T12:29:17.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75d0dd2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc06b0a0 con 0x7f75cc0b1640 2023-11-08T12:29:17.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75d0dd2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0caac0 con 0x7f75cc0c9040 2023-11-08T12:29:17.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75c2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f75cc0b1640 0x7f75cc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75cb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f75cc0b43a0 0x7f75cc15e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:38274/0 (socket says 172.21.15.112:38274) 2023-11-08T12:29:17.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75cb7fe700 1 -- 172.21.15.112:0/2552550357 learned_addr learned my addr 172.21.15.112:0/2552550357 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:17.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75cbfff700 1 --2- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75caffd700 1 -- 172.21.15.112:0/2552550357 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750967447 0 0) 0x7f75bc001110 con 0x7f75cc0b43a0 2023-11-08T12:29:17.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75caffd700 1 -- 172.21.15.112:0/2552550357 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b80035d0 con 0x7f75cc0b43a0 2023-11-08T12:29:17.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75c2ffd700 1 -- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 msgr2=0x7f75cc0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:17.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75c2ffd700 1 --2- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75c2ffd700 1 -- 172.21.15.112:0/2552550357 >> v1:172.21.15.133:6789/0 conn(0x7f75cc0b43a0 legacy=0x7f75cc15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75c2ffd700 1 -- 172.21.15.112:0/2552550357 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0cada0 con 0x7f75cc0b1640 2023-11-08T12:29:17.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75cbfff700 1 --2- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:17.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.539+0000 7f75c2ffd700 1 --2- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b1640 0x7f75cc070080 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009850 tx=0x7f75b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca5b2089201773c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:17.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75caffd700 1 -- 172.21.15.112:0/2552550357 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011830 con 0x7f75cc0b1640 2023-11-08T12:29:17.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75caffd700 1 -- 172.21.15.112:0/2552550357 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4011990 con 0x7f75cc0b1640 2023-11-08T12:29:17.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75caffd700 1 -- 172.21.15.112:0/2552550357 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011d40 con 0x7f75cc0b1640 2023-11-08T12:29:17.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 -- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b1640 msgr2=0x7f75cc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b1640 0x7f75cc070080 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009850 tx=0x7f75b4009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:17.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 -- 172.21.15.112:0/2552550357 shutdown_connections 2023-11-08T12:29:17.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/2552550357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b1640 0x7f75cc070080 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 -- 172.21.15.112:0/2552550357 >> 172.21.15.112:0/2552550357 conn(0x7f75cc0b0f80 msgr2=0x7f75cc0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:17.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 -- 172.21.15.112:0/2552550357 shutdown_connections 2023-11-08T12:29:17.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.543+0000 7f75d0dd2700 1 -- 172.21.15.112:0/2552550357 wait complete. 2023-11-08T12:29:17.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 Processor -- start 2023-11-08T12:29:17.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 -- start start 2023-11-08T12:29:17.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc0b1640 0x7f75cc1f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b43a0 0x7f75cc1f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc1f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc1f9cf0 con 0x7f75cc0b1640 2023-11-08T12:29:17.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc1f9fd0 con 0x7f75cc0b43a0 2023-11-08T12:29:17.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75d0dd2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc1fa2b0 con 0x7f75cc0c9040 2023-11-08T12:29:17.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc0b1640 0x7f75cc1f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc0b1640 0x7f75cc1f93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49500/0 (socket says 172.21.15.112:49500) 2023-11-08T12:29:17.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 -- 172.21.15.112:0/4026938816 learned_addr learned my addr 172.21.15.112:0/4026938816 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:17.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75c2ffd700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b43a0 0x7f75cc1f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cbfff700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc1f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 -- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 msgr2=0x7f75cc1f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc1f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 -- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b43a0 msgr2=0x7f75cc1f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b43a0 0x7f75cc1f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.547+0000 7f75cb7fe700 1 -- 172.21.15.112:0/4026938816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c4009a70 con 0x7f75cc0b1640 2023-11-08T12:29:17.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75cb7fe700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc0b1640 0x7f75cc1f93f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f75bc001270 tx=0x7f75bc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:17.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75c8ff9700 1 -- 172.21.15.112:0/4026938816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc005d90 con 0x7f75cc0b1640 2023-11-08T12:29:17.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b40094b0 con 0x7f75cc0b1640 2023-11-08T12:29:17.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75c8ff9700 1 -- 172.21.15.112:0/4026938816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0070d0 con 0x7f75cc0b1640 2023-11-08T12:29:17.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75c8ff9700 1 -- 172.21.15.112:0/4026938816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc007480 con 0x7f75cc0b1640 2023-11-08T12:29:17.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc06b5d0 con 0x7f75cc0b1640 2023-11-08T12:29:17.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc06b2f0 con 0x7f75cc0b1640 2023-11-08T12:29:17.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.551+0000 7f75c8ff9700 1 -- 172.21.15.112:0/4026938816 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f75bc019030 con 0x7f75cc0b1640 2023-11-08T12:29:17.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.555+0000 7f75c8ff9700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75ac064ee0 0x7f75ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:17.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.555+0000 7f75c8ff9700 1 -- 172.21.15.112:0/4026938816 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f75bc080e80 con 0x7f75cc0b1640 2023-11-08T12:29:17.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.555+0000 7f75c2ffd700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75ac064ee0 0x7f75ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:17.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.555+0000 7f75c2ffd700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75ac064ee0 0x7f75ac067390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75b40090b0 tx=0x7f75b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:17.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.563+0000 7f75c8ff9700 1 -- 172.21.15.112:0/4026938816 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f75bc04f140 con 0x7f75cc0b1640 2023-11-08T12:29:17.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.791+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f75cc0ca7b0 con 0x7f75cc0b1640 2023-11-08T12:29:17.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.799+0000 7f75c8ff9700 1 -- 172.21.15.112:0/4026938816 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f75bc00ce60 con 0x7f75cc0b1640 2023-11-08T12:29:17.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75ac064ee0 msgr2=0x7f75ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75ac064ee0 0x7f75ac067390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f75b40090b0 tx=0x7f75b4008030 comp rx=0 tx=0).stop 2023-11-08T12:29:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc0b1640 msgr2=0x7f75cc1f93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc0b1640 0x7f75cc1f93f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f75bc001270 tx=0x7f75bc00c7d0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 shutdown_connections 2023-11-08T12:29:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f75ac064ee0 0x7f75ac067390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f75cc0c9040 0x7f75cc1f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75cc0b43a0 0x7f75cc1f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 --2- 172.21.15.112:0/4026938816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc0b1640 0x7f75cc1f93f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 >> 172.21.15.112:0/4026938816 conn(0x7f75cc0b0f80 msgr2=0x7f75cc158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:17.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 shutdown_connections 2023-11-08T12:29:17.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.803+0000 7f75d0dd2700 1 -- 172.21.15.112:0/4026938816 wait complete. 2023-11-08T12:29:17.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:18.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.995+0000 7f24a2db4700 1 Processor -- start 2023-11-08T12:29:18.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.995+0000 7f24a2db4700 1 -- start start 2023-11-08T12:29:18.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a2db4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f249c070080 0x7f249c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a2db4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f249c164250 0x7f249c1646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a2db4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249c0ad6c0 con 0x7f249c160710 2023-11-08T12:29:18.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a2db4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c06b1c0 con 0x7f249c164250 2023-11-08T12:29:18.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a2db4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c0adc60 con 0x7f249c070080 2023-11-08T12:29:18.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a25b3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f249c164250 0x7f249c1646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a1db2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f249c160710 0x7f249c0cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:38290/0 (socket says 172.21.15.112:38290) 2023-11-08T12:29:18.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a1db2700 1 -- 172.21.15.112:0/1697376266 learned_addr learned my addr 172.21.15.112:0/1697376266 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:18.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a15b1700 1 --2- 172.21.15.112:0/1697376266 >> v2:172.21.15.133:3300/0 conn(0x7f249c070080 0x7f249c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a0db0700 1 -- 172.21.15.112:0/1697376266 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043370677 0 0) 0x7f249c0ad6c0 con 0x7f249c160710 2023-11-08T12:29:18.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a0db0700 1 -- 172.21.15.112:0/1697376266 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24840035d0 con 0x7f249c160710 2023-11-08T12:29:18.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a15b1700 1 -- 172.21.15.112:0/1697376266 >> v2:172.21.15.112:3300/0 conn(0x7f249c164250 msgr2=0x7f249c1646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:18.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a15b1700 1 --2- 172.21.15.112:0/1697376266 >> v2:172.21.15.112:3300/0 conn(0x7f249c164250 0x7f249c1646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a15b1700 1 -- 172.21.15.112:0/1697376266 >> v1:172.21.15.133:6789/0 conn(0x7f249c160710 legacy=0x7f249c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a15b1700 1 -- 172.21.15.112:0/1697376266 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0709f0 con 0x7f249c070080 2023-11-08T12:29:18.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a25b3700 1 --2- 172.21.15.112:0/1697376266 >> v2:172.21.15.112:3300/0 conn(0x7f249c164250 0x7f249c1646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:17.999+0000 7f24a15b1700 1 --2- 172.21.15.112:0/1697376266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c070080 0x7f249c0704b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f249c1641b0 tx=0x7f2490009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d1eccb88dd57e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a0db0700 1 -- 172.21.15.112:0/1697376266 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490011830 con 0x7f249c070080 2023-11-08T12:29:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a0db0700 1 -- 172.21.15.112:0/1697376266 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2490011990 con 0x7f249c070080 2023-11-08T12:29:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a0db0700 1 -- 172.21.15.112:0/1697376266 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490011d20 con 0x7f249c070080 2023-11-08T12:29:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 -- 172.21.15.112:0/1697376266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c070080 msgr2=0x7f249c0704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 --2- 172.21.15.112:0/1697376266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c070080 0x7f249c0704b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f249c1641b0 tx=0x7f2490009b30 comp rx=0 tx=0).stop 2023-11-08T12:29:18.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 -- 172.21.15.112:0/1697376266 shutdown_connections 2023-11-08T12:29:18.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 --2- 172.21.15.112:0/1697376266 >> v2:172.21.15.112:3300/0 conn(0x7f249c164250 0x7f249c1646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 --2- 172.21.15.112:0/1697376266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c070080 0x7f249c0704b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 -- 172.21.15.112:0/1697376266 >> 172.21.15.112:0/1697376266 conn(0x7f249c0b0f80 msgr2=0x7f249c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:18.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 -- 172.21.15.112:0/1697376266 shutdown_connections 2023-11-08T12:29:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.003+0000 7f24a2db4700 1 -- 172.21.15.112:0/1697376266 wait complete. 2023-11-08T12:29:18.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 Processor -- start 2023-11-08T12:29:18.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 -- start start 2023-11-08T12:29:18.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f249c070080 0x7f249c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c160710 0x7f249c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c164250 0x7f249c162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c15fd80 con 0x7f249c160710 2023-11-08T12:29:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0c37f0 con 0x7f249c164250 2023-11-08T12:29:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a2db4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0c3ad0 con 0x7f249c070080 2023-11-08T12:29:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.007+0000 7f24a15b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c160710 0x7f249c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c160710 0x7f249c151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49524/0 (socket says 172.21.15.112:49524) 2023-11-08T12:29:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 -- 172.21.15.112:0/3915937486 learned_addr learned my addr 172.21.15.112:0/3915937486 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:18.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a25b3700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c164250 0x7f249c162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a1db2700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f249c070080 0x7f249c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 -- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f249c070080 msgr2=0x7f249c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f249c070080 0x7f249c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 -- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c164250 msgr2=0x7f249c162cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c164250 0x7f249c162cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 -- 172.21.15.112:0/3915937486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009a70 con 0x7f249c160710 2023-11-08T12:29:18.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a25b3700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c164250 0x7f249c162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:18.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a15b1700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c160710 0x7f249c151a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2490009b70 tx=0x7f2490004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f249a7fc700 1 -- 172.21.15.112:0/3915937486 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490004480 con 0x7f249c160710 2023-11-08T12:29:18.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f249a7fc700 1 -- 172.21.15.112:0/3915937486 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249001f070 con 0x7f249c160710 2023-11-08T12:29:18.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24900094b0 con 0x7f249c160710 2023-11-08T12:29:18.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f249a7fc700 1 -- 172.21.15.112:0/3915937486 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900038c0 con 0x7f249c160710 2023-11-08T12:29:18.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c06b3d0 con 0x7f249c160710 2023-11-08T12:29:18.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.011+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c06b6b0 con 0x7f249c160710 2023-11-08T12:29:18.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.015+0000 7f249a7fc700 1 -- 172.21.15.112:0/3915937486 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f249002a020 con 0x7f249c160710 2023-11-08T12:29:18.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.015+0000 7f249a7fc700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2488064ee0 0x7f2488067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.015+0000 7f249a7fc700 1 -- 172.21.15.112:0/3915937486 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2490083380 con 0x7f249c160710 2023-11-08T12:29:18.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.015+0000 7f24a1db2700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2488064ee0 0x7f2488067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.015+0000 7f24a1db2700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2488064ee0 0x7f2488067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f248c0011e0 tx=0x7f248c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.019+0000 7f249a7fc700 1 -- 172.21.15.112:0/3915937486 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f24900515c0 con 0x7f249c160710 2023-11-08T12:29:18.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.195+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f249c073cb0 con 0x7f249c160710 2023-11-08T12:29:18.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.199+0000 7f249a7fc700 1 -- 172.21.15.112:0/3915937486 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14424 (secure 0 0 0) 0x7f2490015090 con 0x7f249c160710 2023-11-08T12:29:18.203 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:18.203 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":40,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:14.534603+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:18.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.199+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2488064ee0 msgr2=0x7f2488067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.199+0000 7f24a2db4700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2488064ee0 0x7f2488067390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f248c0011e0 tx=0x7f248c009040 comp rx=0 tx=0).stop 2023-11-08T12:29:18.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.199+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c160710 msgr2=0x7f249c151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.199+0000 7f24a2db4700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c160710 0x7f249c151a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2490009b70 tx=0x7f2490004770 comp rx=0 tx=0).stop 2023-11-08T12:29:18.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.199+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 shutdown_connections 2023-11-08T12:29:18.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.203+0000 7f24a2db4700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2488064ee0 0x7f2488067390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.203+0000 7f24a2db4700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f249c164250 0x7f249c162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.203+0000 7f24a2db4700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c160710 0x7f249c151a80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.203+0000 7f24a2db4700 1 --2- 172.21.15.112:0/3915937486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f249c070080 0x7f249c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.203+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 >> 172.21.15.112:0/3915937486 conn(0x7f249c0b0f80 msgr2=0x7f249c0afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:18.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.203+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 shutdown_connections 2023-11-08T12:29:18.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.203+0000 7f24a2db4700 1 -- 172.21.15.112:0/3915937486 wait complete. 2023-11-08T12:29:18.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:29:18.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:29:18.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.407+0000 7f04a16d5700 1 Processor -- start 2023-11-08T12:29:18.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.407+0000 7f04a16d5700 1 -- start start 2023-11-08T12:29:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04a16d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 0x7f049c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04a16d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f049c06c590 0x7f049c0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04a16d5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c0cd110 con 0x7f049c06cbc0 2023-11-08T12:29:18.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04a16d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0c9a40 con 0x7f049c06c590 2023-11-08T12:29:18.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04a16d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0cc4a0 con 0x7f049c15c360 2023-11-08T12:29:18.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04937fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f049c06cbc0 0x7f049c06be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38974/0 (socket says 172.21.15.112:38974) 2023-11-08T12:29:18.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04937fe700 1 -- 172.21.15.112:0/2207001305 learned_addr learned my addr 172.21.15.112:0/2207001305 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:18.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f049bfff700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 0x7f049c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f04a0ed4700 1 --2- 172.21.15.112:0/2207001305 >> v2:172.21.15.133:3300/0 conn(0x7f049c06c590 0x7f049c0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715909400 0 0) 0x7f049c0cd110 con 0x7f049c06cbc0 2023-11-08T12:29:18.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.411+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04880035d0 con 0x7f049c06cbc0 2023-11-08T12:29:18.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2436826576 0 0) 0x7f04880035d0 con 0x7f049c06cbc0 2023-11-08T12:29:18.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 msgr2=0x7f049c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:18.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 0x7f049c0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 >> v2:172.21.15.133:3300/0 conn(0x7f049c06c590 msgr2=0x7f049c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:18.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 --2- 172.21.15.112:0/2207001305 >> v2:172.21.15.133:3300/0 conn(0x7f049c06c590 0x7f049c0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0cd340 con 0x7f049c06cbc0 2023-11-08T12:29:18.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f0484001670 con 0x7f049c06cbc0 2023-11-08T12:29:18.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 >> v1:172.21.15.112:6789/0 conn(0x7f049c06cbc0 legacy=0x7f049c06be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0488003a20 0x7f0488003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 0x7f0488004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488004db0 0x7f0488005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c9a40 con 0x7f0488003a20 2023-11-08T12:29:18.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0cc4a0 con 0x7f0488004db0 2023-11-08T12:29:18.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048800bab0 con 0x7f049c15c360 2023-11-08T12:29:18.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049bfff700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0488003a20 0x7f0488003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f04937fe700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 0x7f0488004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f04a0ed4700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488004db0 0x7f0488005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049bfff700 1 -- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 msgr2=0x7f0488004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:18.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049bfff700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c15c360 0x7f0488004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049bfff700 1 -- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488004db0 msgr2=0x7f0488005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:18.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049bfff700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488004db0 0x7f0488005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049bfff700 1 -- 172.21.15.112:0/2207001305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880035d0 con 0x7f0488003a20 2023-11-08T12:29:18.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049bfff700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0488003a20 0x7f0488003e30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f048c010350 tx=0x7f04880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a44d1d0af57ecd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c010e70 con 0x7f0488003a20 2023-11-08T12:29:18.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c011040 con 0x7f0488003a20 2023-11-08T12:29:18.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f049b7fe700 1 -- 172.21.15.112:0/2207001305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c00b2f0 con 0x7f0488003a20 2023-11-08T12:29:18.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f04a16d5700 1 -- 172.21.15.112:0/2207001305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0488003a20 msgr2=0x7f0488003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f04a16d5700 1 --2- 172.21.15.112:0/2207001305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0488003a20 0x7f0488003e30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f048c010350 tx=0x7f04880058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.415+0000 7f04a0ed4700 1 -- 172.21.15.112:0/2207001305 reap_dead start 2023-11-08T12:29:18.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.419+0000 7f04a16d5700 1 -- 172.21.15.112:0/2207001305 shutdown_connections 2023-11-08T12:29:18.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.419+0000 7f04a16d5700 1 -- 172.21.15.112:0/2207001305 >> 172.21.15.112:0/2207001305 conn(0x7f049c0cf280 msgr2=0x7f049c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:18.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.419+0000 7f04a16d5700 1 -- 172.21.15.112:0/2207001305 shutdown_connections 2023-11-08T12:29:18.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.419+0000 7f04a16d5700 1 -- 172.21.15.112:0/2207001305 wait complete. 2023-11-08T12:29:18.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.419+0000 7f04a16d5700 1 Processor -- start 2023-11-08T12:29:18.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.419+0000 7f04a16d5700 1 -- start start 2023-11-08T12:29:18.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488003a20 0x7f049c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c0b2ff0 0x7f049c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049c1565e0 0x7f049c0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0b2b60 con 0x7f049c1565e0 2023-11-08T12:29:18.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0b1f50 con 0x7f0488003a20 2023-11-08T12:29:18.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0b2230 con 0x7f049c0b2ff0 2023-11-08T12:29:18.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049c1565e0 0x7f049c0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049c1565e0 0x7f049c0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49548/0 (socket says 172.21.15.112:49548) 2023-11-08T12:29:18.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 -- 172.21.15.112:0/1074883507 learned_addr learned my addr 172.21.15.112:0/1074883507 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f049bfff700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488003a20 0x7f049c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04937fe700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c0b2ff0 0x7f049c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 -- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c0b2ff0 msgr2=0x7f049c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c0b2ff0 0x7f049c0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 -- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488003a20 msgr2=0x7f049c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488003a20 0x7f049c14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 -- 172.21.15.112:0/1074883507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0c9660 con 0x7f049c1565e0 2023-11-08T12:29:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04937fe700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c0b2ff0 0x7f049c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:18.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a0ed4700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049c1565e0 0x7f049c0c49b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f049c0b0210 tx=0x7f0494010ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04997fa700 1 -- 172.21.15.112:0/1074883507 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494004300 con 0x7f049c1565e0 2023-11-08T12:29:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04997fa700 1 -- 172.21.15.112:0/1074883507 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0494004480 con 0x7f049c1565e0 2023-11-08T12:29:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04997fa700 1 -- 172.21.15.112:0/1074883507 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494003900 con 0x7f049c1565e0 2023-11-08T12:29:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0cd620 con 0x7f049c1565e0 2023-11-08T12:29:18.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.423+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c15c730 con 0x7f049c1565e0 2023-11-08T12:29:18.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.427+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c0ce410 con 0x7f049c1565e0 2023-11-08T12:29:18.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.427+0000 7f04997fa700 1 -- 172.21.15.112:0/1074883507 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0494003a60 con 0x7f049c1565e0 2023-11-08T12:29:18.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.431+0000 7f04997fa700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f047c064ee0 0x7f047c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.431+0000 7f04997fa700 1 -- 172.21.15.112:0/1074883507 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0494082150 con 0x7f049c1565e0 2023-11-08T12:29:18.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.431+0000 7f049bfff700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f047c064ee0 0x7f047c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.431+0000 7f049bfff700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f047c064ee0 0x7f047c067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f048c018040 tx=0x7f048c015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.435+0000 7f04997fa700 1 -- 172.21.15.112:0/1074883507 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f04940503b0 con 0x7f049c1565e0 2023-11-08T12:29:18.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.603+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f049c073d20 con 0x7f049c1565e0 2023-11-08T12:29:18.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04997fa700 1 -- 172.21.15.112:0/1074883507 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04940539d0 con 0x7f049c1565e0 2023-11-08T12:29:18.610 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:29:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f047c064ee0 msgr2=0x7f047c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f047c064ee0 0x7f047c067390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f048c018040 tx=0x7f048c015000 comp rx=0 tx=0).stop 2023-11-08T12:29:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049c1565e0 msgr2=0x7f049c0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049c1565e0 0x7f049c0c49b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f049c0b0210 tx=0x7f0494010ad0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 shutdown_connections 2023-11-08T12:29:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f047c064ee0 0x7f047c067390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f049c1565e0 0x7f049c0c49b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f049c0b2ff0 0x7f049c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 --2- 172.21.15.112:0/1074883507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488003a20 0x7f049c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 >> 172.21.15.112:0/1074883507 conn(0x7f049c0cf280 msgr2=0x7f049c0c79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 shutdown_connections 2023-11-08T12:29:18.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.607+0000 7f04a16d5700 1 -- 172.21.15.112:0/1074883507 wait complete. 2023-11-08T12:29:18.634 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:29:18.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.803+0000 7f409aaa7700 1 Processor -- start 2023-11-08T12:29:18.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.803+0000 7f409aaa7700 1 -- start start 2023-11-08T12:29:18.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.803+0000 7f409aaa7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4094069dd0 0x7f40940cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.803+0000 7f409aaa7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40940cc5e0 0x7f40940ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.803+0000 7f409aaa7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409415c780 con 0x7f409415c3b0 2023-11-08T12:29:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.803+0000 7f409aaa7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40940cdd70 con 0x7f4094069dd0 2023-11-08T12:29:18.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.803+0000 7f409aaa7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40940ca9d0 con 0x7f40940cc5e0 2023-11-08T12:29:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4094069dd0 0x7f40940cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4094069dd0 0x7f40940cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49558/0 (socket says 172.21.15.112:49558) 2023-11-08T12:29:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 -- 172.21.15.112:0/3340434208 learned_addr learned my addr 172.21.15.112:0/3340434208 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4099044700 1 --2- 172.21.15.112:0/3340434208 >> v2:172.21.15.133:3300/0 conn(0x7f40940cc5e0 0x7f40940ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 -- 172.21.15.112:0/3340434208 >> v2:172.21.15.133:3300/0 conn(0x7f40940cc5e0 msgr2=0x7f40940ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:18.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 --2- 172.21.15.112:0/3340434208 >> v2:172.21.15.133:3300/0 conn(0x7f40940cc5e0 0x7f40940ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 -- 172.21.15.112:0/3340434208 >> v1:172.21.15.133:6789/0 conn(0x7f409415c3b0 legacy=0x7f4094160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 -- 172.21.15.112:0/3340434208 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940cacb0 con 0x7f4094069dd0 2023-11-08T12:29:18.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f4093fff700 1 --2- 172.21.15.112:0/3340434208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4094069dd0 0x7f40940cc0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f40940711c0 tx=0x7f4080009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee39685e3d28342 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f40937fe700 1 -- 172.21.15.112:0/3340434208 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080011830 con 0x7f4094069dd0 2023-11-08T12:29:18.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f40937fe700 1 -- 172.21.15.112:0/3340434208 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4080011990 con 0x7f4094069dd0 2023-11-08T12:29:18.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f40937fe700 1 -- 172.21.15.112:0/3340434208 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080011d20 con 0x7f4094069dd0 2023-11-08T12:29:18.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 -- 172.21.15.112:0/3340434208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4094069dd0 msgr2=0x7f40940cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3340434208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4094069dd0 0x7f40940cc0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f40940711c0 tx=0x7f4080009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 -- 172.21.15.112:0/3340434208 shutdown_connections 2023-11-08T12:29:18.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3340434208 >> v2:172.21.15.133:3300/0 conn(0x7f40940cc5e0 0x7f40940ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3340434208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4094069dd0 0x7f40940cc0a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 -- 172.21.15.112:0/3340434208 >> 172.21.15.112:0/3340434208 conn(0x7f4094071410 msgr2=0x7f4094071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:18.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 -- 172.21.15.112:0/3340434208 shutdown_connections 2023-11-08T12:29:18.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.807+0000 7f409aaa7700 1 -- 172.21.15.112:0/3340434208 wait complete. 2023-11-08T12:29:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 Processor -- start 2023-11-08T12:29:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 -- start start 2023-11-08T12:29:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4094069dd0 0x7f409415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40940cc5e0 0x7f40941f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409415c3b0 0x7f409414da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940c8da0 con 0x7f409415c3b0 2023-11-08T12:29:18.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940c91c0 con 0x7f4094069dd0 2023-11-08T12:29:18.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f409aaa7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940ae350 con 0x7f40940cc5e0 2023-11-08T12:29:18.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f4099044700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409415c3b0 0x7f409414da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f4093fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40940cc5e0 0x7f40941f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f4099044700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409415c3b0 0x7f409414da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49562/0 (socket says 172.21.15.112:49562) 2023-11-08T12:29:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f4099044700 1 -- 172.21.15.112:0/3737340253 learned_addr learned my addr 172.21.15.112:0/3737340253 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.811+0000 7f4098843700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4094069dd0 0x7f409415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f4099044700 1 -- 172.21.15.112:0/3737340253 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40940cc5e0 msgr2=0x7f40941f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f4099044700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40940cc5e0 0x7f40941f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f4099044700 1 -- 172.21.15.112:0/3737340253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4094069dd0 msgr2=0x7f409415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f4099044700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4094069dd0 0x7f409415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:18.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f4099044700 1 -- 172.21.15.112:0/3737340253 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080009570 con 0x7f409415c3b0 2023-11-08T12:29:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f4099044700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409415c3b0 0x7f409414da50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f408c00efc0 tx=0x7f408c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f40917fa700 1 -- 172.21.15.112:0/3737340253 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c009ea0 con 0x7f409415c3b0 2023-11-08T12:29:18.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f40917fa700 1 -- 172.21.15.112:0/3737340253 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c00f040 con 0x7f409415c3b0 2023-11-08T12:29:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f40917fa700 1 -- 172.21.15.112:0/3737340253 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00ced0 con 0x7f409415c3b0 2023-11-08T12:29:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40940ce2c0 con 0x7f409415c3b0 2023-11-08T12:29:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40940cdfe0 con 0x7f409415c3b0 2023-11-08T12:29:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.815+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40940cca20 con 0x7f409415c3b0 2023-11-08T12:29:18.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.819+0000 7f40917fa700 1 -- 172.21.15.112:0/3737340253 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f408c014480 con 0x7f409415c3b0 2023-11-08T12:29:18.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.819+0000 7f40917fa700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4078064ee0 0x7f4078067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:18.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.819+0000 7f40917fa700 1 -- 172.21.15.112:0/3737340253 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f408c0826d0 con 0x7f409415c3b0 2023-11-08T12:29:18.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.819+0000 7f4098843700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4078064ee0 0x7f4078067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:18.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.819+0000 7f4098843700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4078064ee0 0x7f4078067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4088000f60 tx=0x7f4088009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:18.830 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.827+0000 7f40917fa700 1 -- 172.21.15.112:0/3737340253 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f408c050930 con 0x7f409415c3b0 2023-11-08T12:29:19.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.999+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f40940c8ee0 con 0x7f409415c3b0 2023-11-08T12:29:19.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.999+0000 7f40917fa700 1 -- 172.21.15.112:0/3737340253 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f40940c8ee0 con 0x7f409415c3b0 2023-11-08T12:29:19.004 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:29:19.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.999+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4078064ee0 msgr2=0x7f4078067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.999+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4078064ee0 0x7f4078067390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4088000f60 tx=0x7f4088009040 comp rx=0 tx=0).stop 2023-11-08T12:29:19.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.999+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409415c3b0 msgr2=0x7f409414da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:18.999+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409415c3b0 0x7f409414da50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f408c00efc0 tx=0x7f408c00c3a0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 shutdown_connections 2023-11-08T12:29:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4078064ee0 0x7f4078067390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409415c3b0 0x7f409414da50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40940cc5e0 0x7f40941f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 --2- 172.21.15.112:0/3737340253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4094069dd0 0x7f409415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 >> 172.21.15.112:0/3737340253 conn(0x7f4094071410 msgr2=0x7f409415d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 shutdown_connections 2023-11-08T12:29:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.003+0000 7f409aaa7700 1 -- 172.21.15.112:0/3737340253 wait complete. 2023-11-08T12:29:19.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T12:29:19.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 Processor -- start 2023-11-08T12:29:19.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 -- start start 2023-11-08T12:29:19.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff47c0ad5a0 0x7ff47c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff47c0cb460 0x7ff47c0c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0c1e80 con 0x7ff47c0cb460 2023-11-08T12:29:19.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0c9050 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.187+0000 7ff4811a8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0cb970 con 0x7ff47c0c1a20 2023-11-08T12:29:19.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff47c0cb460 0x7ff47c0c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff47c0cb460 0x7ff47c0c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49576/0 (socket says 172.21.15.112:49576) 2023-11-08T12:29:19.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 -- 172.21.15.112:0/2985894277 learned_addr learned my addr 172.21.15.112:0/2985894277 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:19.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4809a7700 1 --2- 172.21.15.112:0/2985894277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff47bfff700 1 --2- 172.21.15.112:0/2985894277 >> v2:172.21.15.133:3300/0 conn(0x7ff47c0ad5a0 0x7ff47c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 -- 172.21.15.112:0/2985894277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 msgr2=0x7ff47c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:19.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 --2- 172.21.15.112:0/2985894277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 -- 172.21.15.112:0/2985894277 >> v2:172.21.15.133:3300/0 conn(0x7ff47c0ad5a0 msgr2=0x7ff47c0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:19.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 --2- 172.21.15.112:0/2985894277 >> v2:172.21.15.133:3300/0 conn(0x7ff47c0ad5a0 0x7ff47c0caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 -- 172.21.15.112:0/2985894277 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0cbc50 con 0x7ff47c0cb460 2023-11-08T12:29:19.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff47bfff700 1 --2- 172.21.15.112:0/2985894277 >> v2:172.21.15.133:3300/0 conn(0x7ff47c0ad5a0 0x7ff47c0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:19.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4737fe700 1 --2- 172.21.15.112:0/2985894277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0cb460 0x7ff47c0c14e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff47c06df30 tx=0x7ff464009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6b5626381f08ac server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:19.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff47b7fe700 1 -- 172.21.15.112:0/2985894277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400b8a0 con 0x7ff47c0cb460 2023-11-08T12:29:19.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff47b7fe700 1 -- 172.21.15.112:0/2985894277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400ba00 con 0x7ff47c0cb460 2023-11-08T12:29:19.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff47b7fe700 1 -- 172.21.15.112:0/2985894277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400bd90 con 0x7ff47c0cb460 2023-11-08T12:29:19.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 -- 172.21.15.112:0/2985894277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0cb460 msgr2=0x7ff47c0c14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 --2- 172.21.15.112:0/2985894277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0cb460 0x7ff47c0c14e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff47c06df30 tx=0x7ff464009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 -- 172.21.15.112:0/2985894277 shutdown_connections 2023-11-08T12:29:19.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 --2- 172.21.15.112:0/2985894277 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 --2- 172.21.15.112:0/2985894277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0cb460 0x7ff47c0c14e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 --2- 172.21.15.112:0/2985894277 >> v2:172.21.15.133:3300/0 conn(0x7ff47c0ad5a0 0x7ff47c0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 -- 172.21.15.112:0/2985894277 >> 172.21.15.112:0/2985894277 conn(0x7ff47c0ce510 msgr2=0x7ff47c0ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:19.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 -- 172.21.15.112:0/2985894277 shutdown_connections 2023-11-08T12:29:19.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.191+0000 7ff4811a8700 1 -- 172.21.15.112:0/2985894277 wait complete. 2023-11-08T12:29:19.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.195+0000 7ff4811a8700 1 Processor -- start 2023-11-08T12:29:19.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.195+0000 7ff4811a8700 1 -- start start 2023-11-08T12:29:19.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0ad5a0 0x7ff47c1f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47c0cb460 0x7ff47c0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0c3ab0 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0c7080 con 0x7ff47c0cb460 2023-11-08T12:29:19.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0c7360 con 0x7ff47c0c1a20 2023-11-08T12:29:19.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0ad5a0 0x7ff47c1f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0ad5a0 0x7ff47c1f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49592/0 (socket says 172.21.15.112:49592) 2023-11-08T12:29:19.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 -- 172.21.15.112:0/312731441 learned_addr learned my addr 172.21.15.112:0/312731441 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:19.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4809a7700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47c0cb460 0x7ff47c0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4737fe700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 -- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 msgr2=0x7ff47c0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 -- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47c0cb460 msgr2=0x7ff47c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47c0cb460 0x7ff47c0cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 -- 172.21.15.112:0/312731441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464009570 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff47bfff700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0ad5a0 0x7ff47c1f5210 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00e810 tx=0x7ff46c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:19.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4797fa700 1 -- 172.21.15.112:0/312731441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c005c40 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4797fa700 1 -- 172.21.15.112:0/312731441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c005da0 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4797fa700 1 -- 172.21.15.112:0/312731441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c004250 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c0ad970 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.199+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c0c8ce0 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.203+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c0b3590 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.203+0000 7ff4797fa700 1 -- 172.21.15.112:0/312731441 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff46c022070 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.207+0000 7ff4797fa700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff45c064ee0 0x7ff45c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.207+0000 7ff4797fa700 1 -- 172.21.15.112:0/312731441 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff46c081950 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.207+0000 7ff4737fe700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff45c064ee0 0x7ff45c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.207+0000 7ff4737fe700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff45c064ee0 0x7ff45c067390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff464000c00 tx=0x7ff464008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:19.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.211+0000 7ff4797fa700 1 -- 172.21.15.112:0/312731441 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff46c04fd00 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.387+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff47c073cb0 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.387+0000 7ff4797fa700 1 -- 172.21.15.112:0/312731441 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff46c00f040 con 0x7ff47c0ad5a0 2023-11-08T12:29:19.393 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:19.393 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-11-08T12:29:19.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:19.393 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-11-08T12:29:19.393 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-11-08T12:29:19.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:29:19.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:29:19.394 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2023-11-08T12:29:19.394 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2023-11-08T12:29:19.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:29:19.395 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-11-08T12:29:19.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff45c064ee0 msgr2=0x7ff45c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff45c064ee0 0x7ff45c067390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff464000c00 tx=0x7ff464008030 comp rx=0 tx=0).stop 2023-11-08T12:29:19.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0ad5a0 msgr2=0x7ff47c1f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0ad5a0 0x7ff47c1f5210 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00e810 tx=0x7ff46c00eb20 comp rx=0 tx=0).stop 2023-11-08T12:29:19.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 shutdown_connections 2023-11-08T12:29:19.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff45c064ee0 0x7ff45c067390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47c0cb460 0x7ff47c0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff47c0c1a20 0x7ff47c0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 --2- 172.21.15.112:0/312731441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff47c0ad5a0 0x7ff47c1f5210 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 >> 172.21.15.112:0/312731441 conn(0x7ff47c0ce510 msgr2=0x7ff47c0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:19.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 shutdown_connections 2023-11-08T12:29:19.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.391+0000 7ff4811a8700 1 -- 172.21.15.112:0/312731441 wait complete. 2023-11-08T12:29:19.414 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T12:29:19.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T12:29:19.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.595+0000 7f4bcf59e700 1 Processor -- start 2023-11-08T12:29:19.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.595+0000 7f4bcf59e700 1 -- start start 2023-11-08T12:29:19.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcf59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4bd015c6e0 0x7f4bd0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcf59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd015cab0 con 0x7f4bd0071fe0 2023-11-08T12:29:19.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcf59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd00702d0 con 0x7f4bd006a510 2023-11-08T12:29:19.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcf59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd00d2800 con 0x7f4bd015c6e0 2023-11-08T12:29:19.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcdd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4bd0071fe0 0x7f4bd0069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38990/0 (socket says 172.21.15.112:38990) 2023-11-08T12:29:19.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcdd9b700 1 -- 172.21.15.112:0/3376820401 learned_addr learned my addr 172.21.15.112:0/3376820401 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:19.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bce59c700 1 --2- 172.21.15.112:0/3376820401 >> v2:172.21.15.133:3300/0 conn(0x7f4bd015c6e0 0x7f4bd0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcd59a700 1 -- 172.21.15.112:0/3376820401 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751582047 0 0) 0x7f4bd015cab0 con 0x7f4bd0071fe0 2023-11-08T12:29:19.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcd59a700 1 -- 172.21.15.112:0/3376820401 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb80035d0 con 0x7f4bd0071fe0 2023-11-08T12:29:19.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bce59c700 1 -- 172.21.15.112:0/3376820401 >> v1:172.21.15.133:6789/0 conn(0x7f4bd006a510 legacy=0x7f4bd006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bce59c700 1 -- 172.21.15.112:0/3376820401 >> v1:172.21.15.112:6789/0 conn(0x7f4bd0071fe0 legacy=0x7f4bd0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bce59c700 1 -- 172.21.15.112:0/3376820401 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00d2a10 con 0x7f4bd015c6e0 2023-11-08T12:29:19.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bce59c700 1 --2- 172.21.15.112:0/3376820401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd015c6e0 0x7f4bd0071aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009850 tx=0x7f4bc0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4030dd7e0f78c8dd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:19.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcd59a700 1 -- 172.21.15.112:0/3376820401 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011830 con 0x7f4bd015c6e0 2023-11-08T12:29:19.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcd59a700 1 -- 172.21.15.112:0/3376820401 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0011990 con 0x7f4bd015c6e0 2023-11-08T12:29:19.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.599+0000 7f4bcd59a700 1 -- 172.21.15.112:0/3376820401 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011d40 con 0x7f4bd015c6e0 2023-11-08T12:29:19.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 -- 172.21.15.112:0/3376820401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd015c6e0 msgr2=0x7f4bd0071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/3376820401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd015c6e0 0x7f4bd0071aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009850 tx=0x7f4bc0009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:19.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 -- 172.21.15.112:0/3376820401 shutdown_connections 2023-11-08T12:29:19.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/3376820401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd015c6e0 0x7f4bd0071aa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 -- 172.21.15.112:0/3376820401 >> 172.21.15.112:0/3376820401 conn(0x7f4bd00b65b0 msgr2=0x7f4bd0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:19.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 -- 172.21.15.112:0/3376820401 shutdown_connections 2023-11-08T12:29:19.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 -- 172.21.15.112:0/3376820401 wait complete. 2023-11-08T12:29:19.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.603+0000 7f4bcf59e700 1 Processor -- start 2023-11-08T12:29:19.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 -- start start 2023-11-08T12:29:19.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd006a510 0x7f4bd00cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd0071fe0 0x7f4bd00c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bd015c6e0 0x7f4bd01f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00cf180 con 0x7f4bd006a510 2023-11-08T12:29:19.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00ce570 con 0x7f4bd0071fe0 2023-11-08T12:29:19.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00ce850 con 0x7f4bd015c6e0 2023-11-08T12:29:19.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd006a510 0x7f4bd00cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd006a510 0x7f4bd00cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49602/0 (socket says 172.21.15.112:49602) 2023-11-08T12:29:19.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 -- 172.21.15.112:0/1724706501 learned_addr learned my addr 172.21.15.112:0/1724706501 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:19.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bced9d700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bd015c6e0 0x7f4bd01f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcdd9b700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd0071fe0 0x7f4bd00c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 -- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bd015c6e0 msgr2=0x7f4bd01f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bd015c6e0 0x7f4bd01f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 -- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd0071fe0 msgr2=0x7f4bd00c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:19.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd0071fe0 0x7f4bd00c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:19.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 -- 172.21.15.112:0/1724706501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00094b0 con 0x7f4bd006a510 2023-11-08T12:29:19.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bce59c700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd006a510 0x7f4bd00cdf00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0014040 tx=0x7f4bc0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:19.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bbeffd700 1 -- 172.21.15.112:0/1724706501 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0019980 con 0x7f4bd006a510 2023-11-08T12:29:19.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd00d2fd0 con 0x7f4bd006a510 2023-11-08T12:29:19.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bbeffd700 1 -- 172.21.15.112:0/1724706501 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc001e070 con 0x7f4bd006a510 2023-11-08T12:29:19.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bbeffd700 1 -- 172.21.15.112:0/1724706501 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0019d20 con 0x7f4bd006a510 2023-11-08T12:29:19.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.607+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd00d2cf0 con 0x7f4bd006a510 2023-11-08T12:29:19.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.611+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd00d32b0 con 0x7f4bd006a510 2023-11-08T12:29:19.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.611+0000 7f4bbeffd700 1 -- 172.21.15.112:0/1724706501 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4bc002a020 con 0x7f4bd006a510 2023-11-08T12:29:19.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.615+0000 7f4bbeffd700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bb0064f10 0x7f4bb00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:19.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.615+0000 7f4bbeffd700 1 -- 172.21.15.112:0/1724706501 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4bc0082cc0 con 0x7f4bd006a510 2023-11-08T12:29:19.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.615+0000 7f4bcdd9b700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bb0064f10 0x7f4bb00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:19.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.615+0000 7f4bcdd9b700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bb0064f10 0x7f4bb00673c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00ccb00 tx=0x7f4bc4007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:19.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.619+0000 7f4bbeffd700 1 -- 172.21.15.112:0/1724706501 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4bc0050ff0 con 0x7f4bd006a510 2023-11-08T12:29:19.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:19.791+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4bd0073cb0 con 0x7f4bd006a510 2023-11-08T12:29:20.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.299+0000 7f4bbeffd700 1 -- 172.21.15.112:0/1724706501 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4bc000f2e0 con 0x7f4bd006a510 2023-11-08T12:29:20.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bb0064f10 msgr2=0x7f4bb00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:20.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bb0064f10 0x7f4bb00673c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00ccb00 tx=0x7f4bc4007de0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd006a510 msgr2=0x7f4bd00cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:20.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd006a510 0x7f4bd00cdf00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0014040 tx=0x7f4bc0004770 comp rx=0 tx=0).stop 2023-11-08T12:29:20.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 shutdown_connections 2023-11-08T12:29:20.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bb0064f10 0x7f4bb00673c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bd015c6e0 0x7f4bd01f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd0071fe0 0x7f4bd00c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 --2- 172.21.15.112:0/1724706501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bd006a510 0x7f4bd00cdf00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 >> 172.21.15.112:0/1724706501 conn(0x7f4bd00b65b0 msgr2=0x7f4bd00d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:20.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.307+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 shutdown_connections 2023-11-08T12:29:20.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.311+0000 7f4bcf59e700 1 -- 172.21.15.112:0/1724706501 wait complete. 2023-11-08T12:29:20.316 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-11-08T12:29:20.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T12:29:20.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.511+0000 7f63eca20700 1 Processor -- start 2023-11-08T12:29:20.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.515+0000 7f63eca20700 1 -- start start 2023-11-08T12:29:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.515+0000 7f63eca20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e8161030 0x7f63e806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.515+0000 7f63eca20700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80cdba0 con 0x7f63e80cddf0 2023-11-08T12:29:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.515+0000 7f63eca20700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80cd8d0 con 0x7f63e815c7c0 2023-11-08T12:29:20.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.515+0000 7f63eca20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e806c010 con 0x7f63e8161030 2023-11-08T12:29:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.515+0000 7f63e7fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f63e80cddf0 0x7f63e80b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:39004/0 (socket says 172.21.15.112:39004) 2023-11-08T12:29:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.515+0000 7f63e7fff700 1 -- 172.21.15.112:0/901686955 learned_addr learned my addr 172.21.15.112:0/901686955 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e6ffd700 1 --2- 172.21.15.112:0/901686955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e8161030 0x7f63e806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e67fc700 1 -- 172.21.15.112:0/901686955 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517564994 0 0) 0x7f63e80cdba0 con 0x7f63e80cddf0 2023-11-08T12:29:20.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e67fc700 1 -- 172.21.15.112:0/901686955 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d00035d0 con 0x7f63e80cddf0 2023-11-08T12:29:20.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e67fc700 1 -- 172.21.15.112:0/901686955 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978008363 0 0) 0x7f63e80cd8d0 con 0x7f63e815c7c0 2023-11-08T12:29:20.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e67fc700 1 -- 172.21.15.112:0/901686955 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63e80cdba0 con 0x7f63e815c7c0 2023-11-08T12:29:20.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e6ffd700 1 -- 172.21.15.112:0/901686955 >> v1:172.21.15.133:6789/0 conn(0x7f63e815c7c0 legacy=0x7f63e80cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:20.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e6ffd700 1 -- 172.21.15.112:0/901686955 >> v1:172.21.15.112:6789/0 conn(0x7f63e80cddf0 legacy=0x7f63e80b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:20.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e6ffd700 1 -- 172.21.15.112:0/901686955 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e806c2f0 con 0x7f63e8161030 2023-11-08T12:29:20.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e6ffd700 1 --2- 172.21.15.112:0/901686955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e8161030 0x7f63e806cdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009880 tx=0x7f63dc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0b43c174f1c03 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:20.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e67fc700 1 -- 172.21.15.112:0/901686955 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc011830 con 0x7f63e8161030 2023-11-08T12:29:20.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e67fc700 1 -- 172.21.15.112:0/901686955 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc011990 con 0x7f63e8161030 2023-11-08T12:29:20.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63e67fc700 1 -- 172.21.15.112:0/901686955 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc011d20 con 0x7f63e8161030 2023-11-08T12:29:20.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63eca20700 1 -- 172.21.15.112:0/901686955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e8161030 msgr2=0x7f63e806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:20.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63eca20700 1 --2- 172.21.15.112:0/901686955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e8161030 0x7f63e806cdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009880 tx=0x7f63dc009b90 comp rx=0 tx=0).stop 2023-11-08T12:29:20.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63eca20700 1 -- 172.21.15.112:0/901686955 shutdown_connections 2023-11-08T12:29:20.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63eca20700 1 --2- 172.21.15.112:0/901686955 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e8161030 0x7f63e806cdd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63eca20700 1 -- 172.21.15.112:0/901686955 >> 172.21.15.112:0/901686955 conn(0x7f63e80d3800 msgr2=0x7f63e80cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63eca20700 1 -- 172.21.15.112:0/901686955 shutdown_connections 2023-11-08T12:29:20.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.519+0000 7f63eca20700 1 -- 172.21.15.112:0/901686955 wait complete. 2023-11-08T12:29:20.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 Processor -- start 2023-11-08T12:29:20.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 -- start start 2023-11-08T12:29:20.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e80cddf0 0x7f63e81f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e815c7c0 0x7f63e80caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e81f5ed0 0x7f63e80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80cb8c0 con 0x7f63e80cddf0 2023-11-08T12:29:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80cbe10 con 0x7f63e815c7c0 2023-11-08T12:29:20.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63eca20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e81f6370 con 0x7f63e81f5ed0 2023-11-08T12:29:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e80cddf0 0x7f63e81f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e80cddf0 0x7f63e81f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49606/0 (socket says 172.21.15.112:49606) 2023-11-08T12:29:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63e77fe700 1 -- 172.21.15.112:0/2950227678 learned_addr learned my addr 172.21.15.112:0/2950227678 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63e7fff700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e81f5ed0 0x7f63e80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:20.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.523+0000 7f63e6ffd700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e815c7c0 0x7f63e80caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63e77fe700 1 -- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e81f5ed0 msgr2=0x7f63e80c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63e77fe700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e81f5ed0 0x7f63e80c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63e77fe700 1 -- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e815c7c0 msgr2=0x7f63e80caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63e77fe700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e815c7c0 0x7f63e80caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:20.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63e77fe700 1 -- 172.21.15.112:0/2950227678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0094b0 con 0x7f63e80cddf0 2023-11-08T12:29:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63e77fe700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e80cddf0 0x7f63e81f5990 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63d800c730 tx=0x7f63d800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63cffff700 1 -- 172.21.15.112:0/2950227678 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80052d0 con 0x7f63e80cddf0 2023-11-08T12:29:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63cffff700 1 -- 172.21.15.112:0/2950227678 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8005450 con 0x7f63e80cddf0 2023-11-08T12:29:20.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e806c8b0 con 0x7f63e80cddf0 2023-11-08T12:29:20.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63cffff700 1 -- 172.21.15.112:0/2950227678 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80038e0 con 0x7f63e80cddf0 2023-11-08T12:29:20.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e806c5d0 con 0x7f63e80cddf0 2023-11-08T12:29:20.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.527+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e815cb90 con 0x7f63e80cddf0 2023-11-08T12:29:20.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.531+0000 7f63cffff700 1 -- 172.21.15.112:0/2950227678 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f63d8019030 con 0x7f63e80cddf0 2023-11-08T12:29:20.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.531+0000 7f63cffff700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63d4064ee0 0x7f63d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:20.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.531+0000 7f63cffff700 1 -- 172.21.15.112:0/2950227678 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f63d8081530 con 0x7f63e80cddf0 2023-11-08T12:29:20.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.531+0000 7f63e6ffd700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63d4064ee0 0x7f63d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:20.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.535+0000 7f63e6ffd700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63d4064ee0 0x7f63d4067390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0090b0 tx=0x7f63dc01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:20.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.535+0000 7f63cffff700 1 -- 172.21.15.112:0/2950227678 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63d804f810 con 0x7f63e80cddf0 2023-11-08T12:29:20.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:20.707+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f63e81f6890 con 0x7f63e80cddf0 2023-11-08T12:29:21.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.315+0000 7f63cffff700 1 -- 172.21.15.112:0/2950227678 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f63e81f6890 con 0x7f63e80cddf0 2023-11-08T12:29:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63d4064ee0 msgr2=0x7f63d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63d4064ee0 0x7f63d4067390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0090b0 tx=0x7f63dc01c040 comp rx=0 tx=0).stop 2023-11-08T12:29:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e80cddf0 msgr2=0x7f63e81f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e80cddf0 0x7f63e81f5990 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63d800c730 tx=0x7f63d800ca40 comp rx=0 tx=0).stop 2023-11-08T12:29:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 shutdown_connections 2023-11-08T12:29:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63d4064ee0 0x7f63d4067390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63e81f5ed0 0x7f63e80c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e815c7c0 0x7f63e80caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 --2- 172.21.15.112:0/2950227678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63e80cddf0 0x7f63e81f5990 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 >> 172.21.15.112:0/2950227678 conn(0x7f63e80d3800 msgr2=0x7f63e806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 shutdown_connections 2023-11-08T12:29:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.327+0000 7f63eca20700 1 -- 172.21.15.112:0/2950227678 wait complete. 2023-11-08T12:29:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-11-08T12:29:21.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T12:29:21.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.531+0000 7f0e0d777700 1 Processor -- start 2023-11-08T12:29:21.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.531+0000 7f0e0d777700 1 -- start start 2023-11-08T12:29:21.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e0d777700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e08070a90 0x7f0e080c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e0d777700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e0d777700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e08070600 con 0x7f0e08159f10 2023-11-08T12:29:21.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e0d777700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0806b840 con 0x7f0e08070a90 2023-11-08T12:29:21.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e0d777700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0815ae10 con 0x7f0e0815a9f0 2023-11-08T12:29:21.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0dff7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e08070a90 0x7f0e080c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e07fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0e08159f10 0x7f0e0815a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:38324/0 (socket says 172.21.15.112:38324) 2023-11-08T12:29:21.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e07fff700 1 -- 172.21.15.112:0/299513845 learned_addr learned my addr 172.21.15.112:0/299513845 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:21.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0dff7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e08070a90 0x7f0e080c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49610/0 (socket says 172.21.15.112:49610) 2023-11-08T12:29:21.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e0cf76700 1 --2- 172.21.15.112:0/299513845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0dff7fe700 1 -- 172.21.15.112:0/299513845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 msgr2=0x7f0e0806b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:21.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0dff7fe700 1 --2- 172.21.15.112:0/299513845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0806b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0dff7fe700 1 -- 172.21.15.112:0/299513845 >> v1:172.21.15.133:6789/0 conn(0x7f0e08159f10 legacy=0x7f0e0815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0dff7fe700 1 -- 172.21.15.112:0/299513845 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080afcc0 con 0x7f0e08070a90 2023-11-08T12:29:21.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.535+0000 7f0e0cf76700 1 --2- 172.21.15.112:0/299513845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0806b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:21.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0dff7fe700 1 --2- 172.21.15.112:0/299513845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08070a90 0x7f0e080c8c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009850 tx=0x7f0df0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24e3d2a33ed83f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:21.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e077fe700 1 -- 172.21.15.112:0/299513845 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011830 con 0x7f0e08070a90 2023-11-08T12:29:21.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e077fe700 1 -- 172.21.15.112:0/299513845 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0011990 con 0x7f0e08070a90 2023-11-08T12:29:21.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e077fe700 1 -- 172.21.15.112:0/299513845 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011d20 con 0x7f0e08070a90 2023-11-08T12:29:21.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 -- 172.21.15.112:0/299513845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08070a90 msgr2=0x7f0e080c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 --2- 172.21.15.112:0/299513845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08070a90 0x7f0e080c8c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009850 tx=0x7f0df0009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 -- 172.21.15.112:0/299513845 shutdown_connections 2023-11-08T12:29:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 --2- 172.21.15.112:0/299513845 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0806b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 --2- 172.21.15.112:0/299513845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08070a90 0x7f0e080c8c90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 -- 172.21.15.112:0/299513845 >> 172.21.15.112:0/299513845 conn(0x7f0e080cf280 msgr2=0x7f0e080cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:21.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 -- 172.21.15.112:0/299513845 shutdown_connections 2023-11-08T12:29:21.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.539+0000 7f0e0d777700 1 -- 172.21.15.112:0/299513845 wait complete. 2023-11-08T12:29:21.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 Processor -- start 2023-11-08T12:29:21.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 -- start start 2023-11-08T12:29:21.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e08070a90 0x7f0e080cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08159f10 0x7f0e081f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0814b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e081f14a0 con 0x7f0e08159f10 2023-11-08T12:29:21.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e081f5070 con 0x7f0e08070a90 2023-11-08T12:29:21.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.543+0000 7f0e0d777700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e081f5350 con 0x7f0e0815a9f0 2023-11-08T12:29:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08159f10 0x7f0e081f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08159f10 0x7f0e081f0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49626/0 (socket says 172.21.15.112:49626) 2023-11-08T12:29:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 -- 172.21.15.112:0/1759790511 learned_addr learned my addr 172.21.15.112:0/1759790511 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:21.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e0cf76700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0814b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e07fff700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e08070a90 0x7f0e080cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 -- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 msgr2=0x7f0e0814b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0814b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 -- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e08070a90 msgr2=0x7f0e080cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e08070a90 0x7f0e080cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 -- 172.21.15.112:0/1759790511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00094b0 con 0x7f0e08159f10 2023-11-08T12:29:21.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0dff7fe700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08159f10 0x7f0e081f0f60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0df0000c00 tx=0x7f0df0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:21.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e057fa700 1 -- 172.21.15.112:0/1759790511 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0004400 con 0x7f0e08159f10 2023-11-08T12:29:21.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e057fa700 1 -- 172.21.15.112:0/1759790511 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df001f070 con 0x7f0e08159f10 2023-11-08T12:29:21.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e08070290 con 0x7f0e08159f10 2023-11-08T12:29:21.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e057fa700 1 -- 172.21.15.112:0/1759790511 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0003900 con 0x7f0e08159f10 2023-11-08T12:29:21.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0806ffb0 con 0x7f0e08159f10 2023-11-08T12:29:21.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.547+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e080affa0 con 0x7f0e08159f10 2023-11-08T12:29:21.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.551+0000 7f0e057fa700 1 -- 172.21.15.112:0/1759790511 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0df002a020 con 0x7f0e08159f10 2023-11-08T12:29:21.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.551+0000 7f0e057fa700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0de8064ee0 0x7f0de8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.551+0000 7f0e057fa700 1 -- 172.21.15.112:0/1759790511 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f0df0083510 con 0x7f0e08159f10 2023-11-08T12:29:21.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.551+0000 7f0e07fff700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0de8064ee0 0x7f0de8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.555+0000 7f0e07fff700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0de8064ee0 0x7f0de8067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005930 tx=0x7f0df8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:21.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.559+0000 7f0e057fa700 1 -- 172.21.15.112:0/1759790511 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0df0051550 con 0x7f0e08159f10 2023-11-08T12:29:21.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.767+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0e0806cf30 con 0x7f0e08159f10 2023-11-08T12:29:21.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.779+0000 7f0e057fa700 1 -- 172.21.15.112:0/1759790511 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0df005a0c0 con 0x7f0e08159f10 2023-11-08T12:29:21.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0de8064ee0 msgr2=0x7f0de8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0de8064ee0 0x7f0de8067390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005930 tx=0x7f0df8009040 comp rx=0 tx=0).stop 2023-11-08T12:29:21.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08159f10 msgr2=0x7f0e081f0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:21.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08159f10 0x7f0e081f0f60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0df0000c00 tx=0x7f0df0004770 comp rx=0 tx=0).stop 2023-11-08T12:29:21.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 shutdown_connections 2023-11-08T12:29:21.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0de8064ee0 0x7f0de8067390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e0815a9f0 0x7f0e0814b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e08159f10 0x7f0e081f0f60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 --2- 172.21.15.112:0/1759790511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e08070a90 0x7f0e080cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 >> 172.21.15.112:0/1759790511 conn(0x7f0e080cf280 msgr2=0x7f0e080c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:21.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 shutdown_connections 2023-11-08T12:29:21.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.787+0000 7f0e0d777700 1 -- 172.21.15.112:0/1759790511 wait complete. 2023-11-08T12:29:21.805 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 6 and data pool 7 2023-11-08T12:29:21.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.987+0000 7f58560fa700 1 Processor -- start 2023-11-08T12:29:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.987+0000 7f58560fa700 1 -- start start 2023-11-08T12:29:21.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f58560fa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58500cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f58560fa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5850156b60 0x7f58500ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f58560fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f585015fea0 0x7f5850160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:21.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f58560fa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5850160860 con 0x7f585015fea0 2023-11-08T12:29:21.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f58560fa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500ce540 con 0x7f5850156b60 2023-11-08T12:29:21.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f58560fa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585006b0d0 con 0x7f5850156790 2023-11-08T12:29:21.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f585015fea0 0x7f5850160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f585015fea0 0x7f5850160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49638/0 (socket says 172.21.15.112:49638) 2023-11-08T12:29:21.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 -- 172.21.15.112:0/746669335 learned_addr learned my addr 172.21.15.112:0/746669335 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:21.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584f7fe700 1 --2- 172.21.15.112:0/746669335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58500cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584effd700 1 --2- 172.21.15.112:0/746669335 >> v2:172.21.15.133:3300/0 conn(0x7f5850156b60 0x7f58500ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:21.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 -- 172.21.15.112:0/746669335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 msgr2=0x7f58500cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:21.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 --2- 172.21.15.112:0/746669335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58500cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 -- 172.21.15.112:0/746669335 >> v2:172.21.15.133:3300/0 conn(0x7f5850156b60 msgr2=0x7f58500ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 --2- 172.21.15.112:0/746669335 >> v2:172.21.15.133:3300/0 conn(0x7f5850156b60 0x7f58500ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:21.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.991+0000 7f584ffff700 1 -- 172.21.15.112:0/746669335 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585006b560 con 0x7f585015fea0 2023-11-08T12:29:22.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f584ffff700 1 --2- 172.21.15.112:0/746669335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f585015fea0 0x7f5850160320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f585006b970 tx=0x7f5848009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebc0dd3fd71d93c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f584e7fc700 1 -- 172.21.15.112:0/746669335 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848011830 con 0x7f585015fea0 2023-11-08T12:29:22.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f584e7fc700 1 -- 172.21.15.112:0/746669335 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848011990 con 0x7f585015fea0 2023-11-08T12:29:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f584e7fc700 1 -- 172.21.15.112:0/746669335 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848011d20 con 0x7f585015fea0 2023-11-08T12:29:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 -- 172.21.15.112:0/746669335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f585015fea0 msgr2=0x7f5850160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 --2- 172.21.15.112:0/746669335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f585015fea0 0x7f5850160320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f585006b970 tx=0x7f5848009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 -- 172.21.15.112:0/746669335 shutdown_connections 2023-11-08T12:29:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 --2- 172.21.15.112:0/746669335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f585015fea0 0x7f5850160320 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 --2- 172.21.15.112:0/746669335 >> v2:172.21.15.133:3300/0 conn(0x7f5850156b60 0x7f58500ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 --2- 172.21.15.112:0/746669335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58500cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 -- 172.21.15.112:0/746669335 >> 172.21.15.112:0/746669335 conn(0x7f58500cf350 msgr2=0x7f58500b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 -- 172.21.15.112:0/746669335 shutdown_connections 2023-11-08T12:29:22.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.995+0000 7f58560fa700 1 -- 172.21.15.112:0/746669335 wait complete. 2023-11-08T12:29:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 Processor -- start 2023-11-08T12:29:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 -- start start 2023-11-08T12:29:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58501f9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850156b60 0x7f58500c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585015fea0 0x7f58501558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c3b80 con 0x7f5850156b60 2023-11-08T12:29:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c3e60 con 0x7f585015fea0 2023-11-08T12:29:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c4140 con 0x7f5850156790 2023-11-08T12:29:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850156b60 0x7f58500c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850156b60 0x7f58500c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49654/0 (socket says 172.21.15.112:49654) 2023-11-08T12:29:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 -- 172.21.15.112:0/1958922285 learned_addr learned my addr 172.21.15.112:0/1958922285 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584f7fe700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58501f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584ffff700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585015fea0 0x7f58501558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 -- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 msgr2=0x7f58501f9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58501f9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 -- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585015fea0 msgr2=0x7f58501558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585015fea0 0x7f58501558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 -- 172.21.15.112:0/1958922285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848009570 con 0x7f5850156b60 2023-11-08T12:29:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584f7fe700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58501f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:22.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584ffff700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585015fea0 0x7f58501558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:22.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f584effd700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850156b60 0x7f58500c30c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f584400e9d0 tx=0x7f584400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f5837fff700 1 -- 172.21.15.112:0/1958922285 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844009720 con 0x7f5850156b60 2023-11-08T12:29:22.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f5837fff700 1 -- 172.21.15.112:0/1958922285 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400c850 con 0x7f5850156b60 2023-11-08T12:29:22.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:21.999+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585006a7a0 con 0x7f5850156b60 2023-11-08T12:29:22.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.003+0000 7f5837fff700 1 -- 172.21.15.112:0/1958922285 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400cbc0 con 0x7f5850156b60 2023-11-08T12:29:22.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.003+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58500cc990 con 0x7f5850156b60 2023-11-08T12:29:22.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.003+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585006aa80 con 0x7f5850156b60 2023-11-08T12:29:22.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.003+0000 7f5837fff700 1 -- 172.21.15.112:0/1958922285 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5844019030 con 0x7f5850156b60 2023-11-08T12:29:22.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.007+0000 7f5837fff700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f583c064ee0 0x7f583c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.007+0000 7f5837fff700 1 -- 172.21.15.112:0/1958922285 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5844082000 con 0x7f5850156b60 2023-11-08T12:29:22.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.007+0000 7f584f7fe700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f583c064ee0 0x7f583c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.007+0000 7f584f7fe700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f583c064ee0 0x7f583c067390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f58400074c0 tx=0x7f584000d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.011+0000 7f5837fff700 1 -- 172.21.15.112:0/1958922285 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5844050060 con 0x7f5850156b60 2023-11-08T12:29:22.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.183+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58500726c0 con 0x7f5850156b60 2023-11-08T12:29:22.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.183+0000 7f5837fff700 1 -- 172.21.15.112:0/1958922285 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18093 (secure 0 0 0) 0x7f5844053680 con 0x7f5850156b60 2023-11-08T12:29:22.190 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:22.190 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":43,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:21.771117+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:29:19.858911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-08T12:29:20.777517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:22.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f583c064ee0 msgr2=0x7f583c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f583c064ee0 0x7f583c067390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f58400074c0 tx=0x7f584000d040 comp rx=0 tx=0).stop 2023-11-08T12:29:22.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850156b60 msgr2=0x7f58500c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850156b60 0x7f58500c30c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f584400e9d0 tx=0x7f584400ed90 comp rx=0 tx=0).stop 2023-11-08T12:29:22.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 shutdown_connections 2023-11-08T12:29:22.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f583c064ee0 0x7f583c067390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f585015fea0 0x7f58501558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5850156b60 0x7f58500c30c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 --2- 172.21.15.112:0/1958922285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5850156790 0x7f58501f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 >> 172.21.15.112:0/1958922285 conn(0x7f58500cf350 msgr2=0x7f58500ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:22.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 shutdown_connections 2023-11-08T12:29:22.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.191+0000 7f58560fa700 1 -- 172.21.15.112:0/1958922285 wait complete. 2023-11-08T12:29:22.216 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:22.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.383+0000 7fd274acf700 1 Processor -- start 2023-11-08T12:29:22.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.383+0000 7fd274acf700 1 -- start start 2023-11-08T12:29:22.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd274acf700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd27006cad0 0x7fd27006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd274acf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd27006ac00 0x7fd27006b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd274acf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27006b540 con 0x7fd2701587b0 2023-11-08T12:29:22.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd274acf700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700adfe0 con 0x7fd27006cad0 2023-11-08T12:29:22.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd274acf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700b0fd0 con 0x7fd27006ac00 2023-11-08T12:29:22.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd27006cad0 0x7fd27006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd27006cad0 0x7fd27006cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49668/0 (socket says 172.21.15.112:49668) 2023-11-08T12:29:22.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 -- 172.21.15.112:0/1064821488 learned_addr learned my addr 172.21.15.112:0/1064821488 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:22.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26ed9d700 1 --2- 172.21.15.112:0/1064821488 >> v2:172.21.15.133:3300/0 conn(0x7fd27006ac00 0x7fd27006b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 -- 172.21.15.112:0/1064821488 >> v2:172.21.15.133:3300/0 conn(0x7fd27006ac00 msgr2=0x7fd27006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:22.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 --2- 172.21.15.112:0/1064821488 >> v2:172.21.15.133:3300/0 conn(0x7fd27006ac00 0x7fd27006b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 -- 172.21.15.112:0/1064821488 >> v1:172.21.15.133:6789/0 conn(0x7fd2701587b0 legacy=0x7fd2700b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 -- 172.21.15.112:0/1064821488 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270158b80 con 0x7fd27006cad0 2023-11-08T12:29:22.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26ed9d700 1 --2- 172.21.15.112:0/1064821488 >> v2:172.21.15.133:3300/0 conn(0x7fd27006ac00 0x7fd27006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:22.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26dd9b700 1 --2- 172.21.15.112:0/1064821488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd27006cad0 0x7fd27006cf30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd2700713c0 tx=0x7fd264009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da5f0241bda8887 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26d59a700 1 -- 172.21.15.112:0/1064821488 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400ba20 con 0x7fd27006cad0 2023-11-08T12:29:22.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26d59a700 1 -- 172.21.15.112:0/1064821488 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26400bb80 con 0x7fd27006cad0 2023-11-08T12:29:22.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.387+0000 7fd26d59a700 1 -- 172.21.15.112:0/1064821488 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd264009e60 con 0x7fd27006cad0 2023-11-08T12:29:22.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 -- 172.21.15.112:0/1064821488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd27006cad0 msgr2=0x7fd27006cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 --2- 172.21.15.112:0/1064821488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd27006cad0 0x7fd27006cf30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd2700713c0 tx=0x7fd264009c20 comp rx=0 tx=0).stop 2023-11-08T12:29:22.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 -- 172.21.15.112:0/1064821488 shutdown_connections 2023-11-08T12:29:22.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 --2- 172.21.15.112:0/1064821488 >> v2:172.21.15.133:3300/0 conn(0x7fd27006ac00 0x7fd27006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 --2- 172.21.15.112:0/1064821488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd27006cad0 0x7fd27006cf30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 -- 172.21.15.112:0/1064821488 >> 172.21.15.112:0/1064821488 conn(0x7fd2700cf350 msgr2=0x7fd2700b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:22.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 -- 172.21.15.112:0/1064821488 shutdown_connections 2023-11-08T12:29:22.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 -- 172.21.15.112:0/1064821488 wait complete. 2023-11-08T12:29:22.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 Processor -- start 2023-11-08T12:29:22.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.391+0000 7fd274acf700 1 -- start start 2023-11-08T12:29:22.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd27006ac00 0x7fd27014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd27006cad0 0x7fd270070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2701587b0 0x7fd270070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701f3da0 con 0x7fd2701587b0 2023-11-08T12:29:22.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27014be30 con 0x7fd27006ac00 2023-11-08T12:29:22.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701f31d0 con 0x7fd27006cad0 2023-11-08T12:29:22.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2701587b0 0x7fd270070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2701587b0 0x7fd270070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49684/0 (socket says 172.21.15.112:49684) 2023-11-08T12:29:22.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 -- 172.21.15.112:0/367655495 learned_addr learned my addr 172.21.15.112:0/367655495 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:22.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26e59c700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd27006ac00 0x7fd27014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 -- 172.21.15.112:0/367655495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd27006cad0 msgr2=0x7fd270070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd27006cad0 0x7fd270070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 -- 172.21.15.112:0/367655495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd27006ac00 msgr2=0x7fd27014b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd27006ac00 0x7fd27014b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 -- 172.21.15.112:0/367655495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd264009570 con 0x7fd2701587b0 2023-11-08T12:29:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd26ed9d700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2701587b0 0x7fd270070570 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd268009fa0 tx=0x7fd26800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd25effd700 1 -- 172.21.15.112:0/367655495 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268003a40 con 0x7fd2701587b0 2023-11-08T12:29:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd25effd700 1 -- 172.21.15.112:0/367655495 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800f040 con 0x7fd2701587b0 2023-11-08T12:29:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27006d800 con 0x7fd2701587b0 2023-11-08T12:29:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd25effd700 1 -- 172.21.15.112:0/367655495 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268003e00 con 0x7fd2701587b0 2023-11-08T12:29:22.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27006d520 con 0x7fd2701587b0 2023-11-08T12:29:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.395+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27006dae0 con 0x7fd2701587b0 2023-11-08T12:29:22.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.399+0000 7fd25effd700 1 -- 172.21.15.112:0/367655495 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd26801c030 con 0x7fd2701587b0 2023-11-08T12:29:22.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.399+0000 7fd25effd700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd250064ee0 0x7fd250067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.399+0000 7fd25effd700 1 -- 172.21.15.112:0/367655495 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd2680821a0 con 0x7fd2701587b0 2023-11-08T12:29:22.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.399+0000 7fd26e59c700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd250064ee0 0x7fd250067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.403+0000 7fd26e59c700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd250064ee0 0x7fd250067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd260001640 tx=0x7fd260009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.407+0000 7fd25effd700 1 -- 172.21.15.112:0/367655495 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd268050110 con 0x7fd2701587b0 2023-11-08T12:29:22.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.579+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2700726c0 con 0x7fd2701587b0 2023-11-08T12:29:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.583+0000 7fd25effd700 1 -- 172.21.15.112:0/367655495 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18093 (secure 0 0 0) 0x7fd268053730 con 0x7fd2701587b0 2023-11-08T12:29:22.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:22.588 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":43,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:21.771117+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:29:19.858911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-08T12:29:20.777517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd250064ee0 msgr2=0x7fd250067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd250064ee0 0x7fd250067390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd260001640 tx=0x7fd260009040 comp rx=0 tx=0).stop 2023-11-08T12:29:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2701587b0 msgr2=0x7fd270070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2701587b0 0x7fd270070570 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd268009fa0 tx=0x7fd26800d460 comp rx=0 tx=0).stop 2023-11-08T12:29:22.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 shutdown_connections 2023-11-08T12:29:22.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd250064ee0 0x7fd250067390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2701587b0 0x7fd270070570 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd27006cad0 0x7fd270070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 --2- 172.21.15.112:0/367655495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd27006ac00 0x7fd27014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 >> 172.21.15.112:0/367655495 conn(0x7fd2700cf350 msgr2=0x7fd270157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:22.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 shutdown_connections 2023-11-08T12:29:22.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.587+0000 7fd274acf700 1 -- 172.21.15.112:0/367655495 wait complete. 2023-11-08T12:29:22.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T12:29:22.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.783+0000 7f356359e700 1 Processor -- start 2023-11-08T12:29:22.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.783+0000 7f356359e700 1 -- start start 2023-11-08T12:29:22.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f35640b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356415c520 con 0x7f356406ff10 2023-11-08T12:29:22.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356406ac00 con 0x7f3564070360 2023-11-08T12:29:22.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35640b4240 con 0x7f356415c150 2023-11-08T12:29:22.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f3561d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f356406ff10 0x7f356415fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:39020/0 (socket says 172.21.15.112:39020) 2023-11-08T12:29:22.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f3561d9b700 1 -- 172.21.15.112:0/2432492411 learned_addr learned my addr 172.21.15.112:0/2432492411 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:22.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356259c700 1 --2- 172.21.15.112:0/2432492411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f35640b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356159a700 1 -- 172.21.15.112:0/2432492411 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750191551 0 0) 0x7f356415c520 con 0x7f356406ff10 2023-11-08T12:29:22.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356159a700 1 -- 172.21.15.112:0/2432492411 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f354c0035d0 con 0x7f356406ff10 2023-11-08T12:29:22.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356259c700 1 -- 172.21.15.112:0/2432492411 >> v1:172.21.15.133:6789/0 conn(0x7f3564070360 legacy=0x7f3564160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356259c700 1 -- 172.21.15.112:0/2432492411 >> v1:172.21.15.112:6789/0 conn(0x7f356406ff10 legacy=0x7f356415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356259c700 1 -- 172.21.15.112:0/2432492411 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564160a50 con 0x7f356415c150 2023-11-08T12:29:22.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356259c700 1 --2- 172.21.15.112:0/2432492411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f35640b3d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3554009880 tx=0x7f3554009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=854ea7b4c8902bf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356159a700 1 -- 172.21.15.112:0/2432492411 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011830 con 0x7f356415c150 2023-11-08T12:29:22.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356159a700 1 -- 172.21.15.112:0/2432492411 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554011990 con 0x7f356415c150 2023-11-08T12:29:22.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.787+0000 7f356159a700 1 -- 172.21.15.112:0/2432492411 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011d00 con 0x7f356415c150 2023-11-08T12:29:22.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 -- 172.21.15.112:0/2432492411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 msgr2=0x7f35640b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 --2- 172.21.15.112:0/2432492411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f35640b3d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3554009880 tx=0x7f3554009b90 comp rx=0 tx=0).stop 2023-11-08T12:29:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 -- 172.21.15.112:0/2432492411 shutdown_connections 2023-11-08T12:29:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 --2- 172.21.15.112:0/2432492411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f35640b3d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 -- 172.21.15.112:0/2432492411 >> 172.21.15.112:0/2432492411 conn(0x7f35640d3680 msgr2=0x7f35640cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 -- 172.21.15.112:0/2432492411 shutdown_connections 2023-11-08T12:29:22.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 -- 172.21.15.112:0/2432492411 wait complete. 2023-11-08T12:29:22.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 Processor -- start 2023-11-08T12:29:22.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.791+0000 7f356359e700 1 -- start start 2023-11-08T12:29:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f356406ff10 0x7f3564158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3564070360 0x7f3564145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f3564159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3564159660 con 0x7f3564070360 2023-11-08T12:29:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35641590a0 con 0x7f356406ff10 2023-11-08T12:29:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3564159380 con 0x7f356415c150 2023-11-08T12:29:22.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3564070360 0x7f3564145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3564070360 0x7f3564145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49700/0 (socket says 172.21.15.112:49700) 2023-11-08T12:29:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 -- 172.21.15.112:0/799193939 learned_addr learned my addr 172.21.15.112:0/799193939 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3562d9d700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f3564159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356259c700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f356406ff10 0x7f3564158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 -- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 msgr2=0x7f3564159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f3564159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 -- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f356406ff10 msgr2=0x7f3564158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f356406ff10 0x7f3564158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:22.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 -- 172.21.15.112:0/799193939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540094b0 con 0x7f3564070360 2023-11-08T12:29:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3561d9b700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3564070360 0x7f3564145320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3558001260 tx=0x7f355800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3552ffd700 1 -- 172.21.15.112:0/799193939 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580074e0 con 0x7f3564070360 2023-11-08T12:29:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3552ffd700 1 -- 172.21.15.112:0/799193939 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558007640 con 0x7f3564070360 2023-11-08T12:29:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35640d2450 con 0x7f3564070360 2023-11-08T12:29:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f3552ffd700 1 -- 172.21.15.112:0/799193939 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558005a50 con 0x7f3564070360 2023-11-08T12:29:22.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.795+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356406cc50 con 0x7f3564070360 2023-11-08T12:29:22.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.799+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35640d2730 con 0x7f3564070360 2023-11-08T12:29:22.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.799+0000 7f3552ffd700 1 -- 172.21.15.112:0/799193939 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3558019030 con 0x7f3564070360 2023-11-08T12:29:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.799+0000 7f3552ffd700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3544064ee0 0x7f3544067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.799+0000 7f3552ffd700 1 -- 172.21.15.112:0/799193939 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3558081290 con 0x7f3564070360 2023-11-08T12:29:22.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.799+0000 7f356259c700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3544064ee0 0x7f3544067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:22.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.803+0000 7f356259c700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3544064ee0 0x7f3544067390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3554009bd0 tx=0x7f3554010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:22.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:22.807+0000 7f3552ffd700 1 -- 172.21.15.112:0/799193939 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f355804a400 con 0x7f3564070360 2023-11-08T12:29:23.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.011+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f35640b4060 con 0x7f3564070360 2023-11-08T12:29:23.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.783+0000 7f3552ffd700 1 -- 172.21.15.112:0/799193939 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f355804f2b0 con 0x7f3564070360 2023-11-08T12:29:23.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3544064ee0 msgr2=0x7f3544067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3544064ee0 0x7f3544067390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3554009bd0 tx=0x7f3554010000 comp rx=0 tx=0).stop 2023-11-08T12:29:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3564070360 msgr2=0x7f3564145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3564070360 0x7f3564145320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3558001260 tx=0x7f355800c9e0 comp rx=0 tx=0).stop 2023-11-08T12:29:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 shutdown_connections 2023-11-08T12:29:23.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3544064ee0 0x7f3544067390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:23.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f356415c150 0x7f3564159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:23.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3564070360 0x7f3564145320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:23.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 --2- 172.21.15.112:0/799193939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f356406ff10 0x7f3564158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:23.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 >> 172.21.15.112:0/799193939 conn(0x7f35640d3680 msgr2=0x7f35640c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:23.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.787+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 shutdown_connections 2023-11-08T12:29:23.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.791+0000 7f356359e700 1 -- 172.21.15.112:0/799193939 wait complete. 2023-11-08T12:29:23.817 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T12:29:23.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T12:29:23.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.991+0000 7f47af59e700 1 Processor -- start 2023-11-08T12:29:23.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.995+0000 7f47af59e700 1 -- start start 2023-11-08T12:29:24.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.995+0000 7f47af59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f47b015c360 0x7f47b00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:24.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.995+0000 7f47af59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:24.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.995+0000 7f47af59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00cd110 con 0x7f47b006cbc0 2023-11-08T12:29:24.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.995+0000 7f47af59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00c9a40 con 0x7f47b015c360 2023-11-08T12:29:24.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.995+0000 7f47af59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00cc4a0 con 0x7f47b006c590 2023-11-08T12:29:24.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.995+0000 7f47ae59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f47b015c360 0x7f47b00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:24.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47ae59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f47b015c360 0x7f47b00ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49706/0 (socket says 172.21.15.112:49706) 2023-11-08T12:29:24.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47ae59c700 1 -- 172.21.15.112:0/828598543 learned_addr learned my addr 172.21.15.112:0/828598543 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:24.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47aed9d700 1 --2- 172.21.15.112:0/828598543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:24.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47aed9d700 1 -- 172.21.15.112:0/828598543 >> v2:172.21.15.112:3300/0 conn(0x7f47b015c360 msgr2=0x7f47b00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:24.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47aed9d700 1 --2- 172.21.15.112:0/828598543 >> v2:172.21.15.112:3300/0 conn(0x7f47b015c360 0x7f47b00ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47aed9d700 1 -- 172.21.15.112:0/828598543 >> v1:172.21.15.133:6789/0 conn(0x7f47b006cbc0 legacy=0x7f47b006be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47aed9d700 1 -- 172.21.15.112:0/828598543 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00cd340 con 0x7f47b006c590 2023-11-08T12:29:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47ae59c700 1 --2- 172.21.15.112:0/828598543 >> v2:172.21.15.112:3300/0 conn(0x7f47b015c360 0x7f47b00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:24.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47aed9d700 1 --2- 172.21.15.112:0/828598543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c9e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009d90 tx=0x7f47a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e9e13723dae916 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:24.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47add9b700 1 -- 172.21.15.112:0/828598543 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800e070 con 0x7f47b006c590 2023-11-08T12:29:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47add9b700 1 -- 172.21.15.112:0/828598543 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800bb20 con 0x7f47b006c590 2023-11-08T12:29:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47add9b700 1 -- 172.21.15.112:0/828598543 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8012430 con 0x7f47b006c590 2023-11-08T12:29:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47af59e700 1 -- 172.21.15.112:0/828598543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 msgr2=0x7f47b00c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:24.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47af59e700 1 --2- 172.21.15.112:0/828598543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c9e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009d90 tx=0x7f47a800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47af59e700 1 -- 172.21.15.112:0/828598543 shutdown_connections 2023-11-08T12:29:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47af59e700 1 --2- 172.21.15.112:0/828598543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c9e60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47af59e700 1 --2- 172.21.15.112:0/828598543 >> v2:172.21.15.112:3300/0 conn(0x7f47b015c360 0x7f47b00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:23.999+0000 7f47af59e700 1 -- 172.21.15.112:0/828598543 >> 172.21.15.112:0/828598543 conn(0x7f47b00cf280 msgr2=0x7f47b00cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:24.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.003+0000 7f47af59e700 1 -- 172.21.15.112:0/828598543 shutdown_connections 2023-11-08T12:29:24.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.003+0000 7f47af59e700 1 -- 172.21.15.112:0/828598543 wait complete. 2023-11-08T12:29:24.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.003+0000 7f47af59e700 1 Processor -- start 2023-11-08T12:29:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 -- start start 2023-11-08T12:29:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b006cbc0 0x7f47b0147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:24.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015c360 0x7f47b0147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0155350 con 0x7f47b015c360 2023-11-08T12:29:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0155630 con 0x7f47b006cbc0 2023-11-08T12:29:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0155910 con 0x7f47b006c590 2023-11-08T12:29:24.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015c360 0x7f47b0147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015c360 0x7f47b0147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49708/0 (socket says 172.21.15.112:49708) 2023-11-08T12:29:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 -- 172.21.15.112:0/1896127934 learned_addr learned my addr 172.21.15.112:0/1896127934 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47ae59c700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47a5d9b700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b006cbc0 0x7f47b0147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:24.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 -- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 msgr2=0x7f47b00c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:24.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 -- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b006cbc0 msgr2=0x7f47b0147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:24.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b006cbc0 0x7f47b0147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 -- 172.21.15.112:0/1896127934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a000b810 con 0x7f47b015c360 2023-11-08T12:29:24.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47aed9d700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015c360 0x7f47b0147ac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f47a8014040 tx=0x7f47a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:24.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47a77fe700 1 -- 172.21.15.112:0/1896127934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8004780 con 0x7f47b015c360 2023-11-08T12:29:24.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47a77fe700 1 -- 172.21.15.112:0/1896127934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8020070 con 0x7f47b015c360 2023-11-08T12:29:24.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a8009a70 con 0x7f47b015c360 2023-11-08T12:29:24.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.007+0000 7f47a77fe700 1 -- 172.21.15.112:0/1896127934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80276c0 con 0x7f47b015c360 2023-11-08T12:29:24.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.011+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b00c9660 con 0x7f47b015c360 2023-11-08T12:29:24.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.011+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00cd620 con 0x7f47b015c360 2023-11-08T12:29:24.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.011+0000 7f47a77fe700 1 -- 172.21.15.112:0/1896127934 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f47a8012430 con 0x7f47b015c360 2023-11-08T12:29:24.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.011+0000 7f47a77fe700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4790064ee0 0x7f4790067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:24.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.011+0000 7f47a77fe700 1 -- 172.21.15.112:0/1896127934 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f47a8022070 con 0x7f47b015c360 2023-11-08T12:29:24.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.015+0000 7f47ae59c700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4790064ee0 0x7f4790067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:24.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.015+0000 7f47ae59c700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4790064ee0 0x7f4790067390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47a000b260 tx=0x7f47a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:24.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.019+0000 7f47a77fe700 1 -- 172.21.15.112:0/1896127934 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f47a8052230 con 0x7f47b015c360 2023-11-08T12:29:24.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.227+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f47b015c730 con 0x7f47b015c360 2023-11-08T12:29:24.269 INFO:tasks.ceph.mds.c.smithi112.stderr:2023-11-08T12:29:24.263+0000 7fe72bfa6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:29:24.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.795+0000 7f47a77fe700 1 -- 172.21.15.112:0/1896127934 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f47a8055850 con 0x7f47b015c360 2023-11-08T12:29:24.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.799+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4790064ee0 msgr2=0x7f4790067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:24.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.799+0000 7f47af59e700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4790064ee0 0x7f4790067390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47a000b260 tx=0x7f47a0008040 comp rx=0 tx=0).stop 2023-11-08T12:29:24.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.799+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015c360 msgr2=0x7f47b0147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:24.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.799+0000 7f47af59e700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015c360 0x7f47b0147ac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f47a8014040 tx=0x7f47a8004af0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 shutdown_connections 2023-11-08T12:29:24.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4790064ee0 0x7f4790067390 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47b015c360 0x7f47b0147ac0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b006cbc0 0x7f47b0147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 --2- 172.21.15.112:0/1896127934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006c590 0x7f47b00c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:24.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 >> 172.21.15.112:0/1896127934 conn(0x7f47b00cf280 msgr2=0x7f47b015a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:24.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 shutdown_connections 2023-11-08T12:29:24.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:24.803+0000 7f47af59e700 1 -- 172.21.15.112:0/1896127934 wait complete. 2023-11-08T12:29:24.829 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T12:29:24.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:25.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.007+0000 7fb84ede6700 1 Processor -- start 2023-11-08T12:29:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.007+0000 7fb84ede6700 1 -- start start 2023-11-08T12:29:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb84ede6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8480c8d10 0x7fb8480cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb84ede6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb848069d60 0x7fb84806a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb84ede6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84815a850 con 0x7fb84815a480 2023-11-08T12:29:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb84ede6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480ce060 con 0x7fb848069d60 2023-11-08T12:29:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb84ede6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480ce300 con 0x7fb8480c8d10 2023-11-08T12:29:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8480c8d10 0x7fb8480cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8480c8d10 0x7fb8480cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:59864/0 (socket says 172.21.15.112:59864) 2023-11-08T12:29:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb83ffff700 1 -- 172.21.15.112:0/2413508165 learned_addr learned my addr 172.21.15.112:0/2413508165 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb84cb82700 1 --1- 172.21.15.112:0/2413508165 >> v1:172.21.15.133:6789/0 conn(0x7fb84815a480 0x7fb8480cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:38358/0 (socket says 172.21.15.112:38358) 2023-11-08T12:29:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb84d383700 1 --2- 172.21.15.112:0/2413508165 >> v2:172.21.15.133:3300/0 conn(0x7fb848069d60 0x7fb84806a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.011+0000 7fb83ffff700 1 -- 172.21.15.112:0/2413508165 >> v2:172.21.15.133:3300/0 conn(0x7fb848069d60 msgr2=0x7fb84806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83ffff700 1 --2- 172.21.15.112:0/2413508165 >> v2:172.21.15.133:3300/0 conn(0x7fb848069d60 0x7fb84806a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83ffff700 1 -- 172.21.15.112:0/2413508165 >> v1:172.21.15.133:6789/0 conn(0x7fb84815a480 legacy=0x7fb8480cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83ffff700 1 -- 172.21.15.112:0/2413508165 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480cada0 con 0x7fb8480c8d10 2023-11-08T12:29:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83f7fe700 1 -- 172.21.15.112:0/2413508165 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300770529 0 0) 0x7fb84815a850 con 0x7fb84815a480 2023-11-08T12:29:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83ffff700 1 --2- 172.21.15.112:0/2413508165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8480c8d10 0x7fb8480cc9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb838009910 tx=0x7fb838009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a7e0fd6caf0cf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83f7fe700 1 -- 172.21.15.112:0/2413508165 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011830 con 0x7fb8480c8d10 2023-11-08T12:29:25.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83f7fe700 1 -- 172.21.15.112:0/2413508165 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838011990 con 0x7fb8480c8d10 2023-11-08T12:29:25.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb83f7fe700 1 -- 172.21.15.112:0/2413508165 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011d40 con 0x7fb8480c8d10 2023-11-08T12:29:25.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 -- 172.21.15.112:0/2413508165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8480c8d10 msgr2=0x7fb8480cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 --2- 172.21.15.112:0/2413508165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8480c8d10 0x7fb8480cc9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb838009910 tx=0x7fb838009c20 comp rx=0 tx=0).stop 2023-11-08T12:29:25.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 -- 172.21.15.112:0/2413508165 shutdown_connections 2023-11-08T12:29:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 --2- 172.21.15.112:0/2413508165 >> v2:172.21.15.133:3300/0 conn(0x7fb848069d60 0x7fb84806a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 --2- 172.21.15.112:0/2413508165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8480c8d10 0x7fb8480cc9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 -- 172.21.15.112:0/2413508165 >> 172.21.15.112:0/2413508165 conn(0x7fb8480cf350 msgr2=0x7fb8480b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 -- 172.21.15.112:0/2413508165 shutdown_connections 2023-11-08T12:29:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.015+0000 7fb84ede6700 1 -- 172.21.15.112:0/2413508165 wait complete. 2023-11-08T12:29:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.019+0000 7fb84ede6700 1 Processor -- start 2023-11-08T12:29:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.019+0000 7fb84ede6700 1 -- start start 2023-11-08T12:29:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb848069d60 0x7fb8481562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8480c8d10 0x7fb848157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb84815a480 0x7fb848158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848158870 con 0x7fb848069d60 2023-11-08T12:29:25.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8481568f0 con 0x7fb8480c8d10 2023-11-08T12:29:25.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb848156bd0 con 0x7fb84815a480 2023-11-08T12:29:25.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb848069d60 0x7fb8481562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb848069d60 0x7fb8481562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49714/0 (socket says 172.21.15.112:49714) 2023-11-08T12:29:25.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 -- 172.21.15.112:0/742881512 learned_addr learned my addr 172.21.15.112:0/742881512 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:25.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb83ffff700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8480c8d10 0x7fb848157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84d383700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb84815a480 0x7fb848158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 -- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb84815a480 msgr2=0x7fb848158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb84815a480 0x7fb848158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 -- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8480c8d10 msgr2=0x7fb848157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8480c8d10 0x7fb848157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 -- 172.21.15.112:0/742881512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009570 con 0x7fb848069d60 2023-11-08T12:29:25.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84cb82700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb848069d60 0x7fb8481562d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb84400cc20 tx=0x7fb84400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb83d7fa700 1 -- 172.21.15.112:0/742881512 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400aaa0 con 0x7fb848069d60 2023-11-08T12:29:25.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb83d7fa700 1 -- 172.21.15.112:0/742881512 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84400ac20 con 0x7fb848069d60 2023-11-08T12:29:25.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8480add50 con 0x7fb848069d60 2023-11-08T12:29:25.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb83d7fa700 1 -- 172.21.15.112:0/742881512 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440070d0 con 0x7fb848069d60 2023-11-08T12:29:25.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.023+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8480caa30 con 0x7fb848069d60 2023-11-08T12:29:25.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.027+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480ca6e0 con 0x7fb848069d60 2023-11-08T12:29:25.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.027+0000 7fb83d7fa700 1 -- 172.21.15.112:0/742881512 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb844010070 con 0x7fb848069d60 2023-11-08T12:29:25.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.027+0000 7fb83d7fa700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb834064ee0 0x7fb834067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.027+0000 7fb83d7fa700 1 -- 172.21.15.112:0/742881512 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb844081a00 con 0x7fb848069d60 2023-11-08T12:29:25.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.027+0000 7fb83ffff700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb834064ee0 0x7fb834067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.031+0000 7fb83ffff700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb834064ee0 0x7fb834067390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb838009c60 tx=0x7fb83801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.035+0000 7fb83d7fa700 1 -- 172.21.15.112:0/742881512 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb84404f9e0 con 0x7fb848069d60 2023-11-08T12:29:25.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.251+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8480726c0 con 0x7fb848069d60 2023-11-08T12:29:25.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.251+0000 7fb83d7fa700 1 -- 172.21.15.112:0/742881512 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fb844018020 con 0x7fb848069d60 2023-11-08T12:29:25.256 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:25.256 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb834064ee0 msgr2=0x7fb834067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb834064ee0 0x7fb834067390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb838009c60 tx=0x7fb83801c040 comp rx=0 tx=0).stop 2023-11-08T12:29:25.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb848069d60 msgr2=0x7fb8481562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb848069d60 0x7fb8481562d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb84400cc20 tx=0x7fb84400cf30 comp rx=0 tx=0).stop 2023-11-08T12:29:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 shutdown_connections 2023-11-08T12:29:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb834064ee0 0x7fb834067390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb84815a480 0x7fb848158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8480c8d10 0x7fb848157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 --2- 172.21.15.112:0/742881512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb848069d60 0x7fb8481562d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 >> 172.21.15.112:0/742881512 conn(0x7fb8480cf350 msgr2=0x7fb8480b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 shutdown_connections 2023-11-08T12:29:25.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.255+0000 7fb84ede6700 1 -- 172.21.15.112:0/742881512 wait complete. 2023-11-08T12:29:25.262 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:25.282 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:25.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.443+0000 7f0f735e6700 1 Processor -- start 2023-11-08T12:29:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.443+0000 7f0f735e6700 1 -- start start 2023-11-08T12:29:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f735e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f6c163cb0 0x7f0f6c164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f735e6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c0cdfb0 0x7f0f6c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f735e6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f6c06d2f0 0x7f0f6c06bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f735e6700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c0cc290 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f735e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c06d770 con 0x7f0f6c163cb0 2023-11-08T12:29:25.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f735e6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c164080 con 0x7f0f6c0cdfb0 2023-11-08T12:29:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f6c163cb0 0x7f0f6c164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f70b81700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c0cdfb0 0x7f0f6c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71b83700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f6c06d2f0 0x7f0f6c06bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f70b81700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c0cdfb0 0x7f0f6c06cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:42052/0 (socket says 172.21.15.112:42052) 2023-11-08T12:29:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f6c163cb0 0x7f0f6c164cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:52122/0 (socket says 172.21.15.112:52122) 2023-11-08T12:29:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f70b81700 1 -- 172.21.15.112:0/2998792403 learned_addr learned my addr 172.21.15.112:0/2998792403 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 -- 172.21.15.112:0/2998792403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c0cdfb0 msgr2=0x7f0f6c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:25.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 --2- 172.21.15.112:0/2998792403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c0cdfb0 0x7f0f6c06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 -- 172.21.15.112:0/2998792403 >> v2:172.21.15.112:3300/0 conn(0x7f0f6c06d2f0 msgr2=0x7f0f6c06bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 --2- 172.21.15.112:0/2998792403 >> v2:172.21.15.112:3300/0 conn(0x7f0f6c06d2f0 0x7f0f6c06bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 -- 172.21.15.112:0/2998792403 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c069bf0 con 0x7f0f6c163cb0 2023-11-08T12:29:25.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.447+0000 7f0f71382700 1 --2- 172.21.15.112:0/2998792403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c163cb0 0x7f0f6c164cb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c06fbe0 tx=0x7f0f68009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98a7f72614084b1d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f63fff700 1 -- 172.21.15.112:0/2998792403 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68011830 con 0x7f0f6c163cb0 2023-11-08T12:29:25.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f63fff700 1 -- 172.21.15.112:0/2998792403 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f68011990 con 0x7f0f6c163cb0 2023-11-08T12:29:25.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f63fff700 1 -- 172.21.15.112:0/2998792403 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68011d20 con 0x7f0f6c163cb0 2023-11-08T12:29:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 -- 172.21.15.112:0/2998792403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c163cb0 msgr2=0x7f0f6c164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 --2- 172.21.15.112:0/2998792403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c163cb0 0x7f0f6c164cb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c06fbe0 tx=0x7f0f68009b30 comp rx=0 tx=0).stop 2023-11-08T12:29:25.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 -- 172.21.15.112:0/2998792403 shutdown_connections 2023-11-08T12:29:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 --2- 172.21.15.112:0/2998792403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c0cdfb0 0x7f0f6c06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 --2- 172.21.15.112:0/2998792403 >> v2:172.21.15.112:3300/0 conn(0x7f0f6c06d2f0 0x7f0f6c06bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 --2- 172.21.15.112:0/2998792403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c163cb0 0x7f0f6c164cb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 -- 172.21.15.112:0/2998792403 >> 172.21.15.112:0/2998792403 conn(0x7f0f6c0cf350 msgr2=0x7f0f6c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 -- 172.21.15.112:0/2998792403 shutdown_connections 2023-11-08T12:29:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.451+0000 7f0f735e6700 1 -- 172.21.15.112:0/2998792403 wait complete. 2023-11-08T12:29:25.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 Processor -- start 2023-11-08T12:29:25.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 -- start start 2023-11-08T12:29:25.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6c06d2f0 0x7f0f6c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c0cdfb0 0x7f0f6c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c163cb0 0x7f0f6c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c4a80 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c84a0 con 0x7f0f6c0cdfb0 2023-11-08T12:29:25.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c8780 con 0x7f0f6c163cb0 2023-11-08T12:29:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6c06d2f0 0x7f0f6c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6c06d2f0 0x7f0f6c152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47234/0 (socket says 172.21.15.112:47234) 2023-11-08T12:29:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 -- 172.21.15.112:0/1417702379 learned_addr learned my addr 172.21.15.112:0/1417702379 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71b83700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c163cb0 0x7f0f6c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f70b81700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c0cdfb0 0x7f0f6c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 -- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c163cb0 msgr2=0x7f0f6c070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c163cb0 0x7f0f6c070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 -- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c0cdfb0 msgr2=0x7f0f6c0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c0cdfb0 0x7f0f6c0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 -- 172.21.15.112:0/1417702379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f680094b0 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f70b81700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c0cdfb0 0x7f0f6c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:25.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f71382700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6c06d2f0 0x7f0f6c152b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009b70 tx=0x7f0f68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f61ffb700 1 -- 172.21.15.112:0/1417702379 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68004380 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f61ffb700 1 -- 172.21.15.112:0/1417702379 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6801f070 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c0cc4a0 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.455+0000 7f0f61ffb700 1 -- 172.21.15.112:0/1417702379 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680036c0 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.459+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c1651f0 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.459+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c0cc780 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.459+0000 7f0f61ffb700 1 -- 172.21.15.112:0/1417702379 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0f6802a020 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.463+0000 7f0f61ffb700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f50064ee0 0x7f0f50067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.463+0000 7f0f61ffb700 1 -- 172.21.15.112:0/1417702379 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0f680833a0 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.463+0000 7f0f70b81700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f50064ee0 0x7f0f50067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.463+0000 7f0f70b81700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f50064ee0 0x7f0f50067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0ae630 tx=0x7f0f5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.467+0000 7f0f61ffb700 1 -- 172.21.15.112:0/1417702379 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0f68051400 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.639+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f6c0b1f00 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f61ffb700 1 -- 172.21.15.112:0/1417702379 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18080 (secure 0 0 0) 0x7f0f6c0b1f00 con 0x7f0f6c06d2f0 2023-11-08T12:29:25.646 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:25.647 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":44,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:22.775538+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:29:19.858911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-08T12:29:20.777517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:25.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f50064ee0 msgr2=0x7f0f50067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f50064ee0 0x7f0f50067390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0ae630 tx=0x7f0f5c008040 comp rx=0 tx=0).stop 2023-11-08T12:29:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6c06d2f0 msgr2=0x7f0f6c152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6c06d2f0 0x7f0f6c152b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009b70 tx=0x7f0f68004770 comp rx=0 tx=0).stop 2023-11-08T12:29:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 shutdown_connections 2023-11-08T12:29:25.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0f50064ee0 0x7f0f50067390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f6c163cb0 0x7f0f6c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6c0cdfb0 0x7f0f6c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 --2- 172.21.15.112:0/1417702379 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6c06d2f0 0x7f0f6c152b30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 >> 172.21.15.112:0/1417702379 conn(0x7f0f6c0cf350 msgr2=0x7f0f6c162de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:25.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 shutdown_connections 2023-11-08T12:29:25.652 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.643+0000 7f0f735e6700 1 -- 172.21.15.112:0/1417702379 wait complete. 2023-11-08T12:29:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T12:29:25.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:29:25.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19823b4700 1 Processor -- start 2023-11-08T12:29:25.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19823b4700 1 -- start start 2023-11-08T12:29:25.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19823b4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f197c0cd410 0x7f197c0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19823b4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 0x7f197c071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19823b4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c159340 con 0x7f197c158f70 2023-11-08T12:29:25.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19823b4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c071ac0 con 0x7f197c0cd410 2023-11-08T12:29:25.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19823b4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0cea00 con 0x7f197c071100 2023-11-08T12:29:25.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19813b2700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f197c158f70 0x7f197c06c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59008/0 (socket says 172.21.15.112:59008) 2023-11-08T12:29:25.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f19813b2700 1 -- 172.21.15.112:0/1802937446 learned_addr learned my addr 172.21.15.112:0/1802937446 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.835+0000 7f1981bb3700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 0x7f197c071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1980bb1700 1 --2- 172.21.15.112:0/1802937446 >> v2:172.21.15.133:3300/0 conn(0x7f197c0cd410 0x7f197c0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550576300 0 0) 0x7f197c159340 con 0x7f197c158f70 2023-11-08T12:29:25.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19680057e0 con 0x7f197c158f70 2023-11-08T12:29:25.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863841143 0 0) 0x7f19680057e0 con 0x7f197c158f70 2023-11-08T12:29:25.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 msgr2=0x7f197c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:25.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 0x7f197c071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 >> v2:172.21.15.133:3300/0 conn(0x7f197c0cd410 msgr2=0x7f197c0ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:25.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 --2- 172.21.15.112:0/1802937446 >> v2:172.21.15.133:3300/0 conn(0x7f197c0cd410 0x7f197c0ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c06b3c0 con 0x7f197c158f70 2023-11-08T12:29:25.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f19780019f0 con 0x7f197c158f70 2023-11-08T12:29:25.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 >> v1:172.21.15.112:6789/0 conn(0x7f197c158f70 legacy=0x7f197c06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 0x7f1968005c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19680061b0 0x7f1968006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1968006fc0 0x7f1968007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c071ac0 con 0x7f1968006fc0 2023-11-08T12:29:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0cea00 con 0x7f19680061b0 2023-11-08T12:29:25.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196800dc70 con 0x7f197c071100 2023-11-08T12:29:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1981bb3700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1968006fc0 0x7f1968007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1980bb1700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19680061b0 0x7f1968006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f19813b2700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 0x7f1968005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1981bb3700 1 -- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 msgr2=0x7f1968005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1981bb3700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 0x7f1968005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1981bb3700 1 -- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19680061b0 msgr2=0x7f1968006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1981bb3700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19680061b0 0x7f1968006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1981bb3700 1 -- 172.21.15.112:0/1802937446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680057e0 con 0x7f1968006fc0 2023-11-08T12:29:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f19813b2700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c071100 0x7f1968005c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1981bb3700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1968006fc0 0x7f1968007430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1974009b70 tx=0x7f1968007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580f12412ab42c5c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400e660 con 0x7f1968006fc0 2023-11-08T12:29:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197400e7c0 con 0x7f1968006fc0 2023-11-08T12:29:25.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.839+0000 7f1973fff700 1 -- 172.21.15.112:0/1802937446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197400eb30 con 0x7f1968006fc0 2023-11-08T12:29:25.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.843+0000 7f19823b4700 1 -- 172.21.15.112:0/1802937446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1968006fc0 msgr2=0x7f1968007430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.843+0000 7f19823b4700 1 --2- 172.21.15.112:0/1802937446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1968006fc0 0x7f1968007430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1974009b70 tx=0x7f1968007ab0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.843+0000 7f1981bb3700 1 -- 172.21.15.112:0/1802937446 reap_dead start 2023-11-08T12:29:25.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.843+0000 7f19823b4700 1 -- 172.21.15.112:0/1802937446 shutdown_connections 2023-11-08T12:29:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.843+0000 7f19823b4700 1 -- 172.21.15.112:0/1802937446 >> 172.21.15.112:0/1802937446 conn(0x7f197c0b1200 msgr2=0x7f197c0b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.843+0000 7f19823b4700 1 -- 172.21.15.112:0/1802937446 shutdown_connections 2023-11-08T12:29:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.843+0000 7f19823b4700 1 -- 172.21.15.112:0/1802937446 wait complete. 2023-11-08T12:29:25.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 Processor -- start 2023-11-08T12:29:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 -- start start 2023-11-08T12:29:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f197c1ed100 0x7f197c1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f197c14a040 0x7f197c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c1ed4d0 0x7f197c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1e1870 con 0x7f197c14a040 2023-11-08T12:29:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1e1540 con 0x7f197c1ed100 2023-11-08T12:29:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19823b4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0c8f70 con 0x7f197c1ed4d0 2023-11-08T12:29:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f197c14a040 0x7f197c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f197c14a040 0x7f197c0b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47260/0 (socket says 172.21.15.112:47260) 2023-11-08T12:29:25.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 -- 172.21.15.112:0/3254520832 learned_addr learned my addr 172.21.15.112:0/3254520832 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:25.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f19813b2700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f197c1ed100 0x7f197c1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1981bb3700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c1ed4d0 0x7f197c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 -- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c1ed4d0 msgr2=0x7f197c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c1ed4d0 0x7f197c0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 -- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f197c1ed100 msgr2=0x7f197c1499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:25.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f197c1ed100 0x7f197c1499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:25.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 -- 172.21.15.112:0/3254520832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c06b980 con 0x7f197c14a040 2023-11-08T12:29:25.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1980bb1700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f197c14a040 0x7f197c0b2500 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f196c011a20 tx=0x7f196c011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.847+0000 7f1971ffb700 1 -- 172.21.15.112:0/3254520832 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c011ec0 con 0x7f197c14a040 2023-11-08T12:29:25.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.851+0000 7f1971ffb700 1 -- 172.21.15.112:0/3254520832 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c00f940 con 0x7f197c14a040 2023-11-08T12:29:25.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.851+0000 7f1971ffb700 1 -- 172.21.15.112:0/3254520832 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c00fcf0 con 0x7f197c14a040 2023-11-08T12:29:25.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.851+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c06b6a0 con 0x7f197c14a040 2023-11-08T12:29:25.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.851+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c06bc60 con 0x7f197c14a040 2023-11-08T12:29:25.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.851+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c1e1a20 con 0x7f197c14a040 2023-11-08T12:29:25.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.851+0000 7f1971ffb700 1 -- 172.21.15.112:0/3254520832 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f196c014440 con 0x7f197c14a040 2023-11-08T12:29:25.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.855+0000 7f1971ffb700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1960064ee0 0x7f1960067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:25.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.855+0000 7f1971ffb700 1 -- 172.21.15.112:0/3254520832 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f196c082880 con 0x7f197c14a040 2023-11-08T12:29:25.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.855+0000 7f19813b2700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1960064ee0 0x7f1960067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:25.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.855+0000 7f19813b2700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1960064ee0 0x7f1960067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1978001b20 tx=0x7f19780017b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:25.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:25.859+0000 7f1971ffb700 1 -- 172.21.15.112:0/3254520832 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f197c1e1a20 con 0x7f197c14a040 2023-11-08T12:29:26.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.035+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f197c073cb0 con 0x7f1960064ee0 2023-11-08T12:29:26.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.051+0000 7f1971ffb700 1 -- 172.21.15.112:0/3254520832 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300165 (secure 0 0 0) 0x7f197c073cb0 con 0x7f1960064ee0 2023-11-08T12:29:26.056 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:26.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1960064ee0 msgr2=0x7f1960067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1960064ee0 0x7f1960067390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1978001b20 tx=0x7f19780017b0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f197c14a040 msgr2=0x7f197c0b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f197c14a040 0x7f197c0b2500 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f196c011a20 tx=0x7f196c011d30 comp rx=0 tx=0).stop 2023-11-08T12:29:26.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 shutdown_connections 2023-11-08T12:29:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1960064ee0 0x7f1960067390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f197c1ed4d0 0x7f197c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f197c14a040 0x7f197c0b2500 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 --2- 172.21.15.112:0/3254520832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f197c1ed100 0x7f197c1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 >> 172.21.15.112:0/3254520832 conn(0x7f197c0b1200 msgr2=0x7f197c0ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:26.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 shutdown_connections 2023-11-08T12:29:26.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.059+0000 7f19823b4700 1 -- 172.21.15.112:0/3254520832 wait complete. 2023-11-08T12:29:26.068 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:29:26.085 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-11-08T12:29:24.741656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70416,"kb_used_data":4752,"kb_used_omap":0,"kb_used_meta":65600,"kb_avail":754904304,"statfs":{"total":773094113280,"available":773022007296,"internally_reserved":0,"allocated":4866048,"data_stored":2785782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67174400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.438720"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787670+0000","last_change":"2023-11-08T12:29:21.787670+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787670+0000","last_undegraded":"2023-11-08T12:29:21.787670+0000","last_fullsized":"2023-11-08T12:29:21.787670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785634+0000","last_change":"2023-11-08T12:29:21.785634+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785634+0000","last_undegraded":"2023-11-08T12:29:21.785634+0000","last_fullsized":"2023-11-08T12:29:21.785634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:28.967380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802733+0000","last_change":"2023-11-08T12:29:21.802733+0000","last_active":"2023-11-08T12:29:21.802733+0000","last_peered":"2023-11-08T12:29:21.802733+0000","last_clean":"2023-11-08T12:29:21.802733+0000","last_became_active":"2023-11-08T12:29:21.802417+0000","last_became_peered":"2023-11-08T12:29:21.802417+0000","last_unstale":"2023-11-08T12:29:21.802733+0000","last_undegraded":"2023-11-08T12:29:21.802733+0000","last_fullsized":"2023-11-08T12:29:21.802733+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.788302+0000","last_change":"2023-11-08T12:29:21.788302+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.788302+0000","last_undegraded":"2023-11-08T12:29:21.788302+0000","last_fullsized":"2023-11-08T12:29:21.788302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808809+0000","last_change":"2023-11-08T12:29:21.808809+0000","last_active":"2023-11-08T12:29:21.808809+0000","last_peered":"2023-11-08T12:29:21.808809+0000","last_clean":"2023-11-08T12:29:21.808809+0000","last_became_active":"2023-11-08T12:29:21.805982+0000","last_became_peered":"2023-11-08T12:29:21.805982+0000","last_unstale":"2023-11-08T12:29:21.808809+0000","last_undegraded":"2023-11-08T12:29:21.808809+0000","last_fullsized":"2023-11-08T12:29:21.808809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:30:43.794892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.786873+0000","last_change":"2023-11-08T12:29:21.786873+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.786873+0000","last_undegraded":"2023-11-08T12:29:21.786873+0000","last_fullsized":"2023-11-08T12:29:21.786873+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:49:11.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785219+0000","last_change":"2023-11-08T12:29:21.785219+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785219+0000","last_undegraded":"2023-11-08T12:29:21.785219+0000","last_fullsized":"2023-11-08T12:29:21.785219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:31:33.328583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.790498+0000","last_change":"2023-11-08T12:29:21.790498+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.790498+0000","last_undegraded":"2023-11-08T12:29:21.790498+0000","last_fullsized":"2023-11-08T12:29:21.790498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:23.051243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787074+0000","last_change":"2023-11-08T12:29:21.787074+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787074+0000","last_undegraded":"2023-11-08T12:29:21.787074+0000","last_fullsized":"2023-11-08T12:29:21.787074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787774+0000","last_change":"2023-11-08T12:29:21.787774+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787774+0000","last_undegraded":"2023-11-08T12:29:21.787774+0000","last_fullsized":"2023-11-08T12:29:21.787774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:30.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787898+0000","last_change":"2023-11-08T12:29:21.787898+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787898+0000","last_undegraded":"2023-11-08T12:29:21.787898+0000","last_fullsized":"2023-11-08T12:29:21.787898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307643+0000","last_change":"2023-11-08T12:29:20.307643+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307643+0000","last_undegraded":"2023-11-08T12:29:20.307643+0000","last_fullsized":"2023-11-08T12:29:20.307643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800129+0000","last_change":"2023-11-08T12:29:21.795050+0000","last_active":"2023-11-08T12:29:21.800129+0000","last_peered":"2023-11-08T12:29:21.800129+0000","last_clean":"2023-11-08T12:29:21.800129+0000","last_became_active":"2023-11-08T12:29:21.794561+0000","last_became_peered":"2023-11-08T12:29:21.794561+0000","last_unstale":"2023-11-08T12:29:21.800129+0000","last_undegraded":"2023-11-08T12:29:21.800129+0000","last_fullsized":"2023-11-08T12:29:21.800129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:40:42.873851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800543+0000","last_change":"2023-11-08T12:29:21.338664+0000","last_active":"2023-11-08T12:29:21.800543+0000","last_peered":"2023-11-08T12:29:21.800543+0000","last_clean":"2023-11-08T12:29:21.800543+0000","last_became_active":"2023-11-08T12:29:21.338364+0000","last_became_peered":"2023-11-08T12:29:21.338364+0000","last_unstale":"2023-11-08T12:29:21.800543+0000","last_undegraded":"2023-11-08T12:29:21.800543+0000","last_fullsized":"2023-11-08T12:29:21.800543+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:26:46.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310903+0000","last_change":"2023-11-08T12:29:20.310903+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310903+0000","last_undegraded":"2023-11-08T12:29:20.310903+0000","last_fullsized":"2023-11-08T12:29:20.310903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:59.630215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.314747+0000","last_change":"2023-11-08T12:29:20.314747+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.314747+0000","last_undegraded":"2023-11-08T12:29:20.314747+0000","last_fullsized":"2023-11-08T12:29:20.314747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801702+0000","last_change":"2023-11-08T12:29:21.799913+0000","last_active":"2023-11-08T12:29:21.801702+0000","last_peered":"2023-11-08T12:29:21.801702+0000","last_clean":"2023-11-08T12:29:21.801702+0000","last_became_active":"2023-11-08T12:29:21.799604+0000","last_became_peered":"2023-11-08T12:29:21.799604+0000","last_unstale":"2023-11-08T12:29:21.801702+0000","last_undegraded":"2023-11-08T12:29:21.801702+0000","last_fullsized":"2023-11-08T12:29:21.801702+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.308885+0000","last_change":"2023-11-08T12:29:20.308885+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.308885+0000","last_undegraded":"2023-11-08T12:29:20.308885+0000","last_fullsized":"2023-11-08T12:29:20.308885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:21:10.046172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788689+0000","last_change":"2023-11-08T12:29:21.338833+0000","last_active":"2023-11-08T12:29:21.788689+0000","last_peered":"2023-11-08T12:29:21.788689+0000","last_clean":"2023-11-08T12:29:21.788689+0000","last_became_active":"2023-11-08T12:29:21.338621+0000","last_became_peered":"2023-11-08T12:29:21.338621+0000","last_unstale":"2023-11-08T12:29:21.788689+0000","last_undegraded":"2023-11-08T12:29:21.788689+0000","last_fullsized":"2023-11-08T12:29:21.788689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:32.577889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315462+0000","last_change":"2023-11-08T12:29:20.315462+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315462+0000","last_undegraded":"2023-11-08T12:29:20.315462+0000","last_fullsized":"2023-11-08T12:29:20.315462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787005+0000","last_change":"2023-11-08T12:29:21.787005+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787005+0000","last_undegraded":"2023-11-08T12:29:21.787005+0000","last_fullsized":"2023-11-08T12:29:21.787005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:05.769508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.317290+0000","last_change":"2023-11-08T12:29:20.317290+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.317290+0000","last_undegraded":"2023-11-08T12:29:20.317290+0000","last_fullsized":"2023-11-08T12:29:20.317290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800809+0000","last_change":"2023-11-08T12:29:21.800809+0000","last_active":"2023-11-08T12:29:21.800809+0000","last_peered":"2023-11-08T12:29:21.800809+0000","last_clean":"2023-11-08T12:29:21.800809+0000","last_became_active":"2023-11-08T12:29:21.800508+0000","last_became_peered":"2023-11-08T12:29:21.800508+0000","last_unstale":"2023-11-08T12:29:21.800809+0000","last_undegraded":"2023-11-08T12:29:21.800809+0000","last_fullsized":"2023-11-08T12:29:21.800809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789027+0000","last_change":"2023-11-08T12:29:21.336456+0000","last_active":"2023-11-08T12:29:21.789027+0000","last_peered":"2023-11-08T12:29:21.789027+0000","last_clean":"2023-11-08T12:29:21.789027+0000","last_became_active":"2023-11-08T12:29:21.336182+0000","last_became_peered":"2023-11-08T12:29:21.336182+0000","last_unstale":"2023-11-08T12:29:21.789027+0000","last_undegraded":"2023-11-08T12:29:21.789027+0000","last_fullsized":"2023-11-08T12:29:21.789027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315751+0000","last_change":"2023-11-08T12:29:20.315751+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315751+0000","last_undegraded":"2023-11-08T12:29:20.315751+0000","last_fullsized":"2023-11-08T12:29:20.315751+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.311907+0000","last_change":"2023-11-08T12:29:20.311907+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.311907+0000","last_undegraded":"2023-11-08T12:29:20.311907+0000","last_fullsized":"2023-11-08T12:29:20.311907+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:20.287044+0000","last_change":"2023-11-08T12:29:20.287044+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.287044+0000","last_undegraded":"2023-11-08T12:29:20.287044+0000","last_fullsized":"2023-11-08T12:29:20.287044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810358+0000","last_change":"2023-11-08T12:29:21.806201+0000","last_active":"2023-11-08T12:29:21.810358+0000","last_peered":"2023-11-08T12:29:21.810358+0000","last_clean":"2023-11-08T12:29:21.810358+0000","last_became_active":"2023-11-08T12:29:21.805845+0000","last_became_peered":"2023-11-08T12:29:21.805845+0000","last_unstale":"2023-11-08T12:29:21.810358+0000","last_undegraded":"2023-11-08T12:29:21.810358+0000","last_fullsized":"2023-11-08T12:29:21.810358+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:49.547648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.308418+0000","last_change":"2023-11-08T12:29:20.308418+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.308418+0000","last_undegraded":"2023-11-08T12:29:20.308418+0000","last_fullsized":"2023-11-08T12:29:20.308418+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:31:24.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.313856+0000","last_change":"2023-11-08T12:29:20.313856+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.313856+0000","last_undegraded":"2023-11-08T12:29:20.313856+0000","last_fullsized":"2023-11-08T12:29:20.313856+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307370+0000","last_change":"2023-11-08T12:29:20.307370+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307370+0000","last_undegraded":"2023-11-08T12:29:20.307370+0000","last_fullsized":"2023-11-08T12:29:20.307370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.316538+0000","last_change":"2023-11-08T12:29:20.316538+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.316538+0000","last_undegraded":"2023-11-08T12:29:20.316538+0000","last_fullsized":"2023-11-08T12:29:20.316538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:20.287044+0000","last_change":"2023-11-08T12:29:20.287044+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.287044+0000","last_undegraded":"2023-11-08T12:29:20.287044+0000","last_fullsized":"2023-11-08T12:29:20.287044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789243+0000","last_change":"2023-11-08T12:29:21.341006+0000","last_active":"2023-11-08T12:29:21.789243+0000","last_peered":"2023-11-08T12:29:21.789243+0000","last_clean":"2023-11-08T12:29:21.789243+0000","last_became_active":"2023-11-08T12:29:21.340756+0000","last_became_peered":"2023-11-08T12:29:21.340756+0000","last_unstale":"2023-11-08T12:29:21.789243+0000","last_undegraded":"2023-11-08T12:29:21.789243+0000","last_fullsized":"2023-11-08T12:29:21.789243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:57:11.007145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810714+0000","last_change":"2023-11-08T12:29:21.804186+0000","last_active":"2023-11-08T12:29:21.810714+0000","last_peered":"2023-11-08T12:29:21.810714+0000","last_clean":"2023-11-08T12:29:21.810714+0000","last_became_active":"2023-11-08T12:29:21.803904+0000","last_became_peered":"2023-11-08T12:29:21.803904+0000","last_unstale":"2023-11-08T12:29:21.810714+0000","last_undegraded":"2023-11-08T12:29:21.810714+0000","last_fullsized":"2023-11-08T12:29:21.810714+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:35:00.646278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315668+0000","last_change":"2023-11-08T12:29:20.315668+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315668+0000","last_undegraded":"2023-11-08T12:29:20.315668+0000","last_fullsized":"2023-11-08T12:29:20.315668+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787486+0000","last_change":"2023-11-08T12:29:21.787486+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787486+0000","last_undegraded":"2023-11-08T12:29:21.787486+0000","last_fullsized":"2023-11-08T12:29:21.787486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:38.192520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307810+0000","last_change":"2023-11-08T12:29:20.307810+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307810+0000","last_undegraded":"2023-11-08T12:29:20.307810+0000","last_fullsized":"2023-11-08T12:29:20.307810+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307917+0000","last_change":"2023-11-08T12:29:20.307917+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307917+0000","last_undegraded":"2023-11-08T12:29:20.307917+0000","last_fullsized":"2023-11-08T12:29:20.307917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:31:36.137776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315571+0000","last_change":"2023-11-08T12:29:20.315571+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315571+0000","last_undegraded":"2023-11-08T12:29:20.315571+0000","last_fullsized":"2023-11-08T12:29:20.315571+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315120+0000","last_change":"2023-11-08T12:29:20.315120+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315120+0000","last_undegraded":"2023-11-08T12:29:20.315120+0000","last_fullsized":"2023-11-08T12:29:20.315120+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.312393+0000","last_change":"2023-11-08T12:29:20.312393+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.312393+0000","last_undegraded":"2023-11-08T12:29:20.312393+0000","last_fullsized":"2023-11-08T12:29:20.312393+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310356+0000","last_change":"2023-11-08T12:29:20.310356+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310356+0000","last_undegraded":"2023-11-08T12:29:20.310356+0000","last_fullsized":"2023-11-08T12:29:20.310356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.343970+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:29:21.343970+0000","last_peered":"2023-11-08T12:29:21.343970+0000","last_clean":"2023-11-08T12:29:21.343970+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:29:21.343970+0000","last_undegraded":"2023-11-08T12:29:21.343970+0000","last_fullsized":"2023-11-08T12:29:21.343970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788707+0000","last_change":"2023-11-08T12:29:21.342180+0000","last_active":"2023-11-08T12:29:21.788707+0000","last_peered":"2023-11-08T12:29:21.788707+0000","last_clean":"2023-11-08T12:29:21.788707+0000","last_became_active":"2023-11-08T12:29:21.341965+0000","last_became_peered":"2023-11-08T12:29:21.341965+0000","last_unstale":"2023-11-08T12:29:21.788707+0000","last_undegraded":"2023-11-08T12:29:21.788707+0000","last_fullsized":"2023-11-08T12:29:21.788707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:12:59.456980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.620364+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:29:14.620364+0000","last_peered":"2023-11-08T12:29:14.620364+0000","last_clean":"2023-11-08T12:29:14.620364+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:29:14.620364+0000","last_undegraded":"2023-11-08T12:29:14.620364+0000","last_fullsized":"2023-11-08T12:29:14.620364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310549+0000","last_change":"2023-11-08T12:29:20.310549+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310549+0000","last_undegraded":"2023-11-08T12:29:20.310549+0000","last_fullsized":"2023-11-08T12:29:20.310549+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:48.531585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.544005+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:29:14.544005+0000","last_peered":"2023-11-08T12:29:14.544005+0000","last_clean":"2023-11-08T12:29:14.544005+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:29:14.544005+0000","last_undegraded":"2023-11-08T12:29:14.544005+0000","last_fullsized":"2023-11-08T12:29:14.544005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802735+0000","last_change":"2023-11-08T12:29:21.802735+0000","last_active":"2023-11-08T12:29:21.802735+0000","last_peered":"2023-11-08T12:29:21.802735+0000","last_clean":"2023-11-08T12:29:21.802735+0000","last_became_active":"2023-11-08T12:29:21.802154+0000","last_became_peered":"2023-11-08T12:29:21.802154+0000","last_unstale":"2023-11-08T12:29:21.802735+0000","last_undegraded":"2023-11-08T12:29:21.802735+0000","last_fullsized":"2023-11-08T12:29:21.802735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.316116+0000","last_change":"2023-11-08T12:29:20.316116+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.316116+0000","last_undegraded":"2023-11-08T12:29:20.316116+0000","last_fullsized":"2023-11-08T12:29:20.316116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:26.810564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.620150+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:29:14.620150+0000","last_peered":"2023-11-08T12:29:14.620150+0000","last_clean":"2023-11-08T12:29:14.620150+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:29:14.620150+0000","last_undegraded":"2023-11-08T12:29:14.620150+0000","last_fullsized":"2023-11-08T12:29:14.620150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810392+0000","last_change":"2023-11-08T12:29:21.802763+0000","last_active":"2023-11-08T12:29:21.810392+0000","last_peered":"2023-11-08T12:29:21.810392+0000","last_clean":"2023-11-08T12:29:21.810392+0000","last_became_active":"2023-11-08T12:29:21.802445+0000","last_became_peered":"2023-11-08T12:29:21.802445+0000","last_unstale":"2023-11-08T12:29:21.810392+0000","last_undegraded":"2023-11-08T12:29:21.810392+0000","last_fullsized":"2023-11-08T12:29:21.810392+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:58:00.614714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.308179+0000","last_change":"2023-11-08T12:29:20.308179+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.308179+0000","last_undegraded":"2023-11-08T12:29:20.308179+0000","last_fullsized":"2023-11-08T12:29:20.308179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:52:07.194386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.578021+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:29:14.578021+0000","last_peered":"2023-11-08T12:29:14.578021+0000","last_clean":"2023-11-08T12:29:14.578021+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:29:14.578021+0000","last_undegraded":"2023-11-08T12:29:14.578021+0000","last_fullsized":"2023-11-08T12:29:14.578021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310755+0000","last_change":"2023-11-08T12:29:20.310755+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310755+0000","last_undegraded":"2023-11-08T12:29:20.310755+0000","last_fullsized":"2023-11-08T12:29:20.310755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T12:29:13.538940+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:29:13.538940+0000","last_peered":"2023-11-08T12:29:13.538940+0000","last_clean":"2023-11-08T12:29:13.538940+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:29:13.538940+0000","last_undegraded":"2023-11-08T12:29:13.538940+0000","last_fullsized":"2023-11-08T12:29:13.538940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310527+0000","last_change":"2023-11-08T12:29:20.310527+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310527+0000","last_undegraded":"2023-11-08T12:29:20.310527+0000","last_fullsized":"2023-11-08T12:29:20.310527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:57:59.598650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.544163+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:29:14.544163+0000","last_peered":"2023-11-08T12:29:14.544163+0000","last_clean":"2023-11-08T12:29:14.544163+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:29:14.544163+0000","last_undegraded":"2023-11-08T12:29:14.544163+0000","last_fullsized":"2023-11-08T12:29:14.544163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.316279+0000","last_change":"2023-11-08T12:29:20.316279+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.316279+0000","last_undegraded":"2023-11-08T12:29:20.316279+0000","last_fullsized":"2023-11-08T12:29:20.316279+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.578064+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:29:14.578064+0000","last_peered":"2023-11-08T12:29:14.578064+0000","last_clean":"2023-11-08T12:29:14.578064+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:29:14.578064+0000","last_undegraded":"2023-11-08T12:29:14.578064+0000","last_fullsized":"2023-11-08T12:29:14.578064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.544041+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:29:14.544041+0000","last_peered":"2023-11-08T12:29:14.544041+0000","last_clean":"2023-11-08T12:29:14.544041+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:29:14.544041+0000","last_undegraded":"2023-11-08T12:29:14.544041+0000","last_fullsized":"2023-11-08T12:29:14.544041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":60,"acting":60,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476760,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":462848,"data_stored":202197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":7.4889999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":4.1799999999999997}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":4.0300000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.851}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":3.9569999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":5.601},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":3.9119999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.8819999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":4.0720000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.8080000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.69599999999999995}]}]},{"osd":4,"up_from":16,"seq":68719476760,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8728,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363112,"statfs":{"total":96636764160,"available":96627826688,"internally_reserved":0,"allocated":475136,"data_stored":209137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.4139999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.143},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.85399999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":1.546}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.089}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.3}]},{"osd":6,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.53},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.621}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.569},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3720000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9680,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362160,"statfs":{"total":96636764160,"available":96626851840,"internally_reserved":0,"allocated":1056768,"data_stored":792565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.95099999999999996}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.089}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.028},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1779999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.2889999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.415},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.321},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.3520000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.21}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8448,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363392,"statfs":{"total":96636764160,"available":96628113408,"internally_reserved":0,"allocated":450560,"data_stored":195707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":0.78900000000000003},{"interface":"front","average":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":21.238,"5min":21.238,"15min":21.238},"last":0.91500000000000004}]},{"osd":1,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":8.0630000000000006,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.296}]},{"osd":2,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":1.139},{"interface":"front","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":11.907,"5min":11.907,"15min":11.907},"last":1.0980000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.196}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.238},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.3480000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.403},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.3660000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":8.109,"5min":8.109,"15min":8.109},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.496}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8576,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363264,"statfs":{"total":96636764160,"available":96627982336,"internally_reserved":0,"allocated":450560,"data_stored":195707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.76400000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.438}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.335}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.107},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.1639999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":462848,"data_stored":202197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.879},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0109999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.81799999999999995}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.087}]},{"osd":4,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.365},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.2},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.8679999999999999,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.413}]},{"osd":6,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.29},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.542}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.7240000000000002,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":1.206,"5min":1.206,"15min":1.206},"max":{"1min":2.8599999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.4670000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9616,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362224,"statfs":{"total":96636764160,"available":96626917376,"internally_reserved":0,"allocated":1056768,"data_stored":792565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.54,"5min":6.54,"15min":6.54},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":6.6760000000000002,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":0.80300000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":6.5579999999999998,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.0409999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.0169999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.27}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"min":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.099}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.1080000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":450560,"data_stored":195707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.98499999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.96399999999999997}]},{"osd":4,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.224},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.48}]},{"osd":5,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.879},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.3009999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.121}]},{"osd":7,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.409},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:29:26.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:29:26.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.307+0000 7f5c0759e700 1 Processor -- start 2023-11-08T12:29:26.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.307+0000 7f5c0759e700 1 -- start start 2023-11-08T12:29:26.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.307+0000 7f5c0759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.307+0000 7f5c0759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c08069e00 0x7f5c0806a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.307+0000 7f5c0759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0806c600 con 0x7f5c08071aa0 2023-11-08T12:29:26.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.307+0000 7f5c0759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0806cef0 con 0x7f5c08069e00 2023-11-08T12:29:26.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.307+0000 7f5c0759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0806a7c0 con 0x7f5c0815c640 2023-11-08T12:29:26.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5bfdd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5c08071aa0 0x7f5c0806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59014/0 (socket says 172.21.15.112:59014) 2023-11-08T12:29:26.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5bfdd9b700 1 -- 172.21.15.112:0/1647446567 learned_addr learned my addr 172.21.15.112:0/1647446567 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:26.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0659c700 1 --2- 172.21.15.112:0/1647446567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c06d9d700 1 --2- 172.21.15.112:0/1647446567 >> v2:172.21.15.133:3300/0 conn(0x7f5c08069e00 0x7f5c0806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c05d9b700 1 -- 172.21.15.112:0/1647446567 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784908710 0 0) 0x7f5c0806c600 con 0x7f5c08071aa0 2023-11-08T12:29:26.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c05d9b700 1 -- 172.21.15.112:0/1647446567 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf40035d0 con 0x7f5c08071aa0 2023-11-08T12:29:26.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0659c700 1 -- 172.21.15.112:0/1647446567 >> v2:172.21.15.133:3300/0 conn(0x7f5c08069e00 msgr2=0x7f5c0806a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:26.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0659c700 1 --2- 172.21.15.112:0/1647446567 >> v2:172.21.15.133:3300/0 conn(0x7f5c08069e00 0x7f5c0806a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0659c700 1 -- 172.21.15.112:0/1647446567 >> v1:172.21.15.112:6789/0 conn(0x7f5c08071aa0 legacy=0x7f5c0806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0659c700 1 -- 172.21.15.112:0/1647446567 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c080722f0 con 0x7f5c0815c640 2023-11-08T12:29:26.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c06d9d700 1 --2- 172.21.15.112:0/1647446567 >> v2:172.21.15.133:3300/0 conn(0x7f5c08069e00 0x7f5c0806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:26.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0659c700 1 --2- 172.21.15.112:0/1647446567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080d31e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009850 tx=0x7f5bf8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca27b898c30c9ec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:26.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c05d9b700 1 -- 172.21.15.112:0/1647446567 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8011830 con 0x7f5c0815c640 2023-11-08T12:29:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c05d9b700 1 -- 172.21.15.112:0/1647446567 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf8011990 con 0x7f5c0815c640 2023-11-08T12:29:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c05d9b700 1 -- 172.21.15.112:0/1647446567 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8011d40 con 0x7f5c0815c640 2023-11-08T12:29:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 -- 172.21.15.112:0/1647446567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 msgr2=0x7f5c080d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 --2- 172.21.15.112:0/1647446567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080d31e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009850 tx=0x7f5bf8009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 -- 172.21.15.112:0/1647446567 shutdown_connections 2023-11-08T12:29:26.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 --2- 172.21.15.112:0/1647446567 >> v2:172.21.15.133:3300/0 conn(0x7f5c08069e00 0x7f5c0806a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 --2- 172.21.15.112:0/1647446567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080d31e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 -- 172.21.15.112:0/1647446567 >> 172.21.15.112:0/1647446567 conn(0x7f5c080b6520 msgr2=0x7f5c08071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:26.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 -- 172.21.15.112:0/1647446567 shutdown_connections 2023-11-08T12:29:26.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.311+0000 7f5c0759e700 1 -- 172.21.15.112:0/1647446567 wait complete. 2023-11-08T12:29:26.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 Processor -- start 2023-11-08T12:29:26.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 -- start start 2023-11-08T12:29:26.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08069e00 0x7f5c081595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c08071aa0 0x7f5c080b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080b3570 con 0x7f5c08069e00 2023-11-08T12:29:26.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080b3a00 con 0x7f5c08071aa0 2023-11-08T12:29:26.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.315+0000 7f5c0759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080b5310 con 0x7f5c0815c640 2023-11-08T12:29:26.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08069e00 0x7f5c081595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08069e00 0x7f5c081595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47270/0 (socket says 172.21.15.112:47270) 2023-11-08T12:29:26.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 -- 172.21.15.112:0/4202796810 learned_addr learned my addr 172.21.15.112:0/4202796810 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:26.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 -- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 msgr2=0x7f5c080cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5bfdd9b700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c08071aa0 0x7f5c080b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 -- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c08071aa0 msgr2=0x7f5c080b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c08071aa0 0x7f5c080b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 -- 172.21.15.112:0/4202796810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00009a70 con 0x7f5c08069e00 2023-11-08T12:29:26.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5bfdd9b700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c08071aa0 0x7f5c080b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:26.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0659c700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08069e00 0x7f5c081595a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80090b0 tx=0x7f5bf8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:26.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5bff7fe700 1 -- 172.21.15.112:0/4202796810 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8004520 con 0x7f5c08069e00 2023-11-08T12:29:26.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5bff7fe700 1 -- 172.21.15.112:0/4202796810 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf801f070 con 0x7f5c08069e00 2023-11-08T12:29:26.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5bff7fe700 1 -- 172.21.15.112:0/4202796810 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8003900 con 0x7f5c08069e00 2023-11-08T12:29:26.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf80094b0 con 0x7f5c08069e00 2023-11-08T12:29:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0815ca10 con 0x7f5c08069e00 2023-11-08T12:29:26.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.319+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0806da20 con 0x7f5c08069e00 2023-11-08T12:29:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.323+0000 7f5bff7fe700 1 -- 172.21.15.112:0/4202796810 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5bf800f050 con 0x7f5c08069e00 2023-11-08T12:29:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.323+0000 7f5bff7fe700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5be8064ee0 0x7f5be8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.323+0000 7f5bff7fe700 1 -- 172.21.15.112:0/4202796810 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5bf8021070 con 0x7f5c08069e00 2023-11-08T12:29:26.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.323+0000 7f5bfdd9b700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5be8064ee0 0x7f5be8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.323+0000 7f5bfdd9b700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5be8064ee0 0x7f5be8067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c080a08d0 tx=0x7f5bf0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:26.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.327+0000 7f5bff7fe700 1 -- 172.21.15.112:0/4202796810 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5bf8051570 con 0x7f5c08069e00 2023-11-08T12:29:26.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.495+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c080b36b0 con 0x7f5be8064ee0 2023-11-08T12:29:26.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.507+0000 7f5bff7fe700 1 -- 172.21.15.112:0/4202796810 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300165 (secure 0 0 0) 0x7f5bf0005940 con 0x7f5be8064ee0 2023-11-08T12:29:26.517 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5be8064ee0 msgr2=0x7f5be8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5be8064ee0 0x7f5be8067390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c080a08d0 tx=0x7f5bf0009040 comp rx=0 tx=0).stop 2023-11-08T12:29:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08069e00 msgr2=0x7f5c081595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08069e00 0x7f5c081595a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80090b0 tx=0x7f5bf8004770 comp rx=0 tx=0).stop 2023-11-08T12:29:26.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 shutdown_connections 2023-11-08T12:29:26.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5be8064ee0 0x7f5be8067390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0815c640 0x7f5c080cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c08071aa0 0x7f5c080b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 --2- 172.21.15.112:0/4202796810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c08069e00 0x7f5c081595a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 >> 172.21.15.112:0/4202796810 conn(0x7f5c080b6520 msgr2=0x7f5c080b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 shutdown_connections 2023-11-08T12:29:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.519+0000 7f5c0759e700 1 -- 172.21.15.112:0/4202796810 wait complete. 2023-11-08T12:29:26.524 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:29:26.545 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-11-08T12:29:24.741656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70416,"kb_used_data":4752,"kb_used_omap":0,"kb_used_meta":65600,"kb_avail":754904304,"statfs":{"total":773094113280,"available":773022007296,"internally_reserved":0,"allocated":4866048,"data_stored":2785782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67174400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.438720"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787670+0000","last_change":"2023-11-08T12:29:21.787670+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787670+0000","last_undegraded":"2023-11-08T12:29:21.787670+0000","last_fullsized":"2023-11-08T12:29:21.787670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785634+0000","last_change":"2023-11-08T12:29:21.785634+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785634+0000","last_undegraded":"2023-11-08T12:29:21.785634+0000","last_fullsized":"2023-11-08T12:29:21.785634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:28.967380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802733+0000","last_change":"2023-11-08T12:29:21.802733+0000","last_active":"2023-11-08T12:29:21.802733+0000","last_peered":"2023-11-08T12:29:21.802733+0000","last_clean":"2023-11-08T12:29:21.802733+0000","last_became_active":"2023-11-08T12:29:21.802417+0000","last_became_peered":"2023-11-08T12:29:21.802417+0000","last_unstale":"2023-11-08T12:29:21.802733+0000","last_undegraded":"2023-11-08T12:29:21.802733+0000","last_fullsized":"2023-11-08T12:29:21.802733+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.788302+0000","last_change":"2023-11-08T12:29:21.788302+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.788302+0000","last_undegraded":"2023-11-08T12:29:21.788302+0000","last_fullsized":"2023-11-08T12:29:21.788302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808809+0000","last_change":"2023-11-08T12:29:21.808809+0000","last_active":"2023-11-08T12:29:21.808809+0000","last_peered":"2023-11-08T12:29:21.808809+0000","last_clean":"2023-11-08T12:29:21.808809+0000","last_became_active":"2023-11-08T12:29:21.805982+0000","last_became_peered":"2023-11-08T12:29:21.805982+0000","last_unstale":"2023-11-08T12:29:21.808809+0000","last_undegraded":"2023-11-08T12:29:21.808809+0000","last_fullsized":"2023-11-08T12:29:21.808809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:30:43.794892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.786873+0000","last_change":"2023-11-08T12:29:21.786873+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.786873+0000","last_undegraded":"2023-11-08T12:29:21.786873+0000","last_fullsized":"2023-11-08T12:29:21.786873+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:49:11.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785219+0000","last_change":"2023-11-08T12:29:21.785219+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785219+0000","last_undegraded":"2023-11-08T12:29:21.785219+0000","last_fullsized":"2023-11-08T12:29:21.785219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:31:33.328583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.790498+0000","last_change":"2023-11-08T12:29:21.790498+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.790498+0000","last_undegraded":"2023-11-08T12:29:21.790498+0000","last_fullsized":"2023-11-08T12:29:21.790498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:23.051243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787074+0000","last_change":"2023-11-08T12:29:21.787074+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787074+0000","last_undegraded":"2023-11-08T12:29:21.787074+0000","last_fullsized":"2023-11-08T12:29:21.787074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787774+0000","last_change":"2023-11-08T12:29:21.787774+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787774+0000","last_undegraded":"2023-11-08T12:29:21.787774+0000","last_fullsized":"2023-11-08T12:29:21.787774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:30.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787898+0000","last_change":"2023-11-08T12:29:21.787898+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787898+0000","last_undegraded":"2023-11-08T12:29:21.787898+0000","last_fullsized":"2023-11-08T12:29:21.787898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307643+0000","last_change":"2023-11-08T12:29:20.307643+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307643+0000","last_undegraded":"2023-11-08T12:29:20.307643+0000","last_fullsized":"2023-11-08T12:29:20.307643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800129+0000","last_change":"2023-11-08T12:29:21.795050+0000","last_active":"2023-11-08T12:29:21.800129+0000","last_peered":"2023-11-08T12:29:21.800129+0000","last_clean":"2023-11-08T12:29:21.800129+0000","last_became_active":"2023-11-08T12:29:21.794561+0000","last_became_peered":"2023-11-08T12:29:21.794561+0000","last_unstale":"2023-11-08T12:29:21.800129+0000","last_undegraded":"2023-11-08T12:29:21.800129+0000","last_fullsized":"2023-11-08T12:29:21.800129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:40:42.873851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800543+0000","last_change":"2023-11-08T12:29:21.338664+0000","last_active":"2023-11-08T12:29:21.800543+0000","last_peered":"2023-11-08T12:29:21.800543+0000","last_clean":"2023-11-08T12:29:21.800543+0000","last_became_active":"2023-11-08T12:29:21.338364+0000","last_became_peered":"2023-11-08T12:29:21.338364+0000","last_unstale":"2023-11-08T12:29:21.800543+0000","last_undegraded":"2023-11-08T12:29:21.800543+0000","last_fullsized":"2023-11-08T12:29:21.800543+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:26:46.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310903+0000","last_change":"2023-11-08T12:29:20.310903+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310903+0000","last_undegraded":"2023-11-08T12:29:20.310903+0000","last_fullsized":"2023-11-08T12:29:20.310903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:59.630215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.314747+0000","last_change":"2023-11-08T12:29:20.314747+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.314747+0000","last_undegraded":"2023-11-08T12:29:20.314747+0000","last_fullsized":"2023-11-08T12:29:20.314747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801702+0000","last_change":"2023-11-08T12:29:21.799913+0000","last_active":"2023-11-08T12:29:21.801702+0000","last_peered":"2023-11-08T12:29:21.801702+0000","last_clean":"2023-11-08T12:29:21.801702+0000","last_became_active":"2023-11-08T12:29:21.799604+0000","last_became_peered":"2023-11-08T12:29:21.799604+0000","last_unstale":"2023-11-08T12:29:21.801702+0000","last_undegraded":"2023-11-08T12:29:21.801702+0000","last_fullsized":"2023-11-08T12:29:21.801702+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.308885+0000","last_change":"2023-11-08T12:29:20.308885+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.308885+0000","last_undegraded":"2023-11-08T12:29:20.308885+0000","last_fullsized":"2023-11-08T12:29:20.308885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:21:10.046172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788689+0000","last_change":"2023-11-08T12:29:21.338833+0000","last_active":"2023-11-08T12:29:21.788689+0000","last_peered":"2023-11-08T12:29:21.788689+0000","last_clean":"2023-11-08T12:29:21.788689+0000","last_became_active":"2023-11-08T12:29:21.338621+0000","last_became_peered":"2023-11-08T12:29:21.338621+0000","last_unstale":"2023-11-08T12:29:21.788689+0000","last_undegraded":"2023-11-08T12:29:21.788689+0000","last_fullsized":"2023-11-08T12:29:21.788689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:32.577889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315462+0000","last_change":"2023-11-08T12:29:20.315462+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315462+0000","last_undegraded":"2023-11-08T12:29:20.315462+0000","last_fullsized":"2023-11-08T12:29:20.315462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787005+0000","last_change":"2023-11-08T12:29:21.787005+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787005+0000","last_undegraded":"2023-11-08T12:29:21.787005+0000","last_fullsized":"2023-11-08T12:29:21.787005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:05.769508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.317290+0000","last_change":"2023-11-08T12:29:20.317290+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.317290+0000","last_undegraded":"2023-11-08T12:29:20.317290+0000","last_fullsized":"2023-11-08T12:29:20.317290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800809+0000","last_change":"2023-11-08T12:29:21.800809+0000","last_active":"2023-11-08T12:29:21.800809+0000","last_peered":"2023-11-08T12:29:21.800809+0000","last_clean":"2023-11-08T12:29:21.800809+0000","last_became_active":"2023-11-08T12:29:21.800508+0000","last_became_peered":"2023-11-08T12:29:21.800508+0000","last_unstale":"2023-11-08T12:29:21.800809+0000","last_undegraded":"2023-11-08T12:29:21.800809+0000","last_fullsized":"2023-11-08T12:29:21.800809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789027+0000","last_change":"2023-11-08T12:29:21.336456+0000","last_active":"2023-11-08T12:29:21.789027+0000","last_peered":"2023-11-08T12:29:21.789027+0000","last_clean":"2023-11-08T12:29:21.789027+0000","last_became_active":"2023-11-08T12:29:21.336182+0000","last_became_peered":"2023-11-08T12:29:21.336182+0000","last_unstale":"2023-11-08T12:29:21.789027+0000","last_undegraded":"2023-11-08T12:29:21.789027+0000","last_fullsized":"2023-11-08T12:29:21.789027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315751+0000","last_change":"2023-11-08T12:29:20.315751+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315751+0000","last_undegraded":"2023-11-08T12:29:20.315751+0000","last_fullsized":"2023-11-08T12:29:20.315751+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.311907+0000","last_change":"2023-11-08T12:29:20.311907+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.311907+0000","last_undegraded":"2023-11-08T12:29:20.311907+0000","last_fullsized":"2023-11-08T12:29:20.311907+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:20.287044+0000","last_change":"2023-11-08T12:29:20.287044+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.287044+0000","last_undegraded":"2023-11-08T12:29:20.287044+0000","last_fullsized":"2023-11-08T12:29:20.287044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810358+0000","last_change":"2023-11-08T12:29:21.806201+0000","last_active":"2023-11-08T12:29:21.810358+0000","last_peered":"2023-11-08T12:29:21.810358+0000","last_clean":"2023-11-08T12:29:21.810358+0000","last_became_active":"2023-11-08T12:29:21.805845+0000","last_became_peered":"2023-11-08T12:29:21.805845+0000","last_unstale":"2023-11-08T12:29:21.810358+0000","last_undegraded":"2023-11-08T12:29:21.810358+0000","last_fullsized":"2023-11-08T12:29:21.810358+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:49.547648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.308418+0000","last_change":"2023-11-08T12:29:20.308418+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.308418+0000","last_undegraded":"2023-11-08T12:29:20.308418+0000","last_fullsized":"2023-11-08T12:29:20.308418+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:31:24.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.313856+0000","last_change":"2023-11-08T12:29:20.313856+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.313856+0000","last_undegraded":"2023-11-08T12:29:20.313856+0000","last_fullsized":"2023-11-08T12:29:20.313856+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307370+0000","last_change":"2023-11-08T12:29:20.307370+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307370+0000","last_undegraded":"2023-11-08T12:29:20.307370+0000","last_fullsized":"2023-11-08T12:29:20.307370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.316538+0000","last_change":"2023-11-08T12:29:20.316538+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.316538+0000","last_undegraded":"2023-11-08T12:29:20.316538+0000","last_fullsized":"2023-11-08T12:29:20.316538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:20.287044+0000","last_change":"2023-11-08T12:29:20.287044+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.287044+0000","last_undegraded":"2023-11-08T12:29:20.287044+0000","last_fullsized":"2023-11-08T12:29:20.287044+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789243+0000","last_change":"2023-11-08T12:29:21.341006+0000","last_active":"2023-11-08T12:29:21.789243+0000","last_peered":"2023-11-08T12:29:21.789243+0000","last_clean":"2023-11-08T12:29:21.789243+0000","last_became_active":"2023-11-08T12:29:21.340756+0000","last_became_peered":"2023-11-08T12:29:21.340756+0000","last_unstale":"2023-11-08T12:29:21.789243+0000","last_undegraded":"2023-11-08T12:29:21.789243+0000","last_fullsized":"2023-11-08T12:29:21.789243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:57:11.007145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810714+0000","last_change":"2023-11-08T12:29:21.804186+0000","last_active":"2023-11-08T12:29:21.810714+0000","last_peered":"2023-11-08T12:29:21.810714+0000","last_clean":"2023-11-08T12:29:21.810714+0000","last_became_active":"2023-11-08T12:29:21.803904+0000","last_became_peered":"2023-11-08T12:29:21.803904+0000","last_unstale":"2023-11-08T12:29:21.810714+0000","last_undegraded":"2023-11-08T12:29:21.810714+0000","last_fullsized":"2023-11-08T12:29:21.810714+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:35:00.646278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315668+0000","last_change":"2023-11-08T12:29:20.315668+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315668+0000","last_undegraded":"2023-11-08T12:29:20.315668+0000","last_fullsized":"2023-11-08T12:29:20.315668+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787486+0000","last_change":"2023-11-08T12:29:21.787486+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787486+0000","last_undegraded":"2023-11-08T12:29:21.787486+0000","last_fullsized":"2023-11-08T12:29:21.787486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:38.192520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307810+0000","last_change":"2023-11-08T12:29:20.307810+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307810+0000","last_undegraded":"2023-11-08T12:29:20.307810+0000","last_fullsized":"2023-11-08T12:29:20.307810+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.307917+0000","last_change":"2023-11-08T12:29:20.307917+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.307917+0000","last_undegraded":"2023-11-08T12:29:20.307917+0000","last_fullsized":"2023-11-08T12:29:20.307917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:31:36.137776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315571+0000","last_change":"2023-11-08T12:29:20.315571+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315571+0000","last_undegraded":"2023-11-08T12:29:20.315571+0000","last_fullsized":"2023-11-08T12:29:20.315571+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.315120+0000","last_change":"2023-11-08T12:29:20.315120+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.315120+0000","last_undegraded":"2023-11-08T12:29:20.315120+0000","last_fullsized":"2023-11-08T12:29:20.315120+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.312393+0000","last_change":"2023-11-08T12:29:20.312393+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.312393+0000","last_undegraded":"2023-11-08T12:29:20.312393+0000","last_fullsized":"2023-11-08T12:29:20.312393+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310356+0000","last_change":"2023-11-08T12:29:20.310356+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310356+0000","last_undegraded":"2023-11-08T12:29:20.310356+0000","last_fullsized":"2023-11-08T12:29:20.310356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.343970+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:29:21.343970+0000","last_peered":"2023-11-08T12:29:21.343970+0000","last_clean":"2023-11-08T12:29:21.343970+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:29:21.343970+0000","last_undegraded":"2023-11-08T12:29:21.343970+0000","last_fullsized":"2023-11-08T12:29:21.343970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788707+0000","last_change":"2023-11-08T12:29:21.342180+0000","last_active":"2023-11-08T12:29:21.788707+0000","last_peered":"2023-11-08T12:29:21.788707+0000","last_clean":"2023-11-08T12:29:21.788707+0000","last_became_active":"2023-11-08T12:29:21.341965+0000","last_became_peered":"2023-11-08T12:29:21.341965+0000","last_unstale":"2023-11-08T12:29:21.788707+0000","last_undegraded":"2023-11-08T12:29:21.788707+0000","last_fullsized":"2023-11-08T12:29:21.788707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:12:59.456980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.620364+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:29:14.620364+0000","last_peered":"2023-11-08T12:29:14.620364+0000","last_clean":"2023-11-08T12:29:14.620364+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:29:14.620364+0000","last_undegraded":"2023-11-08T12:29:14.620364+0000","last_fullsized":"2023-11-08T12:29:14.620364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310549+0000","last_change":"2023-11-08T12:29:20.310549+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310549+0000","last_undegraded":"2023-11-08T12:29:20.310549+0000","last_fullsized":"2023-11-08T12:29:20.310549+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:48.531585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.544005+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:29:14.544005+0000","last_peered":"2023-11-08T12:29:14.544005+0000","last_clean":"2023-11-08T12:29:14.544005+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:29:14.544005+0000","last_undegraded":"2023-11-08T12:29:14.544005+0000","last_fullsized":"2023-11-08T12:29:14.544005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802735+0000","last_change":"2023-11-08T12:29:21.802735+0000","last_active":"2023-11-08T12:29:21.802735+0000","last_peered":"2023-11-08T12:29:21.802735+0000","last_clean":"2023-11-08T12:29:21.802735+0000","last_became_active":"2023-11-08T12:29:21.802154+0000","last_became_peered":"2023-11-08T12:29:21.802154+0000","last_unstale":"2023-11-08T12:29:21.802735+0000","last_undegraded":"2023-11-08T12:29:21.802735+0000","last_fullsized":"2023-11-08T12:29:21.802735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.316116+0000","last_change":"2023-11-08T12:29:20.316116+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.316116+0000","last_undegraded":"2023-11-08T12:29:20.316116+0000","last_fullsized":"2023-11-08T12:29:20.316116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:26.810564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.620150+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:29:14.620150+0000","last_peered":"2023-11-08T12:29:14.620150+0000","last_clean":"2023-11-08T12:29:14.620150+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:29:14.620150+0000","last_undegraded":"2023-11-08T12:29:14.620150+0000","last_fullsized":"2023-11-08T12:29:14.620150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810392+0000","last_change":"2023-11-08T12:29:21.802763+0000","last_active":"2023-11-08T12:29:21.810392+0000","last_peered":"2023-11-08T12:29:21.810392+0000","last_clean":"2023-11-08T12:29:21.810392+0000","last_became_active":"2023-11-08T12:29:21.802445+0000","last_became_peered":"2023-11-08T12:29:21.802445+0000","last_unstale":"2023-11-08T12:29:21.810392+0000","last_undegraded":"2023-11-08T12:29:21.810392+0000","last_fullsized":"2023-11-08T12:29:21.810392+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:58:00.614714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.308179+0000","last_change":"2023-11-08T12:29:20.308179+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.308179+0000","last_undegraded":"2023-11-08T12:29:20.308179+0000","last_fullsized":"2023-11-08T12:29:20.308179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:52:07.194386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.578021+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:29:14.578021+0000","last_peered":"2023-11-08T12:29:14.578021+0000","last_clean":"2023-11-08T12:29:14.578021+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:29:14.578021+0000","last_undegraded":"2023-11-08T12:29:14.578021+0000","last_fullsized":"2023-11-08T12:29:14.578021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310755+0000","last_change":"2023-11-08T12:29:20.310755+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310755+0000","last_undegraded":"2023-11-08T12:29:20.310755+0000","last_fullsized":"2023-11-08T12:29:20.310755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-08T12:29:13.538940+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:29:13.538940+0000","last_peered":"2023-11-08T12:29:13.538940+0000","last_clean":"2023-11-08T12:29:13.538940+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:29:13.538940+0000","last_undegraded":"2023-11-08T12:29:13.538940+0000","last_fullsized":"2023-11-08T12:29:13.538940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.310527+0000","last_change":"2023-11-08T12:29:20.310527+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.310527+0000","last_undegraded":"2023-11-08T12:29:20.310527+0000","last_fullsized":"2023-11-08T12:29:20.310527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:57:59.598650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.544163+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:29:14.544163+0000","last_peered":"2023-11-08T12:29:14.544163+0000","last_clean":"2023-11-08T12:29:14.544163+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:29:14.544163+0000","last_undegraded":"2023-11-08T12:29:14.544163+0000","last_fullsized":"2023-11-08T12:29:14.544163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:29:21.303108+0000","last_change":"2023-11-08T12:29:21.303108+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.303108+0000","last_undegraded":"2023-11-08T12:29:21.303108+0000","last_fullsized":"2023-11-08T12:29:21.303108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2023-11-08T12:29:20.316279+0000","last_change":"2023-11-08T12:29:20.316279+0000","last_active":"2023-11-08T12:29:20.287044+0000","last_peered":"2023-11-08T12:29:20.287044+0000","last_clean":"2023-11-08T12:29:20.287044+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:20.316279+0000","last_undegraded":"2023-11-08T12:29:20.316279+0000","last_fullsized":"2023-11-08T12:29:20.316279+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.578064+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:29:14.578064+0000","last_peered":"2023-11-08T12:29:14.578064+0000","last_clean":"2023-11-08T12:29:14.578064+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:29:14.578064+0000","last_undegraded":"2023-11-08T12:29:14.578064+0000","last_fullsized":"2023-11-08T12:29:14.578064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-08T12:29:14.544041+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:29:14.544041+0000","last_peered":"2023-11-08T12:29:14.544041+0000","last_clean":"2023-11-08T12:29:14.544041+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:29:14.544041+0000","last_undegraded":"2023-11-08T12:29:14.544041+0000","last_fullsized":"2023-11-08T12:29:14.544041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":60,"acting":60,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476760,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":462848,"data_stored":202197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":7.4889999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":4.1799999999999997}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":4.0300000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.851}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":3.9569999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":5.601},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":3.9119999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.8819999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":4.0720000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.8080000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.69599999999999995}]}]},{"osd":4,"up_from":16,"seq":68719476760,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8728,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363112,"statfs":{"total":96636764160,"available":96627826688,"internally_reserved":0,"allocated":475136,"data_stored":209137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.4139999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.143},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.85399999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":1.546}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.089}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.3}]},{"osd":6,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.53},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.621}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.569},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3720000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9680,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362160,"statfs":{"total":96636764160,"available":96626851840,"internally_reserved":0,"allocated":1056768,"data_stored":792565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.95099999999999996}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.089}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.028},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1779999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.2889999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.415},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.321},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.3520000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.21}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8448,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363392,"statfs":{"total":96636764160,"available":96628113408,"internally_reserved":0,"allocated":450560,"data_stored":195707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":0.78900000000000003},{"interface":"front","average":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":21.238,"5min":21.238,"15min":21.238},"last":0.91500000000000004}]},{"osd":1,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":8.0630000000000006,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.296}]},{"osd":2,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":1.139},{"interface":"front","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":11.907,"5min":11.907,"15min":11.907},"last":1.0980000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.196}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.238},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.3480000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.403},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.3660000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":8.109,"5min":8.109,"15min":8.109},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.496}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8576,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363264,"statfs":{"total":96636764160,"available":96627982336,"internally_reserved":0,"allocated":450560,"data_stored":195707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.76400000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.438}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.335}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.107},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.1639999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":462848,"data_stored":202197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.879},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0109999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.81799999999999995}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.087}]},{"osd":4,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.365},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1319999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.2},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.8679999999999999,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.413}]},{"osd":6,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.29},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.542}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.7240000000000002,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":1.206,"5min":1.206,"15min":1.206},"max":{"1min":2.8599999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.4670000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9616,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362224,"statfs":{"total":96636764160,"available":96626917376,"internally_reserved":0,"allocated":1056768,"data_stored":792565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.54,"5min":6.54,"15min":6.54},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":6.6760000000000002,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":0.80300000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":6.5579999999999998,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.0409999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.0169999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.27}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"min":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.099}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.1080000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":450560,"data_stored":195707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.98499999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.96399999999999997}]},{"osd":4,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.224},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.48}]},{"osd":5,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.879},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.3009999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.121}]},{"osd":7,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.409},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:29:26.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:29:26.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.763+0000 7fbb89220700 1 Processor -- start 2023-11-08T12:29:26.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.763+0000 7fbb89220700 1 -- start start 2023-11-08T12:29:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.763+0000 7fbb89220700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb8415c640 0x7fbb840d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.763+0000 7fbb89220700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.763+0000 7fbb89220700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8406c600 con 0x7fbb84069e00 2023-11-08T12:29:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.763+0000 7fbb89220700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8406cef0 con 0x7fbb8415c640 2023-11-08T12:29:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.763+0000 7fbb89220700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840722f0 con 0x7fbb84071aa0 2023-11-08T12:29:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb8415c640 0x7fbb840d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb7bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb8415c640 0x7fbb840d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:52196/0 (socket says 172.21.15.112:52196) 2023-11-08T12:29:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 -- 172.21.15.112:0/2221199221 learned_addr learned my addr 172.21.15.112:0/2221199221 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb88a1f700 1 --1- 172.21.15.112:0/2221199221 >> v1:172.21.15.133:6789/0 conn(0x7fbb84069e00 0x7fbb840d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:55108/0 (socket says 172.21.15.112:55108) 2023-11-08T12:29:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 -- 172.21.15.112:0/2221199221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 msgr2=0x7fbb8406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 --2- 172.21.15.112:0/2221199221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 -- 172.21.15.112:0/2221199221 >> v1:172.21.15.133:6789/0 conn(0x7fbb84069e00 legacy=0x7fbb840d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 -- 172.21.15.112:0/2221199221 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8415ca10 con 0x7fbb8415c640 2023-11-08T12:29:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb83fff700 1 --2- 172.21.15.112:0/2221199221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8415c640 0x7fbb840d31e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009910 tx=0x7fbb74009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=398c69fbfcd3552c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb837fe700 1 -- 172.21.15.112:0/2221199221 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74011830 con 0x7fbb8415c640 2023-11-08T12:29:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb837fe700 1 -- 172.21.15.112:0/2221199221 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74011990 con 0x7fbb8415c640 2023-11-08T12:29:26.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.767+0000 7fbb837fe700 1 -- 172.21.15.112:0/2221199221 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74011d40 con 0x7fbb8415c640 2023-11-08T12:29:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 -- 172.21.15.112:0/2221199221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8415c640 msgr2=0x7fbb840d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 --2- 172.21.15.112:0/2221199221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8415c640 0x7fbb840d31e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009910 tx=0x7fbb74009c20 comp rx=0 tx=0).stop 2023-11-08T12:29:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 -- 172.21.15.112:0/2221199221 shutdown_connections 2023-11-08T12:29:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 --2- 172.21.15.112:0/2221199221 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 --2- 172.21.15.112:0/2221199221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8415c640 0x7fbb840d31e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 -- 172.21.15.112:0/2221199221 >> 172.21.15.112:0/2221199221 conn(0x7fbb840b6520 msgr2=0x7fbb84071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 -- 172.21.15.112:0/2221199221 shutdown_connections 2023-11-08T12:29:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 -- 172.21.15.112:0/2221199221 wait complete. 2023-11-08T12:29:26.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 Processor -- start 2023-11-08T12:29:26.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.771+0000 7fbb89220700 1 -- start start 2023-11-08T12:29:26.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb84069e00 0x7fbb8415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb8415c640 0x7fbb840b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840cca70 con 0x7fbb8415c640 2023-11-08T12:29:26.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8415a950 con 0x7fbb84069e00 2023-11-08T12:29:26.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb841525f0 con 0x7fbb84071aa0 2023-11-08T12:29:26.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb8415c640 0x7fbb840b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb8415c640 0x7fbb840b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47272/0 (socket says 172.21.15.112:47272) 2023-11-08T12:29:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 -- 172.21.15.112:0/3289625340 learned_addr learned my addr 172.21.15.112:0/3289625340 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb83fff700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb84069e00 0x7fbb8415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb7bfff700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 -- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 msgr2=0x7fbb8415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8415a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 -- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb84069e00 msgr2=0x7fbb8415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb84069e00 0x7fbb8415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 -- 172.21.15.112:0/3289625340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74009570 con 0x7fbb8415c640 2023-11-08T12:29:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb88a1f700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb8415c640 0x7fbb840b3420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00cbc0 tx=0x7fbb7c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb817fa700 1 -- 172.21.15.112:0/3289625340 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00a9e0 con 0x7fbb8415c640 2023-11-08T12:29:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb817fa700 1 -- 172.21.15.112:0/3289625340 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c00ab40 con 0x7fbb8415c640 2023-11-08T12:29:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8406c830 con 0x7fbb8415c640 2023-11-08T12:29:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb817fa700 1 -- 172.21.15.112:0/3289625340 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c007070 con 0x7fbb8415c640 2023-11-08T12:29:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.775+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb84072010 con 0x7fbb8415c640 2023-11-08T12:29:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.779+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8406cb10 con 0x7fbb8415c640 2023-11-08T12:29:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.779+0000 7fbb817fa700 1 -- 172.21.15.112:0/3289625340 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb7c019030 con 0x7fbb8415c640 2023-11-08T12:29:26.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.783+0000 7fbb817fa700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb64064ee0 0x7fbb64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:26.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.783+0000 7fbb817fa700 1 -- 172.21.15.112:0/3289625340 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbb7c081a40 con 0x7fbb8415c640 2023-11-08T12:29:26.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.783+0000 7fbb83fff700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb64064ee0 0x7fbb64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:26.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.783+0000 7fbb83fff700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb64064ee0 0x7fbb64067390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbb74000c00 tx=0x7fbb74008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:26.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.787+0000 7fbb817fa700 1 -- 172.21.15.112:0/3289625340 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb7c04a400 con 0x7fbb8415c640 2023-11-08T12:29:26.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.963+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb84073cb0 con 0x7fbb64064ee0 2023-11-08T12:29:26.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.983+0000 7fbb817fa700 1 -- 172.21.15.112:0/3289625340 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308264 (secure 0 0 0) 0x7fbb84073cb0 con 0x7fbb64064ee0 2023-11-08T12:29:26.992 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:26.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb64064ee0 msgr2=0x7fbb64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb64064ee0 0x7fbb64067390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbb74000c00 tx=0x7fbb74008030 comp rx=0 tx=0).stop 2023-11-08T12:29:26.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb8415c640 msgr2=0x7fbb840b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:26.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb8415c640 0x7fbb840b3420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00cbc0 tx=0x7fbb7c00ced0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 shutdown_connections 2023-11-08T12:29:26.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb64064ee0 0x7fbb64067390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb8415c640 0x7fbb840b3420 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb84071aa0 0x7fbb8415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 --2- 172.21.15.112:0/3289625340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb84069e00 0x7fbb8415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:26.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 >> 172.21.15.112:0/3289625340 conn(0x7fbb840b6520 msgr2=0x7fbb840b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:26.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 shutdown_connections 2023-11-08T12:29:27.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:26.991+0000 7fbb89220700 1 -- 172.21.15.112:0/3289625340 wait complete. 2023-11-08T12:29:27.000 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:29:27.019 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-11-08T12:29:26.742505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71672,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":66560,"kb_avail":754903048,"statfs":{"total":773094113280,"available":773020721152,"internally_reserved":0,"allocated":5169152,"data_stored":2935874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68157440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002271"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502521+0000","last_change":"2023-11-08T12:29:21.817753+0000","last_active":"2023-11-08T12:29:23.502521+0000","last_peered":"2023-11-08T12:29:23.502521+0000","last_clean":"2023-11-08T12:29:23.502521+0000","last_became_active":"2023-11-08T12:29:21.817472+0000","last_became_peered":"2023-11-08T12:29:21.817472+0000","last_unstale":"2023-11-08T12:29:23.502521+0000","last_undegraded":"2023-11-08T12:29:23.502521+0000","last_fullsized":"2023-11-08T12:29:23.502521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:48:49.601579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784936+0000","last_change":"2023-11-08T12:29:21.809249+0000","last_active":"2023-11-08T12:29:22.784936+0000","last_peered":"2023-11-08T12:29:22.784936+0000","last_clean":"2023-11-08T12:29:22.784936+0000","last_became_active":"2023-11-08T12:29:21.808986+0000","last_became_peered":"2023-11-08T12:29:21.808986+0000","last_unstale":"2023-11-08T12:29:22.784936+0000","last_undegraded":"2023-11-08T12:29:22.784936+0000","last_fullsized":"2023-11-08T12:29:22.784936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:47:34.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787670+0000","last_change":"2023-11-08T12:29:21.787670+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787670+0000","last_undegraded":"2023-11-08T12:29:21.787670+0000","last_fullsized":"2023-11-08T12:29:21.787670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495176+0000","last_change":"2023-11-08T12:29:21.807409+0000","last_active":"2023-11-08T12:29:23.495176+0000","last_peered":"2023-11-08T12:29:23.495176+0000","last_clean":"2023-11-08T12:29:23.495176+0000","last_became_active":"2023-11-08T12:29:21.807166+0000","last_became_peered":"2023-11-08T12:29:21.807166+0000","last_unstale":"2023-11-08T12:29:23.495176+0000","last_undegraded":"2023-11-08T12:29:23.495176+0000","last_fullsized":"2023-11-08T12:29:23.495176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:30.081962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784594+0000","last_change":"2023-11-08T12:29:21.804383+0000","last_active":"2023-11-08T12:29:22.784594+0000","last_peered":"2023-11-08T12:29:22.784594+0000","last_clean":"2023-11-08T12:29:22.784594+0000","last_became_active":"2023-11-08T12:29:21.804182+0000","last_became_peered":"2023-11-08T12:29:21.804182+0000","last_unstale":"2023-11-08T12:29:22.784594+0000","last_undegraded":"2023-11-08T12:29:22.784594+0000","last_fullsized":"2023-11-08T12:29:22.784594+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785345+0000","last_change":"2023-11-08T12:29:21.816037+0000","last_active":"2023-11-08T12:29:22.785345+0000","last_peered":"2023-11-08T12:29:22.785345+0000","last_clean":"2023-11-08T12:29:22.785345+0000","last_became_active":"2023-11-08T12:29:21.815653+0000","last_became_peered":"2023-11-08T12:29:21.815653+0000","last_unstale":"2023-11-08T12:29:22.785345+0000","last_undegraded":"2023-11-08T12:29:22.785345+0000","last_fullsized":"2023-11-08T12:29:22.785345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.501888+0000","last_change":"2023-11-08T12:29:21.819916+0000","last_active":"2023-11-08T12:29:23.501888+0000","last_peered":"2023-11-08T12:29:23.501888+0000","last_clean":"2023-11-08T12:29:23.501888+0000","last_became_active":"2023-11-08T12:29:21.819605+0000","last_became_peered":"2023-11-08T12:29:21.819605+0000","last_unstale":"2023-11-08T12:29:23.501888+0000","last_undegraded":"2023-11-08T12:29:23.501888+0000","last_fullsized":"2023-11-08T12:29:23.501888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.493735+0000","last_change":"2023-11-08T12:29:21.813522+0000","last_active":"2023-11-08T12:29:23.493735+0000","last_peered":"2023-11-08T12:29:23.493735+0000","last_clean":"2023-11-08T12:29:23.493735+0000","last_became_active":"2023-11-08T12:29:21.812613+0000","last_became_peered":"2023-11-08T12:29:21.812613+0000","last_unstale":"2023-11-08T12:29:23.493735+0000","last_undegraded":"2023-11-08T12:29:23.493735+0000","last_fullsized":"2023-11-08T12:29:23.493735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495637+0000","last_change":"2023-11-08T12:29:21.827080+0000","last_active":"2023-11-08T12:29:23.495637+0000","last_peered":"2023-11-08T12:29:23.495637+0000","last_clean":"2023-11-08T12:29:23.495637+0000","last_became_active":"2023-11-08T12:29:21.826734+0000","last_became_peered":"2023-11-08T12:29:21.826734+0000","last_unstale":"2023-11-08T12:29:23.495637+0000","last_undegraded":"2023-11-08T12:29:23.495637+0000","last_fullsized":"2023-11-08T12:29:23.495637+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:28:58.357487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495612+0000","last_change":"2023-11-08T12:29:21.808710+0000","last_active":"2023-11-08T12:29:23.495612+0000","last_peered":"2023-11-08T12:29:23.495612+0000","last_clean":"2023-11-08T12:29:23.495612+0000","last_became_active":"2023-11-08T12:29:21.808476+0000","last_became_peered":"2023-11-08T12:29:21.808476+0000","last_unstale":"2023-11-08T12:29:23.495612+0000","last_undegraded":"2023-11-08T12:29:23.495612+0000","last_fullsized":"2023-11-08T12:29:23.495612+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495091+0000","last_change":"2023-11-08T12:29:21.827439+0000","last_active":"2023-11-08T12:29:23.495091+0000","last_peered":"2023-11-08T12:29:23.495091+0000","last_clean":"2023-11-08T12:29:23.495091+0000","last_became_active":"2023-11-08T12:29:21.827185+0000","last_became_peered":"2023-11-08T12:29:21.827185+0000","last_unstale":"2023-11-08T12:29:23.495091+0000","last_undegraded":"2023-11-08T12:29:23.495091+0000","last_fullsized":"2023-11-08T12:29:23.495091+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784669+0000","last_change":"2023-11-08T12:29:21.822648+0000","last_active":"2023-11-08T12:29:22.784669+0000","last_peered":"2023-11-08T12:29:22.784669+0000","last_clean":"2023-11-08T12:29:22.784669+0000","last_became_active":"2023-11-08T12:29:21.822442+0000","last_became_peered":"2023-11-08T12:29:21.822442+0000","last_unstale":"2023-11-08T12:29:22.784669+0000","last_undegraded":"2023-11-08T12:29:22.784669+0000","last_fullsized":"2023-11-08T12:29:22.784669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786731+0000","last_change":"2023-11-08T12:29:21.817755+0000","last_active":"2023-11-08T12:29:22.786731+0000","last_peered":"2023-11-08T12:29:22.786731+0000","last_clean":"2023-11-08T12:29:22.786731+0000","last_became_active":"2023-11-08T12:29:21.817490+0000","last_became_peered":"2023-11-08T12:29:21.817490+0000","last_unstale":"2023-11-08T12:29:22.786731+0000","last_undegraded":"2023-11-08T12:29:22.786731+0000","last_fullsized":"2023-11-08T12:29:22.786731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:56.007182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494144+0000","last_change":"2023-11-08T12:29:21.828260+0000","last_active":"2023-11-08T12:29:23.494144+0000","last_peered":"2023-11-08T12:29:23.494144+0000","last_clean":"2023-11-08T12:29:23.494144+0000","last_became_active":"2023-11-08T12:29:21.827984+0000","last_became_peered":"2023-11-08T12:29:21.827984+0000","last_unstale":"2023-11-08T12:29:23.494144+0000","last_undegraded":"2023-11-08T12:29:23.494144+0000","last_fullsized":"2023-11-08T12:29:23.494144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785168+0000","last_change":"2023-11-08T12:29:21.806695+0000","last_active":"2023-11-08T12:29:22.785168+0000","last_peered":"2023-11-08T12:29:22.785168+0000","last_clean":"2023-11-08T12:29:22.785168+0000","last_became_active":"2023-11-08T12:29:21.806460+0000","last_became_peered":"2023-11-08T12:29:21.806460+0000","last_unstale":"2023-11-08T12:29:22.785168+0000","last_undegraded":"2023-11-08T12:29:22.785168+0000","last_fullsized":"2023-11-08T12:29:22.785168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785634+0000","last_change":"2023-11-08T12:29:21.785634+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785634+0000","last_undegraded":"2023-11-08T12:29:21.785634+0000","last_fullsized":"2023-11-08T12:29:21.785634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:28.967380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802733+0000","last_change":"2023-11-08T12:29:21.802733+0000","last_active":"2023-11-08T12:29:21.802733+0000","last_peered":"2023-11-08T12:29:21.802733+0000","last_clean":"2023-11-08T12:29:21.802733+0000","last_became_active":"2023-11-08T12:29:21.802417+0000","last_became_peered":"2023-11-08T12:29:21.802417+0000","last_unstale":"2023-11-08T12:29:21.802733+0000","last_undegraded":"2023-11-08T12:29:21.802733+0000","last_fullsized":"2023-11-08T12:29:21.802733+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.788302+0000","last_change":"2023-11-08T12:29:21.788302+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.788302+0000","last_undegraded":"2023-11-08T12:29:21.788302+0000","last_fullsized":"2023-11-08T12:29:21.788302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808809+0000","last_change":"2023-11-08T12:29:21.808809+0000","last_active":"2023-11-08T12:29:21.808809+0000","last_peered":"2023-11-08T12:29:21.808809+0000","last_clean":"2023-11-08T12:29:21.808809+0000","last_became_active":"2023-11-08T12:29:21.805982+0000","last_became_peered":"2023-11-08T12:29:21.805982+0000","last_unstale":"2023-11-08T12:29:21.808809+0000","last_undegraded":"2023-11-08T12:29:21.808809+0000","last_fullsized":"2023-11-08T12:29:21.808809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:30:43.794892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787061+0000","last_change":"2023-11-08T12:29:21.819567+0000","last_active":"2023-11-08T12:29:22.787061+0000","last_peered":"2023-11-08T12:29:22.787061+0000","last_clean":"2023-11-08T12:29:22.787061+0000","last_became_active":"2023-11-08T12:29:21.819214+0000","last_became_peered":"2023-11-08T12:29:21.819214+0000","last_unstale":"2023-11-08T12:29:22.787061+0000","last_undegraded":"2023-11-08T12:29:22.787061+0000","last_fullsized":"2023-11-08T12:29:22.787061+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:30.051527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785549+0000","last_change":"2023-11-08T12:29:21.802562+0000","last_active":"2023-11-08T12:29:22.785549+0000","last_peered":"2023-11-08T12:29:22.785549+0000","last_clean":"2023-11-08T12:29:22.785549+0000","last_became_active":"2023-11-08T12:29:21.801814+0000","last_became_peered":"2023-11-08T12:29:21.801814+0000","last_unstale":"2023-11-08T12:29:22.785549+0000","last_undegraded":"2023-11-08T12:29:22.785549+0000","last_fullsized":"2023-11-08T12:29:22.785549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494193+0000","last_change":"2023-11-08T12:29:21.819922+0000","last_active":"2023-11-08T12:29:23.494193+0000","last_peered":"2023-11-08T12:29:23.494193+0000","last_clean":"2023-11-08T12:29:23.494193+0000","last_became_active":"2023-11-08T12:29:21.819683+0000","last_became_peered":"2023-11-08T12:29:21.819683+0000","last_unstale":"2023-11-08T12:29:23.494193+0000","last_undegraded":"2023-11-08T12:29:23.494193+0000","last_fullsized":"2023-11-08T12:29:23.494193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:02:50.507213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.786873+0000","last_change":"2023-11-08T12:29:21.786873+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.786873+0000","last_undegraded":"2023-11-08T12:29:21.786873+0000","last_fullsized":"2023-11-08T12:29:21.786873+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:49:11.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785219+0000","last_change":"2023-11-08T12:29:21.785219+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785219+0000","last_undegraded":"2023-11-08T12:29:21.785219+0000","last_fullsized":"2023-11-08T12:29:21.785219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:31:33.328583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.790498+0000","last_change":"2023-11-08T12:29:21.790498+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.790498+0000","last_undegraded":"2023-11-08T12:29:21.790498+0000","last_fullsized":"2023-11-08T12:29:21.790498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:23.051243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787086+0000","last_change":"2023-11-08T12:29:21.817462+0000","last_active":"2023-11-08T12:29:22.787086+0000","last_peered":"2023-11-08T12:29:22.787086+0000","last_clean":"2023-11-08T12:29:22.787086+0000","last_became_active":"2023-11-08T12:29:21.817208+0000","last_became_peered":"2023-11-08T12:29:21.817208+0000","last_unstale":"2023-11-08T12:29:22.787086+0000","last_undegraded":"2023-11-08T12:29:22.787086+0000","last_fullsized":"2023-11-08T12:29:22.787086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:13:12.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787074+0000","last_change":"2023-11-08T12:29:21.787074+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787074+0000","last_undegraded":"2023-11-08T12:29:21.787074+0000","last_fullsized":"2023-11-08T12:29:21.787074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784704+0000","last_change":"2023-11-08T12:29:21.820063+0000","last_active":"2023-11-08T12:29:22.784704+0000","last_peered":"2023-11-08T12:29:22.784704+0000","last_clean":"2023-11-08T12:29:22.784704+0000","last_became_active":"2023-11-08T12:29:21.819738+0000","last_became_peered":"2023-11-08T12:29:21.819738+0000","last_unstale":"2023-11-08T12:29:22.784704+0000","last_undegraded":"2023-11-08T12:29:22.784704+0000","last_fullsized":"2023-11-08T12:29:22.784704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:13:00.473044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787774+0000","last_change":"2023-11-08T12:29:21.787774+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787774+0000","last_undegraded":"2023-11-08T12:29:21.787774+0000","last_fullsized":"2023-11-08T12:29:21.787774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:30.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787898+0000","last_change":"2023-11-08T12:29:21.787898+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787898+0000","last_undegraded":"2023-11-08T12:29:21.787898+0000","last_fullsized":"2023-11-08T12:29:21.787898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785141+0000","last_change":"2023-11-08T12:29:21.812579+0000","last_active":"2023-11-08T12:29:22.785141+0000","last_peered":"2023-11-08T12:29:22.785141+0000","last_clean":"2023-11-08T12:29:22.785141+0000","last_became_active":"2023-11-08T12:29:21.812294+0000","last_became_peered":"2023-11-08T12:29:21.812294+0000","last_unstale":"2023-11-08T12:29:22.785141+0000","last_undegraded":"2023-11-08T12:29:22.785141+0000","last_fullsized":"2023-11-08T12:29:22.785141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786975+0000","last_change":"2023-11-08T12:29:21.816857+0000","last_active":"2023-11-08T12:29:22.786975+0000","last_peered":"2023-11-08T12:29:22.786975+0000","last_clean":"2023-11-08T12:29:22.786975+0000","last_became_active":"2023-11-08T12:29:21.814297+0000","last_became_peered":"2023-11-08T12:29:21.814297+0000","last_unstale":"2023-11-08T12:29:22.786975+0000","last_undegraded":"2023-11-08T12:29:22.786975+0000","last_fullsized":"2023-11-08T12:29:22.786975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:03:15.852031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.641172+0000","last_change":"2023-11-08T12:29:21.807851+0000","last_active":"2023-11-08T12:29:24.641172+0000","last_peered":"2023-11-08T12:29:24.641172+0000","last_clean":"2023-11-08T12:29:24.641172+0000","last_became_active":"2023-11-08T12:29:21.807594+0000","last_became_peered":"2023-11-08T12:29:21.807594+0000","last_unstale":"2023-11-08T12:29:24.641172+0000","last_undegraded":"2023-11-08T12:29:24.641172+0000","last_fullsized":"2023-11-08T12:29:24.641172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:59:11.369849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802949+0000","last_change":"2023-11-08T12:29:21.349307+0000","last_active":"2023-11-08T12:29:21.802949+0000","last_peered":"2023-11-08T12:29:21.802949+0000","last_clean":"2023-11-08T12:29:21.802949+0000","last_became_active":"2023-11-08T12:29:21.348126+0000","last_became_peered":"2023-11-08T12:29:21.348126+0000","last_unstale":"2023-11-08T12:29:21.802949+0000","last_undegraded":"2023-11-08T12:29:21.802949+0000","last_fullsized":"2023-11-08T12:29:21.802949+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800129+0000","last_change":"2023-11-08T12:29:21.795050+0000","last_active":"2023-11-08T12:29:21.800129+0000","last_peered":"2023-11-08T12:29:21.800129+0000","last_clean":"2023-11-08T12:29:21.800129+0000","last_became_active":"2023-11-08T12:29:21.794561+0000","last_became_peered":"2023-11-08T12:29:21.794561+0000","last_unstale":"2023-11-08T12:29:21.800129+0000","last_undegraded":"2023-11-08T12:29:21.800129+0000","last_fullsized":"2023-11-08T12:29:21.800129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:40:42.873851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800543+0000","last_change":"2023-11-08T12:29:21.338664+0000","last_active":"2023-11-08T12:29:21.800543+0000","last_peered":"2023-11-08T12:29:21.800543+0000","last_clean":"2023-11-08T12:29:21.800543+0000","last_became_active":"2023-11-08T12:29:21.338364+0000","last_became_peered":"2023-11-08T12:29:21.338364+0000","last_unstale":"2023-11-08T12:29:21.800543+0000","last_undegraded":"2023-11-08T12:29:21.800543+0000","last_fullsized":"2023-11-08T12:29:21.800543+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:26:46.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784944+0000","last_change":"2023-11-08T12:29:21.807291+0000","last_active":"2023-11-08T12:29:22.784944+0000","last_peered":"2023-11-08T12:29:22.784944+0000","last_clean":"2023-11-08T12:29:22.784944+0000","last_became_active":"2023-11-08T12:29:21.806952+0000","last_became_peered":"2023-11-08T12:29:21.806952+0000","last_unstale":"2023-11-08T12:29:22.784944+0000","last_undegraded":"2023-11-08T12:29:22.784944+0000","last_fullsized":"2023-11-08T12:29:22.784944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:32:44.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.828778+0000","last_change":"2023-11-08T12:29:21.344422+0000","last_active":"2023-11-08T12:29:21.828778+0000","last_peered":"2023-11-08T12:29:21.828778+0000","last_clean":"2023-11-08T12:29:21.828778+0000","last_became_active":"2023-11-08T12:29:21.344096+0000","last_became_peered":"2023-11-08T12:29:21.344096+0000","last_unstale":"2023-11-08T12:29:21.828778+0000","last_undegraded":"2023-11-08T12:29:21.828778+0000","last_fullsized":"2023-11-08T12:29:21.828778+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:59.630215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.641127+0000","last_change":"2023-11-08T12:29:21.825604+0000","last_active":"2023-11-08T12:29:24.641127+0000","last_peered":"2023-11-08T12:29:24.641127+0000","last_clean":"2023-11-08T12:29:24.641127+0000","last_became_active":"2023-11-08T12:29:21.825335+0000","last_became_peered":"2023-11-08T12:29:21.825335+0000","last_unstale":"2023-11-08T12:29:24.641127+0000","last_undegraded":"2023-11-08T12:29:24.641127+0000","last_fullsized":"2023-11-08T12:29:24.641127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:56.113448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816522+0000","last_change":"2023-11-08T12:29:21.349891+0000","last_active":"2023-11-08T12:29:21.816522+0000","last_peered":"2023-11-08T12:29:21.816522+0000","last_clean":"2023-11-08T12:29:21.816522+0000","last_became_active":"2023-11-08T12:29:21.349601+0000","last_became_peered":"2023-11-08T12:29:21.349601+0000","last_unstale":"2023-11-08T12:29:21.816522+0000","last_undegraded":"2023-11-08T12:29:21.816522+0000","last_fullsized":"2023-11-08T12:29:21.816522+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801702+0000","last_change":"2023-11-08T12:29:21.799913+0000","last_active":"2023-11-08T12:29:21.801702+0000","last_peered":"2023-11-08T12:29:21.801702+0000","last_clean":"2023-11-08T12:29:21.801702+0000","last_became_active":"2023-11-08T12:29:21.799604+0000","last_became_peered":"2023-11-08T12:29:21.799604+0000","last_unstale":"2023-11-08T12:29:21.801702+0000","last_undegraded":"2023-11-08T12:29:21.801702+0000","last_fullsized":"2023-11-08T12:29:21.801702+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805362+0000","last_change":"2023-11-08T12:29:21.341760+0000","last_active":"2023-11-08T12:29:21.805362+0000","last_peered":"2023-11-08T12:29:21.805362+0000","last_clean":"2023-11-08T12:29:21.805362+0000","last_became_active":"2023-11-08T12:29:21.341426+0000","last_became_peered":"2023-11-08T12:29:21.341426+0000","last_unstale":"2023-11-08T12:29:21.805362+0000","last_undegraded":"2023-11-08T12:29:21.805362+0000","last_fullsized":"2023-11-08T12:29:21.805362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:21:10.046172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494455+0000","last_change":"2023-11-08T12:29:21.810802+0000","last_active":"2023-11-08T12:29:23.494455+0000","last_peered":"2023-11-08T12:29:23.494455+0000","last_clean":"2023-11-08T12:29:23.494455+0000","last_became_active":"2023-11-08T12:29:21.810630+0000","last_became_peered":"2023-11-08T12:29:21.810630+0000","last_unstale":"2023-11-08T12:29:23.494455+0000","last_undegraded":"2023-11-08T12:29:23.494455+0000","last_fullsized":"2023-11-08T12:29:23.494455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788689+0000","last_change":"2023-11-08T12:29:21.338833+0000","last_active":"2023-11-08T12:29:21.788689+0000","last_peered":"2023-11-08T12:29:21.788689+0000","last_clean":"2023-11-08T12:29:21.788689+0000","last_became_active":"2023-11-08T12:29:21.338621+0000","last_became_peered":"2023-11-08T12:29:21.338621+0000","last_unstale":"2023-11-08T12:29:21.788689+0000","last_undegraded":"2023-11-08T12:29:21.788689+0000","last_fullsized":"2023-11-08T12:29:21.788689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:32.577889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494026+0000","last_change":"2023-11-08T12:29:21.813361+0000","last_active":"2023-11-08T12:29:23.494026+0000","last_peered":"2023-11-08T12:29:23.494026+0000","last_clean":"2023-11-08T12:29:23.494026+0000","last_became_active":"2023-11-08T12:29:21.812271+0000","last_became_peered":"2023-11-08T12:29:21.812271+0000","last_unstale":"2023-11-08T12:29:23.494026+0000","last_undegraded":"2023-11-08T12:29:23.494026+0000","last_fullsized":"2023-11-08T12:29:23.494026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.796924+0000","last_change":"2023-11-08T12:29:21.339277+0000","last_active":"2023-11-08T12:29:21.796924+0000","last_peered":"2023-11-08T12:29:21.796924+0000","last_clean":"2023-11-08T12:29:21.796924+0000","last_became_active":"2023-11-08T12:29:21.338989+0000","last_became_peered":"2023-11-08T12:29:21.338989+0000","last_unstale":"2023-11-08T12:29:21.796924+0000","last_undegraded":"2023-11-08T12:29:21.796924+0000","last_fullsized":"2023-11-08T12:29:21.796924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787005+0000","last_change":"2023-11-08T12:29:21.787005+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787005+0000","last_undegraded":"2023-11-08T12:29:21.787005+0000","last_fullsized":"2023-11-08T12:29:21.787005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:05.769508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.798425+0000","last_change":"2023-11-08T12:29:21.341564+0000","last_active":"2023-11-08T12:29:21.798425+0000","last_peered":"2023-11-08T12:29:21.798425+0000","last_clean":"2023-11-08T12:29:21.798425+0000","last_became_active":"2023-11-08T12:29:21.341236+0000","last_became_peered":"2023-11-08T12:29:21.341236+0000","last_unstale":"2023-11-08T12:29:21.798425+0000","last_undegraded":"2023-11-08T12:29:21.798425+0000","last_fullsized":"2023-11-08T12:29:21.798425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800809+0000","last_change":"2023-11-08T12:29:21.800809+0000","last_active":"2023-11-08T12:29:21.800809+0000","last_peered":"2023-11-08T12:29:21.800809+0000","last_clean":"2023-11-08T12:29:21.800809+0000","last_became_active":"2023-11-08T12:29:21.800508+0000","last_became_peered":"2023-11-08T12:29:21.800508+0000","last_unstale":"2023-11-08T12:29:21.800809+0000","last_undegraded":"2023-11-08T12:29:21.800809+0000","last_fullsized":"2023-11-08T12:29:21.800809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789027+0000","last_change":"2023-11-08T12:29:21.336456+0000","last_active":"2023-11-08T12:29:21.789027+0000","last_peered":"2023-11-08T12:29:21.789027+0000","last_clean":"2023-11-08T12:29:21.789027+0000","last_became_active":"2023-11-08T12:29:21.336182+0000","last_became_peered":"2023-11-08T12:29:21.336182+0000","last_unstale":"2023-11-08T12:29:21.789027+0000","last_undegraded":"2023-11-08T12:29:21.789027+0000","last_fullsized":"2023-11-08T12:29:21.789027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502622+0000","last_change":"2023-11-08T12:29:21.816825+0000","last_active":"2023-11-08T12:29:23.502622+0000","last_peered":"2023-11-08T12:29:23.502622+0000","last_clean":"2023-11-08T12:29:23.502622+0000","last_became_active":"2023-11-08T12:29:21.816561+0000","last_became_peered":"2023-11-08T12:29:21.816561+0000","last_unstale":"2023-11-08T12:29:23.502622+0000","last_undegraded":"2023-11-08T12:29:23.502622+0000","last_fullsized":"2023-11-08T12:29:23.502622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:13:00.473044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.796670+0000","last_change":"2023-11-08T12:29:21.342736+0000","last_active":"2023-11-08T12:29:21.796670+0000","last_peered":"2023-11-08T12:29:21.796670+0000","last_clean":"2023-11-08T12:29:21.796670+0000","last_became_active":"2023-11-08T12:29:21.342385+0000","last_became_peered":"2023-11-08T12:29:21.342385+0000","last_unstale":"2023-11-08T12:29:21.796670+0000","last_undegraded":"2023-11-08T12:29:21.796670+0000","last_fullsized":"2023-11-08T12:29:21.796670+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785885+0000","last_change":"2023-11-08T12:29:21.820215+0000","last_active":"2023-11-08T12:29:22.785885+0000","last_peered":"2023-11-08T12:29:22.785885+0000","last_clean":"2023-11-08T12:29:22.785885+0000","last_became_active":"2023-11-08T12:29:21.819908+0000","last_became_peered":"2023-11-08T12:29:21.819908+0000","last_unstale":"2023-11-08T12:29:22.785885+0000","last_undegraded":"2023-11-08T12:29:22.785885+0000","last_fullsized":"2023-11-08T12:29:22.785885+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.817409+0000","last_change":"2023-11-08T12:29:21.348938+0000","last_active":"2023-11-08T12:29:21.817409+0000","last_peered":"2023-11-08T12:29:21.817409+0000","last_clean":"2023-11-08T12:29:21.817409+0000","last_became_active":"2023-11-08T12:29:21.348313+0000","last_became_peered":"2023-11-08T12:29:21.348313+0000","last_unstale":"2023-11-08T12:29:21.817409+0000","last_undegraded":"2023-11-08T12:29:21.817409+0000","last_fullsized":"2023-11-08T12:29:21.817409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502217+0000","last_change":"2023-11-08T12:29:21.820121+0000","last_active":"2023-11-08T12:29:23.502217+0000","last_peered":"2023-11-08T12:29:23.502217+0000","last_clean":"2023-11-08T12:29:23.502217+0000","last_became_active":"2023-11-08T12:29:21.819833+0000","last_became_peered":"2023-11-08T12:29:21.819833+0000","last_unstale":"2023-11-08T12:29:23.502217+0000","last_undegraded":"2023-11-08T12:29:23.502217+0000","last_fullsized":"2023-11-08T12:29:23.502217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:32:44.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787130+0000","last_change":"2023-11-08T12:29:21.336777+0000","last_active":"2023-11-08T12:29:22.787130+0000","last_peered":"2023-11-08T12:29:22.787130+0000","last_clean":"2023-11-08T12:29:22.787130+0000","last_became_active":"2023-11-08T12:29:21.336489+0000","last_became_peered":"2023-11-08T12:29:21.336489+0000","last_unstale":"2023-11-08T12:29:22.787130+0000","last_undegraded":"2023-11-08T12:29:22.787130+0000","last_fullsized":"2023-11-08T12:29:22.787130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:52:06.155620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810358+0000","last_change":"2023-11-08T12:29:21.806201+0000","last_active":"2023-11-08T12:29:21.810358+0000","last_peered":"2023-11-08T12:29:21.810358+0000","last_clean":"2023-11-08T12:29:21.810358+0000","last_became_active":"2023-11-08T12:29:21.805845+0000","last_became_peered":"2023-11-08T12:29:21.805845+0000","last_unstale":"2023-11-08T12:29:21.810358+0000","last_undegraded":"2023-11-08T12:29:21.810358+0000","last_fullsized":"2023-11-08T12:29:21.810358+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:49.547648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.793754+0000","last_change":"2023-11-08T12:29:21.342696+0000","last_active":"2023-11-08T12:29:21.793754+0000","last_peered":"2023-11-08T12:29:21.793754+0000","last_clean":"2023-11-08T12:29:21.793754+0000","last_became_active":"2023-11-08T12:29:21.342396+0000","last_became_peered":"2023-11-08T12:29:21.342396+0000","last_unstale":"2023-11-08T12:29:21.793754+0000","last_undegraded":"2023-11-08T12:29:21.793754+0000","last_fullsized":"2023-11-08T12:29:21.793754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:31:24.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494729+0000","last_change":"2023-11-08T12:29:21.819366+0000","last_active":"2023-11-08T12:29:23.494729+0000","last_peered":"2023-11-08T12:29:23.494729+0000","last_clean":"2023-11-08T12:29:23.494729+0000","last_became_active":"2023-11-08T12:29:21.819082+0000","last_became_peered":"2023-11-08T12:29:21.819082+0000","last_unstale":"2023-11-08T12:29:23.494729+0000","last_undegraded":"2023-11-08T12:29:23.494729+0000","last_fullsized":"2023-11-08T12:29:23.494729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:59.392291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800077+0000","last_change":"2023-11-08T12:29:21.348592+0000","last_active":"2023-11-08T12:29:21.800077+0000","last_peered":"2023-11-08T12:29:21.800077+0000","last_clean":"2023-11-08T12:29:21.800077+0000","last_became_active":"2023-11-08T12:29:21.348238+0000","last_became_peered":"2023-11-08T12:29:21.348238+0000","last_unstale":"2023-11-08T12:29:21.800077+0000","last_undegraded":"2023-11-08T12:29:21.800077+0000","last_fullsized":"2023-11-08T12:29:21.800077+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784931+0000","last_change":"2023-11-08T12:29:21.811607+0000","last_active":"2023-11-08T12:29:22.784931+0000","last_peered":"2023-11-08T12:29:22.784931+0000","last_clean":"2023-11-08T12:29:22.784931+0000","last_became_active":"2023-11-08T12:29:21.811360+0000","last_became_peered":"2023-11-08T12:29:21.811360+0000","last_unstale":"2023-11-08T12:29:22.784931+0000","last_undegraded":"2023-11-08T12:29:22.784931+0000","last_fullsized":"2023-11-08T12:29:22.784931+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:14:09.179363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.783562+0000","last_change":"2023-11-08T12:29:21.348443+0000","last_active":"2023-11-08T12:29:21.783562+0000","last_peered":"2023-11-08T12:29:21.783562+0000","last_clean":"2023-11-08T12:29:21.783562+0000","last_became_active":"2023-11-08T12:29:21.348161+0000","last_became_peered":"2023-11-08T12:29:21.348161+0000","last_unstale":"2023-11-08T12:29:21.783562+0000","last_undegraded":"2023-11-08T12:29:21.783562+0000","last_fullsized":"2023-11-08T12:29:21.783562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502001+0000","last_change":"2023-11-08T12:29:21.812704+0000","last_active":"2023-11-08T12:29:23.502001+0000","last_peered":"2023-11-08T12:29:23.502001+0000","last_clean":"2023-11-08T12:29:23.502001+0000","last_became_active":"2023-11-08T12:29:21.812215+0000","last_became_peered":"2023-11-08T12:29:21.812215+0000","last_unstale":"2023-11-08T12:29:23.502001+0000","last_undegraded":"2023-11-08T12:29:23.502001+0000","last_fullsized":"2023-11-08T12:29:23.502001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:47:34.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.832347+0000","last_change":"2023-11-08T12:29:21.338524+0000","last_active":"2023-11-08T12:29:21.832347+0000","last_peered":"2023-11-08T12:29:21.832347+0000","last_clean":"2023-11-08T12:29:21.832347+0000","last_became_active":"2023-11-08T12:29:21.338235+0000","last_became_peered":"2023-11-08T12:29:21.338235+0000","last_unstale":"2023-11-08T12:29:21.832347+0000","last_undegraded":"2023-11-08T12:29:21.832347+0000","last_fullsized":"2023-11-08T12:29:21.832347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787147+0000","last_change":"2023-11-08T12:29:21.812641+0000","last_active":"2023-11-08T12:29:22.787147+0000","last_peered":"2023-11-08T12:29:22.787147+0000","last_clean":"2023-11-08T12:29:22.787147+0000","last_became_active":"2023-11-08T12:29:21.812327+0000","last_became_peered":"2023-11-08T12:29:21.812327+0000","last_unstale":"2023-11-08T12:29:22.787147+0000","last_undegraded":"2023-11-08T12:29:22.787147+0000","last_fullsized":"2023-11-08T12:29:22.787147+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:32:04.240338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787073+0000","last_change":"2023-11-08T12:29:21.335461+0000","last_active":"2023-11-08T12:29:22.787073+0000","last_peered":"2023-11-08T12:29:22.787073+0000","last_clean":"2023-11-08T12:29:22.787073+0000","last_became_active":"2023-11-08T12:29:21.335191+0000","last_became_peered":"2023-11-08T12:29:21.335191+0000","last_unstale":"2023-11-08T12:29:22.787073+0000","last_undegraded":"2023-11-08T12:29:22.787073+0000","last_fullsized":"2023-11-08T12:29:22.787073+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:23:05.661588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495628+0000","last_change":"2023-11-08T12:29:21.803417+0000","last_active":"2023-11-08T12:29:23.495628+0000","last_peered":"2023-11-08T12:29:23.495628+0000","last_clean":"2023-11-08T12:29:23.495628+0000","last_became_active":"2023-11-08T12:29:21.800610+0000","last_became_peered":"2023-11-08T12:29:21.800610+0000","last_unstale":"2023-11-08T12:29:23.495628+0000","last_undegraded":"2023-11-08T12:29:23.495628+0000","last_fullsized":"2023-11-08T12:29:23.495628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789243+0000","last_change":"2023-11-08T12:29:21.341006+0000","last_active":"2023-11-08T12:29:21.789243+0000","last_peered":"2023-11-08T12:29:21.789243+0000","last_clean":"2023-11-08T12:29:21.789243+0000","last_became_active":"2023-11-08T12:29:21.340756+0000","last_became_peered":"2023-11-08T12:29:21.340756+0000","last_unstale":"2023-11-08T12:29:21.789243+0000","last_undegraded":"2023-11-08T12:29:21.789243+0000","last_fullsized":"2023-11-08T12:29:21.789243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:57:11.007145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810714+0000","last_change":"2023-11-08T12:29:21.804186+0000","last_active":"2023-11-08T12:29:21.810714+0000","last_peered":"2023-11-08T12:29:21.810714+0000","last_clean":"2023-11-08T12:29:21.810714+0000","last_became_active":"2023-11-08T12:29:21.803904+0000","last_became_peered":"2023-11-08T12:29:21.803904+0000","last_unstale":"2023-11-08T12:29:21.810714+0000","last_undegraded":"2023-11-08T12:29:21.810714+0000","last_fullsized":"2023-11-08T12:29:21.810714+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:35:00.646278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.823170+0000","last_change":"2023-11-08T12:29:21.342763+0000","last_active":"2023-11-08T12:29:21.823170+0000","last_peered":"2023-11-08T12:29:21.823170+0000","last_clean":"2023-11-08T12:29:21.823170+0000","last_became_active":"2023-11-08T12:29:21.342345+0000","last_became_peered":"2023-11-08T12:29:21.342345+0000","last_unstale":"2023-11-08T12:29:21.823170+0000","last_undegraded":"2023-11-08T12:29:21.823170+0000","last_fullsized":"2023-11-08T12:29:21.823170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787486+0000","last_change":"2023-11-08T12:29:21.787486+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787486+0000","last_undegraded":"2023-11-08T12:29:21.787486+0000","last_fullsized":"2023-11-08T12:29:21.787486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:38.192520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.787585+0000","last_change":"2023-11-08T12:29:21.349412+0000","last_active":"2023-11-08T12:29:21.787585+0000","last_peered":"2023-11-08T12:29:21.787585+0000","last_clean":"2023-11-08T12:29:21.787585+0000","last_became_active":"2023-11-08T12:29:21.349135+0000","last_became_peered":"2023-11-08T12:29:21.349135+0000","last_unstale":"2023-11-08T12:29:21.787585+0000","last_undegraded":"2023-11-08T12:29:21.787585+0000","last_fullsized":"2023-11-08T12:29:21.787585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785378+0000","last_change":"2023-11-08T12:29:21.815535+0000","last_active":"2023-11-08T12:29:22.785378+0000","last_peered":"2023-11-08T12:29:22.785378+0000","last_clean":"2023-11-08T12:29:22.785378+0000","last_became_active":"2023-11-08T12:29:21.815092+0000","last_became_peered":"2023-11-08T12:29:21.815092+0000","last_unstale":"2023-11-08T12:29:22.785378+0000","last_undegraded":"2023-11-08T12:29:22.785378+0000","last_fullsized":"2023-11-08T12:29:22.785378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805581+0000","last_change":"2023-11-08T12:29:21.338488+0000","last_active":"2023-11-08T12:29:21.805581+0000","last_peered":"2023-11-08T12:29:21.805581+0000","last_clean":"2023-11-08T12:29:21.805581+0000","last_became_active":"2023-11-08T12:29:21.338203+0000","last_became_peered":"2023-11-08T12:29:21.338203+0000","last_unstale":"2023-11-08T12:29:21.805581+0000","last_undegraded":"2023-11-08T12:29:21.805581+0000","last_fullsized":"2023-11-08T12:29:21.805581+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:31:36.137776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.640903+0000","last_change":"2023-11-08T12:29:21.811755+0000","last_active":"2023-11-08T12:29:24.640903+0000","last_peered":"2023-11-08T12:29:24.640903+0000","last_clean":"2023-11-08T12:29:24.640903+0000","last_became_active":"2023-11-08T12:29:21.811503+0000","last_became_peered":"2023-11-08T12:29:21.811503+0000","last_unstale":"2023-11-08T12:29:24.640903+0000","last_undegraded":"2023-11-08T12:29:24.640903+0000","last_fullsized":"2023-11-08T12:29:24.640903+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:27.826628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.794917+0000","last_change":"2023-11-08T12:29:21.344980+0000","last_active":"2023-11-08T12:29:21.794917+0000","last_peered":"2023-11-08T12:29:21.794917+0000","last_clean":"2023-11-08T12:29:21.794917+0000","last_became_active":"2023-11-08T12:29:21.344712+0000","last_became_peered":"2023-11-08T12:29:21.344712+0000","last_unstale":"2023-11-08T12:29:21.794917+0000","last_undegraded":"2023-11-08T12:29:21.794917+0000","last_fullsized":"2023-11-08T12:29:21.794917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786770+0000","last_change":"2023-11-08T12:29:21.817403+0000","last_active":"2023-11-08T12:29:22.786770+0000","last_peered":"2023-11-08T12:29:22.786770+0000","last_clean":"2023-11-08T12:29:22.786770+0000","last_became_active":"2023-11-08T12:29:21.817114+0000","last_became_peered":"2023-11-08T12:29:21.817114+0000","last_unstale":"2023-11-08T12:29:22.786770+0000","last_undegraded":"2023-11-08T12:29:22.786770+0000","last_fullsized":"2023-11-08T12:29:22.786770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:29:35.068286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.795735+0000","last_change":"2023-11-08T12:29:21.336783+0000","last_active":"2023-11-08T12:29:21.795735+0000","last_peered":"2023-11-08T12:29:21.795735+0000","last_clean":"2023-11-08T12:29:21.795735+0000","last_became_active":"2023-11-08T12:29:21.335874+0000","last_became_peered":"2023-11-08T12:29:21.335874+0000","last_unstale":"2023-11-08T12:29:21.795735+0000","last_undegraded":"2023-11-08T12:29:21.795735+0000","last_fullsized":"2023-11-08T12:29:21.795735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.493749+0000","last_change":"2023-11-08T12:29:21.827104+0000","last_active":"2023-11-08T12:29:23.493749+0000","last_peered":"2023-11-08T12:29:23.493749+0000","last_clean":"2023-11-08T12:29:23.493749+0000","last_became_active":"2023-11-08T12:29:21.826850+0000","last_became_peered":"2023-11-08T12:29:21.826850+0000","last_unstale":"2023-11-08T12:29:23.493749+0000","last_undegraded":"2023-11-08T12:29:23.493749+0000","last_fullsized":"2023-11-08T12:29:23.493749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800986+0000","last_change":"2023-11-08T12:29:21.345770+0000","last_active":"2023-11-08T12:29:21.800986+0000","last_peered":"2023-11-08T12:29:21.800986+0000","last_clean":"2023-11-08T12:29:21.800986+0000","last_became_active":"2023-11-08T12:29:21.345544+0000","last_became_peered":"2023-11-08T12:29:21.345544+0000","last_unstale":"2023-11-08T12:29:21.800986+0000","last_undegraded":"2023-11-08T12:29:21.800986+0000","last_fullsized":"2023-11-08T12:29:21.800986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785567+0000","last_change":"2023-11-08T12:29:21.805583+0000","last_active":"2023-11-08T12:29:22.785567+0000","last_peered":"2023-11-08T12:29:22.785567+0000","last_clean":"2023-11-08T12:29:22.785567+0000","last_became_active":"2023-11-08T12:29:21.805329+0000","last_became_peered":"2023-11-08T12:29:21.805329+0000","last_unstale":"2023-11-08T12:29:22.785567+0000","last_undegraded":"2023-11-08T12:29:22.785567+0000","last_fullsized":"2023-11-08T12:29:22.785567+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801549+0000","last_change":"2023-11-08T12:29:21.349783+0000","last_active":"2023-11-08T12:29:21.801549+0000","last_peered":"2023-11-08T12:29:21.801549+0000","last_clean":"2023-11-08T12:29:21.801549+0000","last_became_active":"2023-11-08T12:29:21.348368+0000","last_became_peered":"2023-11-08T12:29:21.348368+0000","last_unstale":"2023-11-08T12:29:21.801549+0000","last_undegraded":"2023-11-08T12:29:21.801549+0000","last_fullsized":"2023-11-08T12:29:21.801549+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.343970+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:29:21.343970+0000","last_peered":"2023-11-08T12:29:21.343970+0000","last_clean":"2023-11-08T12:29:21.343970+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:29:21.343970+0000","last_undegraded":"2023-11-08T12:29:21.343970+0000","last_fullsized":"2023-11-08T12:29:21.343970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786012+0000","last_change":"2023-11-08T12:29:21.811783+0000","last_active":"2023-11-08T12:29:22.786012+0000","last_peered":"2023-11-08T12:29:22.786012+0000","last_clean":"2023-11-08T12:29:22.786012+0000","last_became_active":"2023-11-08T12:29:21.811546+0000","last_became_peered":"2023-11-08T12:29:21.811546+0000","last_unstale":"2023-11-08T12:29:22.786012+0000","last_undegraded":"2023-11-08T12:29:22.786012+0000","last_fullsized":"2023-11-08T12:29:22.786012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:59.392291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788707+0000","last_change":"2023-11-08T12:29:21.342180+0000","last_active":"2023-11-08T12:29:21.788707+0000","last_peered":"2023-11-08T12:29:21.788707+0000","last_clean":"2023-11-08T12:29:21.788707+0000","last_became_active":"2023-11-08T12:29:21.341965+0000","last_became_peered":"2023-11-08T12:29:21.341965+0000","last_unstale":"2023-11-08T12:29:21.788707+0000","last_undegraded":"2023-11-08T12:29:21.788707+0000","last_fullsized":"2023-11-08T12:29:21.788707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:12:59.456980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.818280+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:29:21.818280+0000","last_peered":"2023-11-08T12:29:21.818280+0000","last_clean":"2023-11-08T12:29:21.818280+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:29:21.818280+0000","last_undegraded":"2023-11-08T12:29:21.818280+0000","last_fullsized":"2023-11-08T12:29:21.818280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784243+0000","last_change":"2023-11-08T12:29:21.823842+0000","last_active":"2023-11-08T12:29:22.784243+0000","last_peered":"2023-11-08T12:29:22.784243+0000","last_clean":"2023-11-08T12:29:22.784243+0000","last_became_active":"2023-11-08T12:29:21.823376+0000","last_became_peered":"2023-11-08T12:29:21.823376+0000","last_unstale":"2023-11-08T12:29:22.784243+0000","last_undegraded":"2023-11-08T12:29:22.784243+0000","last_fullsized":"2023-11-08T12:29:22.784243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:48:49.601579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808471+0000","last_change":"2023-11-08T12:29:21.346624+0000","last_active":"2023-11-08T12:29:21.808471+0000","last_peered":"2023-11-08T12:29:21.808471+0000","last_clean":"2023-11-08T12:29:21.808471+0000","last_became_active":"2023-11-08T12:29:21.346156+0000","last_became_peered":"2023-11-08T12:29:21.346156+0000","last_unstale":"2023-11-08T12:29:21.808471+0000","last_undegraded":"2023-11-08T12:29:21.808471+0000","last_fullsized":"2023-11-08T12:29:21.808471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:48.531585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.803818+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:29:21.803818+0000","last_peered":"2023-11-08T12:29:21.803818+0000","last_clean":"2023-11-08T12:29:21.803818+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:29:21.803818+0000","last_undegraded":"2023-11-08T12:29:21.803818+0000","last_fullsized":"2023-11-08T12:29:21.803818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802735+0000","last_change":"2023-11-08T12:29:21.802735+0000","last_active":"2023-11-08T12:29:21.802735+0000","last_peered":"2023-11-08T12:29:21.802735+0000","last_clean":"2023-11-08T12:29:21.802735+0000","last_became_active":"2023-11-08T12:29:21.802154+0000","last_became_peered":"2023-11-08T12:29:21.802154+0000","last_unstale":"2023-11-08T12:29:21.802735+0000","last_undegraded":"2023-11-08T12:29:21.802735+0000","last_fullsized":"2023-11-08T12:29:21.802735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.798641+0000","last_change":"2023-11-08T12:29:21.342114+0000","last_active":"2023-11-08T12:29:21.798641+0000","last_peered":"2023-11-08T12:29:21.798641+0000","last_clean":"2023-11-08T12:29:21.798641+0000","last_became_active":"2023-11-08T12:29:21.341856+0000","last_became_peered":"2023-11-08T12:29:21.341856+0000","last_unstale":"2023-11-08T12:29:21.798641+0000","last_undegraded":"2023-11-08T12:29:21.798641+0000","last_fullsized":"2023-11-08T12:29:21.798641+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:26.810564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811411+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:29:21.811411+0000","last_peered":"2023-11-08T12:29:21.811411+0000","last_clean":"2023-11-08T12:29:21.811411+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:29:21.811411+0000","last_undegraded":"2023-11-08T12:29:21.811411+0000","last_fullsized":"2023-11-08T12:29:21.811411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810392+0000","last_change":"2023-11-08T12:29:21.802763+0000","last_active":"2023-11-08T12:29:21.810392+0000","last_peered":"2023-11-08T12:29:21.810392+0000","last_clean":"2023-11-08T12:29:21.810392+0000","last_became_active":"2023-11-08T12:29:21.802445+0000","last_became_peered":"2023-11-08T12:29:21.802445+0000","last_unstale":"2023-11-08T12:29:21.810392+0000","last_undegraded":"2023-11-08T12:29:21.810392+0000","last_fullsized":"2023-11-08T12:29:21.810392+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:58:00.614714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786069+0000","last_change":"2023-11-08T12:29:21.334567+0000","last_active":"2023-11-08T12:29:22.786069+0000","last_peered":"2023-11-08T12:29:22.786069+0000","last_clean":"2023-11-08T12:29:22.786069+0000","last_became_active":"2023-11-08T12:29:21.334322+0000","last_became_peered":"2023-11-08T12:29:21.334322+0000","last_unstale":"2023-11-08T12:29:22.786069+0000","last_undegraded":"2023-11-08T12:29:22.786069+0000","last_fullsized":"2023-11-08T12:29:22.786069+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:52:07.194386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.795001+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:29:21.795001+0000","last_peered":"2023-11-08T12:29:21.795001+0000","last_clean":"2023-11-08T12:29:21.795001+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:29:21.795001+0000","last_undegraded":"2023-11-08T12:29:21.795001+0000","last_fullsized":"2023-11-08T12:29:21.795001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495222+0000","last_change":"2023-11-08T12:29:21.801672+0000","last_active":"2023-11-08T12:29:23.495222+0000","last_peered":"2023-11-08T12:29:23.495222+0000","last_clean":"2023-11-08T12:29:23.495222+0000","last_became_active":"2023-11-08T12:29:21.801407+0000","last_became_peered":"2023-11-08T12:29:21.801407+0000","last_unstale":"2023-11-08T12:29:23.495222+0000","last_undegraded":"2023-11-08T12:29:23.495222+0000","last_fullsized":"2023-11-08T12:29:23.495222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.803735+0000","last_change":"2023-11-08T12:29:21.349084+0000","last_active":"2023-11-08T12:29:21.803735+0000","last_peered":"2023-11-08T12:29:21.803735+0000","last_clean":"2023-11-08T12:29:21.803735+0000","last_became_active":"2023-11-08T12:29:21.348680+0000","last_became_peered":"2023-11-08T12:29:21.348680+0000","last_unstale":"2023-11-08T12:29:21.803735+0000","last_undegraded":"2023-11-08T12:29:21.803735+0000","last_fullsized":"2023-11-08T12:29:21.803735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800385+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:29:21.800385+0000","last_peered":"2023-11-08T12:29:21.800385+0000","last_clean":"2023-11-08T12:29:21.800385+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:29:21.800385+0000","last_undegraded":"2023-11-08T12:29:21.800385+0000","last_fullsized":"2023-11-08T12:29:21.800385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502334+0000","last_change":"2023-11-08T12:29:21.810554+0000","last_active":"2023-11-08T12:29:23.502334+0000","last_peered":"2023-11-08T12:29:23.502334+0000","last_clean":"2023-11-08T12:29:23.502334+0000","last_became_active":"2023-11-08T12:29:21.810139+0000","last_became_peered":"2023-11-08T12:29:21.810139+0000","last_unstale":"2023-11-08T12:29:23.502334+0000","last_undegraded":"2023-11-08T12:29:23.502334+0000","last_fullsized":"2023-11-08T12:29:23.502334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811331+0000","last_change":"2023-11-08T12:29:21.344284+0000","last_active":"2023-11-08T12:29:21.811331+0000","last_peered":"2023-11-08T12:29:21.811331+0000","last_clean":"2023-11-08T12:29:21.811331+0000","last_became_active":"2023-11-08T12:29:21.343968+0000","last_became_peered":"2023-11-08T12:29:21.343968+0000","last_unstale":"2023-11-08T12:29:21.811331+0000","last_undegraded":"2023-11-08T12:29:21.811331+0000","last_fullsized":"2023-11-08T12:29:21.811331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:57:59.598650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800896+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:29:21.800896+0000","last_peered":"2023-11-08T12:29:21.800896+0000","last_clean":"2023-11-08T12:29:21.800896+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:29:21.800896+0000","last_undegraded":"2023-11-08T12:29:21.800896+0000","last_fullsized":"2023-11-08T12:29:21.800896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495580+0000","last_change":"2023-11-08T12:29:21.820768+0000","last_active":"2023-11-08T12:29:23.495580+0000","last_peered":"2023-11-08T12:29:23.495580+0000","last_clean":"2023-11-08T12:29:23.495580+0000","last_became_active":"2023-11-08T12:29:21.820536+0000","last_became_peered":"2023-11-08T12:29:21.820536+0000","last_unstale":"2023-11-08T12:29:23.495580+0000","last_undegraded":"2023-11-08T12:29:23.495580+0000","last_fullsized":"2023-11-08T12:29:23.495580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:14:09.179363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810868+0000","last_change":"2023-11-08T12:29:21.340014+0000","last_active":"2023-11-08T12:29:21.810868+0000","last_peered":"2023-11-08T12:29:21.810868+0000","last_clean":"2023-11-08T12:29:21.810868+0000","last_became_active":"2023-11-08T12:29:21.339760+0000","last_became_peered":"2023-11-08T12:29:21.339760+0000","last_unstale":"2023-11-08T12:29:21.810868+0000","last_undegraded":"2023-11-08T12:29:21.810868+0000","last_fullsized":"2023-11-08T12:29:21.810868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.793224+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:29:21.793224+0000","last_peered":"2023-11-08T12:29:21.793224+0000","last_clean":"2023-11-08T12:29:21.793224+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:29:21.793224+0000","last_undegraded":"2023-11-08T12:29:21.793224+0000","last_fullsized":"2023-11-08T12:29:21.793224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801069+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:29:21.801069+0000","last_peered":"2023-11-08T12:29:21.801069+0000","last_clean":"2023-11-08T12:29:21.801069+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:29:21.801069+0000","last_undegraded":"2023-11-08T12:29:21.801069+0000","last_fullsized":"2023-11-08T12:29:21.801069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476760,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":462848,"data_stored":202197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":7.4889999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":4.1799999999999997}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":4.0300000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.851}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":3.9569999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":5.601},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":3.9119999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.8819999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":4.0720000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.8080000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.69599999999999995}]}]},{"osd":4,"up_from":16,"seq":68719476760,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8728,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363112,"statfs":{"total":96636764160,"available":96627826688,"internally_reserved":0,"allocated":475136,"data_stored":209137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.4139999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.143},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.85399999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":1.546}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.089}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.3}]},{"osd":6,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.53},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.621}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.569},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3720000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9848,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361992,"statfs":{"total":96636764160,"available":96626679808,"internally_reserved":0,"allocated":1097728,"data_stored":814016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79400000000000004}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.98799999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.198}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.071},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.026},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.036}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":223628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":1.2030000000000001},{"interface":"front","average":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":21.238,"5min":21.238,"15min":21.238},"last":0.874}]},{"osd":1,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":8.0630000000000006,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":11.907,"5min":11.907,"15min":11.907},"last":1.3049999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.085},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.127}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.375}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.2410000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":8.109,"5min":8.109,"15min":8.109},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.4099999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":512000,"data_stored":224180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.76400000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.438}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.335}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.107},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.1639999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":223628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.87},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92800000000000005}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.208}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.236},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.054}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.8679999999999999,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.369},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.7240000000000002,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":1.206,"5min":1.206,"15min":1.206},"max":{"1min":2.8599999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.2609999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9848,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361992,"statfs":{"total":96636764160,"available":96626679808,"internally_reserved":0,"allocated":1097728,"data_stored":813960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.54,"5min":6.54,"15min":6.54},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":6.6760000000000002,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":1.2290000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.173},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":1.444}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":6.5579999999999998,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.4850000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.369},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.395}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.347},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.6040000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"min":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.591}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.0509999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8640,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363200,"statfs":{"total":96636764160,"available":96627916800,"internally_reserved":0,"allocated":516096,"data_stored":225128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.876},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.121},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.472}]},{"osd":7,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.21},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":1.5700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:29:27.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-08T12:29:27.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.787670+0000', 'last_change': '2023-11-08T12:29:21.787670+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.787670+0000', 'last_undegraded': '2023-11-08T12:29:21.787670+0000', 'last_fullsized': '2023-11-08T12:29:21.787670+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T12:29:27.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-11-08T12:29:27.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.785634+0000', 'last_change': '2023-11-08T12:29:21.785634+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.785634+0000', 'last_undegraded': '2023-11-08T12:29:21.785634+0000', 'last_fullsized': '2023-11-08T12:29:21.785634+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T22:07:28.967380+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': ['6', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T12:29:27.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-08T12:29:27.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.788302+0000', 'last_change': '2023-11-08T12:29:21.788302+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.788302+0000', 'last_undegraded': '2023-11-08T12:29:21.788302+0000', 'last_fullsized': '2023-11-08T12:29:21.788302+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T12:29:27.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-11-08T12:29:27.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.786873+0000', 'last_change': '2023-11-08T12:29:21.786873+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.786873+0000', 'last_undegraded': '2023-11-08T12:29:21.786873+0000', 'last_fullsized': '2023-11-08T12:29:21.786873+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T18:49:11.842225+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T12:29:27.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-11-08T12:29:27.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.785219+0000', 'last_change': '2023-11-08T12:29:21.785219+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.785219+0000', 'last_undegraded': '2023-11-08T12:29:21.785219+0000', 'last_fullsized': '2023-11-08T12:29:21.785219+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T12:31:33.328583+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T12:29:27.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-11-08T12:29:27.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.790498+0000', 'last_change': '2023-11-08T12:29:21.790498+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.790498+0000', 'last_undegraded': '2023-11-08T12:29:21.790498+0000', 'last_fullsized': '2023-11-08T12:29:21.790498+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T21:09:23.051243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T12:29:27.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-08T12:29:27.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.787074+0000', 'last_change': '2023-11-08T12:29:21.787074+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.787074+0000', 'last_undegraded': '2023-11-08T12:29:21.787074+0000', 'last_fullsized': '2023-11-08T12:29:21.787074+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T12:29:27.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-11-08T12:29:27.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.787774+0000', 'last_change': '2023-11-08T12:29:21.787774+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.787774+0000', 'last_undegraded': '2023-11-08T12:29:21.787774+0000', 'last_fullsized': '2023-11-08T12:29:21.787774+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-10T00:09:30.058995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T12:29:27.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-08T12:29:27.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.787898+0000', 'last_change': '2023-11-08T12:29:21.787898+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.787898+0000', 'last_undegraded': '2023-11-08T12:29:21.787898+0000', 'last_fullsized': '2023-11-08T12:29:21.787898+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-08T12:29:27.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-11-08T12:29:27.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.787005+0000', 'last_change': '2023-11-08T12:29:21.787005+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.787005+0000', 'last_undegraded': '2023-11-08T12:29:21.787005+0000', 'last_fullsized': '2023-11-08T12:29:21.787005+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T17:49:05.769508+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T12:29:27.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-11-08T12:29:27.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 43, 'state': 'creating+activating', 'last_fresh': '2023-11-08T12:29:21.787486+0000', 'last_change': '2023-11-08T12:29:21.787486+0000', 'last_active': '2023-11-08T12:29:21.303108+0000', 'last_peered': '2023-11-08T12:29:21.303108+0000', 'last_clean': '2023-11-08T12:29:21.303108+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:29:21.787486+0000', 'last_undegraded': '2023-11-08T12:29:21.787486+0000', 'last_fullsized': '2023-11-08T12:29:21.787486+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'last_clean_scrub_stamp': '2023-11-08T12:29:21.303108+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T22:23:38.192520+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-08T12:29:27.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-08T12:29:27.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.235+0000 7feb8a9d2700 1 Processor -- start 2023-11-08T12:29:27.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.235+0000 7feb8a9d2700 1 -- start start 2023-11-08T12:29:27.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb8a9d2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb8415c5e0 0x7feb840ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb8a9d2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8406a700 con 0x7feb8415ca80 2023-11-08T12:29:27.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb8a9d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8406a9e0 con 0x7feb840b3530 2023-11-08T12:29:27.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb8a9d2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8406afa0 con 0x7feb8415c5e0 2023-11-08T12:29:27.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb8a1d1700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7feb8415ca80 0x7feb84069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59020/0 (socket says 172.21.15.112:59020) 2023-11-08T12:29:27.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb8a1d1700 1 -- 172.21.15.112:0/2524052318 learned_addr learned my addr 172.21.15.112:0/2524052318 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:27.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb891cf700 1 --2- 172.21.15.112:0/2524052318 >> v2:172.21.15.112:3300/0 conn(0x7feb8415c5e0 0x7feb840ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb889ce700 1 -- 172.21.15.112:0/2524052318 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478791907 0 0) 0x7feb8406a9e0 con 0x7feb840b3530 2023-11-08T12:29:27.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb889ce700 1 -- 172.21.15.112:0/2524052318 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb700035d0 con 0x7feb840b3530 2023-11-08T12:29:27.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb889ce700 1 -- 172.21.15.112:0/2524052318 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850295594 0 0) 0x7feb8406a700 con 0x7feb8415ca80 2023-11-08T12:29:27.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb889ce700 1 -- 172.21.15.112:0/2524052318 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb8406a9e0 con 0x7feb8415ca80 2023-11-08T12:29:27.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb891cf700 1 -- 172.21.15.112:0/2524052318 >> v1:172.21.15.133:6789/0 conn(0x7feb840b3530 legacy=0x7feb840b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb891cf700 1 -- 172.21.15.112:0/2524052318 >> v1:172.21.15.112:6789/0 conn(0x7feb8415ca80 legacy=0x7feb84069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb891cf700 1 -- 172.21.15.112:0/2524052318 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8406acc0 con 0x7feb8415c5e0 2023-11-08T12:29:27.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb891cf700 1 --2- 172.21.15.112:0/2524052318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8415c5e0 0x7feb840ccb90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb74009850 tx=0x7feb74009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbb8c698512f1f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:27.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb889ce700 1 -- 172.21.15.112:0/2524052318 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74011830 con 0x7feb8415c5e0 2023-11-08T12:29:27.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb889ce700 1 -- 172.21.15.112:0/2524052318 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74011990 con 0x7feb8415c5e0 2023-11-08T12:29:27.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.239+0000 7feb889ce700 1 -- 172.21.15.112:0/2524052318 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74011d40 con 0x7feb8415c5e0 2023-11-08T12:29:27.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.243+0000 7feb8a9d2700 1 -- 172.21.15.112:0/2524052318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8415c5e0 msgr2=0x7feb840ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.243+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/2524052318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8415c5e0 0x7feb840ccb90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb74009850 tx=0x7feb74009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:27.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.243+0000 7feb8a9d2700 1 -- 172.21.15.112:0/2524052318 shutdown_connections 2023-11-08T12:29:27.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.243+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/2524052318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8415c5e0 0x7feb840ccb90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.243+0000 7feb8a9d2700 1 -- 172.21.15.112:0/2524052318 >> 172.21.15.112:0/2524052318 conn(0x7feb840ce670 msgr2=0x7feb840cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:27.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.243+0000 7feb8a9d2700 1 -- 172.21.15.112:0/2524052318 shutdown_connections 2023-11-08T12:29:27.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.243+0000 7feb8a9d2700 1 -- 172.21.15.112:0/2524052318 wait complete. 2023-11-08T12:29:27.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 Processor -- start 2023-11-08T12:29:27.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 -- start start 2023-11-08T12:29:27.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb840b3530 0x7feb840cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb8415c5e0 0x7feb840973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8415ca80 0x7feb84154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb841531a0 con 0x7feb840b3530 2023-11-08T12:29:27.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb84152870 con 0x7feb8415ca80 2023-11-08T12:29:27.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a9d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb84152b50 con 0x7feb8415c5e0 2023-11-08T12:29:27.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb840b3530 0x7feb840cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb840b3530 0x7feb840cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47292/0 (socket says 172.21.15.112:47292) 2023-11-08T12:29:27.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 -- 172.21.15.112:0/1750781964 learned_addr learned my addr 172.21.15.112:0/1750781964 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:27.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb8a1d1700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8415ca80 0x7feb84154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb891cf700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb8415c5e0 0x7feb840973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 -- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb8415c5e0 msgr2=0x7feb840973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb8415c5e0 0x7feb840973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 -- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8415ca80 msgr2=0x7feb84154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8415ca80 0x7feb84154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 -- 172.21.15.112:0/1750781964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb740094b0 con 0x7feb840b3530 2023-11-08T12:29:27.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.247+0000 7feb899d0700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb840b3530 0x7feb840cda40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feb800010e0 tx=0x7feb8000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:27.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.251+0000 7feb7a7fc700 1 -- 172.21.15.112:0/1750781964 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800052d0 con 0x7feb840b3530 2023-11-08T12:29:27.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.251+0000 7feb7a7fc700 1 -- 172.21.15.112:0/1750781964 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80005430 con 0x7feb840b3530 2023-11-08T12:29:27.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.251+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb84167240 con 0x7feb840b3530 2023-11-08T12:29:27.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.251+0000 7feb7a7fc700 1 -- 172.21.15.112:0/1750781964 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800055a0 con 0x7feb840b3530 2023-11-08T12:29:27.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.251+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8406c0a0 con 0x7feb840b3530 2023-11-08T12:29:27.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.251+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb841673d0 con 0x7feb840b3530 2023-11-08T12:29:27.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.251+0000 7feb7a7fc700 1 -- 172.21.15.112:0/1750781964 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feb80019030 con 0x7feb840b3530 2023-11-08T12:29:27.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.255+0000 7feb7a7fc700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb68064ee0 0x7feb68067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.255+0000 7feb7a7fc700 1 -- 172.21.15.112:0/1750781964 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feb800814e0 con 0x7feb840b3530 2023-11-08T12:29:27.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.255+0000 7feb891cf700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb68064ee0 0x7feb68067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.255+0000 7feb891cf700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb68064ee0 0x7feb68067390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feb740090b0 tx=0x7feb74008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:27.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.263+0000 7feb7a7fc700 1 -- 172.21.15.112:0/1750781964 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feb8004f3f0 con 0x7feb840b3530 2023-11-08T12:29:27.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7feb84073cb0 con 0x7feb840b3530 2023-11-08T12:29:27.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb7a7fc700 1 -- 172.21.15.112:0/1750781964 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1101 (secure 0 0 0) 0x7feb80052a10 con 0x7feb840b3530 2023-11-08T12:29:27.499 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:27.500 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":119,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1699446461,"num_in_osds":8,"osd_in_since":1699446451,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":94},{"state_name":"creating+activating","count":11}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592698,"bytes_used":73392128,"bytes_avail":773020721152,"bytes_total":773094113280,"inactive_pgs_ratio":0.10476190596818924,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5346}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-08T12:29:00.733525+0000","services":{}},"progress_events":{}} 2023-11-08T12:29:27.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb68064ee0 msgr2=0x7feb68067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb68064ee0 0x7feb68067390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feb740090b0 tx=0x7feb74008030 comp rx=0 tx=0).stop 2023-11-08T12:29:27.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb840b3530 msgr2=0x7feb840cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb840b3530 0x7feb840cda40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feb800010e0 tx=0x7feb8000ca90 comp rx=0 tx=0).stop 2023-11-08T12:29:27.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 shutdown_connections 2023-11-08T12:29:27.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.495+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb68064ee0 0x7feb68067390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.499+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8415ca80 0x7feb84154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.499+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb8415c5e0 0x7feb840973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.499+0000 7feb8a9d2700 1 --2- 172.21.15.112:0/1750781964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb840b3530 0x7feb840cda40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.499+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 >> 172.21.15.112:0/1750781964 conn(0x7feb840ce670 msgr2=0x7feb840ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:27.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.499+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 shutdown_connections 2023-11-08T12:29:27.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.499+0000 7feb8a9d2700 1 -- 172.21.15.112:0/1750781964 wait complete. 2023-11-08T12:29:27.522 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-08T12:29:27.523 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.687+0000 7f8574ed1700 1 Processor -- start 2023-11-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.687+0000 7f8574ed1700 1 -- start start 2023-11-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f8574ed1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f857015c3b0 0x7f85700d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f8574ed1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f857006c040 0x7f857006c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f8574ed1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85700cafd0 0x7f85700cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f8574ed1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700cb990 con 0x7f857015c3b0 2023-11-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f8574ed1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700cebb0 con 0x7f857006c040 2023-11-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f8574ed1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85700ce5f0 con 0x7f85700cafd0 2023-11-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f857015c3b0 0x7f85700d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f857015c3b0 0x7f85700d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47302/0 (socket says 172.21.15.112:47302) 2023-11-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 -- 172.21.15.112:0/3524374569 learned_addr learned my addr 172.21.15.112:0/3524374569 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856dd9b700 1 --2- 172.21.15.112:0/3524374569 >> v2:172.21.15.133:3300/0 conn(0x7f857006c040 0x7f857006c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856ed9d700 1 --2- 172.21.15.112:0/3524374569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85700cafd0 0x7f85700cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 -- 172.21.15.112:0/3524374569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85700cafd0 msgr2=0x7f85700cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 --2- 172.21.15.112:0/3524374569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85700cafd0 0x7f85700cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 -- 172.21.15.112:0/3524374569 >> v2:172.21.15.133:3300/0 conn(0x7f857006c040 msgr2=0x7f857006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 --2- 172.21.15.112:0/3524374569 >> v2:172.21.15.133:3300/0 conn(0x7f857006c040 0x7f857006c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 -- 172.21.15.112:0/3524374569 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700ce8d0 con 0x7f857015c3b0 2023-11-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856ed9d700 1 --2- 172.21.15.112:0/3524374569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85700cafd0 0x7f85700cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856e59c700 1 --2- 172.21.15.112:0/3524374569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857015c3b0 0x7f85700d00b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f85700c4090 tx=0x7f8560009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d08278b50a0c78 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856d59a700 1 -- 172.21.15.112:0/3524374569 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856000b8a0 con 0x7f857015c3b0 2023-11-08T12:29:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856d59a700 1 -- 172.21.15.112:0/3524374569 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856000ba00 con 0x7f857015c3b0 2023-11-08T12:29:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.691+0000 7f856d59a700 1 -- 172.21.15.112:0/3524374569 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856000bd90 con 0x7f857015c3b0 2023-11-08T12:29:27.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 -- 172.21.15.112:0/3524374569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857015c3b0 msgr2=0x7f85700d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3524374569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857015c3b0 0x7f85700d00b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f85700c4090 tx=0x7f8560009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 -- 172.21.15.112:0/3524374569 shutdown_connections 2023-11-08T12:29:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3524374569 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85700cafd0 0x7f85700cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3524374569 >> v2:172.21.15.133:3300/0 conn(0x7f857006c040 0x7f857006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3524374569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f857015c3b0 0x7f85700d00b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 -- 172.21.15.112:0/3524374569 >> 172.21.15.112:0/3524374569 conn(0x7f857006e520 msgr2=0x7f857006e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:27.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 -- 172.21.15.112:0/3524374569 shutdown_connections 2023-11-08T12:29:27.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.695+0000 7f8574ed1700 1 -- 172.21.15.112:0/3524374569 wait complete. 2023-11-08T12:29:27.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.699+0000 7f8574ed1700 1 Processor -- start 2023-11-08T12:29:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.699+0000 7f8574ed1700 1 -- start start 2023-11-08T12:29:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.699+0000 7f8574ed1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f857006c040 0x7f857014c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.699+0000 7f8574ed1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85700cafd0 0x7f85700b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f8574ed1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857015c3b0 0x7f85700b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f8574ed1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700c9d00 con 0x7f85700cafd0 2023-11-08T12:29:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f8574ed1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857014cfa0 con 0x7f857015c3b0 2023-11-08T12:29:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f8574ed1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857014ca30 con 0x7f857006c040 2023-11-08T12:29:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85700cafd0 0x7f85700b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85700cafd0 0x7f85700b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47306/0 (socket says 172.21.15.112:47306) 2023-11-08T12:29:27.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 -- 172.21.15.112:0/3078563465 learned_addr learned my addr 172.21.15.112:0/3078563465 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856e59c700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f857006c040 0x7f857014c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856ed9d700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857015c3b0 0x7f85700b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 -- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f857006c040 msgr2=0x7f857014c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f857006c040 0x7f857014c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 -- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857015c3b0 msgr2=0x7f85700b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857015c3b0 0x7f85700b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 -- 172.21.15.112:0/3078563465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8560009570 con 0x7f85700cafd0 2023-11-08T12:29:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856ed9d700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857015c3b0 0x7f85700b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f856dd9b700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85700cafd0 0x7f85700b2730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f856400d830 tx=0x7f856400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f855effd700 1 -- 172.21.15.112:0/3078563465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564014620 con 0x7f85700cafd0 2023-11-08T12:29:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f855effd700 1 -- 172.21.15.112:0/3078563465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8564014780 con 0x7f85700cafd0 2023-11-08T12:29:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857006bb20 con 0x7f85700cafd0 2023-11-08T12:29:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f855effd700 1 -- 172.21.15.112:0/3078563465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564014b10 con 0x7f85700cafd0 2023-11-08T12:29:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857006b840 con 0x7f85700cafd0 2023-11-08T12:29:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85700d05f0 con 0x7f85700cafd0 2023-11-08T12:29:27.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.703+0000 7f855effd700 1 -- 172.21.15.112:0/3078563465 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8564024070 con 0x7f85700cafd0 2023-11-08T12:29:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.707+0000 7f855effd700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8550064ee0 0x7f8550067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.707+0000 7f855effd700 1 -- 172.21.15.112:0/3078563465 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f85640824d0 con 0x7f85700cafd0 2023-11-08T12:29:27.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.707+0000 7f856e59c700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8550064ee0 0x7f8550067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:27.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.707+0000 7f856e59c700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8550064ee0 0x7f8550067390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8560000c00 tx=0x7f8560008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:27.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.715+0000 7f855effd700 1 -- 172.21.15.112:0/3078563465 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8564050440 con 0x7f85700cafd0 2023-11-08T12:29:27.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.879+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85700726c0 con 0x7f8550064ee0 2023-11-08T12:29:27.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.895+0000 7f855effd700 1 -- 172.21.15.112:0/3078563465 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308264 (secure 0 0 0) 0x7f85700726c0 con 0x7f8550064ee0 2023-11-08T12:29:27.905 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:27.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8550064ee0 msgr2=0x7f8550067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8550064ee0 0x7f8550067390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8560000c00 tx=0x7f8560008030 comp rx=0 tx=0).stop 2023-11-08T12:29:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85700cafd0 msgr2=0x7f85700b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:27.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85700cafd0 0x7f85700b2730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f856400d830 tx=0x7f856400dbf0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 shutdown_connections 2023-11-08T12:29:27.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8550064ee0 0x7f8550067390 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f857015c3b0 0x7f85700b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85700cafd0 0x7f85700b2730 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 --2- 172.21.15.112:0/3078563465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f857006c040 0x7f857014c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:27.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.903+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 >> 172.21.15.112:0/3078563465 conn(0x7f857006e520 msgr2=0x7f8570157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:27.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.907+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 shutdown_connections 2023-11-08T12:29:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:27.907+0000 7f8574ed1700 1 -- 172.21.15.112:0/3078563465 wait complete. 2023-11-08T12:29:27.915 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:29:27.935 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-11-08T12:29:26.742505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71672,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":66560,"kb_avail":754903048,"statfs":{"total":773094113280,"available":773020721152,"internally_reserved":0,"allocated":5169152,"data_stored":2935874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68157440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002271"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502521+0000","last_change":"2023-11-08T12:29:21.817753+0000","last_active":"2023-11-08T12:29:23.502521+0000","last_peered":"2023-11-08T12:29:23.502521+0000","last_clean":"2023-11-08T12:29:23.502521+0000","last_became_active":"2023-11-08T12:29:21.817472+0000","last_became_peered":"2023-11-08T12:29:21.817472+0000","last_unstale":"2023-11-08T12:29:23.502521+0000","last_undegraded":"2023-11-08T12:29:23.502521+0000","last_fullsized":"2023-11-08T12:29:23.502521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:48:49.601579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784936+0000","last_change":"2023-11-08T12:29:21.809249+0000","last_active":"2023-11-08T12:29:22.784936+0000","last_peered":"2023-11-08T12:29:22.784936+0000","last_clean":"2023-11-08T12:29:22.784936+0000","last_became_active":"2023-11-08T12:29:21.808986+0000","last_became_peered":"2023-11-08T12:29:21.808986+0000","last_unstale":"2023-11-08T12:29:22.784936+0000","last_undegraded":"2023-11-08T12:29:22.784936+0000","last_fullsized":"2023-11-08T12:29:22.784936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:47:34.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787670+0000","last_change":"2023-11-08T12:29:21.787670+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787670+0000","last_undegraded":"2023-11-08T12:29:21.787670+0000","last_fullsized":"2023-11-08T12:29:21.787670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495176+0000","last_change":"2023-11-08T12:29:21.807409+0000","last_active":"2023-11-08T12:29:23.495176+0000","last_peered":"2023-11-08T12:29:23.495176+0000","last_clean":"2023-11-08T12:29:23.495176+0000","last_became_active":"2023-11-08T12:29:21.807166+0000","last_became_peered":"2023-11-08T12:29:21.807166+0000","last_unstale":"2023-11-08T12:29:23.495176+0000","last_undegraded":"2023-11-08T12:29:23.495176+0000","last_fullsized":"2023-11-08T12:29:23.495176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:30.081962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784594+0000","last_change":"2023-11-08T12:29:21.804383+0000","last_active":"2023-11-08T12:29:22.784594+0000","last_peered":"2023-11-08T12:29:22.784594+0000","last_clean":"2023-11-08T12:29:22.784594+0000","last_became_active":"2023-11-08T12:29:21.804182+0000","last_became_peered":"2023-11-08T12:29:21.804182+0000","last_unstale":"2023-11-08T12:29:22.784594+0000","last_undegraded":"2023-11-08T12:29:22.784594+0000","last_fullsized":"2023-11-08T12:29:22.784594+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785345+0000","last_change":"2023-11-08T12:29:21.816037+0000","last_active":"2023-11-08T12:29:22.785345+0000","last_peered":"2023-11-08T12:29:22.785345+0000","last_clean":"2023-11-08T12:29:22.785345+0000","last_became_active":"2023-11-08T12:29:21.815653+0000","last_became_peered":"2023-11-08T12:29:21.815653+0000","last_unstale":"2023-11-08T12:29:22.785345+0000","last_undegraded":"2023-11-08T12:29:22.785345+0000","last_fullsized":"2023-11-08T12:29:22.785345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.501888+0000","last_change":"2023-11-08T12:29:21.819916+0000","last_active":"2023-11-08T12:29:23.501888+0000","last_peered":"2023-11-08T12:29:23.501888+0000","last_clean":"2023-11-08T12:29:23.501888+0000","last_became_active":"2023-11-08T12:29:21.819605+0000","last_became_peered":"2023-11-08T12:29:21.819605+0000","last_unstale":"2023-11-08T12:29:23.501888+0000","last_undegraded":"2023-11-08T12:29:23.501888+0000","last_fullsized":"2023-11-08T12:29:23.501888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.493735+0000","last_change":"2023-11-08T12:29:21.813522+0000","last_active":"2023-11-08T12:29:23.493735+0000","last_peered":"2023-11-08T12:29:23.493735+0000","last_clean":"2023-11-08T12:29:23.493735+0000","last_became_active":"2023-11-08T12:29:21.812613+0000","last_became_peered":"2023-11-08T12:29:21.812613+0000","last_unstale":"2023-11-08T12:29:23.493735+0000","last_undegraded":"2023-11-08T12:29:23.493735+0000","last_fullsized":"2023-11-08T12:29:23.493735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495637+0000","last_change":"2023-11-08T12:29:21.827080+0000","last_active":"2023-11-08T12:29:23.495637+0000","last_peered":"2023-11-08T12:29:23.495637+0000","last_clean":"2023-11-08T12:29:23.495637+0000","last_became_active":"2023-11-08T12:29:21.826734+0000","last_became_peered":"2023-11-08T12:29:21.826734+0000","last_unstale":"2023-11-08T12:29:23.495637+0000","last_undegraded":"2023-11-08T12:29:23.495637+0000","last_fullsized":"2023-11-08T12:29:23.495637+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:28:58.357487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495612+0000","last_change":"2023-11-08T12:29:21.808710+0000","last_active":"2023-11-08T12:29:23.495612+0000","last_peered":"2023-11-08T12:29:23.495612+0000","last_clean":"2023-11-08T12:29:23.495612+0000","last_became_active":"2023-11-08T12:29:21.808476+0000","last_became_peered":"2023-11-08T12:29:21.808476+0000","last_unstale":"2023-11-08T12:29:23.495612+0000","last_undegraded":"2023-11-08T12:29:23.495612+0000","last_fullsized":"2023-11-08T12:29:23.495612+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495091+0000","last_change":"2023-11-08T12:29:21.827439+0000","last_active":"2023-11-08T12:29:23.495091+0000","last_peered":"2023-11-08T12:29:23.495091+0000","last_clean":"2023-11-08T12:29:23.495091+0000","last_became_active":"2023-11-08T12:29:21.827185+0000","last_became_peered":"2023-11-08T12:29:21.827185+0000","last_unstale":"2023-11-08T12:29:23.495091+0000","last_undegraded":"2023-11-08T12:29:23.495091+0000","last_fullsized":"2023-11-08T12:29:23.495091+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784669+0000","last_change":"2023-11-08T12:29:21.822648+0000","last_active":"2023-11-08T12:29:22.784669+0000","last_peered":"2023-11-08T12:29:22.784669+0000","last_clean":"2023-11-08T12:29:22.784669+0000","last_became_active":"2023-11-08T12:29:21.822442+0000","last_became_peered":"2023-11-08T12:29:21.822442+0000","last_unstale":"2023-11-08T12:29:22.784669+0000","last_undegraded":"2023-11-08T12:29:22.784669+0000","last_fullsized":"2023-11-08T12:29:22.784669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786731+0000","last_change":"2023-11-08T12:29:21.817755+0000","last_active":"2023-11-08T12:29:22.786731+0000","last_peered":"2023-11-08T12:29:22.786731+0000","last_clean":"2023-11-08T12:29:22.786731+0000","last_became_active":"2023-11-08T12:29:21.817490+0000","last_became_peered":"2023-11-08T12:29:21.817490+0000","last_unstale":"2023-11-08T12:29:22.786731+0000","last_undegraded":"2023-11-08T12:29:22.786731+0000","last_fullsized":"2023-11-08T12:29:22.786731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:56.007182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494144+0000","last_change":"2023-11-08T12:29:21.828260+0000","last_active":"2023-11-08T12:29:23.494144+0000","last_peered":"2023-11-08T12:29:23.494144+0000","last_clean":"2023-11-08T12:29:23.494144+0000","last_became_active":"2023-11-08T12:29:21.827984+0000","last_became_peered":"2023-11-08T12:29:21.827984+0000","last_unstale":"2023-11-08T12:29:23.494144+0000","last_undegraded":"2023-11-08T12:29:23.494144+0000","last_fullsized":"2023-11-08T12:29:23.494144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785168+0000","last_change":"2023-11-08T12:29:21.806695+0000","last_active":"2023-11-08T12:29:22.785168+0000","last_peered":"2023-11-08T12:29:22.785168+0000","last_clean":"2023-11-08T12:29:22.785168+0000","last_became_active":"2023-11-08T12:29:21.806460+0000","last_became_peered":"2023-11-08T12:29:21.806460+0000","last_unstale":"2023-11-08T12:29:22.785168+0000","last_undegraded":"2023-11-08T12:29:22.785168+0000","last_fullsized":"2023-11-08T12:29:22.785168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785634+0000","last_change":"2023-11-08T12:29:21.785634+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785634+0000","last_undegraded":"2023-11-08T12:29:21.785634+0000","last_fullsized":"2023-11-08T12:29:21.785634+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:28.967380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802733+0000","last_change":"2023-11-08T12:29:21.802733+0000","last_active":"2023-11-08T12:29:21.802733+0000","last_peered":"2023-11-08T12:29:21.802733+0000","last_clean":"2023-11-08T12:29:21.802733+0000","last_became_active":"2023-11-08T12:29:21.802417+0000","last_became_peered":"2023-11-08T12:29:21.802417+0000","last_unstale":"2023-11-08T12:29:21.802733+0000","last_undegraded":"2023-11-08T12:29:21.802733+0000","last_fullsized":"2023-11-08T12:29:21.802733+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.788302+0000","last_change":"2023-11-08T12:29:21.788302+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.788302+0000","last_undegraded":"2023-11-08T12:29:21.788302+0000","last_fullsized":"2023-11-08T12:29:21.788302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808809+0000","last_change":"2023-11-08T12:29:21.808809+0000","last_active":"2023-11-08T12:29:21.808809+0000","last_peered":"2023-11-08T12:29:21.808809+0000","last_clean":"2023-11-08T12:29:21.808809+0000","last_became_active":"2023-11-08T12:29:21.805982+0000","last_became_peered":"2023-11-08T12:29:21.805982+0000","last_unstale":"2023-11-08T12:29:21.808809+0000","last_undegraded":"2023-11-08T12:29:21.808809+0000","last_fullsized":"2023-11-08T12:29:21.808809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:30:43.794892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787061+0000","last_change":"2023-11-08T12:29:21.819567+0000","last_active":"2023-11-08T12:29:22.787061+0000","last_peered":"2023-11-08T12:29:22.787061+0000","last_clean":"2023-11-08T12:29:22.787061+0000","last_became_active":"2023-11-08T12:29:21.819214+0000","last_became_peered":"2023-11-08T12:29:21.819214+0000","last_unstale":"2023-11-08T12:29:22.787061+0000","last_undegraded":"2023-11-08T12:29:22.787061+0000","last_fullsized":"2023-11-08T12:29:22.787061+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:30.051527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785549+0000","last_change":"2023-11-08T12:29:21.802562+0000","last_active":"2023-11-08T12:29:22.785549+0000","last_peered":"2023-11-08T12:29:22.785549+0000","last_clean":"2023-11-08T12:29:22.785549+0000","last_became_active":"2023-11-08T12:29:21.801814+0000","last_became_peered":"2023-11-08T12:29:21.801814+0000","last_unstale":"2023-11-08T12:29:22.785549+0000","last_undegraded":"2023-11-08T12:29:22.785549+0000","last_fullsized":"2023-11-08T12:29:22.785549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494193+0000","last_change":"2023-11-08T12:29:21.819922+0000","last_active":"2023-11-08T12:29:23.494193+0000","last_peered":"2023-11-08T12:29:23.494193+0000","last_clean":"2023-11-08T12:29:23.494193+0000","last_became_active":"2023-11-08T12:29:21.819683+0000","last_became_peered":"2023-11-08T12:29:21.819683+0000","last_unstale":"2023-11-08T12:29:23.494193+0000","last_undegraded":"2023-11-08T12:29:23.494193+0000","last_fullsized":"2023-11-08T12:29:23.494193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:02:50.507213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.786873+0000","last_change":"2023-11-08T12:29:21.786873+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.786873+0000","last_undegraded":"2023-11-08T12:29:21.786873+0000","last_fullsized":"2023-11-08T12:29:21.786873+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:49:11.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.785219+0000","last_change":"2023-11-08T12:29:21.785219+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.785219+0000","last_undegraded":"2023-11-08T12:29:21.785219+0000","last_fullsized":"2023-11-08T12:29:21.785219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:31:33.328583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.790498+0000","last_change":"2023-11-08T12:29:21.790498+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.790498+0000","last_undegraded":"2023-11-08T12:29:21.790498+0000","last_fullsized":"2023-11-08T12:29:21.790498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:23.051243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787086+0000","last_change":"2023-11-08T12:29:21.817462+0000","last_active":"2023-11-08T12:29:22.787086+0000","last_peered":"2023-11-08T12:29:22.787086+0000","last_clean":"2023-11-08T12:29:22.787086+0000","last_became_active":"2023-11-08T12:29:21.817208+0000","last_became_peered":"2023-11-08T12:29:21.817208+0000","last_unstale":"2023-11-08T12:29:22.787086+0000","last_undegraded":"2023-11-08T12:29:22.787086+0000","last_fullsized":"2023-11-08T12:29:22.787086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:13:12.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787074+0000","last_change":"2023-11-08T12:29:21.787074+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787074+0000","last_undegraded":"2023-11-08T12:29:21.787074+0000","last_fullsized":"2023-11-08T12:29:21.787074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784704+0000","last_change":"2023-11-08T12:29:21.820063+0000","last_active":"2023-11-08T12:29:22.784704+0000","last_peered":"2023-11-08T12:29:22.784704+0000","last_clean":"2023-11-08T12:29:22.784704+0000","last_became_active":"2023-11-08T12:29:21.819738+0000","last_became_peered":"2023-11-08T12:29:21.819738+0000","last_unstale":"2023-11-08T12:29:22.784704+0000","last_undegraded":"2023-11-08T12:29:22.784704+0000","last_fullsized":"2023-11-08T12:29:22.784704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:13:00.473044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787774+0000","last_change":"2023-11-08T12:29:21.787774+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787774+0000","last_undegraded":"2023-11-08T12:29:21.787774+0000","last_fullsized":"2023-11-08T12:29:21.787774+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:30.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787898+0000","last_change":"2023-11-08T12:29:21.787898+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787898+0000","last_undegraded":"2023-11-08T12:29:21.787898+0000","last_fullsized":"2023-11-08T12:29:21.787898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785141+0000","last_change":"2023-11-08T12:29:21.812579+0000","last_active":"2023-11-08T12:29:22.785141+0000","last_peered":"2023-11-08T12:29:22.785141+0000","last_clean":"2023-11-08T12:29:22.785141+0000","last_became_active":"2023-11-08T12:29:21.812294+0000","last_became_peered":"2023-11-08T12:29:21.812294+0000","last_unstale":"2023-11-08T12:29:22.785141+0000","last_undegraded":"2023-11-08T12:29:22.785141+0000","last_fullsized":"2023-11-08T12:29:22.785141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786975+0000","last_change":"2023-11-08T12:29:21.816857+0000","last_active":"2023-11-08T12:29:22.786975+0000","last_peered":"2023-11-08T12:29:22.786975+0000","last_clean":"2023-11-08T12:29:22.786975+0000","last_became_active":"2023-11-08T12:29:21.814297+0000","last_became_peered":"2023-11-08T12:29:21.814297+0000","last_unstale":"2023-11-08T12:29:22.786975+0000","last_undegraded":"2023-11-08T12:29:22.786975+0000","last_fullsized":"2023-11-08T12:29:22.786975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:03:15.852031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.641172+0000","last_change":"2023-11-08T12:29:21.807851+0000","last_active":"2023-11-08T12:29:24.641172+0000","last_peered":"2023-11-08T12:29:24.641172+0000","last_clean":"2023-11-08T12:29:24.641172+0000","last_became_active":"2023-11-08T12:29:21.807594+0000","last_became_peered":"2023-11-08T12:29:21.807594+0000","last_unstale":"2023-11-08T12:29:24.641172+0000","last_undegraded":"2023-11-08T12:29:24.641172+0000","last_fullsized":"2023-11-08T12:29:24.641172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:59:11.369849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802949+0000","last_change":"2023-11-08T12:29:21.349307+0000","last_active":"2023-11-08T12:29:21.802949+0000","last_peered":"2023-11-08T12:29:21.802949+0000","last_clean":"2023-11-08T12:29:21.802949+0000","last_became_active":"2023-11-08T12:29:21.348126+0000","last_became_peered":"2023-11-08T12:29:21.348126+0000","last_unstale":"2023-11-08T12:29:21.802949+0000","last_undegraded":"2023-11-08T12:29:21.802949+0000","last_fullsized":"2023-11-08T12:29:21.802949+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800129+0000","last_change":"2023-11-08T12:29:21.795050+0000","last_active":"2023-11-08T12:29:21.800129+0000","last_peered":"2023-11-08T12:29:21.800129+0000","last_clean":"2023-11-08T12:29:21.800129+0000","last_became_active":"2023-11-08T12:29:21.794561+0000","last_became_peered":"2023-11-08T12:29:21.794561+0000","last_unstale":"2023-11-08T12:29:21.800129+0000","last_undegraded":"2023-11-08T12:29:21.800129+0000","last_fullsized":"2023-11-08T12:29:21.800129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:40:42.873851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800543+0000","last_change":"2023-11-08T12:29:21.338664+0000","last_active":"2023-11-08T12:29:21.800543+0000","last_peered":"2023-11-08T12:29:21.800543+0000","last_clean":"2023-11-08T12:29:21.800543+0000","last_became_active":"2023-11-08T12:29:21.338364+0000","last_became_peered":"2023-11-08T12:29:21.338364+0000","last_unstale":"2023-11-08T12:29:21.800543+0000","last_undegraded":"2023-11-08T12:29:21.800543+0000","last_fullsized":"2023-11-08T12:29:21.800543+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:26:46.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784944+0000","last_change":"2023-11-08T12:29:21.807291+0000","last_active":"2023-11-08T12:29:22.784944+0000","last_peered":"2023-11-08T12:29:22.784944+0000","last_clean":"2023-11-08T12:29:22.784944+0000","last_became_active":"2023-11-08T12:29:21.806952+0000","last_became_peered":"2023-11-08T12:29:21.806952+0000","last_unstale":"2023-11-08T12:29:22.784944+0000","last_undegraded":"2023-11-08T12:29:22.784944+0000","last_fullsized":"2023-11-08T12:29:22.784944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:32:44.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.828778+0000","last_change":"2023-11-08T12:29:21.344422+0000","last_active":"2023-11-08T12:29:21.828778+0000","last_peered":"2023-11-08T12:29:21.828778+0000","last_clean":"2023-11-08T12:29:21.828778+0000","last_became_active":"2023-11-08T12:29:21.344096+0000","last_became_peered":"2023-11-08T12:29:21.344096+0000","last_unstale":"2023-11-08T12:29:21.828778+0000","last_undegraded":"2023-11-08T12:29:21.828778+0000","last_fullsized":"2023-11-08T12:29:21.828778+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:59.630215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.641127+0000","last_change":"2023-11-08T12:29:21.825604+0000","last_active":"2023-11-08T12:29:24.641127+0000","last_peered":"2023-11-08T12:29:24.641127+0000","last_clean":"2023-11-08T12:29:24.641127+0000","last_became_active":"2023-11-08T12:29:21.825335+0000","last_became_peered":"2023-11-08T12:29:21.825335+0000","last_unstale":"2023-11-08T12:29:24.641127+0000","last_undegraded":"2023-11-08T12:29:24.641127+0000","last_fullsized":"2023-11-08T12:29:24.641127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:56.113448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816522+0000","last_change":"2023-11-08T12:29:21.349891+0000","last_active":"2023-11-08T12:29:21.816522+0000","last_peered":"2023-11-08T12:29:21.816522+0000","last_clean":"2023-11-08T12:29:21.816522+0000","last_became_active":"2023-11-08T12:29:21.349601+0000","last_became_peered":"2023-11-08T12:29:21.349601+0000","last_unstale":"2023-11-08T12:29:21.816522+0000","last_undegraded":"2023-11-08T12:29:21.816522+0000","last_fullsized":"2023-11-08T12:29:21.816522+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801702+0000","last_change":"2023-11-08T12:29:21.799913+0000","last_active":"2023-11-08T12:29:21.801702+0000","last_peered":"2023-11-08T12:29:21.801702+0000","last_clean":"2023-11-08T12:29:21.801702+0000","last_became_active":"2023-11-08T12:29:21.799604+0000","last_became_peered":"2023-11-08T12:29:21.799604+0000","last_unstale":"2023-11-08T12:29:21.801702+0000","last_undegraded":"2023-11-08T12:29:21.801702+0000","last_fullsized":"2023-11-08T12:29:21.801702+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805362+0000","last_change":"2023-11-08T12:29:21.341760+0000","last_active":"2023-11-08T12:29:21.805362+0000","last_peered":"2023-11-08T12:29:21.805362+0000","last_clean":"2023-11-08T12:29:21.805362+0000","last_became_active":"2023-11-08T12:29:21.341426+0000","last_became_peered":"2023-11-08T12:29:21.341426+0000","last_unstale":"2023-11-08T12:29:21.805362+0000","last_undegraded":"2023-11-08T12:29:21.805362+0000","last_fullsized":"2023-11-08T12:29:21.805362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:21:10.046172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494455+0000","last_change":"2023-11-08T12:29:21.810802+0000","last_active":"2023-11-08T12:29:23.494455+0000","last_peered":"2023-11-08T12:29:23.494455+0000","last_clean":"2023-11-08T12:29:23.494455+0000","last_became_active":"2023-11-08T12:29:21.810630+0000","last_became_peered":"2023-11-08T12:29:21.810630+0000","last_unstale":"2023-11-08T12:29:23.494455+0000","last_undegraded":"2023-11-08T12:29:23.494455+0000","last_fullsized":"2023-11-08T12:29:23.494455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788689+0000","last_change":"2023-11-08T12:29:21.338833+0000","last_active":"2023-11-08T12:29:21.788689+0000","last_peered":"2023-11-08T12:29:21.788689+0000","last_clean":"2023-11-08T12:29:21.788689+0000","last_became_active":"2023-11-08T12:29:21.338621+0000","last_became_peered":"2023-11-08T12:29:21.338621+0000","last_unstale":"2023-11-08T12:29:21.788689+0000","last_undegraded":"2023-11-08T12:29:21.788689+0000","last_fullsized":"2023-11-08T12:29:21.788689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:32.577889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494026+0000","last_change":"2023-11-08T12:29:21.813361+0000","last_active":"2023-11-08T12:29:23.494026+0000","last_peered":"2023-11-08T12:29:23.494026+0000","last_clean":"2023-11-08T12:29:23.494026+0000","last_became_active":"2023-11-08T12:29:21.812271+0000","last_became_peered":"2023-11-08T12:29:21.812271+0000","last_unstale":"2023-11-08T12:29:23.494026+0000","last_undegraded":"2023-11-08T12:29:23.494026+0000","last_fullsized":"2023-11-08T12:29:23.494026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.796924+0000","last_change":"2023-11-08T12:29:21.339277+0000","last_active":"2023-11-08T12:29:21.796924+0000","last_peered":"2023-11-08T12:29:21.796924+0000","last_clean":"2023-11-08T12:29:21.796924+0000","last_became_active":"2023-11-08T12:29:21.338989+0000","last_became_peered":"2023-11-08T12:29:21.338989+0000","last_unstale":"2023-11-08T12:29:21.796924+0000","last_undegraded":"2023-11-08T12:29:21.796924+0000","last_fullsized":"2023-11-08T12:29:21.796924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787005+0000","last_change":"2023-11-08T12:29:21.787005+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787005+0000","last_undegraded":"2023-11-08T12:29:21.787005+0000","last_fullsized":"2023-11-08T12:29:21.787005+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:05.769508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.798425+0000","last_change":"2023-11-08T12:29:21.341564+0000","last_active":"2023-11-08T12:29:21.798425+0000","last_peered":"2023-11-08T12:29:21.798425+0000","last_clean":"2023-11-08T12:29:21.798425+0000","last_became_active":"2023-11-08T12:29:21.341236+0000","last_became_peered":"2023-11-08T12:29:21.341236+0000","last_unstale":"2023-11-08T12:29:21.798425+0000","last_undegraded":"2023-11-08T12:29:21.798425+0000","last_fullsized":"2023-11-08T12:29:21.798425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800809+0000","last_change":"2023-11-08T12:29:21.800809+0000","last_active":"2023-11-08T12:29:21.800809+0000","last_peered":"2023-11-08T12:29:21.800809+0000","last_clean":"2023-11-08T12:29:21.800809+0000","last_became_active":"2023-11-08T12:29:21.800508+0000","last_became_peered":"2023-11-08T12:29:21.800508+0000","last_unstale":"2023-11-08T12:29:21.800809+0000","last_undegraded":"2023-11-08T12:29:21.800809+0000","last_fullsized":"2023-11-08T12:29:21.800809+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789027+0000","last_change":"2023-11-08T12:29:21.336456+0000","last_active":"2023-11-08T12:29:21.789027+0000","last_peered":"2023-11-08T12:29:21.789027+0000","last_clean":"2023-11-08T12:29:21.789027+0000","last_became_active":"2023-11-08T12:29:21.336182+0000","last_became_peered":"2023-11-08T12:29:21.336182+0000","last_unstale":"2023-11-08T12:29:21.789027+0000","last_undegraded":"2023-11-08T12:29:21.789027+0000","last_fullsized":"2023-11-08T12:29:21.789027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502622+0000","last_change":"2023-11-08T12:29:21.816825+0000","last_active":"2023-11-08T12:29:23.502622+0000","last_peered":"2023-11-08T12:29:23.502622+0000","last_clean":"2023-11-08T12:29:23.502622+0000","last_became_active":"2023-11-08T12:29:21.816561+0000","last_became_peered":"2023-11-08T12:29:21.816561+0000","last_unstale":"2023-11-08T12:29:23.502622+0000","last_undegraded":"2023-11-08T12:29:23.502622+0000","last_fullsized":"2023-11-08T12:29:23.502622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:13:00.473044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.796670+0000","last_change":"2023-11-08T12:29:21.342736+0000","last_active":"2023-11-08T12:29:21.796670+0000","last_peered":"2023-11-08T12:29:21.796670+0000","last_clean":"2023-11-08T12:29:21.796670+0000","last_became_active":"2023-11-08T12:29:21.342385+0000","last_became_peered":"2023-11-08T12:29:21.342385+0000","last_unstale":"2023-11-08T12:29:21.796670+0000","last_undegraded":"2023-11-08T12:29:21.796670+0000","last_fullsized":"2023-11-08T12:29:21.796670+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785885+0000","last_change":"2023-11-08T12:29:21.820215+0000","last_active":"2023-11-08T12:29:22.785885+0000","last_peered":"2023-11-08T12:29:22.785885+0000","last_clean":"2023-11-08T12:29:22.785885+0000","last_became_active":"2023-11-08T12:29:21.819908+0000","last_became_peered":"2023-11-08T12:29:21.819908+0000","last_unstale":"2023-11-08T12:29:22.785885+0000","last_undegraded":"2023-11-08T12:29:22.785885+0000","last_fullsized":"2023-11-08T12:29:22.785885+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.817409+0000","last_change":"2023-11-08T12:29:21.348938+0000","last_active":"2023-11-08T12:29:21.817409+0000","last_peered":"2023-11-08T12:29:21.817409+0000","last_clean":"2023-11-08T12:29:21.817409+0000","last_became_active":"2023-11-08T12:29:21.348313+0000","last_became_peered":"2023-11-08T12:29:21.348313+0000","last_unstale":"2023-11-08T12:29:21.817409+0000","last_undegraded":"2023-11-08T12:29:21.817409+0000","last_fullsized":"2023-11-08T12:29:21.817409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502217+0000","last_change":"2023-11-08T12:29:21.820121+0000","last_active":"2023-11-08T12:29:23.502217+0000","last_peered":"2023-11-08T12:29:23.502217+0000","last_clean":"2023-11-08T12:29:23.502217+0000","last_became_active":"2023-11-08T12:29:21.819833+0000","last_became_peered":"2023-11-08T12:29:21.819833+0000","last_unstale":"2023-11-08T12:29:23.502217+0000","last_undegraded":"2023-11-08T12:29:23.502217+0000","last_fullsized":"2023-11-08T12:29:23.502217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:32:44.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787130+0000","last_change":"2023-11-08T12:29:21.336777+0000","last_active":"2023-11-08T12:29:22.787130+0000","last_peered":"2023-11-08T12:29:22.787130+0000","last_clean":"2023-11-08T12:29:22.787130+0000","last_became_active":"2023-11-08T12:29:21.336489+0000","last_became_peered":"2023-11-08T12:29:21.336489+0000","last_unstale":"2023-11-08T12:29:22.787130+0000","last_undegraded":"2023-11-08T12:29:22.787130+0000","last_fullsized":"2023-11-08T12:29:22.787130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:52:06.155620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810358+0000","last_change":"2023-11-08T12:29:21.806201+0000","last_active":"2023-11-08T12:29:21.810358+0000","last_peered":"2023-11-08T12:29:21.810358+0000","last_clean":"2023-11-08T12:29:21.810358+0000","last_became_active":"2023-11-08T12:29:21.805845+0000","last_became_peered":"2023-11-08T12:29:21.805845+0000","last_unstale":"2023-11-08T12:29:21.810358+0000","last_undegraded":"2023-11-08T12:29:21.810358+0000","last_fullsized":"2023-11-08T12:29:21.810358+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:49.547648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.793754+0000","last_change":"2023-11-08T12:29:21.342696+0000","last_active":"2023-11-08T12:29:21.793754+0000","last_peered":"2023-11-08T12:29:21.793754+0000","last_clean":"2023-11-08T12:29:21.793754+0000","last_became_active":"2023-11-08T12:29:21.342396+0000","last_became_peered":"2023-11-08T12:29:21.342396+0000","last_unstale":"2023-11-08T12:29:21.793754+0000","last_undegraded":"2023-11-08T12:29:21.793754+0000","last_fullsized":"2023-11-08T12:29:21.793754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:31:24.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494729+0000","last_change":"2023-11-08T12:29:21.819366+0000","last_active":"2023-11-08T12:29:23.494729+0000","last_peered":"2023-11-08T12:29:23.494729+0000","last_clean":"2023-11-08T12:29:23.494729+0000","last_became_active":"2023-11-08T12:29:21.819082+0000","last_became_peered":"2023-11-08T12:29:21.819082+0000","last_unstale":"2023-11-08T12:29:23.494729+0000","last_undegraded":"2023-11-08T12:29:23.494729+0000","last_fullsized":"2023-11-08T12:29:23.494729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:59.392291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800077+0000","last_change":"2023-11-08T12:29:21.348592+0000","last_active":"2023-11-08T12:29:21.800077+0000","last_peered":"2023-11-08T12:29:21.800077+0000","last_clean":"2023-11-08T12:29:21.800077+0000","last_became_active":"2023-11-08T12:29:21.348238+0000","last_became_peered":"2023-11-08T12:29:21.348238+0000","last_unstale":"2023-11-08T12:29:21.800077+0000","last_undegraded":"2023-11-08T12:29:21.800077+0000","last_fullsized":"2023-11-08T12:29:21.800077+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784931+0000","last_change":"2023-11-08T12:29:21.811607+0000","last_active":"2023-11-08T12:29:22.784931+0000","last_peered":"2023-11-08T12:29:22.784931+0000","last_clean":"2023-11-08T12:29:22.784931+0000","last_became_active":"2023-11-08T12:29:21.811360+0000","last_became_peered":"2023-11-08T12:29:21.811360+0000","last_unstale":"2023-11-08T12:29:22.784931+0000","last_undegraded":"2023-11-08T12:29:22.784931+0000","last_fullsized":"2023-11-08T12:29:22.784931+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:14:09.179363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.783562+0000","last_change":"2023-11-08T12:29:21.348443+0000","last_active":"2023-11-08T12:29:21.783562+0000","last_peered":"2023-11-08T12:29:21.783562+0000","last_clean":"2023-11-08T12:29:21.783562+0000","last_became_active":"2023-11-08T12:29:21.348161+0000","last_became_peered":"2023-11-08T12:29:21.348161+0000","last_unstale":"2023-11-08T12:29:21.783562+0000","last_undegraded":"2023-11-08T12:29:21.783562+0000","last_fullsized":"2023-11-08T12:29:21.783562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502001+0000","last_change":"2023-11-08T12:29:21.812704+0000","last_active":"2023-11-08T12:29:23.502001+0000","last_peered":"2023-11-08T12:29:23.502001+0000","last_clean":"2023-11-08T12:29:23.502001+0000","last_became_active":"2023-11-08T12:29:21.812215+0000","last_became_peered":"2023-11-08T12:29:21.812215+0000","last_unstale":"2023-11-08T12:29:23.502001+0000","last_undegraded":"2023-11-08T12:29:23.502001+0000","last_fullsized":"2023-11-08T12:29:23.502001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:47:34.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.832347+0000","last_change":"2023-11-08T12:29:21.338524+0000","last_active":"2023-11-08T12:29:21.832347+0000","last_peered":"2023-11-08T12:29:21.832347+0000","last_clean":"2023-11-08T12:29:21.832347+0000","last_became_active":"2023-11-08T12:29:21.338235+0000","last_became_peered":"2023-11-08T12:29:21.338235+0000","last_unstale":"2023-11-08T12:29:21.832347+0000","last_undegraded":"2023-11-08T12:29:21.832347+0000","last_fullsized":"2023-11-08T12:29:21.832347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787147+0000","last_change":"2023-11-08T12:29:21.812641+0000","last_active":"2023-11-08T12:29:22.787147+0000","last_peered":"2023-11-08T12:29:22.787147+0000","last_clean":"2023-11-08T12:29:22.787147+0000","last_became_active":"2023-11-08T12:29:21.812327+0000","last_became_peered":"2023-11-08T12:29:21.812327+0000","last_unstale":"2023-11-08T12:29:22.787147+0000","last_undegraded":"2023-11-08T12:29:22.787147+0000","last_fullsized":"2023-11-08T12:29:22.787147+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:32:04.240338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787073+0000","last_change":"2023-11-08T12:29:21.335461+0000","last_active":"2023-11-08T12:29:22.787073+0000","last_peered":"2023-11-08T12:29:22.787073+0000","last_clean":"2023-11-08T12:29:22.787073+0000","last_became_active":"2023-11-08T12:29:21.335191+0000","last_became_peered":"2023-11-08T12:29:21.335191+0000","last_unstale":"2023-11-08T12:29:22.787073+0000","last_undegraded":"2023-11-08T12:29:22.787073+0000","last_fullsized":"2023-11-08T12:29:22.787073+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:23:05.661588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495628+0000","last_change":"2023-11-08T12:29:21.803417+0000","last_active":"2023-11-08T12:29:23.495628+0000","last_peered":"2023-11-08T12:29:23.495628+0000","last_clean":"2023-11-08T12:29:23.495628+0000","last_became_active":"2023-11-08T12:29:21.800610+0000","last_became_peered":"2023-11-08T12:29:21.800610+0000","last_unstale":"2023-11-08T12:29:23.495628+0000","last_undegraded":"2023-11-08T12:29:23.495628+0000","last_fullsized":"2023-11-08T12:29:23.495628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.789243+0000","last_change":"2023-11-08T12:29:21.341006+0000","last_active":"2023-11-08T12:29:21.789243+0000","last_peered":"2023-11-08T12:29:21.789243+0000","last_clean":"2023-11-08T12:29:21.789243+0000","last_became_active":"2023-11-08T12:29:21.340756+0000","last_became_peered":"2023-11-08T12:29:21.340756+0000","last_unstale":"2023-11-08T12:29:21.789243+0000","last_undegraded":"2023-11-08T12:29:21.789243+0000","last_fullsized":"2023-11-08T12:29:21.789243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:57:11.007145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810714+0000","last_change":"2023-11-08T12:29:21.804186+0000","last_active":"2023-11-08T12:29:21.810714+0000","last_peered":"2023-11-08T12:29:21.810714+0000","last_clean":"2023-11-08T12:29:21.810714+0000","last_became_active":"2023-11-08T12:29:21.803904+0000","last_became_peered":"2023-11-08T12:29:21.803904+0000","last_unstale":"2023-11-08T12:29:21.810714+0000","last_undegraded":"2023-11-08T12:29:21.810714+0000","last_fullsized":"2023-11-08T12:29:21.810714+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:35:00.646278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.823170+0000","last_change":"2023-11-08T12:29:21.342763+0000","last_active":"2023-11-08T12:29:21.823170+0000","last_peered":"2023-11-08T12:29:21.823170+0000","last_clean":"2023-11-08T12:29:21.823170+0000","last_became_active":"2023-11-08T12:29:21.342345+0000","last_became_peered":"2023-11-08T12:29:21.342345+0000","last_unstale":"2023-11-08T12:29:21.823170+0000","last_undegraded":"2023-11-08T12:29:21.823170+0000","last_fullsized":"2023-11-08T12:29:21.823170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":3,"reported_epoch":43,"state":"creating+activating","last_fresh":"2023-11-08T12:29:21.787486+0000","last_change":"2023-11-08T12:29:21.787486+0000","last_active":"2023-11-08T12:29:21.303108+0000","last_peered":"2023-11-08T12:29:21.303108+0000","last_clean":"2023-11-08T12:29:21.303108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:29:21.787486+0000","last_undegraded":"2023-11-08T12:29:21.787486+0000","last_fullsized":"2023-11-08T12:29:21.787486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:38.192520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.787585+0000","last_change":"2023-11-08T12:29:21.349412+0000","last_active":"2023-11-08T12:29:21.787585+0000","last_peered":"2023-11-08T12:29:21.787585+0000","last_clean":"2023-11-08T12:29:21.787585+0000","last_became_active":"2023-11-08T12:29:21.349135+0000","last_became_peered":"2023-11-08T12:29:21.349135+0000","last_unstale":"2023-11-08T12:29:21.787585+0000","last_undegraded":"2023-11-08T12:29:21.787585+0000","last_fullsized":"2023-11-08T12:29:21.787585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785378+0000","last_change":"2023-11-08T12:29:21.815535+0000","last_active":"2023-11-08T12:29:22.785378+0000","last_peered":"2023-11-08T12:29:22.785378+0000","last_clean":"2023-11-08T12:29:22.785378+0000","last_became_active":"2023-11-08T12:29:21.815092+0000","last_became_peered":"2023-11-08T12:29:21.815092+0000","last_unstale":"2023-11-08T12:29:22.785378+0000","last_undegraded":"2023-11-08T12:29:22.785378+0000","last_fullsized":"2023-11-08T12:29:22.785378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805581+0000","last_change":"2023-11-08T12:29:21.338488+0000","last_active":"2023-11-08T12:29:21.805581+0000","last_peered":"2023-11-08T12:29:21.805581+0000","last_clean":"2023-11-08T12:29:21.805581+0000","last_became_active":"2023-11-08T12:29:21.338203+0000","last_became_peered":"2023-11-08T12:29:21.338203+0000","last_unstale":"2023-11-08T12:29:21.805581+0000","last_undegraded":"2023-11-08T12:29:21.805581+0000","last_fullsized":"2023-11-08T12:29:21.805581+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:31:36.137776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.640903+0000","last_change":"2023-11-08T12:29:21.811755+0000","last_active":"2023-11-08T12:29:24.640903+0000","last_peered":"2023-11-08T12:29:24.640903+0000","last_clean":"2023-11-08T12:29:24.640903+0000","last_became_active":"2023-11-08T12:29:21.811503+0000","last_became_peered":"2023-11-08T12:29:21.811503+0000","last_unstale":"2023-11-08T12:29:24.640903+0000","last_undegraded":"2023-11-08T12:29:24.640903+0000","last_fullsized":"2023-11-08T12:29:24.640903+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:27.826628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.794917+0000","last_change":"2023-11-08T12:29:21.344980+0000","last_active":"2023-11-08T12:29:21.794917+0000","last_peered":"2023-11-08T12:29:21.794917+0000","last_clean":"2023-11-08T12:29:21.794917+0000","last_became_active":"2023-11-08T12:29:21.344712+0000","last_became_peered":"2023-11-08T12:29:21.344712+0000","last_unstale":"2023-11-08T12:29:21.794917+0000","last_undegraded":"2023-11-08T12:29:21.794917+0000","last_fullsized":"2023-11-08T12:29:21.794917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786770+0000","last_change":"2023-11-08T12:29:21.817403+0000","last_active":"2023-11-08T12:29:22.786770+0000","last_peered":"2023-11-08T12:29:22.786770+0000","last_clean":"2023-11-08T12:29:22.786770+0000","last_became_active":"2023-11-08T12:29:21.817114+0000","last_became_peered":"2023-11-08T12:29:21.817114+0000","last_unstale":"2023-11-08T12:29:22.786770+0000","last_undegraded":"2023-11-08T12:29:22.786770+0000","last_fullsized":"2023-11-08T12:29:22.786770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:29:35.068286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.795735+0000","last_change":"2023-11-08T12:29:21.336783+0000","last_active":"2023-11-08T12:29:21.795735+0000","last_peered":"2023-11-08T12:29:21.795735+0000","last_clean":"2023-11-08T12:29:21.795735+0000","last_became_active":"2023-11-08T12:29:21.335874+0000","last_became_peered":"2023-11-08T12:29:21.335874+0000","last_unstale":"2023-11-08T12:29:21.795735+0000","last_undegraded":"2023-11-08T12:29:21.795735+0000","last_fullsized":"2023-11-08T12:29:21.795735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.493749+0000","last_change":"2023-11-08T12:29:21.827104+0000","last_active":"2023-11-08T12:29:23.493749+0000","last_peered":"2023-11-08T12:29:23.493749+0000","last_clean":"2023-11-08T12:29:23.493749+0000","last_became_active":"2023-11-08T12:29:21.826850+0000","last_became_peered":"2023-11-08T12:29:21.826850+0000","last_unstale":"2023-11-08T12:29:23.493749+0000","last_undegraded":"2023-11-08T12:29:23.493749+0000","last_fullsized":"2023-11-08T12:29:23.493749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800986+0000","last_change":"2023-11-08T12:29:21.345770+0000","last_active":"2023-11-08T12:29:21.800986+0000","last_peered":"2023-11-08T12:29:21.800986+0000","last_clean":"2023-11-08T12:29:21.800986+0000","last_became_active":"2023-11-08T12:29:21.345544+0000","last_became_peered":"2023-11-08T12:29:21.345544+0000","last_unstale":"2023-11-08T12:29:21.800986+0000","last_undegraded":"2023-11-08T12:29:21.800986+0000","last_fullsized":"2023-11-08T12:29:21.800986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785567+0000","last_change":"2023-11-08T12:29:21.805583+0000","last_active":"2023-11-08T12:29:22.785567+0000","last_peered":"2023-11-08T12:29:22.785567+0000","last_clean":"2023-11-08T12:29:22.785567+0000","last_became_active":"2023-11-08T12:29:21.805329+0000","last_became_peered":"2023-11-08T12:29:21.805329+0000","last_unstale":"2023-11-08T12:29:22.785567+0000","last_undegraded":"2023-11-08T12:29:22.785567+0000","last_fullsized":"2023-11-08T12:29:22.785567+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801549+0000","last_change":"2023-11-08T12:29:21.349783+0000","last_active":"2023-11-08T12:29:21.801549+0000","last_peered":"2023-11-08T12:29:21.801549+0000","last_clean":"2023-11-08T12:29:21.801549+0000","last_became_active":"2023-11-08T12:29:21.348368+0000","last_became_peered":"2023-11-08T12:29:21.348368+0000","last_unstale":"2023-11-08T12:29:21.801549+0000","last_undegraded":"2023-11-08T12:29:21.801549+0000","last_fullsized":"2023-11-08T12:29:21.801549+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.343970+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:29:21.343970+0000","last_peered":"2023-11-08T12:29:21.343970+0000","last_clean":"2023-11-08T12:29:21.343970+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:29:21.343970+0000","last_undegraded":"2023-11-08T12:29:21.343970+0000","last_fullsized":"2023-11-08T12:29:21.343970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786012+0000","last_change":"2023-11-08T12:29:21.811783+0000","last_active":"2023-11-08T12:29:22.786012+0000","last_peered":"2023-11-08T12:29:22.786012+0000","last_clean":"2023-11-08T12:29:22.786012+0000","last_became_active":"2023-11-08T12:29:21.811546+0000","last_became_peered":"2023-11-08T12:29:21.811546+0000","last_unstale":"2023-11-08T12:29:22.786012+0000","last_undegraded":"2023-11-08T12:29:22.786012+0000","last_fullsized":"2023-11-08T12:29:22.786012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:59.392291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.788707+0000","last_change":"2023-11-08T12:29:21.342180+0000","last_active":"2023-11-08T12:29:21.788707+0000","last_peered":"2023-11-08T12:29:21.788707+0000","last_clean":"2023-11-08T12:29:21.788707+0000","last_became_active":"2023-11-08T12:29:21.341965+0000","last_became_peered":"2023-11-08T12:29:21.341965+0000","last_unstale":"2023-11-08T12:29:21.788707+0000","last_undegraded":"2023-11-08T12:29:21.788707+0000","last_fullsized":"2023-11-08T12:29:21.788707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:12:59.456980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.818280+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:29:21.818280+0000","last_peered":"2023-11-08T12:29:21.818280+0000","last_clean":"2023-11-08T12:29:21.818280+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:29:21.818280+0000","last_undegraded":"2023-11-08T12:29:21.818280+0000","last_fullsized":"2023-11-08T12:29:21.818280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784243+0000","last_change":"2023-11-08T12:29:21.823842+0000","last_active":"2023-11-08T12:29:22.784243+0000","last_peered":"2023-11-08T12:29:22.784243+0000","last_clean":"2023-11-08T12:29:22.784243+0000","last_became_active":"2023-11-08T12:29:21.823376+0000","last_became_peered":"2023-11-08T12:29:21.823376+0000","last_unstale":"2023-11-08T12:29:22.784243+0000","last_undegraded":"2023-11-08T12:29:22.784243+0000","last_fullsized":"2023-11-08T12:29:22.784243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:48:49.601579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808471+0000","last_change":"2023-11-08T12:29:21.346624+0000","last_active":"2023-11-08T12:29:21.808471+0000","last_peered":"2023-11-08T12:29:21.808471+0000","last_clean":"2023-11-08T12:29:21.808471+0000","last_became_active":"2023-11-08T12:29:21.346156+0000","last_became_peered":"2023-11-08T12:29:21.346156+0000","last_unstale":"2023-11-08T12:29:21.808471+0000","last_undegraded":"2023-11-08T12:29:21.808471+0000","last_fullsized":"2023-11-08T12:29:21.808471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:48.531585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.803818+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:29:21.803818+0000","last_peered":"2023-11-08T12:29:21.803818+0000","last_clean":"2023-11-08T12:29:21.803818+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:29:21.803818+0000","last_undegraded":"2023-11-08T12:29:21.803818+0000","last_fullsized":"2023-11-08T12:29:21.803818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802735+0000","last_change":"2023-11-08T12:29:21.802735+0000","last_active":"2023-11-08T12:29:21.802735+0000","last_peered":"2023-11-08T12:29:21.802735+0000","last_clean":"2023-11-08T12:29:21.802735+0000","last_became_active":"2023-11-08T12:29:21.802154+0000","last_became_peered":"2023-11-08T12:29:21.802154+0000","last_unstale":"2023-11-08T12:29:21.802735+0000","last_undegraded":"2023-11-08T12:29:21.802735+0000","last_fullsized":"2023-11-08T12:29:21.802735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.798641+0000","last_change":"2023-11-08T12:29:21.342114+0000","last_active":"2023-11-08T12:29:21.798641+0000","last_peered":"2023-11-08T12:29:21.798641+0000","last_clean":"2023-11-08T12:29:21.798641+0000","last_became_active":"2023-11-08T12:29:21.341856+0000","last_became_peered":"2023-11-08T12:29:21.341856+0000","last_unstale":"2023-11-08T12:29:21.798641+0000","last_undegraded":"2023-11-08T12:29:21.798641+0000","last_fullsized":"2023-11-08T12:29:21.798641+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:26.810564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811411+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:29:21.811411+0000","last_peered":"2023-11-08T12:29:21.811411+0000","last_clean":"2023-11-08T12:29:21.811411+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:29:21.811411+0000","last_undegraded":"2023-11-08T12:29:21.811411+0000","last_fullsized":"2023-11-08T12:29:21.811411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810392+0000","last_change":"2023-11-08T12:29:21.802763+0000","last_active":"2023-11-08T12:29:21.810392+0000","last_peered":"2023-11-08T12:29:21.810392+0000","last_clean":"2023-11-08T12:29:21.810392+0000","last_became_active":"2023-11-08T12:29:21.802445+0000","last_became_peered":"2023-11-08T12:29:21.802445+0000","last_unstale":"2023-11-08T12:29:21.810392+0000","last_undegraded":"2023-11-08T12:29:21.810392+0000","last_fullsized":"2023-11-08T12:29:21.810392+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:58:00.614714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786069+0000","last_change":"2023-11-08T12:29:21.334567+0000","last_active":"2023-11-08T12:29:22.786069+0000","last_peered":"2023-11-08T12:29:22.786069+0000","last_clean":"2023-11-08T12:29:22.786069+0000","last_became_active":"2023-11-08T12:29:21.334322+0000","last_became_peered":"2023-11-08T12:29:21.334322+0000","last_unstale":"2023-11-08T12:29:22.786069+0000","last_undegraded":"2023-11-08T12:29:22.786069+0000","last_fullsized":"2023-11-08T12:29:22.786069+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:52:07.194386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.795001+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:29:21.795001+0000","last_peered":"2023-11-08T12:29:21.795001+0000","last_clean":"2023-11-08T12:29:21.795001+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:29:21.795001+0000","last_undegraded":"2023-11-08T12:29:21.795001+0000","last_fullsized":"2023-11-08T12:29:21.795001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495222+0000","last_change":"2023-11-08T12:29:21.801672+0000","last_active":"2023-11-08T12:29:23.495222+0000","last_peered":"2023-11-08T12:29:23.495222+0000","last_clean":"2023-11-08T12:29:23.495222+0000","last_became_active":"2023-11-08T12:29:21.801407+0000","last_became_peered":"2023-11-08T12:29:21.801407+0000","last_unstale":"2023-11-08T12:29:23.495222+0000","last_undegraded":"2023-11-08T12:29:23.495222+0000","last_fullsized":"2023-11-08T12:29:23.495222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.803735+0000","last_change":"2023-11-08T12:29:21.349084+0000","last_active":"2023-11-08T12:29:21.803735+0000","last_peered":"2023-11-08T12:29:21.803735+0000","last_clean":"2023-11-08T12:29:21.803735+0000","last_became_active":"2023-11-08T12:29:21.348680+0000","last_became_peered":"2023-11-08T12:29:21.348680+0000","last_unstale":"2023-11-08T12:29:21.803735+0000","last_undegraded":"2023-11-08T12:29:21.803735+0000","last_fullsized":"2023-11-08T12:29:21.803735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800385+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:29:21.800385+0000","last_peered":"2023-11-08T12:29:21.800385+0000","last_clean":"2023-11-08T12:29:21.800385+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:29:21.800385+0000","last_undegraded":"2023-11-08T12:29:21.800385+0000","last_fullsized":"2023-11-08T12:29:21.800385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502334+0000","last_change":"2023-11-08T12:29:21.810554+0000","last_active":"2023-11-08T12:29:23.502334+0000","last_peered":"2023-11-08T12:29:23.502334+0000","last_clean":"2023-11-08T12:29:23.502334+0000","last_became_active":"2023-11-08T12:29:21.810139+0000","last_became_peered":"2023-11-08T12:29:21.810139+0000","last_unstale":"2023-11-08T12:29:23.502334+0000","last_undegraded":"2023-11-08T12:29:23.502334+0000","last_fullsized":"2023-11-08T12:29:23.502334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811331+0000","last_change":"2023-11-08T12:29:21.344284+0000","last_active":"2023-11-08T12:29:21.811331+0000","last_peered":"2023-11-08T12:29:21.811331+0000","last_clean":"2023-11-08T12:29:21.811331+0000","last_became_active":"2023-11-08T12:29:21.343968+0000","last_became_peered":"2023-11-08T12:29:21.343968+0000","last_unstale":"2023-11-08T12:29:21.811331+0000","last_undegraded":"2023-11-08T12:29:21.811331+0000","last_fullsized":"2023-11-08T12:29:21.811331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:57:59.598650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800896+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:29:21.800896+0000","last_peered":"2023-11-08T12:29:21.800896+0000","last_clean":"2023-11-08T12:29:21.800896+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:29:21.800896+0000","last_undegraded":"2023-11-08T12:29:21.800896+0000","last_fullsized":"2023-11-08T12:29:21.800896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495580+0000","last_change":"2023-11-08T12:29:21.820768+0000","last_active":"2023-11-08T12:29:23.495580+0000","last_peered":"2023-11-08T12:29:23.495580+0000","last_clean":"2023-11-08T12:29:23.495580+0000","last_became_active":"2023-11-08T12:29:21.820536+0000","last_became_peered":"2023-11-08T12:29:21.820536+0000","last_unstale":"2023-11-08T12:29:23.495580+0000","last_undegraded":"2023-11-08T12:29:23.495580+0000","last_fullsized":"2023-11-08T12:29:23.495580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:14:09.179363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810868+0000","last_change":"2023-11-08T12:29:21.340014+0000","last_active":"2023-11-08T12:29:21.810868+0000","last_peered":"2023-11-08T12:29:21.810868+0000","last_clean":"2023-11-08T12:29:21.810868+0000","last_became_active":"2023-11-08T12:29:21.339760+0000","last_became_peered":"2023-11-08T12:29:21.339760+0000","last_unstale":"2023-11-08T12:29:21.810868+0000","last_undegraded":"2023-11-08T12:29:21.810868+0000","last_fullsized":"2023-11-08T12:29:21.810868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.793224+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:29:21.793224+0000","last_peered":"2023-11-08T12:29:21.793224+0000","last_clean":"2023-11-08T12:29:21.793224+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:29:21.793224+0000","last_undegraded":"2023-11-08T12:29:21.793224+0000","last_fullsized":"2023-11-08T12:29:21.793224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801069+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:29:21.801069+0000","last_peered":"2023-11-08T12:29:21.801069+0000","last_clean":"2023-11-08T12:29:21.801069+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:29:21.801069+0000","last_undegraded":"2023-11-08T12:29:21.801069+0000","last_fullsized":"2023-11-08T12:29:21.801069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476760,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":462848,"data_stored":202197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":7.4889999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":4.1799999999999997}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":4.0300000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.851}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":3.9569999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":5.601},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":3.9119999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.8819999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":4.0720000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.8080000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.69599999999999995}]}]},{"osd":4,"up_from":16,"seq":68719476760,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8728,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363112,"statfs":{"total":96636764160,"available":96627826688,"internally_reserved":0,"allocated":475136,"data_stored":209137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.4139999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.143},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.85399999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":1.546}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.089}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.3}]},{"osd":6,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.53},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.621}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.569},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3720000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9848,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361992,"statfs":{"total":96636764160,"available":96626679808,"internally_reserved":0,"allocated":1097728,"data_stored":814016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79400000000000004}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.98799999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.198}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.071},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.026},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.036}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":223628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":1.2030000000000001},{"interface":"front","average":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":21.238,"5min":21.238,"15min":21.238},"last":0.874}]},{"osd":1,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":8.0630000000000006,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":11.907,"5min":11.907,"15min":11.907},"last":1.3049999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.085},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.127}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.375}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.2410000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":8.109,"5min":8.109,"15min":8.109},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.4099999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":512000,"data_stored":224180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.76400000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.438}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.335}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.107},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.1639999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":223628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.87},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92800000000000005}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.208}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.236},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.054}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.8679999999999999,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.369},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.7240000000000002,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":1.206,"5min":1.206,"15min":1.206},"max":{"1min":2.8599999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.2609999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9848,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361992,"statfs":{"total":96636764160,"available":96626679808,"internally_reserved":0,"allocated":1097728,"data_stored":813960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.54,"5min":6.54,"15min":6.54},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":6.6760000000000002,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":1.2290000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.173},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":1.444}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":6.5579999999999998,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.4850000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.369},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.395}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.347},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.6040000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"min":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.591}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.0509999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8640,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363200,"statfs":{"total":96636764160,"available":96627916800,"internally_reserved":0,"allocated":516096,"data_stored":225128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.876},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.121},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.472}]},{"osd":7,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.21},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":1.5700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:29:30.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:29:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166200f700 1 Processor -- start 2023-11-08T12:29:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166200f700 1 -- start start 2023-11-08T12:29:31.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166200f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f165c0b43a0 0x7f165c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166200f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166200f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c15a550 con 0x7f165c0b1640 2023-11-08T12:29:31.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166200f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c06b0a0 con 0x7f165c0b43a0 2023-11-08T12:29:31.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166200f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0caac0 con 0x7f165c070790 2023-11-08T12:29:31.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166080c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f165c0b1640 0x7f165c070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59032/0 (socket says 172.21.15.112:59032) 2023-11-08T12:29:31.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166080c700 1 -- 172.21.15.112:0/3622617130 learned_addr learned my addr 172.21.15.112:0/3622617130 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:31.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.115+0000 7f166100d700 1 --2- 172.21.15.112:0/3622617130 >> v2:172.21.15.112:3300/0 conn(0x7f165c0b43a0 0x7f165c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166180e700 1 --2- 172.21.15.112:0/3622617130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f1653fff700 1 -- 172.21.15.112:0/3622617130 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865650630 0 0) 0x7f164c001110 con 0x7f165c0b1640 2023-11-08T12:29:31.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f1653fff700 1 -- 172.21.15.112:0/3622617130 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16480035d0 con 0x7f165c0b1640 2023-11-08T12:29:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166100d700 1 -- 172.21.15.112:0/3622617130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 msgr2=0x7f165c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166100d700 1 --2- 172.21.15.112:0/3622617130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c06bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166100d700 1 -- 172.21.15.112:0/3622617130 >> v1:172.21.15.112:6789/0 conn(0x7f165c0b1640 legacy=0x7f165c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166100d700 1 -- 172.21.15.112:0/3622617130 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0cada0 con 0x7f165c0b43a0 2023-11-08T12:29:31.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166100d700 1 --2- 172.21.15.112:0/3622617130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b43a0 0x7f165c15e5d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1658009d90 tx=0x7f165800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffbc93456c1df63 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f1653fff700 1 -- 172.21.15.112:0/3622617130 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165800e070 con 0x7f165c0b43a0 2023-11-08T12:29:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f1653fff700 1 -- 172.21.15.112:0/3622617130 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165800bb20 con 0x7f165c0b43a0 2023-11-08T12:29:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f1653fff700 1 -- 172.21.15.112:0/3622617130 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658012430 con 0x7f165c0b43a0 2023-11-08T12:29:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 -- 172.21.15.112:0/3622617130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b43a0 msgr2=0x7f165c15e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 --2- 172.21.15.112:0/3622617130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b43a0 0x7f165c15e5d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1658009d90 tx=0x7f165800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 -- 172.21.15.112:0/3622617130 shutdown_connections 2023-11-08T12:29:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 --2- 172.21.15.112:0/3622617130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 --2- 172.21.15.112:0/3622617130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b43a0 0x7f165c15e5d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 -- 172.21.15.112:0/3622617130 >> 172.21.15.112:0/3622617130 conn(0x7f165c0b0f80 msgr2=0x7f165c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:31.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 -- 172.21.15.112:0/3622617130 shutdown_connections 2023-11-08T12:29:31.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.119+0000 7f166200f700 1 -- 172.21.15.112:0/3622617130 wait complete. 2023-11-08T12:29:31.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 Processor -- start 2023-11-08T12:29:31.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 -- start start 2023-11-08T12:29:31.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b1640 0x7f165c0c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f165c0b43a0 0x7f165c06c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0cc320 con 0x7f165c0b1640 2023-11-08T12:29:31.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0c4d10 con 0x7f165c0b43a0 2023-11-08T12:29:31.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166200f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0c4ff0 con 0x7f165c070790 2023-11-08T12:29:31.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166080c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b1640 0x7f165c0c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166080c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b1640 0x7f165c0c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47318/0 (socket says 172.21.15.112:47318) 2023-11-08T12:29:31.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166080c700 1 -- 172.21.15.112:0/840177268 learned_addr learned my addr 172.21.15.112:0/840177268 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:31.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166100d700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.123+0000 7f166180e700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f165c0b43a0 0x7f165c06c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166080c700 1 -- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 msgr2=0x7f165c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166080c700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166080c700 1 -- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f165c0b43a0 msgr2=0x7f165c06c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166080c700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f165c0b43a0 0x7f165c06c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166080c700 1 -- 172.21.15.112:0/840177268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658009a70 con 0x7f165c0b1640 2023-11-08T12:29:31.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166180e700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f165c0b43a0 0x7f165c06c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:31.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166080c700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b1640 0x7f165c0c4410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f164c001270 tx=0x7f164c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:31.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f1651ffb700 1 -- 172.21.15.112:0/840177268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c005d90 con 0x7f165c0b1640 2023-11-08T12:29:31.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f1651ffb700 1 -- 172.21.15.112:0/840177268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c0070d0 con 0x7f165c0b1640 2023-11-08T12:29:31.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c06b5d0 con 0x7f165c0b1640 2023-11-08T12:29:31.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f1651ffb700 1 -- 172.21.15.112:0/840177268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c007480 con 0x7f165c0b1640 2023-11-08T12:29:31.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c06b2f0 con 0x7f165c0b1640 2023-11-08T12:29:31.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.127+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c15eb10 con 0x7f165c0b1640 2023-11-08T12:29:31.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.131+0000 7f1651ffb700 1 -- 172.21.15.112:0/840177268 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f164c019030 con 0x7f165c0b1640 2023-11-08T12:29:31.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.131+0000 7f1651ffb700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1640064ee0 0x7f1640067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.131+0000 7f1651ffb700 1 -- 172.21.15.112:0/840177268 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f164c0812b0 con 0x7f165c0b1640 2023-11-08T12:29:31.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.131+0000 7f166100d700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1640064ee0 0x7f1640067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.131+0000 7f166100d700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1640064ee0 0x7f1640067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1658000f80 tx=0x7f1658011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:31.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.135+0000 7f1651ffb700 1 -- 172.21.15.112:0/840177268 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f164c04f280 con 0x7f165c0b1640 2023-11-08T12:29:31.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.303+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f165c15a530 con 0x7f1640064ee0 2023-11-08T12:29:31.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.319+0000 7f1651ffb700 1 -- 172.21.15.112:0/840177268 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308564 (secure 0 0 0) 0x7f165c15a530 con 0x7f1640064ee0 2023-11-08T12:29:31.327 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:31.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1640064ee0 msgr2=0x7f1640067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1640064ee0 0x7f1640067390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1658000f80 tx=0x7f1658011000 comp rx=0 tx=0).stop 2023-11-08T12:29:31.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b1640 msgr2=0x7f165c0c4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b1640 0x7f165c0c4410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f164c001270 tx=0x7f164c00c9e0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 shutdown_connections 2023-11-08T12:29:31.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1640064ee0 0x7f1640067390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f165c0b43a0 0x7f165c06c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f165c0b1640 0x7f165c0c4410 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 --2- 172.21.15.112:0/840177268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f165c070790 0x7f165c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.327+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 >> 172.21.15.112:0/840177268 conn(0x7f165c0b0f80 msgr2=0x7f165c157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:31.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.331+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 shutdown_connections 2023-11-08T12:29:31.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.331+0000 7f166200f700 1 -- 172.21.15.112:0/840177268 wait complete. 2023-11-08T12:29:31.336 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:29:31.357 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-11-08T12:29:30.744308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71944,"kb_used_data":5128,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754902776,"statfs":{"total":773094113280,"available":773020442624,"internally_reserved":0,"allocated":5251072,"data_stored":2973860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.966617"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502521+0000","last_change":"2023-11-08T12:29:21.817753+0000","last_active":"2023-11-08T12:29:23.502521+0000","last_peered":"2023-11-08T12:29:23.502521+0000","last_clean":"2023-11-08T12:29:23.502521+0000","last_became_active":"2023-11-08T12:29:21.817472+0000","last_became_peered":"2023-11-08T12:29:21.817472+0000","last_unstale":"2023-11-08T12:29:23.502521+0000","last_undegraded":"2023-11-08T12:29:23.502521+0000","last_fullsized":"2023-11-08T12:29:23.502521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:48:49.601579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784936+0000","last_change":"2023-11-08T12:29:21.809249+0000","last_active":"2023-11-08T12:29:22.784936+0000","last_peered":"2023-11-08T12:29:22.784936+0000","last_clean":"2023-11-08T12:29:22.784936+0000","last_became_active":"2023-11-08T12:29:21.808986+0000","last_became_peered":"2023-11-08T12:29:21.808986+0000","last_unstale":"2023-11-08T12:29:22.784936+0000","last_undegraded":"2023-11-08T12:29:22.784936+0000","last_fullsized":"2023-11-08T12:29:22.784936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:47:34.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816301+0000","last_change":"2023-11-08T12:29:21.811393+0000","last_active":"2023-11-08T12:29:21.816301+0000","last_peered":"2023-11-08T12:29:21.816301+0000","last_clean":"2023-11-08T12:29:21.816301+0000","last_became_active":"2023-11-08T12:29:21.811080+0000","last_became_peered":"2023-11-08T12:29:21.811080+0000","last_unstale":"2023-11-08T12:29:21.816301+0000","last_undegraded":"2023-11-08T12:29:21.816301+0000","last_fullsized":"2023-11-08T12:29:21.816301+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495176+0000","last_change":"2023-11-08T12:29:21.807409+0000","last_active":"2023-11-08T12:29:23.495176+0000","last_peered":"2023-11-08T12:29:23.495176+0000","last_clean":"2023-11-08T12:29:23.495176+0000","last_became_active":"2023-11-08T12:29:21.807166+0000","last_became_peered":"2023-11-08T12:29:21.807166+0000","last_unstale":"2023-11-08T12:29:23.495176+0000","last_undegraded":"2023-11-08T12:29:23.495176+0000","last_fullsized":"2023-11-08T12:29:23.495176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:33:30.081962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784594+0000","last_change":"2023-11-08T12:29:21.804383+0000","last_active":"2023-11-08T12:29:22.784594+0000","last_peered":"2023-11-08T12:29:22.784594+0000","last_clean":"2023-11-08T12:29:22.784594+0000","last_became_active":"2023-11-08T12:29:21.804182+0000","last_became_peered":"2023-11-08T12:29:21.804182+0000","last_unstale":"2023-11-08T12:29:22.784594+0000","last_undegraded":"2023-11-08T12:29:22.784594+0000","last_fullsized":"2023-11-08T12:29:22.784594+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785345+0000","last_change":"2023-11-08T12:29:21.816037+0000","last_active":"2023-11-08T12:29:22.785345+0000","last_peered":"2023-11-08T12:29:22.785345+0000","last_clean":"2023-11-08T12:29:22.785345+0000","last_became_active":"2023-11-08T12:29:21.815653+0000","last_became_peered":"2023-11-08T12:29:21.815653+0000","last_unstale":"2023-11-08T12:29:22.785345+0000","last_undegraded":"2023-11-08T12:29:22.785345+0000","last_fullsized":"2023-11-08T12:29:22.785345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.501888+0000","last_change":"2023-11-08T12:29:21.819916+0000","last_active":"2023-11-08T12:29:23.501888+0000","last_peered":"2023-11-08T12:29:23.501888+0000","last_clean":"2023-11-08T12:29:23.501888+0000","last_became_active":"2023-11-08T12:29:21.819605+0000","last_became_peered":"2023-11-08T12:29:21.819605+0000","last_unstale":"2023-11-08T12:29:23.501888+0000","last_undegraded":"2023-11-08T12:29:23.501888+0000","last_fullsized":"2023-11-08T12:29:23.501888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.493735+0000","last_change":"2023-11-08T12:29:21.813522+0000","last_active":"2023-11-08T12:29:23.493735+0000","last_peered":"2023-11-08T12:29:23.493735+0000","last_clean":"2023-11-08T12:29:23.493735+0000","last_became_active":"2023-11-08T12:29:21.812613+0000","last_became_peered":"2023-11-08T12:29:21.812613+0000","last_unstale":"2023-11-08T12:29:23.493735+0000","last_undegraded":"2023-11-08T12:29:23.493735+0000","last_fullsized":"2023-11-08T12:29:23.493735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495637+0000","last_change":"2023-11-08T12:29:21.827080+0000","last_active":"2023-11-08T12:29:23.495637+0000","last_peered":"2023-11-08T12:29:23.495637+0000","last_clean":"2023-11-08T12:29:23.495637+0000","last_became_active":"2023-11-08T12:29:21.826734+0000","last_became_peered":"2023-11-08T12:29:21.826734+0000","last_unstale":"2023-11-08T12:29:23.495637+0000","last_undegraded":"2023-11-08T12:29:23.495637+0000","last_fullsized":"2023-11-08T12:29:23.495637+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:28:58.357487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495612+0000","last_change":"2023-11-08T12:29:21.808710+0000","last_active":"2023-11-08T12:29:23.495612+0000","last_peered":"2023-11-08T12:29:23.495612+0000","last_clean":"2023-11-08T12:29:23.495612+0000","last_became_active":"2023-11-08T12:29:21.808476+0000","last_became_peered":"2023-11-08T12:29:21.808476+0000","last_unstale":"2023-11-08T12:29:23.495612+0000","last_undegraded":"2023-11-08T12:29:23.495612+0000","last_fullsized":"2023-11-08T12:29:23.495612+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495091+0000","last_change":"2023-11-08T12:29:21.827439+0000","last_active":"2023-11-08T12:29:23.495091+0000","last_peered":"2023-11-08T12:29:23.495091+0000","last_clean":"2023-11-08T12:29:23.495091+0000","last_became_active":"2023-11-08T12:29:21.827185+0000","last_became_peered":"2023-11-08T12:29:21.827185+0000","last_unstale":"2023-11-08T12:29:23.495091+0000","last_undegraded":"2023-11-08T12:29:23.495091+0000","last_fullsized":"2023-11-08T12:29:23.495091+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784669+0000","last_change":"2023-11-08T12:29:21.822648+0000","last_active":"2023-11-08T12:29:22.784669+0000","last_peered":"2023-11-08T12:29:22.784669+0000","last_clean":"2023-11-08T12:29:22.784669+0000","last_became_active":"2023-11-08T12:29:21.822442+0000","last_became_peered":"2023-11-08T12:29:21.822442+0000","last_unstale":"2023-11-08T12:29:22.784669+0000","last_undegraded":"2023-11-08T12:29:22.784669+0000","last_fullsized":"2023-11-08T12:29:22.784669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786731+0000","last_change":"2023-11-08T12:29:21.817755+0000","last_active":"2023-11-08T12:29:22.786731+0000","last_peered":"2023-11-08T12:29:22.786731+0000","last_clean":"2023-11-08T12:29:22.786731+0000","last_became_active":"2023-11-08T12:29:21.817490+0000","last_became_peered":"2023-11-08T12:29:21.817490+0000","last_unstale":"2023-11-08T12:29:22.786731+0000","last_undegraded":"2023-11-08T12:29:22.786731+0000","last_fullsized":"2023-11-08T12:29:22.786731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:56.007182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494144+0000","last_change":"2023-11-08T12:29:21.828260+0000","last_active":"2023-11-08T12:29:23.494144+0000","last_peered":"2023-11-08T12:29:23.494144+0000","last_clean":"2023-11-08T12:29:23.494144+0000","last_became_active":"2023-11-08T12:29:21.827984+0000","last_became_peered":"2023-11-08T12:29:21.827984+0000","last_unstale":"2023-11-08T12:29:23.494144+0000","last_undegraded":"2023-11-08T12:29:23.494144+0000","last_fullsized":"2023-11-08T12:29:23.494144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785168+0000","last_change":"2023-11-08T12:29:21.806695+0000","last_active":"2023-11-08T12:29:22.785168+0000","last_peered":"2023-11-08T12:29:22.785168+0000","last_clean":"2023-11-08T12:29:22.785168+0000","last_became_active":"2023-11-08T12:29:21.806460+0000","last_became_peered":"2023-11-08T12:29:21.806460+0000","last_unstale":"2023-11-08T12:29:22.785168+0000","last_undegraded":"2023-11-08T12:29:22.785168+0000","last_fullsized":"2023-11-08T12:29:22.785168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.818648+0000","last_change":"2023-11-08T12:29:21.815075+0000","last_active":"2023-11-08T12:29:21.818648+0000","last_peered":"2023-11-08T12:29:21.818648+0000","last_clean":"2023-11-08T12:29:21.818648+0000","last_became_active":"2023-11-08T12:29:21.814795+0000","last_became_peered":"2023-11-08T12:29:21.814795+0000","last_unstale":"2023-11-08T12:29:21.818648+0000","last_undegraded":"2023-11-08T12:29:21.818648+0000","last_fullsized":"2023-11-08T12:29:21.818648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:07:28.967380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.815560+0000","last_change":"2023-11-08T12:29:21.802733+0000","last_active":"2023-11-08T12:29:21.815560+0000","last_peered":"2023-11-08T12:29:21.815560+0000","last_clean":"2023-11-08T12:29:21.815560+0000","last_became_active":"2023-11-08T12:29:21.802417+0000","last_became_peered":"2023-11-08T12:29:21.802417+0000","last_unstale":"2023-11-08T12:29:21.815560+0000","last_undegraded":"2023-11-08T12:29:21.815560+0000","last_fullsized":"2023-11-08T12:29:21.815560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816387+0000","last_change":"2023-11-08T12:29:21.806403+0000","last_active":"2023-11-08T12:29:21.816387+0000","last_peered":"2023-11-08T12:29:21.816387+0000","last_clean":"2023-11-08T12:29:21.816387+0000","last_became_active":"2023-11-08T12:29:21.806102+0000","last_became_peered":"2023-11-08T12:29:21.806102+0000","last_unstale":"2023-11-08T12:29:21.816387+0000","last_undegraded":"2023-11-08T12:29:21.816387+0000","last_fullsized":"2023-11-08T12:29:21.816387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.813144+0000","last_change":"2023-11-08T12:29:21.808809+0000","last_active":"2023-11-08T12:29:21.813144+0000","last_peered":"2023-11-08T12:29:21.813144+0000","last_clean":"2023-11-08T12:29:21.813144+0000","last_became_active":"2023-11-08T12:29:21.805982+0000","last_became_peered":"2023-11-08T12:29:21.805982+0000","last_unstale":"2023-11-08T12:29:21.813144+0000","last_undegraded":"2023-11-08T12:29:21.813144+0000","last_fullsized":"2023-11-08T12:29:21.813144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:30:43.794892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787061+0000","last_change":"2023-11-08T12:29:21.819567+0000","last_active":"2023-11-08T12:29:22.787061+0000","last_peered":"2023-11-08T12:29:22.787061+0000","last_clean":"2023-11-08T12:29:22.787061+0000","last_became_active":"2023-11-08T12:29:21.819214+0000","last_became_peered":"2023-11-08T12:29:21.819214+0000","last_unstale":"2023-11-08T12:29:22.787061+0000","last_undegraded":"2023-11-08T12:29:22.787061+0000","last_fullsized":"2023-11-08T12:29:22.787061+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:30.051527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785549+0000","last_change":"2023-11-08T12:29:21.802562+0000","last_active":"2023-11-08T12:29:22.785549+0000","last_peered":"2023-11-08T12:29:22.785549+0000","last_clean":"2023-11-08T12:29:22.785549+0000","last_became_active":"2023-11-08T12:29:21.801814+0000","last_became_peered":"2023-11-08T12:29:21.801814+0000","last_unstale":"2023-11-08T12:29:22.785549+0000","last_undegraded":"2023-11-08T12:29:22.785549+0000","last_fullsized":"2023-11-08T12:29:22.785549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494193+0000","last_change":"2023-11-08T12:29:21.819922+0000","last_active":"2023-11-08T12:29:23.494193+0000","last_peered":"2023-11-08T12:29:23.494193+0000","last_clean":"2023-11-08T12:29:23.494193+0000","last_became_active":"2023-11-08T12:29:21.819683+0000","last_became_peered":"2023-11-08T12:29:21.819683+0000","last_unstale":"2023-11-08T12:29:23.494193+0000","last_undegraded":"2023-11-08T12:29:23.494193+0000","last_fullsized":"2023-11-08T12:29:23.494193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:02:50.507213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816191+0000","last_change":"2023-11-08T12:29:21.812015+0000","last_active":"2023-11-08T12:29:21.816191+0000","last_peered":"2023-11-08T12:29:21.816191+0000","last_clean":"2023-11-08T12:29:21.816191+0000","last_became_active":"2023-11-08T12:29:21.811677+0000","last_became_peered":"2023-11-08T12:29:21.811677+0000","last_unstale":"2023-11-08T12:29:21.816191+0000","last_undegraded":"2023-11-08T12:29:21.816191+0000","last_fullsized":"2023-11-08T12:29:21.816191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:49:11.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816956+0000","last_change":"2023-11-08T12:29:21.812347+0000","last_active":"2023-11-08T12:29:21.816956+0000","last_peered":"2023-11-08T12:29:21.816956+0000","last_clean":"2023-11-08T12:29:21.816956+0000","last_became_active":"2023-11-08T12:29:21.811740+0000","last_became_peered":"2023-11-08T12:29:21.811740+0000","last_unstale":"2023-11-08T12:29:21.816956+0000","last_undegraded":"2023-11-08T12:29:21.816956+0000","last_fullsized":"2023-11-08T12:29:21.816956+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:31:33.328583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.817379+0000","last_change":"2023-11-08T12:29:21.812153+0000","last_active":"2023-11-08T12:29:21.817379+0000","last_peered":"2023-11-08T12:29:21.817379+0000","last_clean":"2023-11-08T12:29:21.817379+0000","last_became_active":"2023-11-08T12:29:21.811684+0000","last_became_peered":"2023-11-08T12:29:21.811684+0000","last_unstale":"2023-11-08T12:29:21.817379+0000","last_undegraded":"2023-11-08T12:29:21.817379+0000","last_fullsized":"2023-11-08T12:29:21.817379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:09:23.051243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787086+0000","last_change":"2023-11-08T12:29:21.817462+0000","last_active":"2023-11-08T12:29:22.787086+0000","last_peered":"2023-11-08T12:29:22.787086+0000","last_clean":"2023-11-08T12:29:22.787086+0000","last_became_active":"2023-11-08T12:29:21.817208+0000","last_became_peered":"2023-11-08T12:29:21.817208+0000","last_unstale":"2023-11-08T12:29:22.787086+0000","last_undegraded":"2023-11-08T12:29:22.787086+0000","last_fullsized":"2023-11-08T12:29:22.787086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:13:12.191699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816244+0000","last_change":"2023-11-08T12:29:21.810271+0000","last_active":"2023-11-08T12:29:21.816244+0000","last_peered":"2023-11-08T12:29:21.816244+0000","last_clean":"2023-11-08T12:29:21.816244+0000","last_became_active":"2023-11-08T12:29:21.810013+0000","last_became_peered":"2023-11-08T12:29:21.810013+0000","last_unstale":"2023-11-08T12:29:21.816244+0000","last_undegraded":"2023-11-08T12:29:21.816244+0000","last_fullsized":"2023-11-08T12:29:21.816244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784704+0000","last_change":"2023-11-08T12:29:21.820063+0000","last_active":"2023-11-08T12:29:22.784704+0000","last_peered":"2023-11-08T12:29:22.784704+0000","last_clean":"2023-11-08T12:29:22.784704+0000","last_became_active":"2023-11-08T12:29:21.819738+0000","last_became_peered":"2023-11-08T12:29:21.819738+0000","last_unstale":"2023-11-08T12:29:22.784704+0000","last_undegraded":"2023-11-08T12:29:22.784704+0000","last_fullsized":"2023-11-08T12:29:22.784704+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:13:00.473044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.825579+0000","last_change":"2023-11-08T12:29:21.823616+0000","last_active":"2023-11-08T12:29:21.825579+0000","last_peered":"2023-11-08T12:29:21.825579+0000","last_clean":"2023-11-08T12:29:21.825579+0000","last_became_active":"2023-11-08T12:29:21.823242+0000","last_became_peered":"2023-11-08T12:29:21.823242+0000","last_unstale":"2023-11-08T12:29:21.825579+0000","last_undegraded":"2023-11-08T12:29:21.825579+0000","last_fullsized":"2023-11-08T12:29:21.825579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:30.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.815751+0000","last_change":"2023-11-08T12:29:21.808614+0000","last_active":"2023-11-08T12:29:21.815751+0000","last_peered":"2023-11-08T12:29:21.815751+0000","last_clean":"2023-11-08T12:29:21.815751+0000","last_became_active":"2023-11-08T12:29:21.808297+0000","last_became_peered":"2023-11-08T12:29:21.808297+0000","last_unstale":"2023-11-08T12:29:21.815751+0000","last_undegraded":"2023-11-08T12:29:21.815751+0000","last_fullsized":"2023-11-08T12:29:21.815751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785141+0000","last_change":"2023-11-08T12:29:21.812579+0000","last_active":"2023-11-08T12:29:22.785141+0000","last_peered":"2023-11-08T12:29:22.785141+0000","last_clean":"2023-11-08T12:29:22.785141+0000","last_became_active":"2023-11-08T12:29:21.812294+0000","last_became_peered":"2023-11-08T12:29:21.812294+0000","last_unstale":"2023-11-08T12:29:22.785141+0000","last_undegraded":"2023-11-08T12:29:22.785141+0000","last_fullsized":"2023-11-08T12:29:22.785141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786975+0000","last_change":"2023-11-08T12:29:21.816857+0000","last_active":"2023-11-08T12:29:22.786975+0000","last_peered":"2023-11-08T12:29:22.786975+0000","last_clean":"2023-11-08T12:29:22.786975+0000","last_became_active":"2023-11-08T12:29:21.814297+0000","last_became_peered":"2023-11-08T12:29:21.814297+0000","last_unstale":"2023-11-08T12:29:22.786975+0000","last_undegraded":"2023-11-08T12:29:22.786975+0000","last_fullsized":"2023-11-08T12:29:22.786975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:03:15.852031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.641172+0000","last_change":"2023-11-08T12:29:21.807851+0000","last_active":"2023-11-08T12:29:24.641172+0000","last_peered":"2023-11-08T12:29:24.641172+0000","last_clean":"2023-11-08T12:29:24.641172+0000","last_became_active":"2023-11-08T12:29:21.807594+0000","last_became_peered":"2023-11-08T12:29:21.807594+0000","last_unstale":"2023-11-08T12:29:24.641172+0000","last_undegraded":"2023-11-08T12:29:24.641172+0000","last_fullsized":"2023-11-08T12:29:24.641172+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:59:11.369849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.802949+0000","last_change":"2023-11-08T12:29:21.349307+0000","last_active":"2023-11-08T12:29:21.802949+0000","last_peered":"2023-11-08T12:29:21.802949+0000","last_clean":"2023-11-08T12:29:21.802949+0000","last_became_active":"2023-11-08T12:29:21.348126+0000","last_became_peered":"2023-11-08T12:29:21.348126+0000","last_unstale":"2023-11-08T12:29:21.802949+0000","last_undegraded":"2023-11-08T12:29:21.802949+0000","last_fullsized":"2023-11-08T12:29:21.802949+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811262+0000","last_change":"2023-11-08T12:29:21.795050+0000","last_active":"2023-11-08T12:29:21.811262+0000","last_peered":"2023-11-08T12:29:21.811262+0000","last_clean":"2023-11-08T12:29:21.811262+0000","last_became_active":"2023-11-08T12:29:21.794561+0000","last_became_peered":"2023-11-08T12:29:21.794561+0000","last_unstale":"2023-11-08T12:29:21.811262+0000","last_undegraded":"2023-11-08T12:29:21.811262+0000","last_fullsized":"2023-11-08T12:29:21.811262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:40:42.873851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805552+0000","last_change":"2023-11-08T12:29:21.338664+0000","last_active":"2023-11-08T12:29:21.805552+0000","last_peered":"2023-11-08T12:29:21.805552+0000","last_clean":"2023-11-08T12:29:21.805552+0000","last_became_active":"2023-11-08T12:29:21.338364+0000","last_became_peered":"2023-11-08T12:29:21.338364+0000","last_unstale":"2023-11-08T12:29:21.805552+0000","last_undegraded":"2023-11-08T12:29:21.805552+0000","last_fullsized":"2023-11-08T12:29:21.805552+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:26:46.020922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784944+0000","last_change":"2023-11-08T12:29:21.807291+0000","last_active":"2023-11-08T12:29:22.784944+0000","last_peered":"2023-11-08T12:29:22.784944+0000","last_clean":"2023-11-08T12:29:22.784944+0000","last_became_active":"2023-11-08T12:29:21.806952+0000","last_became_peered":"2023-11-08T12:29:21.806952+0000","last_unstale":"2023-11-08T12:29:22.784944+0000","last_undegraded":"2023-11-08T12:29:22.784944+0000","last_fullsized":"2023-11-08T12:29:22.784944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:32:44.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.828778+0000","last_change":"2023-11-08T12:29:21.344422+0000","last_active":"2023-11-08T12:29:21.828778+0000","last_peered":"2023-11-08T12:29:21.828778+0000","last_clean":"2023-11-08T12:29:21.828778+0000","last_became_active":"2023-11-08T12:29:21.344096+0000","last_became_peered":"2023-11-08T12:29:21.344096+0000","last_unstale":"2023-11-08T12:29:21.828778+0000","last_undegraded":"2023-11-08T12:29:21.828778+0000","last_fullsized":"2023-11-08T12:29:21.828778+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:59.630215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.641127+0000","last_change":"2023-11-08T12:29:21.825604+0000","last_active":"2023-11-08T12:29:24.641127+0000","last_peered":"2023-11-08T12:29:24.641127+0000","last_clean":"2023-11-08T12:29:24.641127+0000","last_became_active":"2023-11-08T12:29:21.825335+0000","last_became_peered":"2023-11-08T12:29:21.825335+0000","last_unstale":"2023-11-08T12:29:24.641127+0000","last_undegraded":"2023-11-08T12:29:24.641127+0000","last_fullsized":"2023-11-08T12:29:24.641127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:56.113448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816522+0000","last_change":"2023-11-08T12:29:21.349891+0000","last_active":"2023-11-08T12:29:21.816522+0000","last_peered":"2023-11-08T12:29:21.816522+0000","last_clean":"2023-11-08T12:29:21.816522+0000","last_became_active":"2023-11-08T12:29:21.349601+0000","last_became_peered":"2023-11-08T12:29:21.349601+0000","last_unstale":"2023-11-08T12:29:21.816522+0000","last_undegraded":"2023-11-08T12:29:21.816522+0000","last_fullsized":"2023-11-08T12:29:21.816522+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805340+0000","last_change":"2023-11-08T12:29:21.799913+0000","last_active":"2023-11-08T12:29:21.805340+0000","last_peered":"2023-11-08T12:29:21.805340+0000","last_clean":"2023-11-08T12:29:21.805340+0000","last_became_active":"2023-11-08T12:29:21.799604+0000","last_became_peered":"2023-11-08T12:29:21.799604+0000","last_unstale":"2023-11-08T12:29:21.805340+0000","last_undegraded":"2023-11-08T12:29:21.805340+0000","last_fullsized":"2023-11-08T12:29:21.805340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:43:38.297588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805362+0000","last_change":"2023-11-08T12:29:21.341760+0000","last_active":"2023-11-08T12:29:21.805362+0000","last_peered":"2023-11-08T12:29:21.805362+0000","last_clean":"2023-11-08T12:29:21.805362+0000","last_became_active":"2023-11-08T12:29:21.341426+0000","last_became_peered":"2023-11-08T12:29:21.341426+0000","last_unstale":"2023-11-08T12:29:21.805362+0000","last_undegraded":"2023-11-08T12:29:21.805362+0000","last_fullsized":"2023-11-08T12:29:21.805362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:21:10.046172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494455+0000","last_change":"2023-11-08T12:29:21.810802+0000","last_active":"2023-11-08T12:29:23.494455+0000","last_peered":"2023-11-08T12:29:23.494455+0000","last_clean":"2023-11-08T12:29:23.494455+0000","last_became_active":"2023-11-08T12:29:21.810630+0000","last_became_peered":"2023-11-08T12:29:21.810630+0000","last_unstale":"2023-11-08T12:29:23.494455+0000","last_undegraded":"2023-11-08T12:29:23.494455+0000","last_fullsized":"2023-11-08T12:29:23.494455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808486+0000","last_change":"2023-11-08T12:29:21.338833+0000","last_active":"2023-11-08T12:29:21.808486+0000","last_peered":"2023-11-08T12:29:21.808486+0000","last_clean":"2023-11-08T12:29:21.808486+0000","last_became_active":"2023-11-08T12:29:21.338621+0000","last_became_peered":"2023-11-08T12:29:21.338621+0000","last_unstale":"2023-11-08T12:29:21.808486+0000","last_undegraded":"2023-11-08T12:29:21.808486+0000","last_fullsized":"2023-11-08T12:29:21.808486+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:32.577889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494026+0000","last_change":"2023-11-08T12:29:21.813361+0000","last_active":"2023-11-08T12:29:23.494026+0000","last_peered":"2023-11-08T12:29:23.494026+0000","last_clean":"2023-11-08T12:29:23.494026+0000","last_became_active":"2023-11-08T12:29:21.812271+0000","last_became_peered":"2023-11-08T12:29:21.812271+0000","last_unstale":"2023-11-08T12:29:23.494026+0000","last_undegraded":"2023-11-08T12:29:23.494026+0000","last_fullsized":"2023-11-08T12:29:23.494026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.271601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.796924+0000","last_change":"2023-11-08T12:29:21.339277+0000","last_active":"2023-11-08T12:29:21.796924+0000","last_peered":"2023-11-08T12:29:21.796924+0000","last_clean":"2023-11-08T12:29:21.796924+0000","last_became_active":"2023-11-08T12:29:21.338989+0000","last_became_peered":"2023-11-08T12:29:21.338989+0000","last_unstale":"2023-11-08T12:29:21.796924+0000","last_undegraded":"2023-11-08T12:29:21.796924+0000","last_fullsized":"2023-11-08T12:29:21.796924+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.222891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.818493+0000","last_change":"2023-11-08T12:29:21.813129+0000","last_active":"2023-11-08T12:29:21.818493+0000","last_peered":"2023-11-08T12:29:21.818493+0000","last_clean":"2023-11-08T12:29:21.818493+0000","last_became_active":"2023-11-08T12:29:21.812835+0000","last_became_peered":"2023-11-08T12:29:21.812835+0000","last_unstale":"2023-11-08T12:29:21.818493+0000","last_undegraded":"2023-11-08T12:29:21.818493+0000","last_fullsized":"2023-11-08T12:29:21.818493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:05.769508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.798425+0000","last_change":"2023-11-08T12:29:21.341564+0000","last_active":"2023-11-08T12:29:21.798425+0000","last_peered":"2023-11-08T12:29:21.798425+0000","last_clean":"2023-11-08T12:29:21.798425+0000","last_became_active":"2023-11-08T12:29:21.341236+0000","last_became_peered":"2023-11-08T12:29:21.341236+0000","last_unstale":"2023-11-08T12:29:21.798425+0000","last_undegraded":"2023-11-08T12:29:21.798425+0000","last_fullsized":"2023-11-08T12:29:21.798425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.813313+0000","last_change":"2023-11-08T12:29:21.800809+0000","last_active":"2023-11-08T12:29:21.813313+0000","last_peered":"2023-11-08T12:29:21.813313+0000","last_clean":"2023-11-08T12:29:21.813313+0000","last_became_active":"2023-11-08T12:29:21.800508+0000","last_became_peered":"2023-11-08T12:29:21.800508+0000","last_unstale":"2023-11-08T12:29:21.813313+0000","last_undegraded":"2023-11-08T12:29:21.813313+0000","last_fullsized":"2023-11-08T12:29:21.813313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:13:43.983713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805602+0000","last_change":"2023-11-08T12:29:21.336456+0000","last_active":"2023-11-08T12:29:21.805602+0000","last_peered":"2023-11-08T12:29:21.805602+0000","last_clean":"2023-11-08T12:29:21.805602+0000","last_became_active":"2023-11-08T12:29:21.336182+0000","last_became_peered":"2023-11-08T12:29:21.336182+0000","last_unstale":"2023-11-08T12:29:21.805602+0000","last_undegraded":"2023-11-08T12:29:21.805602+0000","last_fullsized":"2023-11-08T12:29:21.805602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502622+0000","last_change":"2023-11-08T12:29:21.816825+0000","last_active":"2023-11-08T12:29:23.502622+0000","last_peered":"2023-11-08T12:29:23.502622+0000","last_clean":"2023-11-08T12:29:23.502622+0000","last_became_active":"2023-11-08T12:29:21.816561+0000","last_became_peered":"2023-11-08T12:29:21.816561+0000","last_unstale":"2023-11-08T12:29:23.502622+0000","last_undegraded":"2023-11-08T12:29:23.502622+0000","last_fullsized":"2023-11-08T12:29:23.502622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:13:00.473044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.796670+0000","last_change":"2023-11-08T12:29:21.342736+0000","last_active":"2023-11-08T12:29:21.796670+0000","last_peered":"2023-11-08T12:29:21.796670+0000","last_clean":"2023-11-08T12:29:21.796670+0000","last_became_active":"2023-11-08T12:29:21.342385+0000","last_became_peered":"2023-11-08T12:29:21.342385+0000","last_unstale":"2023-11-08T12:29:21.796670+0000","last_undegraded":"2023-11-08T12:29:21.796670+0000","last_fullsized":"2023-11-08T12:29:21.796670+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785885+0000","last_change":"2023-11-08T12:29:21.820215+0000","last_active":"2023-11-08T12:29:22.785885+0000","last_peered":"2023-11-08T12:29:22.785885+0000","last_clean":"2023-11-08T12:29:22.785885+0000","last_became_active":"2023-11-08T12:29:21.819908+0000","last_became_peered":"2023-11-08T12:29:21.819908+0000","last_unstale":"2023-11-08T12:29:22.785885+0000","last_undegraded":"2023-11-08T12:29:22.785885+0000","last_fullsized":"2023-11-08T12:29:22.785885+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:42:48.490950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.817409+0000","last_change":"2023-11-08T12:29:21.348938+0000","last_active":"2023-11-08T12:29:21.817409+0000","last_peered":"2023-11-08T12:29:21.817409+0000","last_clean":"2023-11-08T12:29:21.817409+0000","last_became_active":"2023-11-08T12:29:21.348313+0000","last_became_peered":"2023-11-08T12:29:21.348313+0000","last_unstale":"2023-11-08T12:29:21.817409+0000","last_undegraded":"2023-11-08T12:29:21.817409+0000","last_fullsized":"2023-11-08T12:29:21.817409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502217+0000","last_change":"2023-11-08T12:29:21.820121+0000","last_active":"2023-11-08T12:29:23.502217+0000","last_peered":"2023-11-08T12:29:23.502217+0000","last_clean":"2023-11-08T12:29:23.502217+0000","last_became_active":"2023-11-08T12:29:21.819833+0000","last_became_peered":"2023-11-08T12:29:21.819833+0000","last_unstale":"2023-11-08T12:29:23.502217+0000","last_undegraded":"2023-11-08T12:29:23.502217+0000","last_fullsized":"2023-11-08T12:29:23.502217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:32:44.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787130+0000","last_change":"2023-11-08T12:29:21.336777+0000","last_active":"2023-11-08T12:29:22.787130+0000","last_peered":"2023-11-08T12:29:22.787130+0000","last_clean":"2023-11-08T12:29:22.787130+0000","last_became_active":"2023-11-08T12:29:21.336489+0000","last_became_peered":"2023-11-08T12:29:21.336489+0000","last_unstale":"2023-11-08T12:29:22.787130+0000","last_undegraded":"2023-11-08T12:29:22.787130+0000","last_fullsized":"2023-11-08T12:29:22.787130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:52:06.155620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811063+0000","last_change":"2023-11-08T12:29:21.806201+0000","last_active":"2023-11-08T12:29:21.811063+0000","last_peered":"2023-11-08T12:29:21.811063+0000","last_clean":"2023-11-08T12:29:21.811063+0000","last_became_active":"2023-11-08T12:29:21.805845+0000","last_became_peered":"2023-11-08T12:29:21.805845+0000","last_unstale":"2023-11-08T12:29:21.811063+0000","last_undegraded":"2023-11-08T12:29:21.811063+0000","last_fullsized":"2023-11-08T12:29:21.811063+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:49.547648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.793754+0000","last_change":"2023-11-08T12:29:21.342696+0000","last_active":"2023-11-08T12:29:21.793754+0000","last_peered":"2023-11-08T12:29:21.793754+0000","last_clean":"2023-11-08T12:29:21.793754+0000","last_became_active":"2023-11-08T12:29:21.342396+0000","last_became_peered":"2023-11-08T12:29:21.342396+0000","last_unstale":"2023-11-08T12:29:21.793754+0000","last_undegraded":"2023-11-08T12:29:21.793754+0000","last_fullsized":"2023-11-08T12:29:21.793754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:31:24.502780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.494729+0000","last_change":"2023-11-08T12:29:21.819366+0000","last_active":"2023-11-08T12:29:23.494729+0000","last_peered":"2023-11-08T12:29:23.494729+0000","last_clean":"2023-11-08T12:29:23.494729+0000","last_became_active":"2023-11-08T12:29:21.819082+0000","last_became_peered":"2023-11-08T12:29:21.819082+0000","last_unstale":"2023-11-08T12:29:23.494729+0000","last_undegraded":"2023-11-08T12:29:23.494729+0000","last_fullsized":"2023-11-08T12:29:23.494729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:59.392291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800077+0000","last_change":"2023-11-08T12:29:21.348592+0000","last_active":"2023-11-08T12:29:21.800077+0000","last_peered":"2023-11-08T12:29:21.800077+0000","last_clean":"2023-11-08T12:29:21.800077+0000","last_became_active":"2023-11-08T12:29:21.348238+0000","last_became_peered":"2023-11-08T12:29:21.348238+0000","last_unstale":"2023-11-08T12:29:21.800077+0000","last_undegraded":"2023-11-08T12:29:21.800077+0000","last_fullsized":"2023-11-08T12:29:21.800077+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784931+0000","last_change":"2023-11-08T12:29:21.811607+0000","last_active":"2023-11-08T12:29:22.784931+0000","last_peered":"2023-11-08T12:29:22.784931+0000","last_clean":"2023-11-08T12:29:22.784931+0000","last_became_active":"2023-11-08T12:29:21.811360+0000","last_became_peered":"2023-11-08T12:29:21.811360+0000","last_unstale":"2023-11-08T12:29:22.784931+0000","last_undegraded":"2023-11-08T12:29:22.784931+0000","last_fullsized":"2023-11-08T12:29:22.784931+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:14:09.179363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.783562+0000","last_change":"2023-11-08T12:29:21.348443+0000","last_active":"2023-11-08T12:29:21.783562+0000","last_peered":"2023-11-08T12:29:21.783562+0000","last_clean":"2023-11-08T12:29:21.783562+0000","last_became_active":"2023-11-08T12:29:21.348161+0000","last_became_peered":"2023-11-08T12:29:21.348161+0000","last_unstale":"2023-11-08T12:29:21.783562+0000","last_undegraded":"2023-11-08T12:29:21.783562+0000","last_fullsized":"2023-11-08T12:29:21.783562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:54:39.178079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502001+0000","last_change":"2023-11-08T12:29:21.812704+0000","last_active":"2023-11-08T12:29:23.502001+0000","last_peered":"2023-11-08T12:29:23.502001+0000","last_clean":"2023-11-08T12:29:23.502001+0000","last_became_active":"2023-11-08T12:29:21.812215+0000","last_became_peered":"2023-11-08T12:29:21.812215+0000","last_unstale":"2023-11-08T12:29:23.502001+0000","last_undegraded":"2023-11-08T12:29:23.502001+0000","last_fullsized":"2023-11-08T12:29:23.502001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:47:34.838647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.832347+0000","last_change":"2023-11-08T12:29:21.338524+0000","last_active":"2023-11-08T12:29:21.832347+0000","last_peered":"2023-11-08T12:29:21.832347+0000","last_clean":"2023-11-08T12:29:21.832347+0000","last_became_active":"2023-11-08T12:29:21.338235+0000","last_became_peered":"2023-11-08T12:29:21.338235+0000","last_unstale":"2023-11-08T12:29:21.832347+0000","last_undegraded":"2023-11-08T12:29:21.832347+0000","last_fullsized":"2023-11-08T12:29:21.832347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787147+0000","last_change":"2023-11-08T12:29:21.812641+0000","last_active":"2023-11-08T12:29:22.787147+0000","last_peered":"2023-11-08T12:29:22.787147+0000","last_clean":"2023-11-08T12:29:22.787147+0000","last_became_active":"2023-11-08T12:29:21.812327+0000","last_became_peered":"2023-11-08T12:29:21.812327+0000","last_unstale":"2023-11-08T12:29:22.787147+0000","last_undegraded":"2023-11-08T12:29:22.787147+0000","last_fullsized":"2023-11-08T12:29:22.787147+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:32:04.240338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.787073+0000","last_change":"2023-11-08T12:29:21.335461+0000","last_active":"2023-11-08T12:29:22.787073+0000","last_peered":"2023-11-08T12:29:22.787073+0000","last_clean":"2023-11-08T12:29:22.787073+0000","last_became_active":"2023-11-08T12:29:21.335191+0000","last_became_peered":"2023-11-08T12:29:21.335191+0000","last_unstale":"2023-11-08T12:29:22.787073+0000","last_undegraded":"2023-11-08T12:29:22.787073+0000","last_fullsized":"2023-11-08T12:29:22.787073+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:23:05.661588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495628+0000","last_change":"2023-11-08T12:29:21.803417+0000","last_active":"2023-11-08T12:29:23.495628+0000","last_peered":"2023-11-08T12:29:23.495628+0000","last_clean":"2023-11-08T12:29:23.495628+0000","last_became_active":"2023-11-08T12:29:21.800610+0000","last_became_peered":"2023-11-08T12:29:21.800610+0000","last_unstale":"2023-11-08T12:29:23.495628+0000","last_undegraded":"2023-11-08T12:29:23.495628+0000","last_fullsized":"2023-11-08T12:29:23.495628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:11.943031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816953+0000","last_change":"2023-11-08T12:29:21.341006+0000","last_active":"2023-11-08T12:29:21.816953+0000","last_peered":"2023-11-08T12:29:21.816953+0000","last_clean":"2023-11-08T12:29:21.816953+0000","last_became_active":"2023-11-08T12:29:21.340756+0000","last_became_peered":"2023-11-08T12:29:21.340756+0000","last_unstale":"2023-11-08T12:29:21.816953+0000","last_undegraded":"2023-11-08T12:29:21.816953+0000","last_fullsized":"2023-11-08T12:29:21.816953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:57:11.007145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811122+0000","last_change":"2023-11-08T12:29:21.804186+0000","last_active":"2023-11-08T12:29:21.811122+0000","last_peered":"2023-11-08T12:29:21.811122+0000","last_clean":"2023-11-08T12:29:21.811122+0000","last_became_active":"2023-11-08T12:29:21.803904+0000","last_became_peered":"2023-11-08T12:29:21.803904+0000","last_unstale":"2023-11-08T12:29:21.811122+0000","last_undegraded":"2023-11-08T12:29:21.811122+0000","last_fullsized":"2023-11-08T12:29:21.811122+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:35:00.646278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.823170+0000","last_change":"2023-11-08T12:29:21.342763+0000","last_active":"2023-11-08T12:29:21.823170+0000","last_peered":"2023-11-08T12:29:21.823170+0000","last_clean":"2023-11-08T12:29:21.823170+0000","last_became_active":"2023-11-08T12:29:21.342345+0000","last_became_peered":"2023-11-08T12:29:21.342345+0000","last_unstale":"2023-11-08T12:29:21.823170+0000","last_undegraded":"2023-11-08T12:29:21.823170+0000","last_fullsized":"2023-11-08T12:29:21.823170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.816964+0000","last_change":"2023-11-08T12:29:21.812556+0000","last_active":"2023-11-08T12:29:21.816964+0000","last_peered":"2023-11-08T12:29:21.816964+0000","last_clean":"2023-11-08T12:29:21.816964+0000","last_became_active":"2023-11-08T12:29:21.812230+0000","last_became_peered":"2023-11-08T12:29:21.812230+0000","last_unstale":"2023-11-08T12:29:21.816964+0000","last_undegraded":"2023-11-08T12:29:21.816964+0000","last_fullsized":"2023-11-08T12:29:21.816964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:23:38.192520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.787585+0000","last_change":"2023-11-08T12:29:21.349412+0000","last_active":"2023-11-08T12:29:21.787585+0000","last_peered":"2023-11-08T12:29:21.787585+0000","last_clean":"2023-11-08T12:29:21.787585+0000","last_became_active":"2023-11-08T12:29:21.349135+0000","last_became_peered":"2023-11-08T12:29:21.349135+0000","last_unstale":"2023-11-08T12:29:21.787585+0000","last_undegraded":"2023-11-08T12:29:21.787585+0000","last_fullsized":"2023-11-08T12:29:21.787585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:10:42.464219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785378+0000","last_change":"2023-11-08T12:29:21.815535+0000","last_active":"2023-11-08T12:29:22.785378+0000","last_peered":"2023-11-08T12:29:22.785378+0000","last_clean":"2023-11-08T12:29:22.785378+0000","last_became_active":"2023-11-08T12:29:21.815092+0000","last_became_peered":"2023-11-08T12:29:21.815092+0000","last_unstale":"2023-11-08T12:29:22.785378+0000","last_undegraded":"2023-11-08T12:29:22.785378+0000","last_fullsized":"2023-11-08T12:29:22.785378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:25:38.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805581+0000","last_change":"2023-11-08T12:29:21.338488+0000","last_active":"2023-11-08T12:29:21.805581+0000","last_peered":"2023-11-08T12:29:21.805581+0000","last_clean":"2023-11-08T12:29:21.805581+0000","last_became_active":"2023-11-08T12:29:21.338203+0000","last_became_peered":"2023-11-08T12:29:21.338203+0000","last_unstale":"2023-11-08T12:29:21.805581+0000","last_undegraded":"2023-11-08T12:29:21.805581+0000","last_fullsized":"2023-11-08T12:29:21.805581+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:31:36.137776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:24.640903+0000","last_change":"2023-11-08T12:29:21.811755+0000","last_active":"2023-11-08T12:29:24.640903+0000","last_peered":"2023-11-08T12:29:24.640903+0000","last_clean":"2023-11-08T12:29:24.640903+0000","last_became_active":"2023-11-08T12:29:21.811503+0000","last_became_peered":"2023-11-08T12:29:21.811503+0000","last_unstale":"2023-11-08T12:29:24.640903+0000","last_undegraded":"2023-11-08T12:29:24.640903+0000","last_fullsized":"2023-11-08T12:29:24.640903+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:27.826628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.794917+0000","last_change":"2023-11-08T12:29:21.344980+0000","last_active":"2023-11-08T12:29:21.794917+0000","last_peered":"2023-11-08T12:29:21.794917+0000","last_clean":"2023-11-08T12:29:21.794917+0000","last_became_active":"2023-11-08T12:29:21.344712+0000","last_became_peered":"2023-11-08T12:29:21.344712+0000","last_unstale":"2023-11-08T12:29:21.794917+0000","last_undegraded":"2023-11-08T12:29:21.794917+0000","last_fullsized":"2023-11-08T12:29:21.794917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786770+0000","last_change":"2023-11-08T12:29:21.817403+0000","last_active":"2023-11-08T12:29:22.786770+0000","last_peered":"2023-11-08T12:29:22.786770+0000","last_clean":"2023-11-08T12:29:22.786770+0000","last_became_active":"2023-11-08T12:29:21.817114+0000","last_became_peered":"2023-11-08T12:29:21.817114+0000","last_unstale":"2023-11-08T12:29:22.786770+0000","last_undegraded":"2023-11-08T12:29:22.786770+0000","last_fullsized":"2023-11-08T12:29:22.786770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:29:35.068286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.795735+0000","last_change":"2023-11-08T12:29:21.336783+0000","last_active":"2023-11-08T12:29:21.795735+0000","last_peered":"2023-11-08T12:29:21.795735+0000","last_clean":"2023-11-08T12:29:21.795735+0000","last_became_active":"2023-11-08T12:29:21.335874+0000","last_became_peered":"2023-11-08T12:29:21.335874+0000","last_unstale":"2023-11-08T12:29:21.795735+0000","last_undegraded":"2023-11-08T12:29:21.795735+0000","last_fullsized":"2023-11-08T12:29:21.795735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.493749+0000","last_change":"2023-11-08T12:29:21.827104+0000","last_active":"2023-11-08T12:29:23.493749+0000","last_peered":"2023-11-08T12:29:23.493749+0000","last_clean":"2023-11-08T12:29:23.493749+0000","last_became_active":"2023-11-08T12:29:21.826850+0000","last_became_peered":"2023-11-08T12:29:21.826850+0000","last_unstale":"2023-11-08T12:29:23.493749+0000","last_undegraded":"2023-11-08T12:29:23.493749+0000","last_fullsized":"2023-11-08T12:29:23.493749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:26.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800986+0000","last_change":"2023-11-08T12:29:21.345770+0000","last_active":"2023-11-08T12:29:21.800986+0000","last_peered":"2023-11-08T12:29:21.800986+0000","last_clean":"2023-11-08T12:29:21.800986+0000","last_became_active":"2023-11-08T12:29:21.345544+0000","last_became_peered":"2023-11-08T12:29:21.345544+0000","last_unstale":"2023-11-08T12:29:21.800986+0000","last_undegraded":"2023-11-08T12:29:21.800986+0000","last_fullsized":"2023-11-08T12:29:21.800986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:58:47.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.785567+0000","last_change":"2023-11-08T12:29:21.805583+0000","last_active":"2023-11-08T12:29:22.785567+0000","last_peered":"2023-11-08T12:29:22.785567+0000","last_clean":"2023-11-08T12:29:22.785567+0000","last_became_active":"2023-11-08T12:29:21.805329+0000","last_became_peered":"2023-11-08T12:29:21.805329+0000","last_unstale":"2023-11-08T12:29:22.785567+0000","last_undegraded":"2023-11-08T12:29:22.785567+0000","last_fullsized":"2023-11-08T12:29:22.785567+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801549+0000","last_change":"2023-11-08T12:29:21.349783+0000","last_active":"2023-11-08T12:29:21.801549+0000","last_peered":"2023-11-08T12:29:21.801549+0000","last_clean":"2023-11-08T12:29:21.801549+0000","last_became_active":"2023-11-08T12:29:21.348368+0000","last_became_peered":"2023-11-08T12:29:21.348368+0000","last_unstale":"2023-11-08T12:29:21.801549+0000","last_undegraded":"2023-11-08T12:29:21.801549+0000","last_fullsized":"2023-11-08T12:29:21.801549+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:17:25.535294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.791710+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:29:21.791710+0000","last_peered":"2023-11-08T12:29:21.791710+0000","last_clean":"2023-11-08T12:29:21.791710+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:29:21.791710+0000","last_undegraded":"2023-11-08T12:29:21.791710+0000","last_fullsized":"2023-11-08T12:29:21.791710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786012+0000","last_change":"2023-11-08T12:29:21.811783+0000","last_active":"2023-11-08T12:29:22.786012+0000","last_peered":"2023-11-08T12:29:22.786012+0000","last_clean":"2023-11-08T12:29:22.786012+0000","last_became_active":"2023-11-08T12:29:21.811546+0000","last_became_peered":"2023-11-08T12:29:21.811546+0000","last_unstale":"2023-11-08T12:29:22.786012+0000","last_undegraded":"2023-11-08T12:29:22.786012+0000","last_fullsized":"2023-11-08T12:29:22.786012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:59.392291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.805382+0000","last_change":"2023-11-08T12:29:21.342180+0000","last_active":"2023-11-08T12:29:21.805382+0000","last_peered":"2023-11-08T12:29:21.805382+0000","last_clean":"2023-11-08T12:29:21.805382+0000","last_became_active":"2023-11-08T12:29:21.341965+0000","last_became_peered":"2023-11-08T12:29:21.341965+0000","last_unstale":"2023-11-08T12:29:21.805382+0000","last_undegraded":"2023-11-08T12:29:21.805382+0000","last_fullsized":"2023-11-08T12:29:21.805382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:12:59.456980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.818280+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:29:21.818280+0000","last_peered":"2023-11-08T12:29:21.818280+0000","last_clean":"2023-11-08T12:29:21.818280+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:29:21.818280+0000","last_undegraded":"2023-11-08T12:29:21.818280+0000","last_fullsized":"2023-11-08T12:29:21.818280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.784243+0000","last_change":"2023-11-08T12:29:21.823842+0000","last_active":"2023-11-08T12:29:22.784243+0000","last_peered":"2023-11-08T12:29:22.784243+0000","last_clean":"2023-11-08T12:29:22.784243+0000","last_became_active":"2023-11-08T12:29:21.823376+0000","last_became_peered":"2023-11-08T12:29:21.823376+0000","last_unstale":"2023-11-08T12:29:22.784243+0000","last_undegraded":"2023-11-08T12:29:22.784243+0000","last_fullsized":"2023-11-08T12:29:22.784243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:48:49.601579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.808471+0000","last_change":"2023-11-08T12:29:21.346624+0000","last_active":"2023-11-08T12:29:21.808471+0000","last_peered":"2023-11-08T12:29:21.808471+0000","last_clean":"2023-11-08T12:29:21.808471+0000","last_became_active":"2023-11-08T12:29:21.346156+0000","last_became_peered":"2023-11-08T12:29:21.346156+0000","last_unstale":"2023-11-08T12:29:21.808471+0000","last_undegraded":"2023-11-08T12:29:21.808471+0000","last_fullsized":"2023-11-08T12:29:21.808471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:48.531585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.803818+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:29:21.803818+0000","last_peered":"2023-11-08T12:29:21.803818+0000","last_clean":"2023-11-08T12:29:21.803818+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:29:21.803818+0000","last_undegraded":"2023-11-08T12:29:21.803818+0000","last_fullsized":"2023-11-08T12:29:21.803818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.815528+0000","last_change":"2023-11-08T12:29:21.802735+0000","last_active":"2023-11-08T12:29:21.815528+0000","last_peered":"2023-11-08T12:29:21.815528+0000","last_clean":"2023-11-08T12:29:21.815528+0000","last_became_active":"2023-11-08T12:29:21.802154+0000","last_became_peered":"2023-11-08T12:29:21.802154+0000","last_unstale":"2023-11-08T12:29:21.815528+0000","last_undegraded":"2023-11-08T12:29:21.815528+0000","last_fullsized":"2023-11-08T12:29:21.815528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:13:48.230866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.798641+0000","last_change":"2023-11-08T12:29:21.342114+0000","last_active":"2023-11-08T12:29:21.798641+0000","last_peered":"2023-11-08T12:29:21.798641+0000","last_clean":"2023-11-08T12:29:21.798641+0000","last_became_active":"2023-11-08T12:29:21.341856+0000","last_became_peered":"2023-11-08T12:29:21.341856+0000","last_unstale":"2023-11-08T12:29:21.798641+0000","last_undegraded":"2023-11-08T12:29:21.798641+0000","last_fullsized":"2023-11-08T12:29:21.798641+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:18:26.810564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811411+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:29:21.811411+0000","last_peered":"2023-11-08T12:29:21.811411+0000","last_clean":"2023-11-08T12:29:21.811411+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:29:21.811411+0000","last_undegraded":"2023-11-08T12:29:21.811411+0000","last_fullsized":"2023-11-08T12:29:21.811411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811281+0000","last_change":"2023-11-08T12:29:21.802763+0000","last_active":"2023-11-08T12:29:21.811281+0000","last_peered":"2023-11-08T12:29:21.811281+0000","last_clean":"2023-11-08T12:29:21.811281+0000","last_became_active":"2023-11-08T12:29:21.802445+0000","last_became_peered":"2023-11-08T12:29:21.802445+0000","last_unstale":"2023-11-08T12:29:21.811281+0000","last_undegraded":"2023-11-08T12:29:21.811281+0000","last_fullsized":"2023-11-08T12:29:21.811281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:58:00.614714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:22.786069+0000","last_change":"2023-11-08T12:29:21.334567+0000","last_active":"2023-11-08T12:29:22.786069+0000","last_peered":"2023-11-08T12:29:22.786069+0000","last_clean":"2023-11-08T12:29:22.786069+0000","last_became_active":"2023-11-08T12:29:21.334322+0000","last_became_peered":"2023-11-08T12:29:21.334322+0000","last_unstale":"2023-11-08T12:29:22.786069+0000","last_undegraded":"2023-11-08T12:29:22.786069+0000","last_fullsized":"2023-11-08T12:29:22.786069+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:52:07.194386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.795001+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:29:21.795001+0000","last_peered":"2023-11-08T12:29:21.795001+0000","last_clean":"2023-11-08T12:29:21.795001+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:29:21.795001+0000","last_undegraded":"2023-11-08T12:29:21.795001+0000","last_fullsized":"2023-11-08T12:29:21.795001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495222+0000","last_change":"2023-11-08T12:29:21.801672+0000","last_active":"2023-11-08T12:29:23.495222+0000","last_peered":"2023-11-08T12:29:23.495222+0000","last_clean":"2023-11-08T12:29:23.495222+0000","last_became_active":"2023-11-08T12:29:21.801407+0000","last_became_peered":"2023-11-08T12:29:21.801407+0000","last_unstale":"2023-11-08T12:29:23.495222+0000","last_undegraded":"2023-11-08T12:29:23.495222+0000","last_fullsized":"2023-11-08T12:29:23.495222+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:46:37.576103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.803735+0000","last_change":"2023-11-08T12:29:21.349084+0000","last_active":"2023-11-08T12:29:21.803735+0000","last_peered":"2023-11-08T12:29:21.803735+0000","last_clean":"2023-11-08T12:29:21.803735+0000","last_became_active":"2023-11-08T12:29:21.348680+0000","last_became_peered":"2023-11-08T12:29:21.348680+0000","last_unstale":"2023-11-08T12:29:21.803735+0000","last_undegraded":"2023-11-08T12:29:21.803735+0000","last_fullsized":"2023-11-08T12:29:21.803735+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:14:03.615614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800385+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:29:21.800385+0000","last_peered":"2023-11-08T12:29:21.800385+0000","last_clean":"2023-11-08T12:29:21.800385+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:29:21.800385+0000","last_undegraded":"2023-11-08T12:29:21.800385+0000","last_fullsized":"2023-11-08T12:29:21.800385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.502334+0000","last_change":"2023-11-08T12:29:21.810554+0000","last_active":"2023-11-08T12:29:23.502334+0000","last_peered":"2023-11-08T12:29:23.502334+0000","last_clean":"2023-11-08T12:29:23.502334+0000","last_became_active":"2023-11-08T12:29:21.810139+0000","last_became_peered":"2023-11-08T12:29:21.810139+0000","last_unstale":"2023-11-08T12:29:23.502334+0000","last_undegraded":"2023-11-08T12:29:23.502334+0000","last_fullsized":"2023-11-08T12:29:23.502334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:33.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.811331+0000","last_change":"2023-11-08T12:29:21.344284+0000","last_active":"2023-11-08T12:29:21.811331+0000","last_peered":"2023-11-08T12:29:21.811331+0000","last_clean":"2023-11-08T12:29:21.811331+0000","last_became_active":"2023-11-08T12:29:21.343968+0000","last_became_peered":"2023-11-08T12:29:21.343968+0000","last_unstale":"2023-11-08T12:29:21.811331+0000","last_undegraded":"2023-11-08T12:29:21.811331+0000","last_fullsized":"2023-11-08T12:29:21.811331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:57:59.598650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.800896+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:29:21.800896+0000","last_peered":"2023-11-08T12:29:21.800896+0000","last_clean":"2023-11-08T12:29:21.800896+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:29:21.800896+0000","last_undegraded":"2023-11-08T12:29:21.800896+0000","last_fullsized":"2023-11-08T12:29:21.800896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-08T12:29:23.495580+0000","last_change":"2023-11-08T12:29:21.820768+0000","last_active":"2023-11-08T12:29:23.495580+0000","last_peered":"2023-11-08T12:29:23.495580+0000","last_clean":"2023-11-08T12:29:23.495580+0000","last_became_active":"2023-11-08T12:29:21.820536+0000","last_became_peered":"2023-11-08T12:29:21.820536+0000","last_unstale":"2023-11-08T12:29:23.495580+0000","last_undegraded":"2023-11-08T12:29:23.495580+0000","last_fullsized":"2023-11-08T12:29:23.495580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:21.303108+0000","last_clean_scrub_stamp":"2023-11-08T12:29:21.303108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:14:09.179363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.810868+0000","last_change":"2023-11-08T12:29:21.340014+0000","last_active":"2023-11-08T12:29:21.810868+0000","last_peered":"2023-11-08T12:29:21.810868+0000","last_clean":"2023-11-08T12:29:21.810868+0000","last_became_active":"2023-11-08T12:29:21.339760+0000","last_became_peered":"2023-11-08T12:29:21.339760+0000","last_unstale":"2023-11-08T12:29:21.810868+0000","last_undegraded":"2023-11-08T12:29:21.810868+0000","last_fullsized":"2023-11-08T12:29:21.810868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:29:20.287044+0000","last_clean_scrub_stamp":"2023-11-08T12:29:20.287044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:55.097385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.793224+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:29:21.793224+0000","last_peered":"2023-11-08T12:29:21.793224+0000","last_clean":"2023-11-08T12:29:21.793224+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:29:21.793224+0000","last_undegraded":"2023-11-08T12:29:21.793224+0000","last_fullsized":"2023-11-08T12:29:21.793224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-08T12:29:21.801069+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:29:21.801069+0000","last_peered":"2023-11-08T12:29:21.801069+0000","last_clean":"2023-11-08T12:29:21.801069+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:29:21.801069+0000","last_undegraded":"2023-11-08T12:29:21.801069+0000","last_fullsized":"2023-11-08T12:29:21.801069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476761,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8632,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363208,"statfs":{"total":96636764160,"available":96627924992,"internally_reserved":0,"allocated":507904,"data_stored":224214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.103},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.4259999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.298},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.512}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.323}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.181},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.1379999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.23},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.569}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.268}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.83599999999999997}]}]},{"osd":4,"up_from":16,"seq":68719476761,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8828,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363012,"statfs":{"total":96636764160,"available":96627724288,"internally_reserved":0,"allocated":512000,"data_stored":225106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71499999999999997}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.357}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":1.4390000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.121},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.226}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.2229999999999999,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.2909999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.512},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.1800000000000002,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.5509999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.5960000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9848,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361992,"statfs":{"total":96636764160,"available":96626679808,"internally_reserved":0,"allocated":1097728,"data_stored":814016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79400000000000004}]},{"osd":2,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.98799999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":3.4100000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.198}]},{"osd":5,"last update":"Wed Nov 8 12:28:41 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.071},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":1.026},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.036}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":223628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":20.099,"5min":20.099,"15min":20.099},"last":1.2030000000000001},{"interface":"front","average":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":21.238,"5min":21.238,"15min":21.238},"last":0.874}]},{"osd":1,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":8.0630000000000006,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":11.907,"5min":11.907,"15min":11.907},"last":1.3049999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.085},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.127}]},{"osd":4,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.375}]},{"osd":6,"last update":"Wed Nov 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.2410000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:28:40 2023","interfaces":[{"interface":"back","average":{"1min":1.865,"5min":1.865,"15min":1.865},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":8.109,"5min":8.109,"15min":8.109},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.4099999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":512000,"data_stored":224180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.76400000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1890000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.438}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.335}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":1.107},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.1639999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":223628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.87},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92800000000000005}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.208}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.236},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.054}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.8679999999999999,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.369},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.7240000000000002,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":1.206,"5min":1.206,"15min":1.206},"max":{"1min":2.8599999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.2609999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9848,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361992,"statfs":{"total":96636764160,"available":96626679808,"internally_reserved":0,"allocated":1097728,"data_stored":813960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":6.54,"5min":6.54,"15min":6.54},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":6.6760000000000002,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":1.2290000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.173},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":1.444}]},{"osd":3,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":6.5579999999999998,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.4850000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":1.369},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.395}]},{"osd":5,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.347},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.6040000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"min":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":1.095,"5min":1.095,"15min":1.095},"max":{"1min":3.2269999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.591}]},{"osd":7,"last update":"Wed Nov 8 12:28:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.0509999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8640,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363200,"statfs":{"total":96636764160,"available":96627916800,"internally_reserved":0,"allocated":516096,"data_stored":225128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.94599999999999995}]},{"osd":1,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.006},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1080000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.85799999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.429}]},{"osd":5,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.085,"5min":1.085,"15min":1.085},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.327},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":1.389}]},{"osd":6,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":1.111,"5min":1.111,"15min":1.111},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.159}]},{"osd":7,"last update":"Wed Nov 8 12:28:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.488},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:29:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T12:29:31.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-08T12:29:31.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.583+0000 7f1af28bc700 1 Processor -- start 2023-11-08T12:29:31.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.583+0000 7f1af28bc700 1 -- start start 2023-11-08T12:29:31.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af28bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1aec15c280 0x7f1aec06a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af28bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 0x7f1aec0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af28bc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0d0b80 con 0x7f1aec06abb0 2023-11-08T12:29:31.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af28bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0d2960 con 0x7f1aec15c280 2023-11-08T12:29:31.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af28bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0d2680 con 0x7f1aec15c650 2023-11-08T12:29:31.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1aec06abb0 0x7f1aec15ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59036/0 (socket says 172.21.15.112:59036) 2023-11-08T12:29:31.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 -- 172.21.15.112:0/3099863622 learned_addr learned my addr 172.21.15.112:0/3099863622 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:31.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af10b9700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 0x7f1aec0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af18ba700 1 --2- 172.21.15.112:0/3099863622 >> v2:172.21.15.133:3300/0 conn(0x7f1aec15c280 0x7f1aec06a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774195666 0 0) 0x7f1aec0d0b80 con 0x7f1aec06abb0 2023-11-08T12:29:31.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad80035d0 con 0x7f1aec06abb0 2023-11-08T12:29:31.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456638028 0 0) 0x7f1ad80035d0 con 0x7f1aec06abb0 2023-11-08T12:29:31.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 msgr2=0x7f1aec0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:31.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 0x7f1aec0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 >> v2:172.21.15.133:3300/0 conn(0x7f1aec15c280 msgr2=0x7f1aec06a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:31.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 --2- 172.21.15.112:0/3099863622 >> v2:172.21.15.133:3300/0 conn(0x7f1aec15c280 0x7f1aec06a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0d0810 con 0x7f1aec06abb0 2023-11-08T12:29:31.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f1ae40019f0 con 0x7f1aec06abb0 2023-11-08T12:29:31.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 >> v1:172.21.15.112:6789/0 conn(0x7f1aec06abb0 legacy=0x7f1aec15ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad8003a20 0x7f1ad8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 0x7f1ad8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad8004db0 0x7f1ad8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0d2960 con 0x7f1ad8003a20 2023-11-08T12:29:31.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0d2680 con 0x7f1ad8004db0 2023-11-08T12:29:31.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad800ba30 con 0x7f1aec15c650 2023-11-08T12:29:31.596 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af18ba700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad8003a20 0x7f1ad8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad8004db0 0x7f1ad8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.597 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af10b9700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 0x7f1ad8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 -- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 msgr2=0x7f1ad8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:31.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aec15c650 0x7f1ad8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 -- 172.21.15.112:0/3099863622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad8003a20 msgr2=0x7f1ad8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:31.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad8003a20 0x7f1ad8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af20bb700 1 -- 172.21.15.112:0/3099863622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80035d0 con 0x7f1ad8004db0 2023-11-08T12:29:31.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.587+0000 7f1af18ba700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad8003a20 0x7f1ad8003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:31.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af20bb700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad8004db0 0x7f1ad8005220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1aec06afb0 tx=0x7f1ad80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a320adade054b12b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:31.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40072d0 con 0x7f1ad8004db0 2023-11-08T12:29:31.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae4007450 con 0x7f1ad8004db0 2023-11-08T12:29:31.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af08b8700 1 -- 172.21.15.112:0/3099863622 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4007800 con 0x7f1ad8004db0 2023-11-08T12:29:31.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af28bc700 1 -- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad8004db0 msgr2=0x7f1ad8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af28bc700 1 --2- 172.21.15.112:0/3099863622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad8004db0 0x7f1ad8005220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1aec06afb0 tx=0x7f1ad80058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af20bb700 1 -- 172.21.15.112:0/3099863622 reap_dead start 2023-11-08T12:29:31.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af28bc700 1 -- 172.21.15.112:0/3099863622 shutdown_connections 2023-11-08T12:29:31.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af28bc700 1 -- 172.21.15.112:0/3099863622 >> 172.21.15.112:0/3099863622 conn(0x7f1aec0b53e0 msgr2=0x7f1aec06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:31.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af28bc700 1 -- 172.21.15.112:0/3099863622 shutdown_connections 2023-11-08T12:29:31.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.591+0000 7f1af28bc700 1 -- 172.21.15.112:0/3099863622 wait complete. 2023-11-08T12:29:31.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 Processor -- start 2023-11-08T12:29:31.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 -- start start 2023-11-08T12:29:31.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad8004db0 0x7f1aec15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aec0b8750 0x7f1aec1f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aec0b6810 0x7f1aec0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0b63f0 con 0x7f1aec0b8750 2023-11-08T12:29:31.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1f62d0 con 0x7f1aec0b6810 2023-11-08T12:29:31.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.595+0000 7f1af28bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec1f5d10 con 0x7f1ad8004db0 2023-11-08T12:29:31.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aec0b8750 0x7f1aec1f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aec0b8750 0x7f1aec1f53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47340/0 (socket says 172.21.15.112:47340) 2023-11-08T12:29:31.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 -- 172.21.15.112:0/2900739419 learned_addr learned my addr 172.21.15.112:0/2900739419 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:31.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af18ba700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad8004db0 0x7f1aec15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af20bb700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aec0b6810 0x7f1aec0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 -- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad8004db0 msgr2=0x7f1aec15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad8004db0 0x7f1aec15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 -- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aec0b6810 msgr2=0x7f1aec0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aec0b6810 0x7f1aec0b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 -- 172.21.15.112:0/2900739419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0d2450 con 0x7f1aec0b8750 2023-11-08T12:29:31.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af10b9700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aec0b8750 0x7f1aec1f53c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1adc011a00 tx=0x7f1adc011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:31.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1ae27fc700 1 -- 172.21.15.112:0/2900739419 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc011ea0 con 0x7f1aec0b8750 2023-11-08T12:29:31.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1ae27fc700 1 -- 172.21.15.112:0/2900739419 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc004240 con 0x7f1aec0b8750 2023-11-08T12:29:31.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec0d22c0 con 0x7f1aec0b8750 2023-11-08T12:29:31.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1ae27fc700 1 -- 172.21.15.112:0/2900739419 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0045d0 con 0x7f1aec0b8750 2023-11-08T12:29:31.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec0b20a0 con 0x7f1aec0b8750 2023-11-08T12:29:31.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.599+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec073cb0 con 0x7f1aec0b8750 2023-11-08T12:29:31.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.603+0000 7f1ae27fc700 1 -- 172.21.15.112:0/2900739419 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1adc025070 con 0x7f1aec0b8750 2023-11-08T12:29:31.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.603+0000 7f1ae27fc700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1ad0064f10 0x7f1ad00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:31.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.603+0000 7f1ae27fc700 1 -- 172.21.15.112:0/2900739419 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1adc082350 con 0x7f1aec0b8750 2023-11-08T12:29:31.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.603+0000 7f1af18ba700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1ad0064f10 0x7f1ad00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:31.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.607+0000 7f1af18ba700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1ad0064f10 0x7f1ad00673c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1aec160790 tx=0x7f1ae8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:31.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.611+0000 7f1ae27fc700 1 -- 172.21.15.112:0/2900739419 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1adc050350 con 0x7f1aec0b8750 2023-11-08T12:29:31.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.847+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f1aec15bdf0 con 0x7f1aec0b8750 2023-11-08T12:29:31.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.859+0000 7f1ae27fc700 1 -- 172.21.15.112:0/2900739419 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1adc053970 con 0x7f1aec0b8750 2023-11-08T12:29:31.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.859+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1ad0064f10 msgr2=0x7f1ad00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.859+0000 7f1af28bc700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1ad0064f10 0x7f1ad00673c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1aec160790 tx=0x7f1ae8009240 comp rx=0 tx=0).stop 2023-11-08T12:29:31.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.859+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aec0b8750 msgr2=0x7f1aec1f53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:31.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.859+0000 7f1af28bc700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aec0b8750 0x7f1aec1f53c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1adc011a00 tx=0x7f1adc011d10 comp rx=0 tx=0).stop 2023-11-08T12:29:31.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 shutdown_connections 2023-11-08T12:29:31.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1ad0064f10 0x7f1ad00673c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aec0b6810 0x7f1aec0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1aec0b8750 0x7f1aec1f53c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 --2- 172.21.15.112:0/2900739419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ad8004db0 0x7f1aec15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:31.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 >> 172.21.15.112:0/2900739419 conn(0x7f1aec0b53e0 msgr2=0x7f1aec0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:31.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 shutdown_connections 2023-11-08T12:29:31.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:31.863+0000 7f1af28bc700 1 -- 172.21.15.112:0/2900739419 wait complete. 2023-11-08T12:29:31.869 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2023-11-08T12:29:31.890 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:32.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.075+0000 7ff83686f700 1 Processor -- start 2023-11-08T12:29:32.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.075+0000 7ff83686f700 1 -- start start 2023-11-08T12:29:32.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83686f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff830160710 0x7ff8300cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83686f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8300cc860 0x7ff830070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83686f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff830069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83686f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff830070a60 con 0x7ff830160710 2023-11-08T12:29:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83686f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83006b1c0 con 0x7ff8300cc860 2023-11-08T12:29:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83686f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300ad6c0 con 0x7ff8300705c0 2023-11-08T12:29:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83586d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff830160710 0x7ff8300cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83586d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff830160710 0x7ff8300cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47352/0 (socket says 172.21.15.112:47352) 2023-11-08T12:29:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83586d700 1 -- 172.21.15.112:0/2090827548 learned_addr learned my addr 172.21.15.112:0/2090827548 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83606e700 1 --2- 172.21.15.112:0/2090827548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff830069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83506c700 1 --2- 172.21.15.112:0/2090827548 >> v2:172.21.15.133:3300/0 conn(0x7ff8300cc860 0x7ff830070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83606e700 1 -- 172.21.15.112:0/2090827548 >> v2:172.21.15.133:3300/0 conn(0x7ff8300cc860 msgr2=0x7ff830070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83606e700 1 --2- 172.21.15.112:0/2090827548 >> v2:172.21.15.133:3300/0 conn(0x7ff8300cc860 0x7ff830070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83606e700 1 -- 172.21.15.112:0/2090827548 >> v2:172.21.15.112:3300/0 conn(0x7ff830160710 msgr2=0x7ff8300cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83606e700 1 --2- 172.21.15.112:0/2090827548 >> v2:172.21.15.112:3300/0 conn(0x7ff830160710 0x7ff8300cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83606e700 1 -- 172.21.15.112:0/2090827548 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300adc60 con 0x7ff8300705c0 2023-11-08T12:29:32.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83586d700 1 --2- 172.21.15.112:0/2090827548 >> v2:172.21.15.112:3300/0 conn(0x7ff830160710 0x7ff8300cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:32.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83606e700 1 --2- 172.21.15.112:0/2090827548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff830069bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8301641b0 tx=0x7ff82800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb47abdd4fadda6a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83486b700 1 -- 172.21.15.112:0/2090827548 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800e070 con 0x7ff8300705c0 2023-11-08T12:29:32.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83486b700 1 -- 172.21.15.112:0/2090827548 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800bb20 con 0x7ff8300705c0 2023-11-08T12:29:32.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.079+0000 7ff83486b700 1 -- 172.21.15.112:0/2090827548 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828012430 con 0x7ff8300705c0 2023-11-08T12:29:32.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 -- 172.21.15.112:0/2090827548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 msgr2=0x7ff830069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 --2- 172.21.15.112:0/2090827548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff830069bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8301641b0 tx=0x7ff82800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:32.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 -- 172.21.15.112:0/2090827548 shutdown_connections 2023-11-08T12:29:32.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 --2- 172.21.15.112:0/2090827548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff830069bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 --2- 172.21.15.112:0/2090827548 >> v2:172.21.15.133:3300/0 conn(0x7ff8300cc860 0x7ff830070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 --2- 172.21.15.112:0/2090827548 >> v2:172.21.15.112:3300/0 conn(0x7ff830160710 0x7ff8300cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 -- 172.21.15.112:0/2090827548 >> 172.21.15.112:0/2090827548 conn(0x7ff8300b0f80 msgr2=0x7ff8300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:32.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 -- 172.21.15.112:0/2090827548 shutdown_connections 2023-11-08T12:29:32.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 -- 172.21.15.112:0/2090827548 wait complete. 2023-11-08T12:29:32.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.083+0000 7ff83686f700 1 Processor -- start 2023-11-08T12:29:32.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83686f700 1 -- start start 2023-11-08T12:29:32.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83686f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff8300c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83686f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300cc860 0x7ff8301f9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83686f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff830160710 0x7ff830069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83686f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8301fa170 con 0x7ff830160710 2023-11-08T12:29:32.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83686f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8301f9bb0 con 0x7ff8300cc860 2023-11-08T12:29:32.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83686f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8301f9e90 con 0x7ff8300705c0 2023-11-08T12:29:32.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff830160710 0x7ff830069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff830160710 0x7ff830069dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47368/0 (socket says 172.21.15.112:47368) 2023-11-08T12:29:32.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 -- 172.21.15.112:0/3756234001 learned_addr learned my addr 172.21.15.112:0/3756234001 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:32.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83586d700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff8300c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83506c700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300cc860 0x7ff8301f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 -- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 msgr2=0x7ff8300c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff8300c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 -- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300cc860 msgr2=0x7ff8301f9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300cc860 0x7ff8301f9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 -- 172.21.15.112:0/3756234001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009570 con 0x7ff830160710 2023-11-08T12:29:32.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.087+0000 7ff83606e700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff830160710 0x7ff830069dd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff828014040 tx=0x7ff828004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.091+0000 7ff8267fc700 1 -- 172.21.15.112:0/3756234001 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828004800 con 0x7ff830160710 2023-11-08T12:29:32.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.091+0000 7ff8267fc700 1 -- 172.21.15.112:0/3756234001 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828020070 con 0x7ff830160710 2023-11-08T12:29:32.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.091+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff828009a70 con 0x7ff830160710 2023-11-08T12:29:32.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.091+0000 7ff8267fc700 1 -- 172.21.15.112:0/3756234001 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280276c0 con 0x7ff830160710 2023-11-08T12:29:32.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.091+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83006b6b0 con 0x7ff830160710 2023-11-08T12:29:32.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.091+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83006b3d0 con 0x7ff830160710 2023-11-08T12:29:32.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.091+0000 7ff8267fc700 1 -- 172.21.15.112:0/3756234001 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff828012430 con 0x7ff830160710 2023-11-08T12:29:32.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.095+0000 7ff8267fc700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff814064ee0 0x7ff814067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.095+0000 7ff8267fc700 1 -- 172.21.15.112:0/3756234001 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff828022070 con 0x7ff830160710 2023-11-08T12:29:32.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.095+0000 7ff83586d700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff814064ee0 0x7ff814067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.095+0000 7ff83586d700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff814064ee0 0x7ff814067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff82c006d50 tx=0x7ff82c0092e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.099+0000 7ff8267fc700 1 -- 172.21.15.112:0/3756234001 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff828052010 con 0x7ff830160710 2023-11-08T12:29:32.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.307+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8300ad8f0 con 0x7ff830160710 2023-11-08T12:29:32.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff8267fc700 1 -- 172.21.15.112:0/3756234001 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7ff828055630 con 0x7ff830160710 2023-11-08T12:29:32.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:32.315 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:32.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff814064ee0 msgr2=0x7ff814067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff814064ee0 0x7ff814067390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff82c006d50 tx=0x7ff82c0092e0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff830160710 msgr2=0x7ff830069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff830160710 0x7ff830069dd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff828014040 tx=0x7ff828004af0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 shutdown_connections 2023-11-08T12:29:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff814064ee0 0x7ff814067390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff830160710 0x7ff830069dd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300cc860 0x7ff8301f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 --2- 172.21.15.112:0/3756234001 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8300705c0 0x7ff8300c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 >> 172.21.15.112:0/3756234001 conn(0x7ff8300b0f80 msgr2=0x7ff8300aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 shutdown_connections 2023-11-08T12:29:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.311+0000 7ff83686f700 1 -- 172.21.15.112:0/3756234001 wait complete. 2023-11-08T12:29:32.320 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:32.740 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T12:29:21.771466+0000', 'modified': '2023-11-08T12:29:24.784806+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5346}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5346': {'gid': 5346, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.112:6837/2051824845', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 2051824845}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 2051824845}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T12:29:32.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T12:29:32.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-08T12:29:32.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.935+0000 7f82b58d8700 1 Processor -- start 2023-11-08T12:29:32.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.939+0000 7f82b58d8700 1 -- start start 2023-11-08T12:29:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.939+0000 7f82b58d8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f82b015c210 0x7f82b0160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.939+0000 7f82b58d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.939+0000 7f82b58d8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82b00b1850 0x7f82b0071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.939+0000 7f82b58d8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00cf640 con 0x7f82b015c210 2023-11-08T12:29:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.939+0000 7f82b58d8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00b1cd0 con 0x7f82b00b1850 2023-11-08T12:29:32.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.939+0000 7f82b58d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b0160d40 con 0x7f82b00c9ee0 2023-11-08T12:29:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f82b015c210 0x7f82b0160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f82b015c210 0x7f82b0160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47384/0 (socket says 172.21.15.112:47384) 2023-11-08T12:29:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 -- 172.21.15.112:0/2902477665 learned_addr learned my addr 172.21.15.112:0/2902477665 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/2902477665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82af7fe700 1 --2- 172.21.15.112:0/2902477665 >> v2:172.21.15.133:3300/0 conn(0x7f82b00b1850 0x7f82b0071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 -- 172.21.15.112:0/2902477665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 msgr2=0x7f82b00b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 --2- 172.21.15.112:0/2902477665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 -- 172.21.15.112:0/2902477665 >> v2:172.21.15.133:3300/0 conn(0x7f82b00b1850 msgr2=0x7f82b0071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 --2- 172.21.15.112:0/2902477665 >> v2:172.21.15.133:3300/0 conn(0x7f82b00b1850 0x7f82b0071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 -- 172.21.15.112:0/2902477665 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00ca3e0 con 0x7f82b015c210 2023-11-08T12:29:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82af7fe700 1 --2- 172.21.15.112:0/2902477665 >> v2:172.21.15.133:3300/0 conn(0x7f82b00b1850 0x7f82b0071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/2902477665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:32.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82aeffd700 1 --2- 172.21.15.112:0/2902477665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b015c210 0x7f82b0160800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f82b00aef70 tx=0x7f82a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82e5bc976616edc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82adffb700 1 -- 172.21.15.112:0/2902477665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000b8a0 con 0x7f82b015c210 2023-11-08T12:29:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82adffb700 1 -- 172.21.15.112:0/2902477665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a000ba00 con 0x7f82b015c210 2023-11-08T12:29:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82adffb700 1 -- 172.21.15.112:0/2902477665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000bd90 con 0x7f82b015c210 2023-11-08T12:29:32.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 -- 172.21.15.112:0/2902477665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b015c210 msgr2=0x7f82b0160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 --2- 172.21.15.112:0/2902477665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b015c210 0x7f82b0160800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f82b00aef70 tx=0x7f82a0009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 -- 172.21.15.112:0/2902477665 shutdown_connections 2023-11-08T12:29:32.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 --2- 172.21.15.112:0/2902477665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 --2- 172.21.15.112:0/2902477665 >> v2:172.21.15.133:3300/0 conn(0x7f82b00b1850 0x7f82b0071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 --2- 172.21.15.112:0/2902477665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b015c210 0x7f82b0160800 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 -- 172.21.15.112:0/2902477665 >> 172.21.15.112:0/2902477665 conn(0x7f82b006ecf0 msgr2=0x7f82b00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 -- 172.21.15.112:0/2902477665 shutdown_connections 2023-11-08T12:29:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.943+0000 7f82b58d8700 1 -- 172.21.15.112:0/2902477665 wait complete. 2023-11-08T12:29:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.947+0000 7f82b58d8700 1 Processor -- start 2023-11-08T12:29:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82b58d8700 1 -- start start 2023-11-08T12:29:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82b58d8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00b1850 0x7f82b0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82b58d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82b58d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b015c210 0x7f82b00b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82b58d8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00c7a50 con 0x7f82b00b1850 2023-11-08T12:29:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82b58d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00b27f0 con 0x7f82b015c210 2023-11-08T12:29:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82b58d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00b2ad0 con 0x7f82b00c9ee0 2023-11-08T12:29:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00b1850 0x7f82b0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00b1850 0x7f82b0155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47392/0 (socket says 172.21.15.112:47392) 2023-11-08T12:29:32.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 -- 172.21.15.112:0/4207772489 learned_addr learned my addr 172.21.15.112:0/4207772489 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:32.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82af7fe700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b015c210 0x7f82b00b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 -- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 msgr2=0x7f82b00ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 -- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b015c210 msgr2=0x7f82b00b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b015c210 0x7f82b00b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 -- 172.21.15.112:0/4207772489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a0009570 con 0x7f82b00b1850 2023-11-08T12:29:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82af7fe700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b015c210 0x7f82b00b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.951+0000 7f82aeffd700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00b1850 0x7f82b0155e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f82a0000c00 tx=0x7f82a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.955+0000 7f8297fff700 1 -- 172.21.15.112:0/4207772489 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00038c0 con 0x7f82b00b1850 2023-11-08T12:29:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.955+0000 7f8297fff700 1 -- 172.21.15.112:0/4207772489 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a001e070 con 0x7f82b00b1850 2023-11-08T12:29:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.955+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b00ca9a0 con 0x7f82b00b1850 2023-11-08T12:29:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.955+0000 7f8297fff700 1 -- 172.21.15.112:0/4207772489 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0003c80 con 0x7f82b00b1850 2023-11-08T12:29:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.955+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b00ca6c0 con 0x7f82b00b1850 2023-11-08T12:29:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.955+0000 7f8297fff700 1 -- 172.21.15.112:0/4207772489 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f82a000f050 con 0x7f82b00b1850 2023-11-08T12:29:32.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.959+0000 7f8297fff700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f829c064f10 0x7f829c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.959+0000 7f8297fff700 1 -- 172.21.15.112:0/4207772489 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f82a0020070 con 0x7f82b00b1850 2023-11-08T12:29:32.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.959+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f829c064f10 0x7f829c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.959+0000 7f82b8b63740 1 Processor -- start 2023-11-08T12:29:32.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.959+0000 7f82b8b63740 1 -- start start 2023-11-08T12:29:32.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.959+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f829c064f10 0x7f829c0673c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82b01571b0 tx=0x7f82a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x206ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbe710 0x206f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x206f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2dae0 con 0x1dbeae0 2023-11-08T12:29:32.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f9dbd0 con 0x1e09790 2023-11-08T12:29:32.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f96ed0 con 0x1dbe710 2023-11-08T12:29:32.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x206ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x206ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47396/0 (socket says 172.21.15.112:47396) 2023-11-08T12:29:32.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 -- 172.21.15.112:0/2425779631 learned_addr learned my addr 172.21.15.112:0/2425779631 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:32.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbe710 0x206f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82af7fe700 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x206f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 -- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbe710 msgr2=0x206f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbe710 0x206f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 -- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 msgr2=0x206f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x206f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 -- 172.21.15.112:0/2425779631 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fbccc0 con 0x1dbeae0 2023-11-08T12:29:32.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82af7fe700 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x206f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:32.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbe710 0x206f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:32.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82aeffd700 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x206ee00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f82a000b100 tx=0x7f82a002d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d3c8ada6eb7dd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82957fa700 1 -- 172.21.15.112:0/2425779631 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0053880 con 0x1dbeae0 2023-11-08T12:29:32.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82957fa700 1 -- 172.21.15.112:0/2425779631 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0059030 con 0x1dbeae0 2023-11-08T12:29:32.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82957fa700 1 -- 172.21.15.112:0/2425779631 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00549d0 con 0x1dbeae0 2023-11-08T12:29:32.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- 172.21.15.112:0/2425779631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 msgr2=0x206ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x206ee00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f82a000b100 tx=0x7f82a002d350 comp rx=0 tx=0).stop 2023-11-08T12:29:32.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- 172.21.15.112:0/2425779631 shutdown_connections 2023-11-08T12:29:32.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x206f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbe710 0x206f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 --2- 172.21.15.112:0/2425779631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x206ee00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- 172.21.15.112:0/2425779631 >> 172.21.15.112:0/2425779631 conn(0x1dbeeb0 msgr2=0x2057700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:32.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- 172.21.15.112:0/2425779631 shutdown_connections 2023-11-08T12:29:32.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.963+0000 7f82b8b63740 1 -- 172.21.15.112:0/2425779631 wait complete. 2023-11-08T12:29:32.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 -- start start 2023-11-08T12:29:32.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 Processor -- start 2023-11-08T12:29:32.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbe710 0x207b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x206c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x20495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e43b20 con 0x1dbe710 2023-11-08T12:29:32.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x206c870 con 0x1e09790 2023-11-08T12:29:32.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x207bb20 con 0x1dbeae0 2023-11-08T12:29:32.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82b8b63740 10 client.0 _ll_register_callbacks cb 0x1ff30d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:29:32.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbe710 0x207b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbe710 0x207b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47400/0 (socket says 172.21.15.112:47400) 2023-11-08T12:29:32.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 -- 172.21.15.112:0/739261096 learned_addr learned my addr 172.21.15.112:0/739261096 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:32.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82af7fe700 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x20495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x206c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 -- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 msgr2=0x206c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x206c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 -- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 msgr2=0x20495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:32.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x20495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 -- 172.21.15.112:0/739261096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b00ca6c0 con 0x1dbe710 2023-11-08T12:29:32.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f82aeffd700 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbe710 0x207b530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82a0055190 tx=0x7f82a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d2b9f73815cf52 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:32.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.967+0000 7f828e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:29:32.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 1 -- 172.21.15.112:0/739261096 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0053940 con 0x1dbe710 2023-11-08T12:29:32.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 1 -- 172.21.15.112:0/739261096 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f82a0061030 con 0x1dbe710 2023-11-08T12:29:32.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f8ff50 con 0x1dbe710 2023-11-08T12:29:32.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 1 -- 172.21.15.112:0/739261096 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a005d5f0 con 0x1dbe710 2023-11-08T12:29:32.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 10 client.5550 fetch_fsmap learned FSMap version 16 2023-11-08T12:29:32.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x1e0a9e0 con 0x1dbe710 2023-11-08T12:29:32.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 1 -- 172.21.15.112:0/739261096 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f8ff50 con 0x1dbe710 2023-11-08T12:29:32.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 1 -- 172.21.15.112:0/739261096 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f82a005d0e0 con 0x1dbe710 2023-11-08T12:29:32.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 10 client.5550 fetch_fsmap finished waiting for FSMap version 16 2023-11-08T12:29:32.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 10 client.5550 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T12:29:32.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 20 client.5550 populate_metadata read hostname 'smithi112' 2023-11-08T12:29:32.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x207cf30 0x2047d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 4 client.5550 mds_command: new command op to 5346 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:29:32.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 --> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f8fc70 con 0x207cf30 2023-11-08T12:29:32.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x207cf30 0x2047d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:32.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 10 client.5550 ms_handle_connect on v2:172.21.15.112:6836/2051824845 2023-11-08T12:29:32.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x207cf30 0x2047d40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=830c884bcb605a4a server_cookie=79191e5bdbcd9f0e in_seq=0 out_seq=0 2023-11-08T12:29:32.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 1 -- 172.21.15.112:0/739261096 <== mds.0 v2:172.21.15.112:6836/2051824845 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1f8fc70 con 0x207cf30 2023-11-08T12:29:32.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 10 client.5550 handle_command_reply: tid=0 2023-11-08T12:29:32.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 client.5550 shutdown 2023-11-08T12:29:32.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbe710 msgr2=0x207b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:32.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbe710 0x207b530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82a0055190 tx=0x7f82a0015000 comp rx=0 tx=0).stop 2023-11-08T12:29:32.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 shutdown_connections 2023-11-08T12:29:32.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x207cf30 0x2047d40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e09790 0x20495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x206c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 --2- 172.21.15.112:0/739261096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbe710 0x207b530 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:32.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f828e7fc700 0 client.5550 ms_handle_reset on v2:172.21.15.112:6836/2051824845 2023-11-08T12:29:32.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.971+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 >> 172.21.15.112:0/739261096 conn(0x1dbeeb0 msgr2=0x2057540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:32.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.975+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 shutdown_connections 2023-11-08T12:29:32.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.975+0000 7f82b8b63740 1 -- 172.21.15.112:0/739261096 wait complete. 2023-11-08T12:29:32.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.975+0000 7f82b8b63740 20 client.5550 trim_cache size 0 max 16384 2023-11-08T12:29:32.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.991+0000 7f82b8b63740 1 Processor -- start 2023-11-08T12:29:32.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82b8b63740 1 -- start start 2023-11-08T12:29:32.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x2057a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x2055d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e09790 0x20562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:32.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82b8b63740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f9dbd0 con 0x1dbeae0 2023-11-08T12:29:32.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2dae0 con 0x1dbe710 2023-11-08T12:29:33.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f6cde0 con 0x1e09790 2023-11-08T12:29:33.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82ae7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x2055d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x2057a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x2057a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:52348/0 (socket says 172.21.15.112:52348) 2023-11-08T12:29:33.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82aeffd700 1 -- 172.21.15.112:0/1731868694 learned_addr learned my addr 172.21.15.112:0/1731868694 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:33.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82af7fe700 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e09790 0x20562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82ae7fc700 1 -- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e09790 msgr2=0x20562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:33.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e09790 0x20562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82ae7fc700 1 -- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 msgr2=0x2057a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:33.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x2057a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82ae7fc700 1 -- 172.21.15.112:0/1731868694 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00b3350 con 0x1dbeae0 2023-11-08T12:29:33.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82aeffd700 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x2057a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:33.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x2055d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82b00c80f0 tx=0x7f82a4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806986199e221f22 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:33.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f8295ffb700 1 -- 172.21.15.112:0/1731868694 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4014590 con 0x1dbeae0 2023-11-08T12:29:33.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.995+0000 7f8295ffb700 1 -- 172.21.15.112:0/1731868694 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a401c040 con 0x1dbeae0 2023-11-08T12:29:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f8295ffb700 1 -- 172.21.15.112:0/1731868694 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4027150 con 0x1dbeae0 2023-11-08T12:29:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 -- 172.21.15.112:0/1731868694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 msgr2=0x2055d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x2055d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82b00c80f0 tx=0x7f82a4015000 comp rx=0 tx=0).stop 2023-11-08T12:29:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 -- 172.21.15.112:0/1731868694 shutdown_connections 2023-11-08T12:29:33.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e09790 0x20562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dbeae0 0x2055d80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 --2- 172.21.15.112:0/1731868694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x2057a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 -- 172.21.15.112:0/1731868694 >> 172.21.15.112:0/1731868694 conn(0x1dbeeb0 msgr2=0x2057370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:33.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 -- 172.21.15.112:0/1731868694 shutdown_connections 2023-11-08T12:29:33.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 -- 172.21.15.112:0/1731868694 wait complete. 2023-11-08T12:29:33.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 -- start start 2023-11-08T12:29:33.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 Processor -- start 2023-11-08T12:29:33.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x20708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x20d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:32.999+0000 7f82b8b63740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1e09790 0x20d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f942d0 con 0x1e09790 2023-11-08T12:29:33.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f946e0 con 0x1dbe710 2023-11-08T12:29:33.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x2087d10 con 0x1dbeae0 2023-11-08T12:29:33.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 10 client.0 _ll_register_callbacks cb 0x1f432d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:29:33.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82af7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1e09790 0x20d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x20708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x20708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:52350/0 (socket says 172.21.15.112:52350) 2023-11-08T12:29:33.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 -- 172.21.15.112:0/467513342 learned_addr learned my addr 172.21.15.112:0/467513342 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:33.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x20d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 -- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 msgr2=0x20d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:33.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x20d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 -- 172.21.15.112:0/467513342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1e09790 msgr2=0x20d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:33.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1e09790 0x20d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 -- 172.21.15.112:0/467513342 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1e0a9e0 con 0x1dbe710 2023-11-08T12:29:33.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82aeffd700 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x20708a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82a0053830 tx=0x7f82a0051950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeaec8bcef417e01 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:33.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f828e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-11-08T12:29:33.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f828e7fc700 1 -- 172.21.15.112:0/467513342 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0081c40 con 0x1dbe710 2023-11-08T12:29:33.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f828e7fc700 1 -- 172.21.15.112:0/467513342 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f82a0061070 con 0x1dbe710 2023-11-08T12:29:33.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82a0059030 con 0x1dbe710 2023-11-08T12:29:33.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f828e7fc700 1 -- 172.21.15.112:0/467513342 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a0053940 con 0x1dbe710 2023-11-08T12:29:33.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 10 client.5434 fetch_fsmap learned FSMap version 16 2023-11-08T12:29:33.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f82a400e040 con 0x1dbe710 2023-11-08T12:29:33.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f828e7fc700 1 -- 172.21.15.112:0/467513342 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0059030 con 0x1dbe710 2023-11-08T12:29:33.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f828e7fc700 1 -- 172.21.15.112:0/467513342 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f82a0051320 con 0x1dbe710 2023-11-08T12:29:33.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 10 client.5434 fetch_fsmap finished waiting for FSMap version 16 2023-11-08T12:29:33.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 10 client.5434 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-08T12:29:33.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 20 client.5434 populate_metadata read hostname 'smithi112' 2023-11-08T12:29:33.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x20870b0 0x2087480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 4 client.5434 mds_command: new command op to 5346 tid=0[{"prefix": "status"}] 2023-11-08T12:29:33.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 --> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1e3b260 con 0x20870b0 2023-11-08T12:29:33.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.003+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x20870b0 0x2087480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82ae7fc700 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x20870b0 0x2087480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b716e6c7a4bceaa server_cookie=7c058522acbc74e in_seq=0 out_seq=0 2023-11-08T12:29:33.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f828e7fc700 10 client.5434 ms_handle_connect on v2:172.21.15.112:6836/2051824845 2023-11-08T12:29:33.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f828e7fc700 1 -- 172.21.15.112:0/467513342 <== mds.0 v2:172.21.15.112:6836/2051824845 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x1e3b260 con 0x20870b0 2023-11-08T12:29:33.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f828e7fc700 10 client.5434 handle_command_reply: tid=0 2023-11-08T12:29:33.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 client.5434 shutdown 2023-11-08T12:29:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 msgr2=0x20708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x20708a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82a0053830 tx=0x7f82a0051950 comp rx=0 tx=0).stop 2023-11-08T12:29:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 shutdown_connections 2023-11-08T12:29:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.112:6836/2051824845,v1:172.21.15.112:6837/2051824845] conn(0x20870b0 0x2087480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1e09790 0x20d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dbeae0 0x20d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 --2- 172.21.15.112:0/467513342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dbe710 0x20708a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f828e7fc700 0 client.5434 ms_handle_reset on v2:172.21.15.112:6836/2051824845 2023-11-08T12:29:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 >> 172.21.15.112:0/467513342 conn(0x1dbeeb0 msgr2=0x2048440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 shutdown_connections 2023-11-08T12:29:33.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 1 -- 172.21.15.112:0/467513342 wait complete. 2023-11-08T12:29:33.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b8b63740 20 client.5434 trim_cache size 0 max 16384 2023-11-08T12:29:33.022 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:29:33.022 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "c14663df-4425-4498-9232-3ffa5f578bfa", 2023-11-08T12:29:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-11-08T12:29:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5346, 2023-11-08T12:29:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-11-08T12:29:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-11-08T12:29:33.023 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-11-08T12:29:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 11.233416168, 2023-11-08T12:29:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 16, 2023-11-08T12:29:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 44, 2023-11-08T12:29:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 44, 2023-11-08T12:29:33.024 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 19.524698982 2023-11-08T12:29:33.024 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:29:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f829c064f10 msgr2=0x7f829c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f829c064f10 0x7f829c0673c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82b01571b0 tx=0x7f82a4008040 comp rx=0 tx=0).stop 2023-11-08T12:29:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00b1850 msgr2=0x7f82b0155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00b1850 0x7f82b0155e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f82a0000c00 tx=0x7f82a0004770 comp rx=0 tx=0).stop 2023-11-08T12:29:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 shutdown_connections 2023-11-08T12:29:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f829c064f10 0x7f829c0673c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b015c210 0x7f82b00b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82b00c9ee0 0x7f82b00ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 --2- 172.21.15.112:0/4207772489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00b1850 0x7f82b0155e00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 >> 172.21.15.112:0/4207772489 conn(0x7f82b006ecf0 msgr2=0x7f82b0156830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 shutdown_connections 2023-11-08T12:29:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.007+0000 7f82b58d8700 1 -- 172.21.15.112:0/4207772489 wait complete. 2023-11-08T12:29:33.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:29:33.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.219+0000 7fa22ea61700 1 Processor -- start 2023-11-08T12:29:33.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22ea61700 1 -- start start 2023-11-08T12:29:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22ea61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228160710 0x7fa2280cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22ea61700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa228070790 0x7fa228164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22ea61700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280ad6c0 con 0x7fa2280cc860 2023-11-08T12:29:33.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22ea61700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22806b1c0 con 0x7fa228070790 2023-11-08T12:29:33.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22ea61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280adc60 con 0x7fa228160710 2023-11-08T12:29:33.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22e260700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa228070790 0x7fa228164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22d25e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa2280cc860 0x7fa228070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:55128/0 (socket says 172.21.15.112:55128) 2023-11-08T12:29:33.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22d25e700 1 -- 172.21.15.112:0/1019769898 learned_addr learned my addr 172.21.15.112:0/1019769898 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:33.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22da5f700 1 --2- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228160710 0x7fa2280cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22e260700 1 -- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228160710 msgr2=0x7fa2280cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:33.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22e260700 1 --2- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228160710 0x7fa2280cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22e260700 1 -- 172.21.15.112:0/1019769898 >> v1:172.21.15.133:6789/0 conn(0x7fa2280cc860 legacy=0x7fa228070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22e260700 1 -- 172.21.15.112:0/1019769898 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22806b3d0 con 0x7fa228070790 2023-11-08T12:29:33.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22e260700 1 --2- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228070790 0x7fa228164250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa220009d90 tx=0x7fa22000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d4c173f67e59d27 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:33.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.223+0000 7fa22ca5d700 1 -- 172.21.15.112:0/1019769898 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000e070 con 0x7fa228070790 2023-11-08T12:29:33.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ca5d700 1 -- 172.21.15.112:0/1019769898 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000bb20 con 0x7fa228070790 2023-11-08T12:29:33.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ca5d700 1 -- 172.21.15.112:0/1019769898 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220012430 con 0x7fa228070790 2023-11-08T12:29:33.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 -- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228070790 msgr2=0x7fa228164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 --2- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228070790 0x7fa228164250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa220009d90 tx=0x7fa22000b330 comp rx=0 tx=0).stop 2023-11-08T12:29:33.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 -- 172.21.15.112:0/1019769898 shutdown_connections 2023-11-08T12:29:33.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 --2- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228070790 0x7fa228164250 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 --2- 172.21.15.112:0/1019769898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228160710 0x7fa2280cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 -- 172.21.15.112:0/1019769898 >> 172.21.15.112:0/1019769898 conn(0x7fa2280b0f80 msgr2=0x7fa2280ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:33.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 -- 172.21.15.112:0/1019769898 shutdown_connections 2023-11-08T12:29:33.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 -- 172.21.15.112:0/1019769898 wait complete. 2023-11-08T12:29:33.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.227+0000 7fa22ea61700 1 Processor -- start 2023-11-08T12:29:33.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 -- start start 2023-11-08T12:29:33.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228070790 0x7fa228159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2280cc860 0x7fa22815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228160710 0x7fa2280c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280c2a00 con 0x7fa2280cc860 2023-11-08T12:29:33.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280c2ce0 con 0x7fa228160710 2023-11-08T12:29:33.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280c2fc0 con 0x7fa228070790 2023-11-08T12:29:33.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2280cc860 0x7fa22815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2280cc860 0x7fa22815d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47434/0 (socket says 172.21.15.112:47434) 2023-11-08T12:29:33.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 -- 172.21.15.112:0/2263123325 learned_addr learned my addr 172.21.15.112:0/2263123325 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:33.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22da5f700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228070790 0x7fa228159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22e260700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228160710 0x7fa2280c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 -- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228070790 msgr2=0x7fa228159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228070790 0x7fa228159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 -- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228160710 msgr2=0x7fa2280c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228160710 0x7fa2280c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 -- 172.21.15.112:0/2263123325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220009a70 con 0x7fa2280cc860 2023-11-08T12:29:33.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22d25e700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2280cc860 0x7fa22815d3d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c700 tx=0x7fa21800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:33.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa21e7fc700 1 -- 172.21.15.112:0/2263123325 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218005d90 con 0x7fa2280cc860 2023-11-08T12:29:33.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa21e7fc700 1 -- 172.21.15.112:0/2263123325 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180070d0 con 0x7fa2280cc860 2023-11-08T12:29:33.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa21e7fc700 1 -- 172.21.15.112:0/2263123325 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218007440 con 0x7fa2280cc860 2023-11-08T12:29:33.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.231+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2280ad8f0 con 0x7fa2280cc860 2023-11-08T12:29:33.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.235+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22806b6b0 con 0x7fa2280cc860 2023-11-08T12:29:33.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.235+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228160ae0 con 0x7fa2280cc860 2023-11-08T12:29:33.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.235+0000 7fa21e7fc700 1 -- 172.21.15.112:0/2263123325 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa218019030 con 0x7fa2280cc860 2023-11-08T12:29:33.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.239+0000 7fa21e7fc700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa20c064ee0 0x7fa20c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:33.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.239+0000 7fa21e7fc700 1 -- 172.21.15.112:0/2263123325 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa218081150 con 0x7fa2280cc860 2023-11-08T12:29:33.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.239+0000 7fa22da5f700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa20c064ee0 0x7fa20c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:33.243 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.239+0000 7fa22da5f700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa20c064ee0 0x7fa20c067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa224009b50 tx=0x7fa224009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:33.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.243+0000 7fa21e7fc700 1 -- 172.21.15.112:0/2263123325 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa21804a400 con 0x7fa2280cc860 2023-11-08T12:29:33.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.459+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa228073cb0 con 0x7fa2280cc860 2023-11-08T12:29:33.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.459+0000 7fa21e7fc700 1 -- 172.21.15.112:0/2263123325 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa218017060 con 0x7fa2280cc860 2023-11-08T12:29:33.464 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T12:29:33.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa20c064ee0 msgr2=0x7fa20c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa20c064ee0 0x7fa20c067390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa224009b50 tx=0x7fa224009240 comp rx=0 tx=0).stop 2023-11-08T12:29:33.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2280cc860 msgr2=0x7fa22815d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:33.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2280cc860 0x7fa22815d3d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c700 tx=0x7fa21800ca10 comp rx=0 tx=0).stop 2023-11-08T12:29:33.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 shutdown_connections 2023-11-08T12:29:33.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa20c064ee0 0x7fa20c067390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa228160710 0x7fa2280c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2280cc860 0x7fa22815d3d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 --2- 172.21.15.112:0/2263123325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa228070790 0x7fa228159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:33.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 >> 172.21.15.112:0/2263123325 conn(0x7fa2280b0f80 msgr2=0x7fa2280c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:33.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 shutdown_connections 2023-11-08T12:29:33.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:33.463+0000 7fa22ea61700 1 -- 172.21.15.112:0/2263123325 wait complete. 2023-11-08T12:29:33.487 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T12:29:33.487 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:29:33.488 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-11-08T12:29:33.488 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T12:29:33.488 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T12:29:33.488 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T12:29:33.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T12:29:33.489 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:29:33.489 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:29:33.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:33.490 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-11-08T12:29:33.509 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:29:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:29:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:29:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:29:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.510 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:29:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:29:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-11-08T12:29:33.511 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:29:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-11-08T12:29:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-11-08T12:29:33.511 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:29:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:29:33.512 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:29:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:29:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:29:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42257sec preferred_lft 42257sec 2023-11-08T12:29:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-11-08T12:29:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.513 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:29:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:61:4e:41:39 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:29:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:29:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.514 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:29:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:b3:c1:35:93:6c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:29:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T12:29:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::e41f:52ff:fe23:f36d/64 scope link 2023-11-08T12:29:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.515 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:29:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2e:62:07:0d:fa:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T12:29:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2c62:7ff:fe0d:fa29/64 scope link 2023-11-08T12:29:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.516 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:29:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:b3:c1:35:93:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T12:29:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::24b3:c1ff:fe35:936c/64 scope link 2023-11-08T12:29:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:29:33.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:33.518 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:29:33.599 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-11-08T12:29:33.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:33.603 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-11-08T12:29:33.672 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-11-08T12:29:33.673 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:29:33.673 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:29:33.673 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:29:33.674 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:29:33.674 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:29:33.674 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:29:33.674 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:29:33.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:33.675 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:29:33.675 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:29:33.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:29:33.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:29:33.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:29:33.677 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:29:33.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:33.807 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:29:33.825 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T12:29:33.825 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T12:29:33.826 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:29:33.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:33.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-11-08T12:29:33.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:29:33.907 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T12:29:33.972 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:29:33.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:29:33.973 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:29:34.037 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-08T12:29:34.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.038 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:29:34.195 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:29:34.196 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:29:34.196 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-11-08T12:29:34.196 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@c14663df-4425-4498-9232-3ffa5f578bfa.cephfs=/ 2023-11-08T12:29:34.196 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-11-08T12:29:34.202 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T12:29:34.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:29:34.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.242 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:29:34.317 INFO:teuthology.orchestra.run.smithi112.stdout:client5132 2023-11-08T12:29:34.317 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:29:34.318 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:34.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.385 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-11-08T12:29:34.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.462 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-11-08T12:29:34.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.530 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-11-08T12:29:34.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.597 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-11-08T12:29:34.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.668 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-11-08T12:29:34.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:34.729 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-08T12:29:34.808 INFO:teuthology.orchestra.run.smithi112.stdout:./ 2023-11-08T12:29:34.809 INFO:teuthology.orchestra.run.smithi112.stdout:./rfile 2023-11-08T12:29:34.809 INFO:teuthology.orchestra.run.smithi112.stdout:./parentdir 2023-11-08T12:29:34.809 INFO:teuthology.orchestra.run.smithi112.stdout:./parentdir/pfile 2023-11-08T12:29:34.809 INFO:teuthology.orchestra.run.smithi112.stdout:./parentdir/childdir 2023-11-08T12:29:34.810 INFO:teuthology.orchestra.run.smithi112.stdout:./parentdir/childdir/cfile 2023-11-08T12:29:34.811 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:29:34.811 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:29:34.812 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:29:34.812 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:29:34.812 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-08T12:29:34.813 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:29:34.957 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-11-08T12:29:35.146 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:29:35.146 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:29:35.147 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:29:35.147 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:29:35.148 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-11-08T12:29:35.148 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:29:35.286 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627778 2023-11-08T12:29:35.477 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:29:35.478 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:29:35.478 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:29:35.478 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:29:35.479 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-11-08T12:29:35.479 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:29:35.613 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627776 2023-11-08T12:29:35.801 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:29:35.802 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:29:35.802 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:29:35.803 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:29:35.803 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-11-08T12:29:35.803 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:29:35.951 INFO:teuthology.orchestra.run.smithi112.stdout:1099511628279 2023-11-08T12:29:36.137 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:29:36.138 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:29:36.138 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:29:36.139 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:29:36.139 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-11-08T12:29:36.139 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:29:36.280 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627777 2023-11-08T12:29:36.467 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:29:36.468 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:29:36.468 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:29:36.468 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:29:36.469 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-11-08T12:29:36.469 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:29:36.611 INFO:teuthology.orchestra.run.smithi112.stdout:1099511628280 2023-11-08T12:29:36.800 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:29:36.801 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:36.860 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:29:36.861 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:36.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:37.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.131+0000 7f6f4af69700 1 Processor -- start 2023-11-08T12:29:37.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.131+0000 7f6f4af69700 1 -- start start 2023-11-08T12:29:37.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f4af69700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f44160710 0x7f6f440cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f4af69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44070790 0x7f6f44164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f4af69700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f440ad6c0 con 0x7f6f440cc860 2023-11-08T12:29:37.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f4af69700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4406b1c0 con 0x7f6f44160710 2023-11-08T12:29:37.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f4af69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440adc60 con 0x7f6f44070790 2023-11-08T12:29:37.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49f67700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f44160710 0x7f6f440cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49f67700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f44160710 0x7f6f440cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:58910/0 (socket says 172.21.15.112:58910) 2023-11-08T12:29:37.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49766700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6f440cc860 0x7f6f44070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:32834/0 (socket says 172.21.15.112:32834) 2023-11-08T12:29:37.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49f67700 1 -- 172.21.15.112:0/2140341783 learned_addr learned my addr 172.21.15.112:0/2140341783 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:37.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f4a768700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44070790 0x7f6f44164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49f67700 1 -- 172.21.15.112:0/2140341783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44070790 msgr2=0x7f6f44164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:37.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49f67700 1 --2- 172.21.15.112:0/2140341783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44070790 0x7f6f44164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49f67700 1 -- 172.21.15.112:0/2140341783 >> v1:172.21.15.133:6789/0 conn(0x7f6f440cc860 legacy=0x7f6f44070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.135+0000 7f6f49f67700 1 -- 172.21.15.112:0/2140341783 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4406b3d0 con 0x7f6f44160710 2023-11-08T12:29:37.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f49f67700 1 --2- 172.21.15.112:0/2140341783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44160710 0x7f6f440cc320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009910 tx=0x7f6f40009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d6c179ed155d28 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f48f65700 1 -- 172.21.15.112:0/2140341783 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011830 con 0x7f6f44160710 2023-11-08T12:29:37.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f48f65700 1 -- 172.21.15.112:0/2140341783 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40011990 con 0x7f6f44160710 2023-11-08T12:29:37.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f48f65700 1 -- 172.21.15.112:0/2140341783 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011d40 con 0x7f6f44160710 2023-11-08T12:29:37.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 -- 172.21.15.112:0/2140341783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44160710 msgr2=0x7f6f440cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 --2- 172.21.15.112:0/2140341783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44160710 0x7f6f440cc320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009910 tx=0x7f6f40009c20 comp rx=0 tx=0).stop 2023-11-08T12:29:37.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 -- 172.21.15.112:0/2140341783 shutdown_connections 2023-11-08T12:29:37.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 --2- 172.21.15.112:0/2140341783 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44070790 0x7f6f44164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 --2- 172.21.15.112:0/2140341783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44160710 0x7f6f440cc320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 -- 172.21.15.112:0/2140341783 >> 172.21.15.112:0/2140341783 conn(0x7f6f440b0f80 msgr2=0x7f6f440ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:37.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 -- 172.21.15.112:0/2140341783 shutdown_connections 2023-11-08T12:29:37.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.139+0000 7f6f4af69700 1 -- 172.21.15.112:0/2140341783 wait complete. 2023-11-08T12:29:37.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 Processor -- start 2023-11-08T12:29:37.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 -- start start 2023-11-08T12:29:37.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44070790 0x7f6f4415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f440cc860 0x7f6f440b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44160710 0x7f6f441f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4415d760 con 0x7f6f44160710 2023-11-08T12:29:37.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440c36a0 con 0x7f6f44070790 2023-11-08T12:29:37.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4af69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4415a550 con 0x7f6f440cc860 2023-11-08T12:29:37.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.143+0000 7f6f4a768700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44160710 0x7f6f441f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f440cc860 0x7f6f440b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49f67700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44070790 0x7f6f4415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49f67700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44070790 0x7f6f4415cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:58926/0 (socket says 172.21.15.112:58926) 2023-11-08T12:29:37.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f440cc860 0x7f6f440b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:50416/0 (socket says 172.21.15.112:50416) 2023-11-08T12:29:37.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49f67700 1 -- 172.21.15.112:0/37741941 learned_addr learned my addr 172.21.15.112:0/37741941 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:37.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 -- 172.21.15.112:0/37741941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44070790 msgr2=0x7f6f4415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44070790 0x7f6f4415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 -- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44160710 msgr2=0x7f6f441f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44160710 0x7f6f441f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 -- 172.21.15.112:0/37741941 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40009570 con 0x7f6f440cc860 2023-11-08T12:29:37.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f49766700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f440cc860 0x7f6f440b2650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400c500 tx=0x7f6f3400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f3a7fc700 1 -- 172.21.15.112:0/37741941 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34005cd0 con 0x7f6f440cc860 2023-11-08T12:29:37.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f3a7fc700 1 -- 172.21.15.112:0/37741941 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f34005e30 con 0x7f6f440cc860 2023-11-08T12:29:37.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f440ad8f0 con 0x7f6f440cc860 2023-11-08T12:29:37.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f3a7fc700 1 -- 172.21.15.112:0/37741941 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340072d0 con 0x7f6f440cc860 2023-11-08T12:29:37.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4406b6b0 con 0x7f6f440cc860 2023-11-08T12:29:37.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.147+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f44160ae0 con 0x7f6f440cc860 2023-11-08T12:29:37.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.151+0000 7f6f3a7fc700 1 -- 172.21.15.112:0/37741941 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6f34019030 con 0x7f6f440cc860 2023-11-08T12:29:37.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.151+0000 7f6f3a7fc700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f28064f10 0x7f6f280673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.151+0000 7f6f3a7fc700 1 -- 172.21.15.112:0/37741941 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6f340811c0 con 0x7f6f440cc860 2023-11-08T12:29:37.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.151+0000 7f6f49f67700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f28064f10 0x7f6f280673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.155+0000 7f6f49f67700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f28064f10 0x7f6f280673c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009150 tx=0x7f6f40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.163+0000 7f6f3a7fc700 1 -- 172.21.15.112:0/37741941 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6f3404a400 con 0x7f6f440cc860 2023-11-08T12:29:37.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.339+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f440c37e0 con 0x7f6f440cc860 2023-11-08T12:29:37.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.343+0000 7f6f3a7fc700 1 -- 172.21.15.112:0/37741941 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18232 (secure 0 0 0) 0x7f6f3404f1a0 con 0x7f6f440cc860 2023-11-08T12:29:37.346 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:37.346 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:36.882358+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:29:19.858911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-08T12:29:20.777517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.343+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f28064f10 msgr2=0x7f6f280673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.343+0000 7f6f4af69700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f28064f10 0x7f6f280673c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009150 tx=0x7f6f40008030 comp rx=0 tx=0).stop 2023-11-08T12:29:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.343+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f440cc860 msgr2=0x7f6f440b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.343+0000 7f6f4af69700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f440cc860 0x7f6f440b2650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400c500 tx=0x7f6f3400c810 comp rx=0 tx=0).stop 2023-11-08T12:29:37.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 shutdown_connections 2023-11-08T12:29:37.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6f28064f10 0x7f6f280673c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f44160710 0x7f6f441f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f440cc860 0x7f6f440b2650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 --2- 172.21.15.112:0/37741941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44070790 0x7f6f4415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 >> 172.21.15.112:0/37741941 conn(0x7f6f440b0f80 msgr2=0x7f6f44069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:37.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 shutdown_connections 2023-11-08T12:29:37.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.347+0000 7f6f4af69700 1 -- 172.21.15.112:0/37741941 wait complete. 2023-11-08T12:29:37.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:29:19.858911+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:29:20.777517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:29:37.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:29:37.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.539+0000 7f05cd337700 1 Processor -- start 2023-11-08T12:29:37.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.543+0000 7f05cd337700 1 -- start start 2023-11-08T12:29:37.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.543+0000 7f05cd337700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05c8070620 0x7f05c80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.543+0000 7f05cd337700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c8069bf0 0x7f05c8069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.543+0000 7f05cd337700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c815c520 con 0x7f05c815c150 2023-11-08T12:29:37.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.543+0000 7f05cd337700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80b4240 con 0x7f05c8069bf0 2023-11-08T12:29:37.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.543+0000 7f05cd337700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c806cc50 con 0x7f05c8070620 2023-11-08T12:29:37.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c8069bf0 0x7f05c8069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c6ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f05c815c150 0x7f05c806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59072/0 (socket says 172.21.15.112:59072) 2023-11-08T12:29:37.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c6ffd700 1 -- 172.21.15.112:0/3734668257 learned_addr learned my addr 172.21.15.112:0/3734668257 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:37.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c67fc700 1 --2- 172.21.15.112:0/3734668257 >> v2:172.21.15.133:3300/0 conn(0x7f05c8070620 0x7f05c80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c5ffb700 1 -- 172.21.15.112:0/3734668257 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377706720 0 0) 0x7f05c815c520 con 0x7f05c815c150 2023-11-08T12:29:37.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c5ffb700 1 -- 172.21.15.112:0/3734668257 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b00035d0 con 0x7f05c815c150 2023-11-08T12:29:37.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c77fe700 1 -- 172.21.15.112:0/3734668257 >> v2:172.21.15.133:3300/0 conn(0x7f05c8070620 msgr2=0x7f05c80b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:37.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c77fe700 1 --2- 172.21.15.112:0/3734668257 >> v2:172.21.15.133:3300/0 conn(0x7f05c8070620 0x7f05c80b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c77fe700 1 -- 172.21.15.112:0/3734668257 >> v1:172.21.15.112:6789/0 conn(0x7f05c815c150 legacy=0x7f05c806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c77fe700 1 -- 172.21.15.112:0/3734668257 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80d2450 con 0x7f05c8069bf0 2023-11-08T12:29:37.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c77fe700 1 --2- 172.21.15.112:0/3734668257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c8069ff0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f05c8066d30 tx=0x7f05c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c843522e587283 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c5ffb700 1 -- 172.21.15.112:0/3734668257 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000e070 con 0x7f05c8069bf0 2023-11-08T12:29:37.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c5ffb700 1 -- 172.21.15.112:0/3734668257 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000bb20 con 0x7f05c8069bf0 2023-11-08T12:29:37.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05c5ffb700 1 -- 172.21.15.112:0/3734668257 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0012430 con 0x7f05c8069bf0 2023-11-08T12:29:37.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 -- 172.21.15.112:0/3734668257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 msgr2=0x7f05c8069ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 --2- 172.21.15.112:0/3734668257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c8069ff0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f05c8066d30 tx=0x7f05c000b330 comp rx=0 tx=0).stop 2023-11-08T12:29:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 -- 172.21.15.112:0/3734668257 shutdown_connections 2023-11-08T12:29:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 --2- 172.21.15.112:0/3734668257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c8069ff0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 --2- 172.21.15.112:0/3734668257 >> v2:172.21.15.133:3300/0 conn(0x7f05c8070620 0x7f05c80b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 -- 172.21.15.112:0/3734668257 >> 172.21.15.112:0/3734668257 conn(0x7f05c80d3680 msgr2=0x7f05c80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 -- 172.21.15.112:0/3734668257 shutdown_connections 2023-11-08T12:29:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.547+0000 7f05cd337700 1 -- 172.21.15.112:0/3734668257 wait complete. 2023-11-08T12:29:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.551+0000 7f05cd337700 1 Processor -- start 2023-11-08T12:29:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 -- start start 2023-11-08T12:29:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c80c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05c8070620 0x7f05c80b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05c815c150 0x7f05c8142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80b8070 con 0x7f05c8069bf0 2023-11-08T12:29:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80b73f0 con 0x7f05c815c150 2023-11-08T12:29:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80b76d0 con 0x7f05c8070620 2023-11-08T12:29:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c80c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c80c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40682/0 (socket says 172.21.15.112:40682) 2023-11-08T12:29:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 -- 172.21.15.112:0/618407276 learned_addr learned my addr 172.21.15.112:0/618407276 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c67fc700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05c8070620 0x7f05c80b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c77fe700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05c815c150 0x7f05c8142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 -- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05c8070620 msgr2=0x7f05c80b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05c8070620 0x7f05c80b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 -- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05c815c150 msgr2=0x7f05c8142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05c815c150 0x7f05c8142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 -- 172.21.15.112:0/618407276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0009a70 con 0x7f05c8069bf0 2023-11-08T12:29:37.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05c6ffd700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c80c9cb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c4d0 tx=0x7f05b800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05af7fe700 1 -- 172.21.15.112:0/618407276 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8005d90 con 0x7f05c8069bf0 2023-11-08T12:29:37.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05af7fe700 1 -- 172.21.15.112:0/618407276 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b80070d0 con 0x7f05c8069bf0 2023-11-08T12:29:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c80d05e0 con 0x7f05c8069bf0 2023-11-08T12:29:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05af7fe700 1 -- 172.21.15.112:0/618407276 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8007480 con 0x7f05c8069bf0 2023-11-08T12:29:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.555+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c80d2730 con 0x7f05c8069bf0 2023-11-08T12:29:37.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:29:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.559+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c80d2140 con 0x7f05c8069bf0 2023-11-08T12:29:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.559+0000 7f05af7fe700 1 -- 172.21.15.112:0/618407276 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f05b8019030 con 0x7f05c8069bf0 2023-11-08T12:29:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.559+0000 7f05af7fe700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f05b4064ee0 0x7f05b4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.559+0000 7f05af7fe700 1 -- 172.21.15.112:0/618407276 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f05b80813e0 con 0x7f05c8069bf0 2023-11-08T12:29:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.559+0000 7f05c67fc700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f05b4064ee0 0x7f05b4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.563+0000 7f05c67fc700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f05b4064ee0 0x7f05b4067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f05c8143180 tx=0x7f05bc0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.573 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:29:37.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.571+0000 7f05af7fe700 1 -- 172.21.15.112:0/618407276 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f05b804f380 con 0x7f05c8069bf0 2023-11-08T12:29:37.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.743+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05c8073d20 con 0x7f05c8069bf0 2023-11-08T12:29:37.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.743+0000 7f05af7fe700 1 -- 172.21.15.112:0/618407276 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05b80529a0 con 0x7f05c8069bf0 2023-11-08T12:29:37.750 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:29:37.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f05b4064ee0 msgr2=0x7f05b4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f05b4064ee0 0x7f05b4067390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f05c8143180 tx=0x7f05bc0091c0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 msgr2=0x7f05c80c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c80c9cb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c4d0 tx=0x7f05b800c7e0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 shutdown_connections 2023-11-08T12:29:37.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f05b4064ee0 0x7f05b4067390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05c815c150 0x7f05c8142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05c8070620 0x7f05c80b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 --2- 172.21.15.112:0/618407276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c8069bf0 0x7f05c80c9cb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 >> 172.21.15.112:0/618407276 conn(0x7f05c80d3680 msgr2=0x7f05c80c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:37.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 shutdown_connections 2023-11-08T12:29:37.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.747+0000 7f05cd337700 1 -- 172.21.15.112:0/618407276 wait complete. 2023-11-08T12:29:37.772 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:29:37.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.967+0000 7f51c8a0f700 1 Processor -- start 2023-11-08T12:29:37.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.967+0000 7f51c8a0f700 1 -- start start 2023-11-08T12:29:37.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51c415c0f0 0x7f51c40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51c4160770 0x7f51c40cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40c95b0 con 0x7f51c40cbe80 2023-11-08T12:29:37.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c4069bf0 con 0x7f51c4160770 2023-11-08T12:29:37.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c4069ed0 con 0x7f51c415c0f0 2023-11-08T12:29:37.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51c4160770 0x7f51c40cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51c4160770 0x7f51c40cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40690/0 (socket says 172.21.15.112:40690) 2023-11-08T12:29:37.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 -- 172.21.15.112:0/3858907856 learned_addr learned my addr 172.21.15.112:0/3858907856 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c37fe700 1 --2- 172.21.15.112:0/3858907856 >> v2:172.21.15.133:3300/0 conn(0x7f51c415c0f0 0x7f51c40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 -- 172.21.15.112:0/3858907856 >> v2:172.21.15.133:3300/0 conn(0x7f51c415c0f0 msgr2=0x7f51c40ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 --2- 172.21.15.112:0/3858907856 >> v2:172.21.15.133:3300/0 conn(0x7f51c415c0f0 0x7f51c40ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 -- 172.21.15.112:0/3858907856 >> v1:172.21.15.133:6789/0 conn(0x7f51c40cbe80 legacy=0x7f51c406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 -- 172.21.15.112:0/3858907856 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c40cece0 con 0x7f51c4160770 2023-11-08T12:29:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c2ffd700 1 --2- 172.21.15.112:0/3858907856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c4160770 0x7f51c40cb940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f51c40ceec0 tx=0x7f51b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbed4b09403e6a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c27fc700 1 -- 172.21.15.112:0/3858907856 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8011830 con 0x7f51c4160770 2023-11-08T12:29:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c27fc700 1 -- 172.21.15.112:0/3858907856 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8011990 con 0x7f51c4160770 2023-11-08T12:29:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c27fc700 1 -- 172.21.15.112:0/3858907856 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8011d20 con 0x7f51c4160770 2023-11-08T12:29:37.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- 172.21.15.112:0/3858907856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c4160770 msgr2=0x7f51c40cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/3858907856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c4160770 0x7f51c40cb940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f51c40ceec0 tx=0x7f51b8009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- 172.21.15.112:0/3858907856 shutdown_connections 2023-11-08T12:29:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/3858907856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c4160770 0x7f51c40cb940 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/3858907856 >> v2:172.21.15.133:3300/0 conn(0x7f51c415c0f0 0x7f51c40ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- 172.21.15.112:0/3858907856 >> 172.21.15.112:0/3858907856 conn(0x7f51c40cef60 msgr2=0x7f51c40cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- 172.21.15.112:0/3858907856 shutdown_connections 2023-11-08T12:29:37.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.971+0000 7f51c8a0f700 1 -- 172.21.15.112:0/3858907856 wait complete. 2023-11-08T12:29:37.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.975+0000 7f51c8a0f700 1 Processor -- start 2023-11-08T12:29:37.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.975+0000 7f51c8a0f700 1 -- start start 2023-11-08T12:29:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c8a0f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c40cbe80 0x7f51c41f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c8a0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c415c0f0 0x7f51c40c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c8a0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c4160770 0x7f51c4145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c8a0f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4146740 con 0x7f51c40cbe80 2023-11-08T12:29:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c8a0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4146a20 con 0x7f51c4160770 2023-11-08T12:29:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c8a0f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c40c8390 con 0x7f51c415c0f0 2023-11-08T12:29:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c40cbe80 0x7f51c41f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c40cbe80 0x7f51c41f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40694/0 (socket says 172.21.15.112:40694) 2023-11-08T12:29:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 -- 172.21.15.112:0/4032390941 learned_addr learned my addr 172.21.15.112:0/4032390941 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:37.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c2ffd700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c415c0f0 0x7f51c40c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c3fff700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c4160770 0x7f51c4145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 -- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c415c0f0 msgr2=0x7f51c40c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c415c0f0 0x7f51c40c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 -- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c4160770 msgr2=0x7f51c4145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:37.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c4160770 0x7f51c4145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:37.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 -- 172.21.15.112:0/4032390941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8009570 con 0x7f51c40cbe80 2023-11-08T12:29:37.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c3fff700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c4160770 0x7f51c4145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:37.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c37fe700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c40cbe80 0x7f51c41f4e40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51b400e870 tx=0x7f51b400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51abfff700 1 -- 172.21.15.112:0/4032390941 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40095a0 con 0x7f51c40cbe80 2023-11-08T12:29:37.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51abfff700 1 -- 172.21.15.112:0/4032390941 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4013680 con 0x7f51c40cbe80 2023-11-08T12:29:37.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51abfff700 1 -- 172.21.15.112:0/4032390941 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40139f0 con 0x7f51c40cbe80 2023-11-08T12:29:37.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.979+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c40ccc60 con 0x7f51c40cbe80 2023-11-08T12:29:37.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.983+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c40cc290 con 0x7f51c40cbe80 2023-11-08T12:29:37.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.983+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c40ccf40 con 0x7f51c40cbe80 2023-11-08T12:29:37.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.983+0000 7f51abfff700 1 -- 172.21.15.112:0/4032390941 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f51b4019030 con 0x7f51c40cbe80 2023-11-08T12:29:37.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.987+0000 7f51abfff700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51b0064ee0 0x7f51b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:37.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.987+0000 7f51abfff700 1 -- 172.21.15.112:0/4032390941 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f51b4081e10 con 0x7f51c40cbe80 2023-11-08T12:29:37.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.987+0000 7f51c2ffd700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51b0064ee0 0x7f51b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:37.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.987+0000 7f51c2ffd700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51b0064ee0 0x7f51b0067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f51b8000c00 tx=0x7f51b8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:37.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:37.995+0000 7f51abfff700 1 -- 172.21.15.112:0/4032390941 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f51b404fe30 con 0x7f51c40cbe80 2023-11-08T12:29:38.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.163+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51c4073d20 con 0x7f51c40cbe80 2023-11-08T12:29:38.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51abfff700 1 -- 172.21.15.112:0/4032390941 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51b4053450 con 0x7f51c40cbe80 2023-11-08T12:29:38.170 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:29:38.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51b0064ee0 msgr2=0x7f51b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51b0064ee0 0x7f51b0067390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f51b8000c00 tx=0x7f51b8008030 comp rx=0 tx=0).stop 2023-11-08T12:29:38.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c40cbe80 msgr2=0x7f51c41f4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c40cbe80 0x7f51c41f4e40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51b400e870 tx=0x7f51b400eb80 comp rx=0 tx=0).stop 2023-11-08T12:29:38.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 shutdown_connections 2023-11-08T12:29:38.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51b0064ee0 0x7f51b0067390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c4160770 0x7f51c4145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c415c0f0 0x7f51c40c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 --2- 172.21.15.112:0/4032390941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51c40cbe80 0x7f51c41f4e40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 >> 172.21.15.112:0/4032390941 conn(0x7f51c40cef60 msgr2=0x7f51c406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:38.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.167+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 shutdown_connections 2023-11-08T12:29:38.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.171+0000 7f51c8a0f700 1 -- 172.21.15.112:0/4032390941 wait complete. 2023-11-08T12:29:38.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:29:38.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.367+0000 7f4557141700 1 Processor -- start 2023-11-08T12:29:38.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.367+0000 7f4557141700 1 -- start start 2023-11-08T12:29:38.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f4557141700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45500cdc50 0x7f4550069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f4557141700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f455006ff10 0x7f4550070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f4557141700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500708b0 con 0x7f455015e190 2023-11-08T12:29:38.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f4557141700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455015e560 con 0x7f45500cdc50 2023-11-08T12:29:38.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f4557141700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455006be80 con 0x7f455006ff10 2023-11-08T12:29:38.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f455593e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45500cdc50 0x7f4550069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f455593e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45500cdc50 0x7f4550069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40708/0 (socket says 172.21.15.112:40708) 2023-11-08T12:29:38.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f455593e700 1 -- 172.21.15.112:0/3667320391 learned_addr learned my addr 172.21.15.112:0/3667320391 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:38.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f4556940700 1 --2- 172.21.15.112:0/3667320391 >> v2:172.21.15.133:3300/0 conn(0x7f455006ff10 0x7f4550070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f455593e700 1 -- 172.21.15.112:0/3667320391 >> v2:172.21.15.133:3300/0 conn(0x7f455006ff10 msgr2=0x7f4550070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:38.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f455593e700 1 --2- 172.21.15.112:0/3667320391 >> v2:172.21.15.133:3300/0 conn(0x7f455006ff10 0x7f4550070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f455593e700 1 -- 172.21.15.112:0/3667320391 >> v1:172.21.15.133:6789/0 conn(0x7f455015e190 legacy=0x7f4550161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.371+0000 7f455593e700 1 -- 172.21.15.112:0/3667320391 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500ce0a0 con 0x7f45500cdc50 2023-11-08T12:29:38.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f455593e700 1 --2- 172.21.15.112:0/3667320391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45500cdc50 0x7f4550069bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f455006bbe0 tx=0x7f4540009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7132bd95afb00a12 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:38.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f455513d700 1 -- 172.21.15.112:0/3667320391 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540011830 con 0x7f45500cdc50 2023-11-08T12:29:38.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f455513d700 1 -- 172.21.15.112:0/3667320391 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4540011990 con 0x7f45500cdc50 2023-11-08T12:29:38.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f455513d700 1 -- 172.21.15.112:0/3667320391 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540011d20 con 0x7f45500cdc50 2023-11-08T12:29:38.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 -- 172.21.15.112:0/3667320391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45500cdc50 msgr2=0x7f4550069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 --2- 172.21.15.112:0/3667320391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45500cdc50 0x7f4550069bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f455006bbe0 tx=0x7f4540009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 -- 172.21.15.112:0/3667320391 shutdown_connections 2023-11-08T12:29:38.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 --2- 172.21.15.112:0/3667320391 >> v2:172.21.15.133:3300/0 conn(0x7f455006ff10 0x7f4550070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 --2- 172.21.15.112:0/3667320391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45500cdc50 0x7f4550069bf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 -- 172.21.15.112:0/3667320391 >> 172.21.15.112:0/3667320391 conn(0x7f45500cf280 msgr2=0x7f45500cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:38.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 -- 172.21.15.112:0/3667320391 shutdown_connections 2023-11-08T12:29:38.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.375+0000 7f4557141700 1 -- 172.21.15.112:0/3667320391 wait complete. 2023-11-08T12:29:38.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 Processor -- start 2023-11-08T12:29:38.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 -- start start 2023-11-08T12:29:38.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455006ff10 0x7f455014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45500cdc50 0x7f455015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f455015e190 0x7f455015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45501611c0 con 0x7f455015e190 2023-11-08T12:29:38.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4550161410 con 0x7f455006ff10 2023-11-08T12:29:38.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4557141700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45501616f0 con 0x7f45500cdc50 2023-11-08T12:29:38.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4556940700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f455015e190 0x7f455015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4556940700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f455015e190 0x7f455015ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40718/0 (socket says 172.21.15.112:40718) 2023-11-08T12:29:38.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f4556940700 1 -- 172.21.15.112:0/3412625657 learned_addr learned my addr 172.21.15.112:0/3412625657 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:38.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f455613f700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455006ff10 0x7f455014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.379+0000 7f455593e700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45500cdc50 0x7f455015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4556940700 1 -- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45500cdc50 msgr2=0x7f455015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4556940700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45500cdc50 0x7f455015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4556940700 1 -- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455006ff10 msgr2=0x7f455014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4556940700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455006ff10 0x7f455014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4556940700 1 -- 172.21.15.112:0/3412625657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540009570 con 0x7f455015e190 2023-11-08T12:29:38.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f455593e700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45500cdc50 0x7f455015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:38.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4556940700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f455015e190 0x7f455015ac90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f454800efc0 tx=0x7f454800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:38.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4546ffd700 1 -- 172.21.15.112:0/3412625657 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548009ea0 con 0x7f455015e190 2023-11-08T12:29:38.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4546ffd700 1 -- 172.21.15.112:0/3412625657 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454800f040 con 0x7f455015e190 2023-11-08T12:29:38.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500af990 con 0x7f455015e190 2023-11-08T12:29:38.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4546ffd700 1 -- 172.21.15.112:0/3412625657 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548014480 con 0x7f455015e190 2023-11-08T12:29:38.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45500ce330 con 0x7f455015e190 2023-11-08T12:29:38.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.383+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45500afc70 con 0x7f455015e190 2023-11-08T12:29:38.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.387+0000 7f4546ffd700 1 -- 172.21.15.112:0/3412625657 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f45480145e0 con 0x7f455015e190 2023-11-08T12:29:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.387+0000 7f4546ffd700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4534064ee0 0x7f4534067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.391+0000 7f4546ffd700 1 -- 172.21.15.112:0/3412625657 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4548082af0 con 0x7f455015e190 2023-11-08T12:29:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.391+0000 7f455613f700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4534064ee0 0x7f4534067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.391+0000 7f455613f700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4534064ee0 0x7f4534067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f454c000f60 tx=0x7f454c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:38.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.395+0000 7f4546ffd700 1 -- 172.21.15.112:0/3412625657 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4548050a20 con 0x7f455015e190 2023-11-08T12:29:38.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.559+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4550073d20 con 0x7f455015e190 2023-11-08T12:29:38.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.559+0000 7f4546ffd700 1 -- 172.21.15.112:0/3412625657 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4548054040 con 0x7f455015e190 2023-11-08T12:29:38.565 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:29:38.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.563+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4534064ee0 msgr2=0x7f4534067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.563+0000 7f4557141700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4534064ee0 0x7f4534067390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f454c000f60 tx=0x7f454c009040 comp rx=0 tx=0).stop 2023-11-08T12:29:38.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.563+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f455015e190 msgr2=0x7f455015ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.563+0000 7f4557141700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f455015e190 0x7f455015ac90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f454800efc0 tx=0x7f454800c3a0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 shutdown_connections 2023-11-08T12:29:38.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4534064ee0 0x7f4534067390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f455015e190 0x7f455015ac90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45500cdc50 0x7f455015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 --2- 172.21.15.112:0/3412625657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455006ff10 0x7f455014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 >> 172.21.15.112:0/3412625657 conn(0x7f45500cf280 msgr2=0x7f4550070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:38.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 shutdown_connections 2023-11-08T12:29:38.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.567+0000 7f4557141700 1 -- 172.21.15.112:0/3412625657 wait complete. 2023-11-08T12:29:38.593 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:29:38.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.763+0000 7ff07dba7700 1 Processor -- start 2023-11-08T12:29:38.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff07dba7700 1 -- start start 2023-11-08T12:29:38.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff07dba7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07806b360 0x7ff07815a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff07dba7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff0780ca9e0 0x7ff0780c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff07dba7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0780adeb0 0x7ff0780ae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff07dba7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0781596e0 con 0x7ff0780ca9e0 2023-11-08T12:29:38.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff07dba7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0780ae860 con 0x7ff0780adeb0 2023-11-08T12:29:38.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff07dba7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07815a7a0 con 0x7ff07806b360 2023-11-08T12:29:38.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff076ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff0780ca9e0 0x7ff0780c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.767+0000 7ff076ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff0780ca9e0 0x7ff0780c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40734/0 (socket says 172.21.15.112:40734) 2023-11-08T12:29:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff076ffd700 1 -- 172.21.15.112:0/625984714 learned_addr learned my addr 172.21.15.112:0/625984714 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff0777fe700 1 --2- 172.21.15.112:0/625984714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07806b360 0x7ff07815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff077fff700 1 --2- 172.21.15.112:0/625984714 >> v2:172.21.15.133:3300/0 conn(0x7ff0780adeb0 0x7ff0780ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff076ffd700 1 -- 172.21.15.112:0/625984714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07806b360 msgr2=0x7ff07815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:38.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff076ffd700 1 --2- 172.21.15.112:0/625984714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07806b360 0x7ff07815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff076ffd700 1 -- 172.21.15.112:0/625984714 >> v2:172.21.15.133:3300/0 conn(0x7ff0780adeb0 msgr2=0x7ff0780ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff076ffd700 1 --2- 172.21.15.112:0/625984714 >> v2:172.21.15.133:3300/0 conn(0x7ff0780adeb0 0x7ff0780ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff076ffd700 1 -- 172.21.15.112:0/625984714 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780c9630 con 0x7ff0780ca9e0 2023-11-08T12:29:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff076ffd700 1 --2- 172.21.15.112:0/625984714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780ca9e0 0x7ff0780c9ac0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff0780af8b0 tx=0x7ff06c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f09c610d931dc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:38.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff0767fc700 1 -- 172.21.15.112:0/625984714 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00b8a0 con 0x7ff0780ca9e0 2023-11-08T12:29:38.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff0767fc700 1 -- 172.21.15.112:0/625984714 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c00ba00 con 0x7ff0780ca9e0 2023-11-08T12:29:38.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff0767fc700 1 -- 172.21.15.112:0/625984714 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00bd90 con 0x7ff0780ca9e0 2023-11-08T12:29:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 -- 172.21.15.112:0/625984714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780ca9e0 msgr2=0x7ff0780c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 --2- 172.21.15.112:0/625984714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780ca9e0 0x7ff0780c9ac0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff0780af8b0 tx=0x7ff06c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 -- 172.21.15.112:0/625984714 shutdown_connections 2023-11-08T12:29:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 --2- 172.21.15.112:0/625984714 >> v2:172.21.15.133:3300/0 conn(0x7ff0780adeb0 0x7ff0780ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 --2- 172.21.15.112:0/625984714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780ca9e0 0x7ff0780c9ac0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 --2- 172.21.15.112:0/625984714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07806b360 0x7ff07815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 -- 172.21.15.112:0/625984714 >> 172.21.15.112:0/625984714 conn(0x7ff0780cf580 msgr2=0x7ff0780cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:38.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 -- 172.21.15.112:0/625984714 shutdown_connections 2023-11-08T12:29:38.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.771+0000 7ff07dba7700 1 -- 172.21.15.112:0/625984714 wait complete. 2023-11-08T12:29:38.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 Processor -- start 2023-11-08T12:29:38.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 -- start start 2023-11-08T12:29:38.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07806b360 0x7ff0780c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780adeb0 0x7ff0780c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0780ca9e0 0x7ff078151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780ac930 con 0x7ff0780adeb0 2023-11-08T12:29:38.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff078152160 con 0x7ff07806b360 2023-11-08T12:29:38.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff07dba7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780abd20 con 0x7ff0780ca9e0 2023-11-08T12:29:38.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff076ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780adeb0 0x7ff0780c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff076ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780adeb0 0x7ff0780c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40736/0 (socket says 172.21.15.112:40736) 2023-11-08T12:29:38.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.775+0000 7ff076ffd700 1 -- 172.21.15.112:0/380224647 learned_addr learned my addr 172.21.15.112:0/380224647 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:38.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff0777fe700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07806b360 0x7ff0780c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff077fff700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0780ca9e0 0x7ff078151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff076ffd700 1 -- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0780ca9e0 msgr2=0x7ff078151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff076ffd700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0780ca9e0 0x7ff078151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff076ffd700 1 -- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07806b360 msgr2=0x7ff0780c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff076ffd700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07806b360 0x7ff0780c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff076ffd700 1 -- 172.21.15.112:0/380224647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c009570 con 0x7ff0780adeb0 2023-11-08T12:29:38.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff077fff700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0780ca9e0 0x7ff078151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:38.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff0777fe700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07806b360 0x7ff0780c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:38.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff076ffd700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780adeb0 0x7ff0780c8310 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff06c000c00 tx=0x7ff06c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:38.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff05ffff700 1 -- 172.21.15.112:0/380224647 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0038c0 con 0x7ff0780adeb0 2023-11-08T12:29:38.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff05ffff700 1 -- 172.21.15.112:0/380224647 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c01e070 con 0x7ff0780adeb0 2023-11-08T12:29:38.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0780adc00 con 0x7ff0780adeb0 2023-11-08T12:29:38.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff05ffff700 1 -- 172.21.15.112:0/380224647 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c003c40 con 0x7ff0780adeb0 2023-11-08T12:29:38.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0780cb150 con 0x7ff0780adeb0 2023-11-08T12:29:38.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.779+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0780cae70 con 0x7ff0780adeb0 2023-11-08T12:29:38.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.783+0000 7ff05ffff700 1 -- 172.21.15.112:0/380224647 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff06c00f050 con 0x7ff0780adeb0 2023-11-08T12:29:38.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.783+0000 7ff05ffff700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff064064ee0 0x7ff064067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:38.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.783+0000 7ff05ffff700 1 -- 172.21.15.112:0/380224647 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff06c020070 con 0x7ff0780adeb0 2023-11-08T12:29:38.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.783+0000 7ff0777fe700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff064064ee0 0x7ff064067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:38.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.783+0000 7ff0777fe700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff064064ee0 0x7ff064067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff068009990 tx=0x7ff068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:38.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.787+0000 7ff05ffff700 1 -- 172.21.15.112:0/380224647 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff06c051840 con 0x7ff0780adeb0 2023-11-08T12:29:38.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.963+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0780733b0 con 0x7ff0780adeb0 2023-11-08T12:29:38.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.963+0000 7ff05ffff700 1 -- 172.21.15.112:0/380224647 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff06c054e60 con 0x7ff0780adeb0 2023-11-08T12:29:38.967 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:29:38.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.963+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff064064ee0 msgr2=0x7ff064067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.963+0000 7ff07dba7700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff064064ee0 0x7ff064067390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff068009990 tx=0x7ff068008040 comp rx=0 tx=0).stop 2023-11-08T12:29:38.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.963+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780adeb0 msgr2=0x7ff0780c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:38.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.963+0000 7ff07dba7700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780adeb0 0x7ff0780c8310 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff06c000c00 tx=0x7ff06c004770 comp rx=0 tx=0).stop 2023-11-08T12:29:38.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 shutdown_connections 2023-11-08T12:29:38.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff064064ee0 0x7ff064067390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0780ca9e0 0x7ff078151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0780adeb0 0x7ff0780c8310 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 --2- 172.21.15.112:0/380224647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07806b360 0x7ff0780c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:38.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 >> 172.21.15.112:0/380224647 conn(0x7ff0780cf580 msgr2=0x7ff078070800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:38.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 shutdown_connections 2023-11-08T12:29:38.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:38.967+0000 7ff07dba7700 1 -- 172.21.15.112:0/380224647 wait complete. 2023-11-08T12:29:38.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:29:39.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.163+0000 7f9d44de8700 1 Processor -- start 2023-11-08T12:29:39.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.163+0000 7f9d44de8700 1 -- start start 2023-11-08T12:29:39.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d44de8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d40071aa0 0x7f9d4006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d44de8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d40069e00 0x7f9d4006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d44de8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4006c600 con 0x7f9d4015c640 2023-11-08T12:29:39.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d44de8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4006cef0 con 0x7f9d40069e00 2023-11-08T12:29:39.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d44de8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400d38f0 con 0x7f9d40071aa0 2023-11-08T12:29:39.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d40069e00 0x7f9d4006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9d40069e00 0x7f9d4006a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40740/0 (socket says 172.21.15.112:40740) 2023-11-08T12:29:39.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 -- 172.21.15.112:0/2134707740 learned_addr learned my addr 172.21.15.112:0/2134707740 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:39.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3effd700 1 --2- 172.21.15.112:0/2134707740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d40071aa0 0x7f9d4006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 -- 172.21.15.112:0/2134707740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d40071aa0 msgr2=0x7f9d4006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:39.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 --2- 172.21.15.112:0/2134707740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d40071aa0 0x7f9d4006d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 -- 172.21.15.112:0/2134707740 >> v1:172.21.15.133:6789/0 conn(0x7f9d4015c640 legacy=0x7f9d400d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 -- 172.21.15.112:0/2134707740 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400722f0 con 0x7f9d40069e00 2023-11-08T12:29:39.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3ffff700 1 --2- 172.21.15.112:0/2134707740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4006a280 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009e50 tx=0x7f9d3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cd24a1f30f490b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:39.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3e7fc700 1 -- 172.21.15.112:0/2134707740 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800e070 con 0x7f9d40069e00 2023-11-08T12:29:39.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3e7fc700 1 -- 172.21.15.112:0/2134707740 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800b9c0 con 0x7f9d40069e00 2023-11-08T12:29:39.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.167+0000 7f9d3e7fc700 1 -- 172.21.15.112:0/2134707740 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800bd70 con 0x7f9d40069e00 2023-11-08T12:29:39.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 -- 172.21.15.112:0/2134707740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 msgr2=0x7f9d4006a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2134707740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4006a280 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009e50 tx=0x7f9d3800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:39.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 -- 172.21.15.112:0/2134707740 shutdown_connections 2023-11-08T12:29:39.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2134707740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4006a280 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2134707740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d40071aa0 0x7f9d4006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 -- 172.21.15.112:0/2134707740 >> 172.21.15.112:0/2134707740 conn(0x7f9d400b6520 msgr2=0x7f9d40071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:39.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 -- 172.21.15.112:0/2134707740 shutdown_connections 2023-11-08T12:29:39.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.171+0000 7f9d44de8700 1 -- 172.21.15.112:0/2134707740 wait complete. 2023-11-08T12:29:39.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 Processor -- start 2023-11-08T12:29:39.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 -- start start 2023-11-08T12:29:39.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4009baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d40071aa0 0x7f9d400c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4015c640 0x7f9d400ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c7e50 con 0x7f9d40069e00 2023-11-08T12:29:39.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c7240 con 0x7f9d40071aa0 2023-11-08T12:29:39.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d44de8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c7520 con 0x7f9d4015c640 2023-11-08T12:29:39.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4009baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4009baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40746/0 (socket says 172.21.15.112:40746) 2023-11-08T12:29:39.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 -- 172.21.15.112:0/2857584870 learned_addr learned my addr 172.21.15.112:0/2857584870 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:39.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3effd700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d40071aa0 0x7f9d400c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3ffff700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4015c640 0x7f9d400ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 -- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4015c640 msgr2=0x7f9d400ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4015c640 0x7f9d400ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 -- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d40071aa0 msgr2=0x7f9d400c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d40071aa0 0x7f9d400c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3f7fe700 1 -- 172.21.15.112:0/2857584870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009b30 con 0x7f9d40069e00 2023-11-08T12:29:39.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.175+0000 7f9d3ffff700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4015c640 0x7f9d400ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:39.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.179+0000 7f9d3f7fe700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4009baa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c500 tx=0x7f9d3000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:39.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.179+0000 7f9d27fff700 1 -- 172.21.15.112:0/2857584870 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300052d0 con 0x7f9d40069e00 2023-11-08T12:29:39.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.179+0000 7f9d27fff700 1 -- 172.21.15.112:0/2857584870 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30005430 con 0x7f9d40069e00 2023-11-08T12:29:39.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.179+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40072010 con 0x7f9d40069e00 2023-11-08T12:29:39.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.179+0000 7f9d27fff700 1 -- 172.21.15.112:0/2857584870 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300055a0 con 0x7f9d40069e00 2023-11-08T12:29:39.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.179+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4015ca10 con 0x7f9d40069e00 2023-11-08T12:29:39.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.179+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4006c830 con 0x7f9d40069e00 2023-11-08T12:29:39.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.183+0000 7f9d27fff700 1 -- 172.21.15.112:0/2857584870 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9d30019030 con 0x7f9d40069e00 2023-11-08T12:29:39.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.183+0000 7f9d27fff700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d2c064ee0 0x7f9d2c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.183+0000 7f9d27fff700 1 -- 172.21.15.112:0/2857584870 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9d30081300 con 0x7f9d40069e00 2023-11-08T12:29:39.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.183+0000 7f9d3effd700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d2c064ee0 0x7f9d2c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.183+0000 7f9d3effd700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d2c064ee0 0x7f9d2c067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d400a08d0 tx=0x7f9d34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:39.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.191+0000 7f9d27fff700 1 -- 172.21.15.112:0/2857584870 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9d3004f320 con 0x7f9d40069e00 2023-11-08T12:29:39.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.379+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d40073cb0 con 0x7f9d40069e00 2023-11-08T12:29:39.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d27fff700 1 -- 172.21.15.112:0/2857584870 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d30052940 con 0x7f9d40069e00 2023-11-08T12:29:39.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d2c064ee0 msgr2=0x7f9d2c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d2c064ee0 0x7f9d2c067390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d400a08d0 tx=0x7f9d34008040 comp rx=0 tx=0).stop 2023-11-08T12:29:39.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 msgr2=0x7f9d4009baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4009baa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c500 tx=0x7f9d3000c810 comp rx=0 tx=0).stop 2023-11-08T12:29:39.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 shutdown_connections 2023-11-08T12:29:39.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9d2c064ee0 0x7f9d2c067390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9d4015c640 0x7f9d400ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d40071aa0 0x7f9d400c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 --2- 172.21.15.112:0/2857584870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9d40069e00 0x7f9d4009baa0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 >> 172.21.15.112:0/2857584870 conn(0x7f9d400b6520 msgr2=0x7f9d400b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:39.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 shutdown_connections 2023-11-08T12:29:39.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.383+0000 7f9d44de8700 1 -- 172.21.15.112:0/2857584870 wait complete. 2023-11-08T12:29:39.392 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:29:39.409 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T12:29:39.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:39.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T12:29:39.489 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:29:39.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:29:39.489 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T12:29:39.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:39.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f7198a6d700 1 Processor -- start 2023-11-08T12:29:39.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f7198a6d700 1 -- start start 2023-11-08T12:29:39.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f7198a6d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71940cf2a0 0x7f7194069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f7198a6d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f7198a6d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940ca740 con 0x7f719415c410 2023-11-08T12:29:39.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f7198a6d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940ca9e0 con 0x7f71940cf2a0 2023-11-08T12:29:39.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f7198a6d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940cacc0 con 0x7f719406a1a0 2023-11-08T12:29:39.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f71937fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f719415c410 0x7f7194160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59076/0 (socket says 172.21.15.112:59076) 2023-11-08T12:29:39.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.723+0000 7f71937fe700 1 -- 172.21.15.112:0/3322413098 learned_addr learned my addr 172.21.15.112:0/3322413098 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:39.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7193fff700 1 --2- 172.21.15.112:0/3322413098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7192ffd700 1 --2- 172.21.15.112:0/3322413098 >> v2:172.21.15.133:3300/0 conn(0x7f71940cf2a0 0x7f7194069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f71927fc700 1 -- 172.21.15.112:0/3322413098 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059196480 0 0) 0x7f71940ca740 con 0x7f719415c410 2023-11-08T12:29:39.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f71927fc700 1 -- 172.21.15.112:0/3322413098 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f717c0035d0 con 0x7f719415c410 2023-11-08T12:29:39.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7193fff700 1 -- 172.21.15.112:0/3322413098 >> v2:172.21.15.133:3300/0 conn(0x7f71940cf2a0 msgr2=0x7f7194069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:39.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7193fff700 1 --2- 172.21.15.112:0/3322413098 >> v2:172.21.15.133:3300/0 conn(0x7f71940cf2a0 0x7f7194069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7193fff700 1 -- 172.21.15.112:0/3322413098 >> v1:172.21.15.112:6789/0 conn(0x7f719415c410 legacy=0x7f7194160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7193fff700 1 -- 172.21.15.112:0/3322413098 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940cdb90 con 0x7f719406a1a0 2023-11-08T12:29:39.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7193fff700 1 --2- 172.21.15.112:0/3322413098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b1240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f718c009d90 tx=0x7f718c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bec191c4319ea91 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:39.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f71927fc700 1 -- 172.21.15.112:0/3322413098 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00e070 con 0x7f719406a1a0 2023-11-08T12:29:39.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f71927fc700 1 -- 172.21.15.112:0/3322413098 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c00bb20 con 0x7f719406a1a0 2023-11-08T12:29:39.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f71927fc700 1 -- 172.21.15.112:0/3322413098 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c012430 con 0x7f719406a1a0 2023-11-08T12:29:39.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 -- 172.21.15.112:0/3322413098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 msgr2=0x7f71940b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 --2- 172.21.15.112:0/3322413098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b1240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f718c009d90 tx=0x7f718c00b330 comp rx=0 tx=0).stop 2023-11-08T12:29:39.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 -- 172.21.15.112:0/3322413098 shutdown_connections 2023-11-08T12:29:39.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 --2- 172.21.15.112:0/3322413098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b1240 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 --2- 172.21.15.112:0/3322413098 >> v2:172.21.15.133:3300/0 conn(0x7f71940cf2a0 0x7f7194069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 -- 172.21.15.112:0/3322413098 >> 172.21.15.112:0/3322413098 conn(0x7f71940cc240 msgr2=0x7f71940cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:39.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 -- 172.21.15.112:0/3322413098 shutdown_connections 2023-11-08T12:29:39.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.727+0000 7f7198a6d700 1 -- 172.21.15.112:0/3322413098 wait complete. 2023-11-08T12:29:39.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.731+0000 7f7198a6d700 1 Processor -- start 2023-11-08T12:29:39.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.731+0000 7f7198a6d700 1 -- start start 2023-11-08T12:29:39.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71940cf2a0 0x7f71940b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719415c410 0x7f71940b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b3de0 con 0x7f719415c410 2023-11-08T12:29:39.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71941f4f00 con 0x7f71940cf2a0 2023-11-08T12:29:39.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71941f51e0 con 0x7f719406a1a0 2023-11-08T12:29:39.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719415c410 0x7f71940b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719415c410 0x7f71940b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40756/0 (socket says 172.21.15.112:40756) 2023-11-08T12:29:39.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 -- 172.21.15.112:0/4011666671 learned_addr learned my addr 172.21.15.112:0/4011666671 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:39.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7192ffd700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71940cf2a0 0x7f71940b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f71937fe700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 -- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 msgr2=0x7f71940b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 -- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71940cf2a0 msgr2=0x7f71940b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71940cf2a0 0x7f71940b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 -- 172.21.15.112:0/4011666671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c009a70 con 0x7f719415c410 2023-11-08T12:29:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7193fff700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719415c410 0x7f71940b46e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f718c014040 tx=0x7f718c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f717bfff700 1 -- 172.21.15.112:0/4011666671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c012430 con 0x7f719415c410 2023-11-08T12:29:39.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f717bfff700 1 -- 172.21.15.112:0/4011666671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c020070 con 0x7f719415c410 2023-11-08T12:29:39.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719415c7e0 con 0x7f719415c410 2023-11-08T12:29:39.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f717bfff700 1 -- 172.21.15.112:0/4011666671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c003e10 con 0x7f719415c410 2023-11-08T12:29:39.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.735+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71940cde70 con 0x7f719415c410 2023-11-08T12:29:39.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.739+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719415c970 con 0x7f719415c410 2023-11-08T12:29:39.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.739+0000 7f717bfff700 1 -- 172.21.15.112:0/4011666671 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f718c02e070 con 0x7f719415c410 2023-11-08T12:29:39.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.743+0000 7f717bfff700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7180064ee0 0x7f7180067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:39.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.743+0000 7f717bfff700 1 -- 172.21.15.112:0/4011666671 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f718c022070 con 0x7f719415c410 2023-11-08T12:29:39.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.743+0000 7f71937fe700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7180064ee0 0x7f7180067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:39.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.743+0000 7f71937fe700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7180064ee0 0x7f7180067390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7184007fd0 tx=0x7f7184007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:39.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.751+0000 7f717bfff700 1 -- 172.21.15.112:0/4011666671 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f718c051bb0 con 0x7f719415c410 2023-11-08T12:29:39.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.955+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71940c78e0 con 0x7f719415c410 2023-11-08T12:29:39.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f717bfff700 1 -- 172.21.15.112:0/4011666671 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f71940c78e0 con 0x7f719415c410 2023-11-08T12:29:39.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:39.963 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:39.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7180064ee0 msgr2=0x7f7180067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7180064ee0 0x7f7180067390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7184007fd0 tx=0x7f7184007de0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719415c410 msgr2=0x7f71940b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:39.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719415c410 0x7f71940b46e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f718c014040 tx=0x7f718c004af0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 shutdown_connections 2023-11-08T12:29:39.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7180064ee0 0x7f7180067390 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f719415c410 0x7f71940b46e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71940cf2a0 0x7f71940b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 --2- 172.21.15.112:0/4011666671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f719406a1a0 0x7f71940b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 >> 172.21.15.112:0/4011666671 conn(0x7f71940cc240 msgr2=0x7f71940b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 shutdown_connections 2023-11-08T12:29:39.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:39.959+0000 7f7198a6d700 1 -- 172.21.15.112:0/4011666671 wait complete. 2023-11-08T12:29:39.968 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:39.983 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-08T12:29:40.193 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2023-11-08T12:29:40.194 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-08T12:29:40.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:40.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90b59e700 1 Processor -- start 2023-11-08T12:29:40.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90b59e700 1 -- start start 2023-11-08T12:29:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe90c0b43a0 0x7fe90c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c070790 0x7fe90c06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90b59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c15a550 con 0x7fe90c0b1640 2023-11-08T12:29:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90b59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c06b0a0 con 0x7fe90c0b43a0 2023-11-08T12:29:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0caac0 con 0x7fe90c070790 2023-11-08T12:29:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe90c0b43a0 0x7fe90c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe901d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe90c0b1640 0x7fe90c070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59082/0 (socket says 172.21.15.112:59082) 2023-11-08T12:29:40.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe901d9b700 1 -- 172.21.15.112:0/1832137242 learned_addr learned my addr 172.21.15.112:0/1832137242 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:40.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90ad9d700 1 --2- 172.21.15.112:0/1832137242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c070790 0x7fe90c06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:40.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90a59c700 1 -- 172.21.15.112:0/1832137242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c070790 msgr2=0x7fe90c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:40.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90a59c700 1 --2- 172.21.15.112:0/1832137242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c070790 0x7fe90c06bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90a59c700 1 -- 172.21.15.112:0/1832137242 >> v1:172.21.15.112:6789/0 conn(0x7fe90c0b1640 legacy=0x7fe90c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:40.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90a59c700 1 -- 172.21.15.112:0/1832137242 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0cada0 con 0x7fe90c0b43a0 2023-11-08T12:29:40.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90ad9d700 1 --2- 172.21.15.112:0/1832137242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c070790 0x7fe90c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:40.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe909d9b700 1 -- 172.21.15.112:0/1832137242 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064775784 0 0) 0x7fe8f4001110 con 0x7fe90c0b1640 2023-11-08T12:29:40.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.367+0000 7fe90a59c700 1 --2- 172.21.15.112:0/1832137242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c0b43a0 0x7fe90c15e5d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009850 tx=0x7fe8fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da90f0f75949f3d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:40.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe909d9b700 1 -- 172.21.15.112:0/1832137242 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc011830 con 0x7fe90c0b43a0 2023-11-08T12:29:40.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe909d9b700 1 -- 172.21.15.112:0/1832137242 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc011990 con 0x7fe90c0b43a0 2023-11-08T12:29:40.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe909d9b700 1 -- 172.21.15.112:0/1832137242 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc011d20 con 0x7fe90c0b43a0 2023-11-08T12:29:40.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 -- 172.21.15.112:0/1832137242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c0b43a0 msgr2=0x7fe90c15e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:40.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 --2- 172.21.15.112:0/1832137242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c0b43a0 0x7fe90c15e5d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009850 tx=0x7fe8fc009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:40.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 -- 172.21.15.112:0/1832137242 shutdown_connections 2023-11-08T12:29:40.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 --2- 172.21.15.112:0/1832137242 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c070790 0x7fe90c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 --2- 172.21.15.112:0/1832137242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c0b43a0 0x7fe90c15e5d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 -- 172.21.15.112:0/1832137242 >> 172.21.15.112:0/1832137242 conn(0x7fe90c0b0f80 msgr2=0x7fe90c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:40.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 -- 172.21.15.112:0/1832137242 shutdown_connections 2023-11-08T12:29:40.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.371+0000 7fe90b59e700 1 -- 172.21.15.112:0/1832137242 wait complete. 2023-11-08T12:29:40.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.375+0000 7fe90b59e700 1 Processor -- start 2023-11-08T12:29:40.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.375+0000 7fe90b59e700 1 -- start start 2023-11-08T12:29:40.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.375+0000 7fe90b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c070790 0x7fe90c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:40.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c0b1640 0x7fe90c155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:40.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90c0b43a0 0x7fe90c15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:40.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c15af50 con 0x7fe90c070790 2023-11-08T12:29:40.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c15b8b0 con 0x7fe90c0b43a0 2023-11-08T12:29:40.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c15c7f0 con 0x7fe90c0b1640 2023-11-08T12:29:40.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c070790 0x7fe90c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:40.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c070790 0x7fe90c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40780/0 (socket says 172.21.15.112:40780) 2023-11-08T12:29:40.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 -- 172.21.15.112:0/3774615498 learned_addr learned my addr 172.21.15.112:0/3774615498 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:40.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe901d9b700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c0b1640 0x7fe90c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:40.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90ad9d700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90c0b43a0 0x7fe90c15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:40.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 -- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c0b1640 msgr2=0x7fe90c155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:40.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c0b1640 0x7fe90c155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 -- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90c0b43a0 msgr2=0x7fe90c15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:40.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90c0b43a0 0x7fe90c15bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 -- 172.21.15.112:0/3774615498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0094b0 con 0x7fe90c070790 2023-11-08T12:29:40.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90a59c700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c070790 0x7fe90c15b370 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009fd0 tx=0x7fe8fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:40.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe9037fe700 1 -- 172.21.15.112:0/3774615498 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc0036c0 con 0x7fe90c070790 2023-11-08T12:29:40.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c06b5d0 con 0x7fe90c070790 2023-11-08T12:29:40.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe9037fe700 1 -- 172.21.15.112:0/3774615498 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc01e070 con 0x7fe90c070790 2023-11-08T12:29:40.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe9037fe700 1 -- 172.21.15.112:0/3774615498 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc003a40 con 0x7fe90c070790 2023-11-08T12:29:40.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90c06b2f0 con 0x7fe90c070790 2023-11-08T12:29:40.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.379+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90c15eb10 con 0x7fe90c070790 2023-11-08T12:29:40.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.383+0000 7fe9037fe700 1 -- 172.21.15.112:0/3774615498 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe8fc00f050 con 0x7fe90c070790 2023-11-08T12:29:40.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.383+0000 7fe9037fe700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8ec064ee0 0x7fe8ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:40.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.383+0000 7fe9037fe700 1 -- 172.21.15.112:0/3774615498 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe8fc0831b0 con 0x7fe90c070790 2023-11-08T12:29:40.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.387+0000 7fe901d9b700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8ec064ee0 0x7fe8ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:40.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.387+0000 7fe901d9b700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8ec064ee0 0x7fe8ec067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe90c1594f0 tx=0x7fe8f4007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:40.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.391+0000 7fe9037fe700 1 -- 172.21.15.112:0/3774615498 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe8fc051060 con 0x7fe90c070790 2023-11-08T12:29:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.595+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe90c073cb0 con 0x7fe90c070790 2023-11-08T12:29:40.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe9037fe700 1 -- 172.21.15.112:0/3774615498 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fe8fc054680 con 0x7fe90c070790 2023-11-08T12:29:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:40.602 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8ec064ee0 msgr2=0x7fe8ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8ec064ee0 0x7fe8ec067390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe90c1594f0 tx=0x7fe8f4007a60 comp rx=0 tx=0).stop 2023-11-08T12:29:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c070790 msgr2=0x7fe90c15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c070790 0x7fe90c15b370 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009fd0 tx=0x7fe8fc004770 comp rx=0 tx=0).stop 2023-11-08T12:29:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 shutdown_connections 2023-11-08T12:29:40.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8ec064ee0 0x7fe8ec067390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe90c0b43a0 0x7fe90c15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe90c0b1640 0x7fe90c155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 --2- 172.21.15.112:0/3774615498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe90c070790 0x7fe90c15b370 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:40.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 >> 172.21.15.112:0/3774615498 conn(0x7fe90c0b0f80 msgr2=0x7fe90c0c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:40.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 shutdown_connections 2023-11-08T12:29:40.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:40.599+0000 7fe90b59e700 1 -- 172.21.15.112:0/3774615498 wait complete. 2023-11-08T12:29:40.608 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:40.627 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parentdir mytag 2023-11-08T12:29:40.818 INFO:teuthology.orchestra.run.smithi112.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-11-08T12:29:40.818 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-11-08T12:29:50.820 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-11-08T12:29:50.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.886+0000 7fe87db90140 1 Processor -- start 2023-11-08T12:29:50.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.886+0000 7fe87db90140 1 -- start start 2023-11-08T12:29:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24ad8700 0x558f24b26840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24c43e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24b96f40 0x558f24c46370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f24a00240 con 0x558f24ad8700 2023-11-08T12:29:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f24b1c530 con 0x558f24b0b980 2023-11-08T12:29:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f24b02740 con 0x558f24b96f40 2023-11-08T12:29:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24ad8700 0x558f24b26840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24ad8700 0x558f24b26840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50762/0 (socket says 172.21.15.112:50762) 2023-11-08T12:29:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 -- 172.21.15.112:0/1184295041 learned_addr learned my addr 172.21.15.112:0/1184295041 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:50.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87bec6700 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24b96f40 0x558f24c46370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe872ec4700 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24c43e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 -- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24b96f40 msgr2=0x558f24c46370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24b96f40 0x558f24c46370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 -- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 msgr2=0x558f24c43e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:50.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24c43e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 -- 172.21.15.112:0/1184295041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874005de0 con 0x558f24ad8700 2023-11-08T12:29:50.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87bec6700 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24b96f40 0x558f24c46370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:50.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe872ec4700 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24c43e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:50.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87b6c5700 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24ad8700 0x558f24b26840 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00a7e0 tx=0x7fe86c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b895f2d816a8c05 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:50.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87a6c3700 1 -- 172.21.15.112:0/1184295041 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c012660 con 0x558f24ad8700 2023-11-08T12:29:50.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87a6c3700 1 -- 172.21.15.112:0/1184295041 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c0127c0 con 0x558f24ad8700 2023-11-08T12:29:50.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87a6c3700 1 -- 172.21.15.112:0/1184295041 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c012b50 con 0x558f24ad8700 2023-11-08T12:29:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 -- 172.21.15.112:0/1184295041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24ad8700 msgr2=0x558f24b26840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24ad8700 0x558f24b26840 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00a7e0 tx=0x7fe86c005d80 comp rx=0 tx=0).stop 2023-11-08T12:29:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 -- 172.21.15.112:0/1184295041 shutdown_connections 2023-11-08T12:29:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24b96f40 0x558f24c46370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.890+0000 7fe87db90140 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24c43e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 --2- 172.21.15.112:0/1184295041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24ad8700 0x558f24b26840 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 -- 172.21.15.112:0/1184295041 >> 172.21.15.112:0/1184295041 conn(0x558f24adec30 msgr2=0x558f24b24b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 -- 172.21.15.112:0/1184295041 shutdown_connections 2023-11-08T12:29:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 -- 172.21.15.112:0/1184295041 wait complete. 2023-11-08T12:29:50.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 Processor -- start 2023-11-08T12:29:50.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 -- start start 2023-11-08T12:29:50.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24ad8700 0x558f24ba48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24ba4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24b96f40 0x558f24b03a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f24ba43a0 con 0x558f24b96f40 2023-11-08T12:29:50.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f24ba4640 con 0x558f24b0b980 2023-11-08T12:29:50.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.894+0000 7fe87db90140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f24b1c760 con 0x558f24ad8700 2023-11-08T12:29:50.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24b96f40 0x558f24b03a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87b6c5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24ad8700 0x558f24ba48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24b96f40 0x558f24b03a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50778/0 (socket says 172.21.15.112:50778) 2023-11-08T12:29:50.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 -- 172.21.15.112:0/538499734 learned_addr learned my addr 172.21.15.112:0/538499734 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:50.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe872ec4700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24ba4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 -- 172.21.15.112:0/538499734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24ad8700 msgr2=0x558f24ba48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:50.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x558f24ad8700 0x558f24ba48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 -- 172.21.15.112:0/538499734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 msgr2=0x558f24ba4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:50.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24ba4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 -- 172.21.15.112:0/538499734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c00a410 con 0x558f24b96f40 2023-11-08T12:29:50.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe872ec4700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558f24b0b980 0x558f24ba4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:50.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87bec6700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24b96f40 0x558f24b03a80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe874015040 tx=0x7fe874002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:50.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe8796c1700 1 -- 172.21.15.112:0/538499734 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87401c410 con 0x558f24b96f40 2023-11-08T12:29:50.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe8796c1700 1 -- 172.21.15.112:0/538499734 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87401c590 con 0x558f24b96f40 2023-11-08T12:29:50.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f24a18390 con 0x558f24b96f40 2023-11-08T12:29:50.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe8796c1700 1 -- 172.21.15.112:0/538499734 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87401c940 con 0x558f24b96f40 2023-11-08T12:29:50.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.898+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f24a0b8b0 con 0x558f24b96f40 2023-11-08T12:29:50.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.902+0000 7fe8796c1700 1 -- 172.21.15.112:0/538499734 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe87402c070 con 0x558f24b96f40 2023-11-08T12:29:50.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.902+0000 7fe8796c1700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe85c063840 0x7fe85c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.902+0000 7fe8796c1700 1 -- 172.21.15.112:0/538499734 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe874081f20 con 0x558f24b96f40 2023-11-08T12:29:50.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.902+0000 7fe87b6c5700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe85c063840 0x7fe85c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x558f24ba3e90 0x558f24b1d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 --> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x558f24b1d680 con 0x558f24ba3e90 2023-11-08T12:29:50.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87b6c5700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe85c063840 0x7fe85c065cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000f80 tx=0x7fe86c012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:50.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe872ec4700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x558f24ba3e90 0x558f24b1d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe872ec4700 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x558f24ba3e90 0x558f24b1d140 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:50.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe872ec4700 1 -- 172.21.15.112:0/538499734 <== osd.0 v2:172.21.15.112:6801/35551 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fe86400e580 con 0x558f24ba3e90 2023-11-08T12:29:50.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x558f24ba3e90 msgr2=0x558f24b1d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:50.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x558f24ba3e90 0x558f24b1d140 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe85c063840 msgr2=0x7fe85c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:50.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe85c063840 0x7fe85c065cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000f80 tx=0x7fe86c012000 comp rx=0 tx=0).stop 2023-11-08T12:29:50.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24b96f40 msgr2=0x558f24b03a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:50.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 --2- 172.21.15.112:0/538499734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558f24b96f40 0x558f24b03a80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe874015040 tx=0x7fe874002fb0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87bec6700 1 -- 172.21.15.112:0/538499734 reap_dead start 2023-11-08T12:29:50.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 shutdown_connections 2023-11-08T12:29:50.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 >> 172.21.15.112:0/538499734 conn(0x558f24adec30 msgr2=0x558f24b26840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:50.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 shutdown_connections 2023-11-08T12:29:50.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.906+0000 7fe87db90140 1 -- 172.21.15.112:0/538499734 wait complete. 2023-11-08T12:29:50.919 INFO:teuthology.orchestra.run.smithi112.stdout:mytag 2023-11-08T12:29:50.920 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-11-08T12:29:50.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 Processor -- start 2023-11-08T12:29:50.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 -- start start 2023-11-08T12:29:50.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85e50840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 0x563a85e2cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 0x563a85e2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:50.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a85d97180 con 0x563a85e02700 2023-11-08T12:29:50.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a85d2a240 con 0x563a85e02ad0 2023-11-08T12:29:50.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224bff6140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a85e2ff30 con 0x563a85ec0f40 2023-11-08T12:29:50.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85e50840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85e50840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50796/0 (socket says 172.21.15.112:50796) 2023-11-08T12:29:50.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 -- 172.21.15.112:0/563154418 learned_addr learned my addr 172.21.15.112:0/563154418 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:50.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224932a700 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 0x563a85e2cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224a32c700 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 0x563a85e2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:50.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 -- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 msgr2=0x563a85e2d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:50.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 0x563a85e2d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 -- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 msgr2=0x563a85e2cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:50.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 0x563a85e2cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:50.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 -- 172.21.15.112:0/563154418 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224400a100 con 0x563a85e02700 2023-11-08T12:29:50.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f224a32c700 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 0x563a85e2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:51.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2249b2b700 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85e50840 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f223c001e30 tx=0x7f223c00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ddf60c09119879 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.982+0000 7f2243fff700 1 -- 172.21.15.112:0/563154418 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c014070 con 0x563a85e02700 2023-11-08T12:29:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f2243fff700 1 -- 172.21.15.112:0/563154418 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c008030 con 0x563a85e02700 2023-11-08T12:29:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f2243fff700 1 -- 172.21.15.112:0/563154418 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00bdb0 con 0x563a85e02700 2023-11-08T12:29:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- 172.21.15.112:0/563154418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 msgr2=0x563a85e50840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85e50840 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f223c001e30 tx=0x7f223c00b4c0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- 172.21.15.112:0/563154418 shutdown_connections 2023-11-08T12:29:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 0x563a85e2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 0x563a85e2cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 --2- 172.21.15.112:0/563154418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85e50840 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- 172.21.15.112:0/563154418 >> 172.21.15.112:0/563154418 conn(0x563a85e08c30 msgr2=0x563a85e4eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- 172.21.15.112:0/563154418 shutdown_connections 2023-11-08T12:29:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- 172.21.15.112:0/563154418 wait complete. 2023-11-08T12:29:51.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 Processor -- start 2023-11-08T12:29:51.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- start start 2023-11-08T12:29:51.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85edcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 0x563a85ebf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 0x563a85ebfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a85e4b3c0 con 0x563a85e02700 2023-11-08T12:29:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a85e48c30 con 0x563a85e02ad0 2023-11-08T12:29:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f224bff6140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a85e481b0 con 0x563a85ec0f40 2023-11-08T12:29:51.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f2249b2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85edcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f2249b2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85edcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50798/0 (socket says 172.21.15.112:50798) 2023-11-08T12:29:51.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.986+0000 7f2249b2b700 1 -- 172.21.15.112:0/1889725299 learned_addr learned my addr 172.21.15.112:0/1889725299 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2249b2b700 1 -- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 msgr2=0x563a85ebfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2249b2b700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563a85ec0f40 0x563a85ebfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2249b2b700 1 -- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 msgr2=0x563a85ebf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2249b2b700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a85e02ad0 0x563a85ebf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2249b2b700 1 -- 172.21.15.112:0/1889725299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c00a040 con 0x563a85e02700 2023-11-08T12:29:51.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2249b2b700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85edcf60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f223c00b8c0 tx=0x7f223c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2242ffd700 1 -- 172.21.15.112:0/1889725299 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c014040 con 0x563a85e02700 2023-11-08T12:29:51.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2242ffd700 1 -- 172.21.15.112:0/1889725299 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c01b630 con 0x563a85e02700 2023-11-08T12:29:51.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2242ffd700 1 -- 172.21.15.112:0/1889725299 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c01b9e0 con 0x563a85e02700 2023-11-08T12:29:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a85d358b0 con 0x563a85e02700 2023-11-08T12:29:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a85d425d0 con 0x563a85e02700 2023-11-08T12:29:51.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.990+0000 7f2242ffd700 1 -- 172.21.15.112:0/1889725299 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f223c02b070 con 0x563a85e02700 2023-11-08T12:29:51.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f2242ffd700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f222c063810 0x7f222c065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f2242ffd700 1 -- 172.21.15.112:0/1889725299 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f223c0821b0 con 0x563a85e02700 2023-11-08T12:29:51.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224932a700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f222c063810 0x7f222c065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x563a85edd4a0 0x563a85e47140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- osd_op(unknown.0.0:1 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563a85e4c7c0 con 0x563a85edd4a0 2023-11-08T12:29:51.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224a32c700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x563a85edd4a0 0x563a85e47140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224932a700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f222c063810 0x7f222c065cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2234004170 tx=0x7f2234006500 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224a32c700 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x563a85edd4a0 0x563a85e47140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224a32c700 1 -- 172.21.15.112:0/1889725299 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f224400fa80 con 0x563a85edd4a0 2023-11-08T12:29:51.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x563a85edd4a0 msgr2=0x563a85e47140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x563a85edd4a0 0x563a85e47140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f222c063810 msgr2=0x7f222c065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f222c063810 0x7f222c065cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2234004170 tx=0x7f2234006500 comp rx=0 tx=0).stop 2023-11-08T12:29:51.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 msgr2=0x563a85edcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.994+0000 7f224bff6140 1 --2- 172.21.15.112:0/1889725299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563a85e02700 0x563a85edcf60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f223c00b8c0 tx=0x7f223c000ed0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.998+0000 7f224a32c700 1 -- 172.21.15.112:0/1889725299 reap_dead start 2023-11-08T12:29:51.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.998+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 shutdown_connections 2023-11-08T12:29:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.998+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 >> 172.21.15.112:0/1889725299 conn(0x563a85e08c30 msgr2=0x563a85e4e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.998+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 shutdown_connections 2023-11-08T12:29:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:50.998+0000 7f224bff6140 1 -- 172.21.15.112:0/1889725299 wait complete. 2023-11-08T12:29:51.022 INFO:teuthology.orchestra.run.smithi112.stdout:mytag 2023-11-08T12:29:51.023 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-11-08T12:29:51.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.090+0000 7f6ccc534140 1 Processor -- start 2023-11-08T12:29:51.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.090+0000 7f6ccc534140 1 -- start start 2023-11-08T12:29:51.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd56ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd4e2980 0x5620dd4fd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd56df40 0x5620dd587e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dd3d7240 con 0x5620dd4af700 2023-11-08T12:29:51.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dd6110f0 con 0x5620dd56df40 2023-11-08T12:29:51.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620dd56cb50 con 0x5620dd4e2980 2023-11-08T12:29:51.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd56ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd56ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50802/0 (socket says 172.21.15.112:50802) 2023-11-08T12:29:51.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 -- 172.21.15.112:0/3318363984 learned_addr learned my addr 172.21.15.112:0/3318363984 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cc9868700 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd4e2980 0x5620dd4fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 -- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd4e2980 msgr2=0x5620dd4fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:51.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd4e2980 0x5620dd4fd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 -- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd56df40 msgr2=0x5620dd587e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:51.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd56df40 0x5620dd587e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 -- 172.21.15.112:0/3318363984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc005d20 con 0x5620dd4af700 2023-11-08T12:29:51.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cc9868700 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd4e2980 0x5620dd4fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:51.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cca069700 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd56ece0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x5620dd4b81c0 tx=0x7f6cbc00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e8dd18d27470e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cc8866700 1 -- 172.21.15.112:0/3318363984 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc008690 con 0x5620dd4af700 2023-11-08T12:29:51.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cc8866700 1 -- 172.21.15.112:0/3318363984 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc008960 con 0x5620dd4af700 2023-11-08T12:29:51.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6cc8866700 1 -- 172.21.15.112:0/3318363984 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc008cf0 con 0x5620dd4af700 2023-11-08T12:29:51.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- 172.21.15.112:0/3318363984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 msgr2=0x5620dd56ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd56ece0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x5620dd4b81c0 tx=0x7f6cbc00d000 comp rx=0 tx=0).stop 2023-11-08T12:29:51.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- 172.21.15.112:0/3318363984 shutdown_connections 2023-11-08T12:29:51.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd56df40 0x5620dd587e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd4e2980 0x5620dd4fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 --2- 172.21.15.112:0/3318363984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd56ece0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- 172.21.15.112:0/3318363984 >> 172.21.15.112:0/3318363984 conn(0x5620dd4b5c30 msgr2=0x5620dd4dfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- 172.21.15.112:0/3318363984 shutdown_connections 2023-11-08T12:29:51.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.094+0000 7f6ccc534140 1 -- 172.21.15.112:0/3318363984 wait complete. 2023-11-08T12:29:51.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 Processor -- start 2023-11-08T12:29:51.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 -- start start 2023-11-08T12:29:51.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd4dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd4e2980 0x5620dd570f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd56df40 0x5620dd587310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dd571460 con 0x5620dd4af700 2023-11-08T12:29:51.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dd4dd250 con 0x5620dd4e2980 2023-11-08T12:29:51.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6ccc534140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620dd4dd4f0 con 0x5620dd56df40 2023-11-08T12:29:51.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd4dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd4dcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50810/0 (socket says 172.21.15.112:50810) 2023-11-08T12:29:51.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 -- 172.21.15.112:0/2054356415 learned_addr learned my addr 172.21.15.112:0/2054356415 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cc9868700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd4e2980 0x5620dd570f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca86a700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd56df40 0x5620dd587310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 -- 172.21.15.112:0/2054356415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd56df40 msgr2=0x5620dd587310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5620dd56df40 0x5620dd587310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 -- 172.21.15.112:0/2054356415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd4e2980 msgr2=0x5620dd570f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd4e2980 0x5620dd570f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 -- 172.21.15.112:0/2054356415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620dd409760 con 0x5620dd4af700 2023-11-08T12:29:51.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cc9868700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620dd4e2980 0x5620dd570f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:51.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cca069700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd4dcc20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00ac00 tx=0x7f6cbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cbb7fe700 1 -- 172.21.15.112:0/2054356415 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc01c940 con 0x5620dd4af700 2023-11-08T12:29:51.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cbb7fe700 1 -- 172.21.15.112:0/2054356415 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc01cac0 con 0x5620dd4af700 2023-11-08T12:29:51.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.098+0000 7f6cbb7fe700 1 -- 172.21.15.112:0/2054356415 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc01ce70 con 0x5620dd4af700 2023-11-08T12:29:51.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.102+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5620dd3ef390 con 0x5620dd4af700 2023-11-08T12:29:51.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.102+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620dd3e28b0 con 0x5620dd4af700 2023-11-08T12:29:51.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.102+0000 7f6cbb7fe700 1 -- 172.21.15.112:0/2054356415 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6cbc035070 con 0x5620dd4af700 2023-11-08T12:29:51.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.102+0000 7f6cbb7fe700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cac063840 0x7f6cac065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.102+0000 7f6cbb7fe700 1 -- 172.21.15.112:0/2054356415 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6cbc083510 con 0x5620dd4af700 2023-11-08T12:29:51.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6cc9868700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cac063840 0x7f6cac065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x5620dd4d60f0 0x5620dd4d64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 --> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] -- osd_op(unknown.0.0:1 7.36 7:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x5620dd4d6a30 con 0x5620dd4d60f0 2023-11-08T12:29:51.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6cca86a700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x5620dd4d60f0 0x5620dd4d64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6cc9868700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cac063840 0x7f6cac065cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0004170 tx=0x7f6cc0000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6cca86a700 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x5620dd4d60f0 0x5620dd4d64f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6cca86a700 1 -- 172.21.15.112:0/2054356415 <== osd.0 v2:172.21.15.112:6801/35551 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f6cc400e5f0 con 0x5620dd4d60f0 2023-11-08T12:29:51.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x5620dd4d60f0 msgr2=0x5620dd4d64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x5620dd4d60f0 0x5620dd4d64f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cac063840 msgr2=0x7f6cac065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6cac063840 0x7f6cac065cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0004170 tx=0x7f6cc0000bc0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 msgr2=0x5620dd4dcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 --2- 172.21.15.112:0/2054356415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5620dd4af700 0x5620dd4dcc20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00ac00 tx=0x7f6cbc002fb0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6cca86a700 1 -- 172.21.15.112:0/2054356415 reap_dead start 2023-11-08T12:29:51.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 shutdown_connections 2023-11-08T12:29:51.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 >> 172.21.15.112:0/2054356415 conn(0x5620dd4b5c30 msgr2=0x5620dd589e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 shutdown_connections 2023-11-08T12:29:51.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.106+0000 7f6ccc534140 1 -- 172.21.15.112:0/2054356415 wait complete. 2023-11-08T12:29:51.122 INFO:teuthology.orchestra.run.smithi112.stdout:mytag 2023-11-08T12:29:51.123 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-11-08T12:29:51.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 Processor -- start 2023-11-08T12:29:51.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 -- start start 2023-11-08T12:29:51.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a06970 0x560c89a90f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c899b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a94960 0x560c899e7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c899b7780 con 0x560c89a06d40 2023-11-08T12:29:51.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c899b7a20 con 0x560c89a94960 2023-11-08T12:29:51.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99aef8140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c899b7cc0 con 0x560c89a06970 2023-11-08T12:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99022c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c899b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a06970 0x560c89a90f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa99922e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a94960 0x560c899e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a06970 0x560c89a90f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:41690/0 (socket says 172.21.15.112:41690) 2023-11-08T12:29:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 -- 172.21.15.112:0/2244082000 learned_addr learned my addr 172.21.15.112:0/2244082000 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 -- 172.21.15.112:0/2244082000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a94960 msgr2=0x560c899e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 --2- 172.21.15.112:0/2244082000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a94960 0x560c899e7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 -- 172.21.15.112:0/2244082000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 msgr2=0x560c899b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 --2- 172.21.15.112:0/2244082000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c899b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 -- 172.21.15.112:0/2244082000 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980005de0 con 0x560c89a06970 2023-11-08T12:29:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.186+0000 7fa998a2d700 1 --2- 172.21.15.112:0/2244082000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a06970 0x560c89a90f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9880096b0 tx=0x7fa9880099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=171f570f389c725a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa9937fe700 1 -- 172.21.15.112:0/2244082000 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988010820 con 0x560c89a06970 2023-11-08T12:29:51.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa9937fe700 1 -- 172.21.15.112:0/2244082000 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98800b050 con 0x560c89a06970 2023-11-08T12:29:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa9937fe700 1 -- 172.21.15.112:0/2244082000 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988010b80 con 0x560c89a06970 2023-11-08T12:29:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 -- 172.21.15.112:0/2244082000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a06970 msgr2=0x560c89a90f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 --2- 172.21.15.112:0/2244082000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a06970 0x560c89a90f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9880096b0 tx=0x7fa9880099c0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 -- 172.21.15.112:0/2244082000 shutdown_connections 2023-11-08T12:29:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 --2- 172.21.15.112:0/2244082000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a94960 0x560c899e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 --2- 172.21.15.112:0/2244082000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c899b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 --2- 172.21.15.112:0/2244082000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a06970 0x560c89a90f10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 -- 172.21.15.112:0/2244082000 >> 172.21.15.112:0/2244082000 conn(0x560c899bec30 msgr2=0x560c899ea5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 -- 172.21.15.112:0/2244082000 shutdown_connections 2023-11-08T12:29:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 -- 172.21.15.112:0/2244082000 wait complete. 2023-11-08T12:29:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 Processor -- start 2023-11-08T12:29:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.190+0000 7fa99aef8140 1 -- start start 2023-11-08T12:29:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a06970 0x560c89a8f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c89a8fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a94960 0x560c899fc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c89a8ff90 con 0x560c89a06d40 2023-11-08T12:29:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c899fd690 con 0x560c89a06970 2023-11-08T12:29:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c899fd930 con 0x560c89a94960 2023-11-08T12:29:51.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c89a8fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c89a8fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50846/0 (socket says 172.21.15.112:50846) 2023-11-08T12:29:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 -- 172.21.15.112:0/3596749435 learned_addr learned my addr 172.21.15.112:0/3596749435 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa998a2d700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a06970 0x560c89a8f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99922e700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a94960 0x560c899fc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 -- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a94960 msgr2=0x560c899fc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560c89a94960 0x560c899fc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 -- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a06970 msgr2=0x560c89a8f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c89a06970 0x560c89a8f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 -- 172.21.15.112:0/3596749435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880092e0 con 0x560c89a06d40 2023-11-08T12:29:51.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99022c700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c89a8fa50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa98000a4f0 tx=0x7fa980002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa9927fc700 1 -- 172.21.15.112:0/3596749435 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980026630 con 0x560c89a06d40 2023-11-08T12:29:51.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa9927fc700 1 -- 172.21.15.112:0/3596749435 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980021070 con 0x560c89a06d40 2023-11-08T12:29:51.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c89912760 con 0x560c89a06d40 2023-11-08T12:29:51.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa9927fc700 1 -- 172.21.15.112:0/3596749435 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980026990 con 0x560c89a06d40 2023-11-08T12:29:51.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.194+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c898f8390 con 0x560c89a06d40 2023-11-08T12:29:51.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.198+0000 7fa9927fc700 1 -- 172.21.15.112:0/3596749435 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa98002c020 con 0x560c89a06d40 2023-11-08T12:29:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.198+0000 7fa9927fc700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978063810 0x7fa978065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.198+0000 7fa9927fc700 1 -- 172.21.15.112:0/3596749435 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa9800828e0 con 0x560c89a06d40 2023-11-08T12:29:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.198+0000 7fa998a2d700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978063810 0x7fa978065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x560c899fd150 0x560c899ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 --> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] -- osd_op(unknown.0.0:1 7.19 7:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x560c899eaad0 con 0x560c899fd150 2023-11-08T12:29:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99922e700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x560c899fd150 0x560c899ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa998a2d700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978063810 0x7fa978065cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa988013040 tx=0x7fa98801b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99922e700 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x560c899fd150 0x560c899ffd40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99922e700 1 -- 172.21.15.112:0/3596749435 <== osd.6 v2:172.21.15.133:6816/35802 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fa9940076f0 con 0x560c899fd150 2023-11-08T12:29:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x560c899fd150 msgr2=0x560c899ffd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x560c899fd150 0x560c899ffd40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978063810 msgr2=0x7fa978065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa978063810 0x7fa978065cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa988013040 tx=0x7fa98801b040 comp rx=0 tx=0).stop 2023-11-08T12:29:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 msgr2=0x560c89a8fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 --2- 172.21.15.112:0/3596749435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560c89a06d40 0x560c89a8fa50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa98000a4f0 tx=0x7fa980002fb0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99922e700 1 -- 172.21.15.112:0/3596749435 reap_dead start 2023-11-08T12:29:51.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 shutdown_connections 2023-11-08T12:29:51.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 >> 172.21.15.112:0/3596749435 conn(0x560c899bec30 msgr2=0x560c89a90f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 shutdown_connections 2023-11-08T12:29:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.202+0000 7fa99aef8140 1 -- 172.21.15.112:0/3596749435 wait complete. 2023-11-08T12:29:51.216 INFO:teuthology.orchestra.run.smithi112.stdout:mytag 2023-11-08T12:29:51.216 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-11-08T12:29:51.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 Processor -- start 2023-11-08T12:29:51.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 -- start start 2023-11-08T12:29:51.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b0342b3700 0x55b0343748f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342e6980 0x55b034375850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b034371830 0x55b034375d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0341db240 con 0x55b0342e6980 2023-11-08T12:29:51.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0342b3cb0 con 0x55b034371830 2023-11-08T12:29:51.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce38ea7140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b034370c30 con 0x55b0342b3700 2023-11-08T12:29:51.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342e6980 0x55b034375850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342e6980 0x55b034375850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50850/0 (socket says 172.21.15.112:50850) 2023-11-08T12:29:51.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 -- 172.21.15.112:0/2675406092 learned_addr learned my addr 172.21.15.112:0/2675406092 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce371dd700 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b034371830 0x55b034375d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce369dc700 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b0342b3700 0x55b0343748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 -- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b0342b3700 msgr2=0x55b0343748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:51.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b0342b3700 0x55b0343748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 -- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b034371830 msgr2=0x55b034375d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:51.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b034371830 0x55b034375d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 -- 172.21.15.112:0/2675406092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c005de0 con 0x55b0342e6980 2023-11-08T12:29:51.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce371dd700 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b034371830 0x55b034375d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:51.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce361db700 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342e6980 0x55b034375850 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d956b8b6341fd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce351d9700 1 -- 172.21.15.112:0/2675406092 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c008b60 con 0x55b0342e6980 2023-11-08T12:29:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce351d9700 1 -- 172.21.15.112:0/2675406092 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c008cc0 con 0x55b0342e6980 2023-11-08T12:29:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.274+0000 7fce351d9700 1 -- 172.21.15.112:0/2675406092 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c012650 con 0x55b0342e6980 2023-11-08T12:29:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- 172.21.15.112:0/2675406092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342e6980 msgr2=0x55b034375850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342e6980 0x55b034375850 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c00d000 comp rx=0 tx=0).stop 2023-11-08T12:29:51.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- 172.21.15.112:0/2675406092 shutdown_connections 2023-11-08T12:29:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b034371830 0x55b034375d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342e6980 0x55b034375850 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 --2- 172.21.15.112:0/2675406092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b0342b3700 0x55b0343748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- 172.21.15.112:0/2675406092 >> 172.21.15.112:0/2675406092 conn(0x55b0342b9c30 msgr2=0x55b034373f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- 172.21.15.112:0/2675406092 shutdown_connections 2023-11-08T12:29:51.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- 172.21.15.112:0/2675406092 wait complete. 2023-11-08T12:29:51.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 Processor -- start 2023-11-08T12:29:51.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- start start 2023-11-08T12:29:51.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342b3700 0x55b0343606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0342e6980 0x55b0342e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b034371830 0x55b034363b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034360ce0 con 0x55b0342b3700 2023-11-08T12:29:51.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b034360f80 con 0x55b0342e6980 2023-11-08T12:29:51.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce38ea7140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b034361220 con 0x55b034371830 2023-11-08T12:29:51.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce369dc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342b3700 0x55b0343606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce369dc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342b3700 0x55b0343606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50854/0 (socket says 172.21.15.112:50854) 2023-11-08T12:29:51.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce369dc700 1 -- 172.21.15.112:0/1748341345 learned_addr learned my addr 172.21.15.112:0/1748341345 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.278+0000 7fce371dd700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b034371830 0x55b034363b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce361db700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0342e6980 0x55b0342e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce369dc700 1 -- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b034371830 msgr2=0x55b034363b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce369dc700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b034371830 0x55b034363b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce369dc700 1 -- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0342e6980 msgr2=0x55b0342e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce369dc700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0342e6980 0x55b0342e34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce369dc700 1 -- 172.21.15.112:0/1748341345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b03420d760 con 0x55b0342b3700 2023-11-08T12:29:51.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce369dc700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342b3700 0x55b0343606b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fce2800f6a0 tx=0x7fce2800fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce1ffff700 1 -- 172.21.15.112:0/1748341345 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28015690 con 0x55b0342b3700 2023-11-08T12:29:51.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce1ffff700 1 -- 172.21.15.112:0/1748341345 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce280157f0 con 0x55b0342b3700 2023-11-08T12:29:51.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0341f3390 con 0x55b0342b3700 2023-11-08T12:29:51.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce1ffff700 1 -- 172.21.15.112:0/1748341345 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28015b80 con 0x55b0342b3700 2023-11-08T12:29:51.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0341e68b0 con 0x55b0342b3700 2023-11-08T12:29:51.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.282+0000 7fce1ffff700 1 -- 172.21.15.112:0/1748341345 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fce28015ce0 con 0x55b0342b3700 2023-11-08T12:29:51.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.286+0000 7fce1ffff700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce24063840 0x7fce24065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.286+0000 7fce1ffff700 1 -- 172.21.15.112:0/1748341345 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fce28081790 con 0x55b0342b3700 2023-11-08T12:29:51.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.286+0000 7fce361db700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce24063840 0x7fce24065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.286+0000 7fce38ea7140 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x55b0342e3a10 0x55b0342dec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.286+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 --> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] -- osd_op(unknown.0.0:1 7.12 7:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55b034364080 con 0x55b0342e3a10 2023-11-08T12:29:51.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.286+0000 7fce371dd700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x55b0342e3a10 0x55b0342dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.286+0000 7fce361db700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce24063840 0x7fce24065cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fce2c021000 tx=0x7fce2c008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce371dd700 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x55b0342e3a10 0x55b0342dec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce371dd700 1 -- 172.21.15.112:0/1748341345 <== osd.6 v2:172.21.15.133:6816/35802 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fce3000f490 con 0x55b0342e3a10 2023-11-08T12:29:51.299 INFO:teuthology.orchestra.run.smithi112.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-11-08T12:29:51.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x55b0342e3a10 msgr2=0x55b0342dec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x55b0342e3a10 0x55b0342dec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce24063840 msgr2=0x7fce24065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce24063840 0x7fce24065cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fce2c021000 tx=0x7fce2c008000 comp rx=0 tx=0).stop 2023-11-08T12:29:51.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342b3700 msgr2=0x55b0343606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 --2- 172.21.15.112:0/1748341345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b0342b3700 0x55b0343606b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fce2800f6a0 tx=0x7fce2800fa60 comp rx=0 tx=0).stop 2023-11-08T12:29:51.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce371dd700 1 -- 172.21.15.112:0/1748341345 reap_dead start 2023-11-08T12:29:51.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 shutdown_connections 2023-11-08T12:29:51.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 >> 172.21.15.112:0/1748341345 conn(0x55b0342b9c30 msgr2=0x55b034373d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 shutdown_connections 2023-11-08T12:29:51.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.290+0000 7fce38ea7140 1 -- 172.21.15.112:0/1748341345 wait complete. 2023-11-08T12:29:51.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:29:51.302 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T12:29:51.303 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:29:51.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:29:51.385 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T12:29:51.386 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:29:51.387 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:51.412 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:29:51.413 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:29:51.413 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:51.452 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:29:51.453 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:29:51.453 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:51.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:29:51.473 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:29:51.474 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:29:51.512 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:29:51.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:51.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.690+0000 7fbc92fb7700 1 Processor -- start 2023-11-08T12:29:51.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.690+0000 7fbc92fb7700 1 -- start start 2023-11-08T12:29:51.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.690+0000 7fbc92fb7700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbc8c066b40 0x7fbc8c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.690+0000 7fbc92fb7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c0ce120 0x7fbc8c06a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.690+0000 7fbc92fb7700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c0718f0 con 0x7fbc8c15bd60 2023-11-08T12:29:51.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.690+0000 7fbc92fb7700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c0cb420 con 0x7fbc8c066b40 2023-11-08T12:29:51.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.690+0000 7fbc92fb7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c070850 con 0x7fbc8c0ce120 2023-11-08T12:29:51.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc91fb5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbc8c066b40 0x7fbc8c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc927b6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbc8c15bd60 0x7fbc8c0b19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38852/0 (socket says 172.21.15.112:38852) 2023-11-08T12:29:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc927b6700 1 -- 172.21.15.112:0/235040503 learned_addr learned my addr 172.21.15.112:0/235040503 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc917b4700 1 --2- 172.21.15.112:0/235040503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c0ce120 0x7fbc8c06a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc91fb5700 1 -- 172.21.15.112:0/235040503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c0ce120 msgr2=0x7fbc8c06a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc91fb5700 1 --2- 172.21.15.112:0/235040503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c0ce120 0x7fbc8c06a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc91fb5700 1 -- 172.21.15.112:0/235040503 >> v1:172.21.15.112:6789/0 conn(0x7fbc8c15bd60 legacy=0x7fbc8c0b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc91fb5700 1 -- 172.21.15.112:0/235040503 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c070b30 con 0x7fbc8c066b40 2023-11-08T12:29:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc90fb3700 1 -- 172.21.15.112:0/235040503 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817539910 0 0) 0x7fbc8c0718f0 con 0x7fbc8c15bd60 2023-11-08T12:29:51.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc91fb5700 1 --2- 172.21.15.112:0/235040503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c066b40 0x7fbc8c069bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009dc0 tx=0x7fbc8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478b94661b4a6778 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc90fb3700 1 -- 172.21.15.112:0/235040503 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800e070 con 0x7fbc8c066b40 2023-11-08T12:29:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc90fb3700 1 -- 172.21.15.112:0/235040503 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800bae0 con 0x7fbc8c066b40 2023-11-08T12:29:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc90fb3700 1 -- 172.21.15.112:0/235040503 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800be90 con 0x7fbc8c066b40 2023-11-08T12:29:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc92fb7700 1 -- 172.21.15.112:0/235040503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c066b40 msgr2=0x7fbc8c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/235040503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c066b40 0x7fbc8c069bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009dc0 tx=0x7fbc8800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:51.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc92fb7700 1 -- 172.21.15.112:0/235040503 shutdown_connections 2023-11-08T12:29:51.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/235040503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c0ce120 0x7fbc8c06a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/235040503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c066b40 0x7fbc8c069bf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.694+0000 7fbc92fb7700 1 -- 172.21.15.112:0/235040503 >> 172.21.15.112:0/235040503 conn(0x7fbc8c0b06a0 msgr2=0x7fbc8c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.698+0000 7fbc92fb7700 1 -- 172.21.15.112:0/235040503 shutdown_connections 2023-11-08T12:29:51.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.698+0000 7fbc92fb7700 1 -- 172.21.15.112:0/235040503 wait complete. 2023-11-08T12:29:51.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.698+0000 7fbc92fb7700 1 Processor -- start 2023-11-08T12:29:51.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.698+0000 7fbc92fb7700 1 -- start start 2023-11-08T12:29:51.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c066b40 0x7fbc8c143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c0ce120 0x7fbc8c1279c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc8c15bd60 0x7fbc8c129a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c145420 con 0x7fbc8c0ce120 2023-11-08T12:29:51.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c12a4a0 con 0x7fbc8c15bd60 2023-11-08T12:29:51.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c12a780 con 0x7fbc8c066b40 2023-11-08T12:29:51.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c0ce120 0x7fbc8c1279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c0ce120 0x7fbc8c1279c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50870/0 (socket says 172.21.15.112:50870) 2023-11-08T12:29:51.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 -- 172.21.15.112:0/3096981630 learned_addr learned my addr 172.21.15.112:0/3096981630 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:51.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc91fb5700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c066b40 0x7fbc8c143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc927b6700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc8c15bd60 0x7fbc8c129a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 -- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c066b40 msgr2=0x7fbc8c143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c066b40 0x7fbc8c143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 -- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc8c15bd60 msgr2=0x7fbc8c129a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc8c15bd60 0x7fbc8c129a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 -- 172.21.15.112:0/3096981630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc88009a70 con 0x7fbc8c0ce120 2023-11-08T12:29:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc927b6700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc8c15bd60 0x7fbc8c129a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc917b4700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c0ce120 0x7fbc8c1279c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00e840 tx=0x7fbc7c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc827fc700 1 -- 172.21.15.112:0/3096981630 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0095a0 con 0x7fbc8c0ce120 2023-11-08T12:29:51.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc827fc700 1 -- 172.21.15.112:0/3096981630 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c013680 con 0x7fbc8c0ce120 2023-11-08T12:29:51.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc827fc700 1 -- 172.21.15.112:0/3096981630 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0139f0 con 0x7fbc8c0ce120 2023-11-08T12:29:51.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c0710f0 con 0x7fbc8c0ce120 2023-11-08T12:29:51.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.702+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c070e10 con 0x7fbc8c0ce120 2023-11-08T12:29:51.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.706+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c0713d0 con 0x7fbc8c0ce120 2023-11-08T12:29:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.706+0000 7fbc827fc700 1 -- 172.21.15.112:0/3096981630 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbc7c019030 con 0x7fbc8c0ce120 2023-11-08T12:29:51.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.710+0000 7fbc827fc700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc70064ee0 0x7fbc70067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.710+0000 7fbc827fc700 1 -- 172.21.15.112:0/3096981630 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbc7c081e00 con 0x7fbc8c0ce120 2023-11-08T12:29:51.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.710+0000 7fbc91fb5700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc70064ee0 0x7fbc70067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:51.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.710+0000 7fbc91fb5700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc70064ee0 0x7fbc70067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc88014040 tx=0x7fbc88011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:51.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.714+0000 7fbc827fc700 1 -- 172.21.15.112:0/3096981630 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbc7c04fdc0 con 0x7fbc8c0ce120 2023-11-08T12:29:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.922+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc8c073cb0 con 0x7fbc8c0ce120 2023-11-08T12:29:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.922+0000 7fbc827fc700 1 -- 172.21.15.112:0/3096981630 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fbc7c0533e0 con 0x7fbc8c0ce120 2023-11-08T12:29:51.930 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:51.930 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc70064ee0 msgr2=0x7fbc70067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc70064ee0 0x7fbc70067390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc88014040 tx=0x7fbc88011000 comp rx=0 tx=0).stop 2023-11-08T12:29:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c0ce120 msgr2=0x7fbc8c1279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c0ce120 0x7fbc8c1279c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00e840 tx=0x7fbc7c00eb50 comp rx=0 tx=0).stop 2023-11-08T12:29:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 shutdown_connections 2023-11-08T12:29:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbc70064ee0 0x7fbc70067390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc8c15bd60 0x7fbc8c129a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc8c0ce120 0x7fbc8c1279c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 --2- 172.21.15.112:0/3096981630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc8c066b40 0x7fbc8c143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:51.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 >> 172.21.15.112:0/3096981630 conn(0x7fbc8c0b06a0 msgr2=0x7fbc8c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:51.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 shutdown_connections 2023-11-08T12:29:51.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:51.926+0000 7fbc92fb7700 1 -- 172.21.15.112:0/3096981630 wait complete. 2023-11-08T12:29:51.935 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:51.953 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:52.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f897a862700 1 Processor -- start 2023-11-08T12:29:52.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f897a862700 1 -- start start 2023-11-08T12:29:52.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f897a862700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89741604b0 0x7f89740b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f897a862700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8974160880 0x7f89740b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f897a862700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89740ce430 con 0x7f89740b3bb0 2023-11-08T12:29:52.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f897a862700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89740cbcd0 con 0x7f8974160880 2023-11-08T12:29:52.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f897a862700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89740cb710 con 0x7f89741604b0 2023-11-08T12:29:52.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f89737fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8974160880 0x7f89740b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f89737fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8974160880 0x7f89740b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50878/0 (socket says 172.21.15.112:50878) 2023-11-08T12:29:52.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f89737fe700 1 -- 172.21.15.112:0/3606047839 learned_addr learned my addr 172.21.15.112:0/3606047839 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:52.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f8973fff700 1 --2- 172.21.15.112:0/3606047839 >> v2:172.21.15.133:3300/0 conn(0x7f89741604b0 0x7f89740b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f89737fe700 1 -- 172.21.15.112:0/3606047839 >> v2:172.21.15.133:3300/0 conn(0x7f89741604b0 msgr2=0x7f89740b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:52.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f89737fe700 1 --2- 172.21.15.112:0/3606047839 >> v2:172.21.15.133:3300/0 conn(0x7f89741604b0 0x7f89740b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f89737fe700 1 -- 172.21.15.112:0/3606047839 >> v1:172.21.15.112:6789/0 conn(0x7f89740b3bb0 legacy=0x7f89740cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f89737fe700 1 -- 172.21.15.112:0/3606047839 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89740cb9f0 con 0x7f8974160880 2023-11-08T12:29:52.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.118+0000 7f8973fff700 1 --2- 172.21.15.112:0/3606047839 >> v2:172.21.15.133:3300/0 conn(0x7f89741604b0 0x7f89740b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:52.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f89737fe700 1 --2- 172.21.15.112:0/3606047839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740b1b30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89740b2c60 tx=0x7f895c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59ff7f8fc25742e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f8972ffd700 1 -- 172.21.15.112:0/3606047839 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00b8a0 con 0x7f8974160880 2023-11-08T12:29:52.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f8972ffd700 1 -- 172.21.15.112:0/3606047839 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00ba00 con 0x7f8974160880 2023-11-08T12:29:52.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f8972ffd700 1 -- 172.21.15.112:0/3606047839 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00bd90 con 0x7f8974160880 2023-11-08T12:29:52.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 -- 172.21.15.112:0/3606047839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 msgr2=0x7f89740b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 --2- 172.21.15.112:0/3606047839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740b1b30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89740b2c60 tx=0x7f895c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 -- 172.21.15.112:0/3606047839 shutdown_connections 2023-11-08T12:29:52.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 --2- 172.21.15.112:0/3606047839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740b1b30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 --2- 172.21.15.112:0/3606047839 >> v2:172.21.15.133:3300/0 conn(0x7f89741604b0 0x7f89740b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 -- 172.21.15.112:0/3606047839 >> 172.21.15.112:0/3606047839 conn(0x7f89740ccb30 msgr2=0x7f89740ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:52.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 -- 172.21.15.112:0/3606047839 shutdown_connections 2023-11-08T12:29:52.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.122+0000 7f897a862700 1 -- 172.21.15.112:0/3606047839 wait complete. 2023-11-08T12:29:52.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 Processor -- start 2023-11-08T12:29:52.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 -- start start 2023-11-08T12:29:52.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89740b3bb0 0x7f89740b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89741604b0 0x7f89741f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740b2530 con 0x7f8974160880 2023-11-08T12:29:52.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740b2810 con 0x7f89741604b0 2023-11-08T12:29:52.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f897a862700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89741615e0 con 0x7f89740b3bb0 2023-11-08T12:29:52.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f8979600700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f8979600700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50888/0 (socket says 172.21.15.112:50888) 2023-11-08T12:29:52.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f8979600700 1 -- 172.21.15.112:0/1989943744 learned_addr learned my addr 172.21.15.112:0/1989943744 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:52.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.126+0000 7f89737fe700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89741604b0 0x7f89741f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8979600700 1 -- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89740b3bb0 msgr2=0x7f89740b1c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-08T12:29:52.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8979600700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89740b3bb0 0x7f89740b1c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8979600700 1 -- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89741604b0 msgr2=0x7f89741f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8979600700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89741604b0 0x7f89741f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8979600700 1 -- 172.21.15.112:0/1989943744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009570 con 0x7f8974160880 2023-11-08T12:29:52.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f89737fe700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89741604b0 0x7f89741f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:52.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8979600700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740c5db0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f896c00cc50 tx=0x7f896c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8970ff9700 1 -- 172.21.15.112:0/1989943744 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c00ad80 con 0x7f8974160880 2023-11-08T12:29:52.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8970ff9700 1 -- 172.21.15.112:0/1989943744 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c00ce50 con 0x7f8974160880 2023-11-08T12:29:52.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8970ff9700 1 -- 172.21.15.112:0/1989943744 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c003c60 con 0x7f8974160880 2023-11-08T12:29:52.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89740cef10 con 0x7f8974160880 2023-11-08T12:29:52.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89740cec30 con 0x7f8974160880 2023-11-08T12:29:52.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89740cb240 con 0x7f8974160880 2023-11-08T12:29:52.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.130+0000 7f8970ff9700 1 -- 172.21.15.112:0/1989943744 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f896c010050 con 0x7f8974160880 2023-11-08T12:29:52.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.134+0000 7f8970ff9700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8954064ee0 0x7f8954067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.134+0000 7f8970ff9700 1 -- 172.21.15.112:0/1989943744 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f896c081e30 con 0x7f8974160880 2023-11-08T12:29:52.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.134+0000 7f8973fff700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8954064ee0 0x7f8954067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.134+0000 7f8973fff700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8954064ee0 0x7f8954067390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8964006fd0 tx=0x7f8964008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.138+0000 7f8970ff9700 1 -- 172.21.15.112:0/1989943744 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f896c04fe50 con 0x7f8974160880 2023-11-08T12:29:52.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.318+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8974161440 con 0x7f8974160880 2023-11-08T12:29:52.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f8970ff9700 1 -- 172.21.15.112:0/1989943744 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18232 (secure 0 0 0) 0x7f8974161440 con 0x7f8974160880 2023-11-08T12:29:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:52.327 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:36.882358+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:29:19.858911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-08T12:29:20.777517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:52.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8954064ee0 msgr2=0x7f8954067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8954064ee0 0x7f8954067390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8964006fd0 tx=0x7f8964008040 comp rx=0 tx=0).stop 2023-11-08T12:29:52.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 msgr2=0x7f89740c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740c5db0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f896c00cc50 tx=0x7f896c00a340 comp rx=0 tx=0).stop 2023-11-08T12:29:52.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 shutdown_connections 2023-11-08T12:29:52.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8954064ee0 0x7f8954067390 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8974160880 0x7f89740c5db0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89741604b0 0x7f89741f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 --2- 172.21.15.112:0/1989943744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89740b3bb0 0x7f89740b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.322+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 >> 172.21.15.112:0/1989943744 conn(0x7f89740ccb30 msgr2=0x7f89740b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:52.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.326+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 shutdown_connections 2023-11-08T12:29:52.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.326+0000 7f897a862700 1 -- 172.21.15.112:0/1989943744 wait complete. 2023-11-08T12:29:52.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:29:19.858911+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:29:20.777517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:29:52.355 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:29:52.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.526+0000 7f825ebb4700 1 Processor -- start 2023-11-08T12:29:52.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.526+0000 7f825ebb4700 1 -- start start 2023-11-08T12:29:52.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825ebb4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8258070620 0x7f82580b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825ebb4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825815c520 con 0x7f825815c150 2023-11-08T12:29:52.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825ebb4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825806cc50 con 0x7f8258069bf0 2023-11-08T12:29:52.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825dbb2700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f825815c150 0x7f825806ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38876/0 (socket says 172.21.15.112:38876) 2023-11-08T12:29:52.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825dbb2700 1 -- 172.21.15.112:0/2302586738 learned_addr learned my addr 172.21.15.112:0/2302586738 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:52.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825ebb4700 1 -- 172.21.15.112:0/2302586738 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580b4240 con 0x7f8258070620 2023-11-08T12:29:52.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825d3b1700 1 --2- 172.21.15.112:0/2302586738 >> v2:172.21.15.133:3300/0 conn(0x7f8258070620 0x7f82580b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273884070 0 0) 0x7f825815c520 con 0x7f825815c150 2023-11-08T12:29:52.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82440035d0 con 0x7f825815c150 2023-11-08T12:29:52.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313465500 0 0) 0x7f825806cc50 con 0x7f8258069bf0 2023-11-08T12:29:52.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f825815c520 con 0x7f8258069bf0 2023-11-08T12:29:52.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825d3b1700 1 -- 172.21.15.112:0/2302586738 >> v1:172.21.15.133:6789/0 conn(0x7f8258069bf0 legacy=0x7f8258069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825d3b1700 1 -- 172.21.15.112:0/2302586738 >> v1:172.21.15.112:6789/0 conn(0x7f825815c150 legacy=0x7f825806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636568736 0 0) 0x7f82440035d0 con 0x7f825815c150 2023-11-08T12:29:52.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.530+0000 7f825d3b1700 1 -- 172.21.15.112:0/2302586738 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580d2450 con 0x7f8258070620 2023-11-08T12:29:52.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825d3b1700 1 --2- 172.21.15.112:0/2302586738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 0x7f82580b3d00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8248009840 tx=0x7f8248009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99f1ca17ba511c64 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254001670 con 0x7f8258070620 2023-11-08T12:29:52.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248004030 con 0x7f8258070620 2023-11-08T12:29:52.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825cbb0700 1 -- 172.21.15.112:0/2302586738 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480043c0 con 0x7f8258070620 2023-11-08T12:29:52.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825ebb4700 1 -- 172.21.15.112:0/2302586738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 msgr2=0x7f82580b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825ebb4700 1 --2- 172.21.15.112:0/2302586738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 0x7f82580b3d00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8248009840 tx=0x7f8248009b50 comp rx=0 tx=0).stop 2023-11-08T12:29:52.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825ebb4700 1 -- 172.21.15.112:0/2302586738 shutdown_connections 2023-11-08T12:29:52.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825ebb4700 1 --2- 172.21.15.112:0/2302586738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 0x7f82580b3d00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825ebb4700 1 -- 172.21.15.112:0/2302586738 >> 172.21.15.112:0/2302586738 conn(0x7f82580d3680 msgr2=0x7f82580cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:52.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825ebb4700 1 -- 172.21.15.112:0/2302586738 shutdown_connections 2023-11-08T12:29:52.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.534+0000 7f825ebb4700 1 -- 172.21.15.112:0/2302586738 wait complete. 2023-11-08T12:29:52.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 Processor -- start 2023-11-08T12:29:52.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 -- start start 2023-11-08T12:29:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8258069bf0 0x7f82580c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 0x7f8258152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f825815c150 0x7f82580b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580ccfa0 con 0x7f825815c150 2023-11-08T12:29:52.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580b40a0 con 0x7f8258070620 2023-11-08T12:29:52.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8258153470 con 0x7f8258069bf0 2023-11-08T12:29:52.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f825815c150 0x7f82580b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f825815c150 0x7f82580b7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50892/0 (socket says 172.21.15.112:50892) 2023-11-08T12:29:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 -- 172.21.15.112:0/3681690475 learned_addr learned my addr 172.21.15.112:0/3681690475 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825d3b1700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 0x7f8258152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825dbb2700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8258069bf0 0x7f82580c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 -- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8258069bf0 msgr2=0x7f82580c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8258069bf0 0x7f82580c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 -- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 msgr2=0x7f8258152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 0x7f8258152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 -- 172.21.15.112:0/3681690475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8248009450 con 0x7f825815c150 2023-11-08T12:29:52.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825e3b3700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f825815c150 0x7f82580b7b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f825000cc20 tx=0x7f825000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f824e7fc700 1 -- 172.21.15.112:0/3681690475 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250003c20 con 0x7f825815c150 2023-11-08T12:29:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f824e7fc700 1 -- 172.21.15.112:0/3681690475 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250003d80 con 0x7f825815c150 2023-11-08T12:29:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82580d05e0 con 0x7f825815c150 2023-11-08T12:29:52.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f824e7fc700 1 -- 172.21.15.112:0/3681690475 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000aa80 con 0x7f825815c150 2023-11-08T12:29:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.538+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82580d2730 con 0x7f825815c150 2023-11-08T12:29:52.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.542+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82580d2140 con 0x7f825815c150 2023-11-08T12:29:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.542+0000 7f824e7fc700 1 -- 172.21.15.112:0/3681690475 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8250010050 con 0x7f825815c150 2023-11-08T12:29:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.546+0000 7f824e7fc700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f823c064ee0 0x7f823c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.546+0000 7f824e7fc700 1 -- 172.21.15.112:0/3681690475 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8250081fe0 con 0x7f825815c150 2023-11-08T12:29:52.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.546+0000 7f825dbb2700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f823c064ee0 0x7f823c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.546+0000 7f825dbb2700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f823c064ee0 0x7f823c067390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f82540017a0 tx=0x7f8254001670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.550+0000 7f824e7fc700 1 -- 172.21.15.112:0/3681690475 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f825004ff10 con 0x7f825815c150 2023-11-08T12:29:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.722+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8258073d20 con 0x7f825815c150 2023-11-08T12:29:52.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.722+0000 7f824e7fc700 1 -- 172.21.15.112:0/3681690475 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8250053530 con 0x7f825815c150 2023-11-08T12:29:52.727 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:29:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.722+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f823c064ee0 msgr2=0x7f823c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.722+0000 7f825ebb4700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f823c064ee0 0x7f823c067390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f82540017a0 tx=0x7f8254001670 comp rx=0 tx=0).stop 2023-11-08T12:29:52.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.722+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f825815c150 msgr2=0x7f82580b7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.722+0000 7f825ebb4700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f825815c150 0x7f82580b7b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f825000cc20 tx=0x7f825000cf30 comp rx=0 tx=0).stop 2023-11-08T12:29:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 shutdown_connections 2023-11-08T12:29:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f823c064ee0 0x7f823c067390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f825815c150 0x7f82580b7b20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8258070620 0x7f8258152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 --2- 172.21.15.112:0/3681690475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8258069bf0 0x7f82580c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 >> 172.21.15.112:0/3681690475 conn(0x7f82580d3680 msgr2=0x7f8258155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 shutdown_connections 2023-11-08T12:29:52.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.726+0000 7f825ebb4700 1 -- 172.21.15.112:0/3681690475 wait complete. 2023-11-08T12:29:52.755 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:29:52.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.926+0000 7f915dc8c700 1 Processor -- start 2023-11-08T12:29:52.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.926+0000 7f915dc8c700 1 -- start start 2023-11-08T12:29:52.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915dc8c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f915815e190 0x7f91580cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915dc8c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9158161560 0x7f9158069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915dc8c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915dc8c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580708d0 con 0x7f9158161560 2023-11-08T12:29:52.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915dc8c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915815e560 con 0x7f915815e190 2023-11-08T12:29:52.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915dc8c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915806be80 con 0x7f915806ff10 2023-11-08T12:29:52.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f915815e190 0x7f91580cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f915815e190 0x7f91580cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:47880/0 (socket says 172.21.15.112:47880) 2023-11-08T12:29:52.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 -- 172.21.15.112:0/3405436109 learned_addr learned my addr 172.21.15.112:0/3405436109 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:52.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f9157fff700 1 --2- 172.21.15.112:0/3405436109 >> v2:172.21.15.112:3300/0 conn(0x7f9158161560 0x7f9158069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915d48b700 1 --2- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 -- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 msgr2=0x7f9158070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 --2- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 -- 172.21.15.112:0/3405436109 >> v2:172.21.15.112:3300/0 conn(0x7f9158161560 msgr2=0x7f9158069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 --2- 172.21.15.112:0/3405436109 >> v2:172.21.15.112:3300/0 conn(0x7f9158161560 0x7f9158069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 -- 172.21.15.112:0/3405436109 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91580ce330 con 0x7f915815e190 2023-11-08T12:29:52.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f915cc8a700 1 --2- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580cdc50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91580cb9b0 tx=0x7f914c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c00e33fec8bbe77 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f91577fe700 1 -- 172.21.15.112:0/3405436109 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c011830 con 0x7f915815e190 2023-11-08T12:29:52.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f91577fe700 1 -- 172.21.15.112:0/3405436109 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c011990 con 0x7f915815e190 2023-11-08T12:29:52.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.930+0000 7f91577fe700 1 -- 172.21.15.112:0/3405436109 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c011d20 con 0x7f915815e190 2023-11-08T12:29:52.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 -- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 msgr2=0x7f91580cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 --2- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580cdc50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91580cb9b0 tx=0x7f914c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 -- 172.21.15.112:0/3405436109 shutdown_connections 2023-11-08T12:29:52.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 --2- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 --2- 172.21.15.112:0/3405436109 >> v2:172.21.15.112:3300/0 conn(0x7f9158161560 0x7f9158069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 --2- 172.21.15.112:0/3405436109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580cdc50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 -- 172.21.15.112:0/3405436109 >> 172.21.15.112:0/3405436109 conn(0x7f91580cf280 msgr2=0x7f91580cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 -- 172.21.15.112:0/3405436109 shutdown_connections 2023-11-08T12:29:52.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 -- 172.21.15.112:0/3405436109 wait complete. 2023-11-08T12:29:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 Processor -- start 2023-11-08T12:29:52.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.934+0000 7f915dc8c700 1 -- start start 2023-11-08T12:29:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158161560 0x7f91580c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91580b3c30 con 0x7f9158161560 2023-11-08T12:29:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581619b0 con 0x7f915815e190 2023-11-08T12:29:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9158152fb0 con 0x7f915806ff10 2023-11-08T12:29:52.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158161560 0x7f91580c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158161560 0x7f91580c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50910/0 (socket says 172.21.15.112:50910) 2023-11-08T12:29:52.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 -- 172.21.15.112:0/142395430 learned_addr learned my addr 172.21.15.112:0/142395430 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:52.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f9157fff700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915cc8a700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 -- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 msgr2=0x7f9158152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 -- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 msgr2=0x7f91580b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:52.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:52.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 -- 172.21.15.112:0/142395430 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009570 con 0x7f9158161560 2023-11-08T12:29:52.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f9157fff700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:52.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915d48b700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158161560 0x7f91580c6070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9150007e40 tx=0x7f915000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f91557fa700 1 -- 172.21.15.112:0/142395430 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000ed30 con 0x7f9158161560 2023-11-08T12:29:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f91557fa700 1 -- 172.21.15.112:0/142395430 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150014420 con 0x7f9158161560 2023-11-08T12:29:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91580afc70 con 0x7f9158161560 2023-11-08T12:29:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f91557fa700 1 -- 172.21.15.112:0/142395430 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500147d0 con 0x7f9158161560 2023-11-08T12:29:52.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.938+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91580af990 con 0x7f9158161560 2023-11-08T12:29:52.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.942+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91580aff50 con 0x7f9158161560 2023-11-08T12:29:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.942+0000 7f91557fa700 1 -- 172.21.15.112:0/142395430 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9150012050 con 0x7f9158161560 2023-11-08T12:29:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.946+0000 7f91557fa700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f913c064ee0 0x7f913c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.946+0000 7f91557fa700 1 -- 172.21.15.112:0/142395430 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9150082500 con 0x7f9158161560 2023-11-08T12:29:52.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.946+0000 7f915cc8a700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f913c064ee0 0x7f913c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:52.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.946+0000 7f915cc8a700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f913c064ee0 0x7f913c067390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f914c000c00 tx=0x7f914c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:52.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:52.950+0000 7f91557fa700 1 -- 172.21.15.112:0/142395430 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9150050520 con 0x7f9158161560 2023-11-08T12:29:53.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.122+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9158073d20 con 0x7f9158161560 2023-11-08T12:29:53.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.126+0000 7f91557fa700 1 -- 172.21.15.112:0/142395430 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9150053b40 con 0x7f9158161560 2023-11-08T12:29:53.130 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:29:53.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.126+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f913c064ee0 msgr2=0x7f913c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.126+0000 7f915dc8c700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f913c064ee0 0x7f913c067390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f914c000c00 tx=0x7f914c008030 comp rx=0 tx=0).stop 2023-11-08T12:29:53.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.126+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158161560 msgr2=0x7f91580c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.126+0000 7f915dc8c700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158161560 0x7f91580c6070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9150007e40 tx=0x7f915000e3c0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 shutdown_connections 2023-11-08T12:29:53.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f913c064ee0 0x7f913c067390 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158161560 0x7f91580c6070 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915815e190 0x7f91580b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 --2- 172.21.15.112:0/142395430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915806ff10 0x7f9158152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 >> 172.21.15.112:0/142395430 conn(0x7f91580cf280 msgr2=0x7f91580c4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:53.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 shutdown_connections 2023-11-08T12:29:53.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.130+0000 7f915dc8c700 1 -- 172.21.15.112:0/142395430 wait complete. 2023-11-08T12:29:53.157 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:29:53.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.342+0000 7fe259682700 1 Processor -- start 2023-11-08T12:29:53.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.342+0000 7fe259682700 1 -- start start 2023-11-08T12:29:53.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe259682700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe254167100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe259682700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540cd080 con 0x7fe25415c310 2023-11-08T12:29:53.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe259682700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540d21a0 con 0x7fe2540d1310 2023-11-08T12:29:53.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe259682700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25406d240 con 0x7fe2540707d0 2023-11-08T12:29:53.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe252ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe25415c310 0x7fe25406b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38892/0 (socket says 172.21.15.112:38892) 2023-11-08T12:29:53.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe252ffd700 1 -- 172.21.15.112:0/4235738900 learned_addr learned my addr 172.21.15.112:0/4235738900 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:53.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe2537fe700 1 --2- 172.21.15.112:0/4235738900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe254167100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe251ffb700 1 -- 172.21.15.112:0/4235738900 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634229439 0 0) 0x7fe2540cd080 con 0x7fe25415c310 2023-11-08T12:29:53.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe251ffb700 1 -- 172.21.15.112:0/4235738900 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe23c0035d0 con 0x7fe25415c310 2023-11-08T12:29:53.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe251ffb700 1 -- 172.21.15.112:0/4235738900 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932124977 0 0) 0x7fe2540d21a0 con 0x7fe2540d1310 2023-11-08T12:29:53.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe2537fe700 1 -- 172.21.15.112:0/4235738900 >> v1:172.21.15.133:6789/0 conn(0x7fe2540d1310 legacy=0x7fe2540700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe2537fe700 1 -- 172.21.15.112:0/4235738900 >> v1:172.21.15.112:6789/0 conn(0x7fe25415c310 legacy=0x7fe25406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe2537fe700 1 -- 172.21.15.112:0/4235738900 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540d1900 con 0x7fe2540707d0 2023-11-08T12:29:53.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe2537fe700 1 --2- 172.21.15.112:0/4235738900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe254167100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009dc0 tx=0x7fe24c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7053cfa0db7b2301 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:53.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe251ffb700 1 -- 172.21.15.112:0/4235738900 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00e070 con 0x7fe2540707d0 2023-11-08T12:29:53.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe251ffb700 1 -- 172.21.15.112:0/4235738900 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c00bb20 con 0x7fe2540707d0 2023-11-08T12:29:53.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.346+0000 7fe251ffb700 1 -- 172.21.15.112:0/4235738900 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00bed0 con 0x7fe2540707d0 2023-11-08T12:29:53.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 -- 172.21.15.112:0/4235738900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 msgr2=0x7fe254167100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 --2- 172.21.15.112:0/4235738900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe254167100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009dc0 tx=0x7fe24c00b330 comp rx=0 tx=0).stop 2023-11-08T12:29:53.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 -- 172.21.15.112:0/4235738900 shutdown_connections 2023-11-08T12:29:53.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 --2- 172.21.15.112:0/4235738900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe254167100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 -- 172.21.15.112:0/4235738900 >> 172.21.15.112:0/4235738900 conn(0x7fe2540d0140 msgr2=0x7fe2540d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 -- 172.21.15.112:0/4235738900 shutdown_connections 2023-11-08T12:29:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 -- 172.21.15.112:0/4235738900 wait complete. 2023-11-08T12:29:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 Processor -- start 2023-11-08T12:29:53.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.350+0000 7fe259682700 1 -- start start 2023-11-08T12:29:53.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe2540c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2540d1310 0x7fe2540c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe25415c310 0x7fe25415e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25415f7d0 con 0x7fe2540d1310 2023-11-08T12:29:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25415f4f0 con 0x7fe25415c310 2023-11-08T12:29:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540c6700 con 0x7fe2540707d0 2023-11-08T12:29:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe2527fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2540d1310 0x7fe2540c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe2540c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe2537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe25415c310 0x7fe25415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe2540c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:41784/0 (socket says 172.21.15.112:41784) 2023-11-08T12:29:53.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 -- 172.21.15.112:0/2579711473 learned_addr learned my addr 172.21.15.112:0/2579711473 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 -- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe25415c310 msgr2=0x7fe25415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe25415c310 0x7fe25415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 -- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2540d1310 msgr2=0x7fe2540c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2540d1310 0x7fe2540c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 -- 172.21.15.112:0/2579711473 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c009a70 con 0x7fe2540707d0 2023-11-08T12:29:53.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe2537fe700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe25415c310 0x7fe25415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:53.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe252ffd700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe2540c71e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe24400c4f0 tx=0x7fe24400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:53.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe23b7fe700 1 -- 172.21.15.112:0/2579711473 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244005d90 con 0x7fe2540707d0 2023-11-08T12:29:53.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe23b7fe700 1 -- 172.21.15.112:0/2579711473 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2440070d0 con 0x7fe2540707d0 2023-11-08T12:29:53.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25406d450 con 0x7fe2540707d0 2023-11-08T12:29:53.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe23b7fe700 1 -- 172.21.15.112:0/2579711473 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244007440 con 0x7fe2540707d0 2023-11-08T12:29:53.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.354+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25415c6e0 con 0x7fe2540707d0 2023-11-08T12:29:53.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.358+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25406d730 con 0x7fe2540707d0 2023-11-08T12:29:53.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.358+0000 7fe23b7fe700 1 -- 172.21.15.112:0/2579711473 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe244019030 con 0x7fe2540707d0 2023-11-08T12:29:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.358+0000 7fe23b7fe700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe240064ee0 0x7fe240067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.358+0000 7fe23b7fe700 1 -- 172.21.15.112:0/2579711473 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe244081710 con 0x7fe2540707d0 2023-11-08T12:29:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.362+0000 7fe2527fc700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe240064ee0 0x7fe240067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.362+0000 7fe2527fc700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe240064ee0 0x7fe240067390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2540b8980 tx=0x7fe248009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:53.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.366+0000 7fe23b7fe700 1 -- 172.21.15.112:0/2579711473 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe24404f770 con 0x7fe2540707d0 2023-11-08T12:29:53.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.538+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe254073d20 con 0x7fe2540707d0 2023-11-08T12:29:53.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.542+0000 7fe23b7fe700 1 -- 172.21.15.112:0/2579711473 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe244052d90 con 0x7fe2540707d0 2023-11-08T12:29:53.547 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:29:53.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe240064ee0 msgr2=0x7fe240067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe240064ee0 0x7fe240067390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2540b8980 tx=0x7fe248009040 comp rx=0 tx=0).stop 2023-11-08T12:29:53.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 msgr2=0x7fe2540c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe2540c71e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe24400c4f0 tx=0x7fe24400c800 comp rx=0 tx=0).stop 2023-11-08T12:29:53.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 shutdown_connections 2023-11-08T12:29:53.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe240064ee0 0x7fe240067390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe25415c310 0x7fe25415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2540d1310 0x7fe2540c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 --2- 172.21.15.112:0/2579711473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2540707d0 0x7fe2540c71e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 >> 172.21.15.112:0/2579711473 conn(0x7fe2540d0140 msgr2=0x7fe25406a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:53.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 shutdown_connections 2023-11-08T12:29:53.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.546+0000 7fe259682700 1 -- 172.21.15.112:0/2579711473 wait complete. 2023-11-08T12:29:53.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:29:53.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.754+0000 7fc34e6d1700 1 Processor -- start 2023-11-08T12:29:53.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.754+0000 7fc34e6d1700 1 -- start start 2023-11-08T12:29:53.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34e6d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc34815c150 0x7fc3480b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34e6d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 0x7fc348070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34e6d1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34815c520 con 0x7fc34815fc30 2023-11-08T12:29:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34e6d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480b4240 con 0x7fc34815c150 2023-11-08T12:29:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34e6d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480708a0 con 0x7fc34806ff10 2023-11-08T12:29:53.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34ded0700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc34815fc30 0x7fc3481600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38902/0 (socket says 172.21.15.112:38902) 2023-11-08T12:29:53.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34ded0700 1 -- 172.21.15.112:0/964675750 learned_addr learned my addr 172.21.15.112:0/964675750 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:53.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34d6cf700 1 --2- 172.21.15.112:0/964675750 >> v2:172.21.15.133:3300/0 conn(0x7fc34815c150 0x7fc3480b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc34cece700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 0x7fc348070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994941412 0 0) 0x7fc34815c520 con 0x7fc34815fc30 2023-11-08T12:29:53.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.758+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3340035d0 con 0x7fc34815fc30 2023-11-08T12:29:53.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1073109193 0 0) 0x7fc3340035d0 con 0x7fc34815fc30 2023-11-08T12:29:53.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 msgr2=0x7fc348070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:53.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 0x7fc348070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 >> v2:172.21.15.133:3300/0 conn(0x7fc34815c150 msgr2=0x7fc3480b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:53.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 --2- 172.21.15.112:0/964675750 >> v2:172.21.15.133:3300/0 conn(0x7fc34815c150 0x7fc3480b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34806ac00 con 0x7fc34815fc30 2023-11-08T12:29:53.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fc3400019f0 con 0x7fc34815fc30 2023-11-08T12:29:53.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 >> v1:172.21.15.112:6789/0 conn(0x7fc34815fc30 legacy=0x7fc3481600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 0x7fc334003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc334004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc334004db0 0x7fc334005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480b4240 con 0x7fc334003fa0 2023-11-08T12:29:53.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480708a0 con 0x7fc334004db0 2023-11-08T12:29:53.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33400ba30 con 0x7fc34806ff10 2023-11-08T12:29:53.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34cece700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc334004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34d6cf700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 0x7fc334003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34ded0700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc334004db0 0x7fc334005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34cece700 1 -- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 msgr2=0x7fc334003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:53.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34cece700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34806ff10 0x7fc334003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34cece700 1 -- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc334004db0 msgr2=0x7fc334005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:53.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34cece700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc334004db0 0x7fc334005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34cece700 1 -- 172.21.15.112:0/964675750 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340035d0 con 0x7fc334003fa0 2023-11-08T12:29:53.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34cece700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc334004870 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc338009b60 tx=0x7fc3340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5184d6828a2c2370 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:53.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338005a40 con 0x7fc334003fa0 2023-11-08T12:29:53.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338005ba0 con 0x7fc334003fa0 2023-11-08T12:29:53.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc33ffff700 1 -- 172.21.15.112:0/964675750 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800e6c0 con 0x7fc334003fa0 2023-11-08T12:29:53.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34e6d1700 1 -- 172.21.15.112:0/964675750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 msgr2=0x7fc334004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34e6d1700 1 --2- 172.21.15.112:0/964675750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc334004870 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc338009b60 tx=0x7fc3340058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34ded0700 1 -- 172.21.15.112:0/964675750 reap_dead start 2023-11-08T12:29:53.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34e6d1700 1 -- 172.21.15.112:0/964675750 shutdown_connections 2023-11-08T12:29:53.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.762+0000 7fc34e6d1700 1 -- 172.21.15.112:0/964675750 >> 172.21.15.112:0/964675750 conn(0x7fc3480d3680 msgr2=0x7fc3480cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:53.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.766+0000 7fc34e6d1700 1 -- 172.21.15.112:0/964675750 shutdown_connections 2023-11-08T12:29:53.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.766+0000 7fc34e6d1700 1 -- 172.21.15.112:0/964675750 wait complete. 2023-11-08T12:29:53.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.766+0000 7fc34e6d1700 1 Processor -- start 2023-11-08T12:29:53.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.766+0000 7fc34e6d1700 1 -- start start 2023-11-08T12:29:53.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc3480cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3480cf440 0x7fc34815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3481f11e0 0x7fc3480c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480cd690 con 0x7fc334003fa0 2023-11-08T12:29:53.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34815e000 con 0x7fc3481f11e0 2023-11-08T12:29:53.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480cfbb0 con 0x7fc3480cf440 2023-11-08T12:29:53.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc3480cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc3480cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50948/0 (socket says 172.21.15.112:50948) 2023-11-08T12:29:53.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 -- 172.21.15.112:0/2821816746 learned_addr learned my addr 172.21.15.112:0/2821816746 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:53.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34ded0700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3481f11e0 0x7fc3480c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 -- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3480cf440 msgr2=0x7fc34815dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34cece700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3480cf440 0x7fc34815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3480cf440 0x7fc34815dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 -- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3481f11e0 msgr2=0x7fc3480c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3481f11e0 0x7fc3480c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 -- 172.21.15.112:0/2821816746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480d2450 con 0x7fc334003fa0 2023-11-08T12:29:53.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34ded0700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3481f11e0 0x7fc3480c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:53.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34d6cf700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc3480cb730 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc344011ad0 tx=0x7fc344011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:53.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc33dffb700 1 -- 172.21.15.112:0/2821816746 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400fa60 con 0x7fc334003fa0 2023-11-08T12:29:53.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc33dffb700 1 -- 172.21.15.112:0/2821816746 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34400fbc0 con 0x7fc334003fa0 2023-11-08T12:29:53.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34806cc50 con 0x7fc334003fa0 2023-11-08T12:29:53.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc33dffb700 1 -- 172.21.15.112:0/2821816746 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344014440 con 0x7fc334003fa0 2023-11-08T12:29:53.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.770+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3480d2730 con 0x7fc334003fa0 2023-11-08T12:29:53.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.774+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc348073d20 con 0x7fc334003fa0 2023-11-08T12:29:53.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.774+0000 7fc33dffb700 1 -- 172.21.15.112:0/2821816746 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc3440145a0 con 0x7fc334003fa0 2023-11-08T12:29:53.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.774+0000 7fc33dffb700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc32c064ee0 0x7fc32c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:53.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.774+0000 7fc33dffb700 1 -- 172.21.15.112:0/2821816746 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc344082980 con 0x7fc334003fa0 2023-11-08T12:29:53.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.774+0000 7fc34cece700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc32c064ee0 0x7fc32c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:53.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.778+0000 7fc34cece700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc32c064ee0 0x7fc32c067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc3480cc750 tx=0x7fc338008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:53.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.782+0000 7fc33dffb700 1 -- 172.21.15.112:0/2821816746 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc344050940 con 0x7fc334003fa0 2023-11-08T12:29:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.958+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3480d0150 con 0x7fc334003fa0 2023-11-08T12:29:53.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc33dffb700 1 -- 172.21.15.112:0/2821816746 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3440220a0 con 0x7fc334003fa0 2023-11-08T12:29:53.966 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:29:53.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc32c064ee0 msgr2=0x7fc32c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc32c064ee0 0x7fc32c067390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc3480cc750 tx=0x7fc338008030 comp rx=0 tx=0).stop 2023-11-08T12:29:53.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 msgr2=0x7fc3480cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc3480cb730 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc344011ad0 tx=0x7fc344011e90 comp rx=0 tx=0).stop 2023-11-08T12:29:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 shutdown_connections 2023-11-08T12:29:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc32c064ee0 0x7fc32c067390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3481f11e0 0x7fc3480c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3480cf440 0x7fc34815dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 --2- 172.21.15.112:0/2821816746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc334003fa0 0x7fc3480cb730 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:53.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 >> 172.21.15.112:0/2821816746 conn(0x7fc3480d3680 msgr2=0x7fc34806be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:53.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 shutdown_connections 2023-11-08T12:29:53.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:53.962+0000 7fc34e6d1700 1 -- 172.21.15.112:0/2821816746 wait complete. 2023-11-08T12:29:53.990 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:54.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.162+0000 7f696e1ef700 1 Processor -- start 2023-11-08T12:29:54.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696e1ef700 1 -- start start 2023-11-08T12:29:54.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696e1ef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696815c1a0 0x7f696806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696e1ef700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6968070790 0x7f696806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696e1ef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69680adf90 con 0x7f69680cdeb0 2023-11-08T12:29:54.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696e1ef700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6968069bf0 con 0x7f6968070790 2023-11-08T12:29:54.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696e1ef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69680ce370 con 0x7f696815c1a0 2023-11-08T12:29:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d9ee700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6968070790 0x7f696806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d9ee700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6968070790 0x7f696806a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50958/0 (socket says 172.21.15.112:50958) 2023-11-08T12:29:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d9ee700 1 -- 172.21.15.112:0/4228206674 learned_addr learned my addr 172.21.15.112:0/4228206674 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d1ed700 1 --2- 172.21.15.112:0/4228206674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696815c1a0 0x7f696806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d9ee700 1 -- 172.21.15.112:0/4228206674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696815c1a0 msgr2=0x7f696806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d9ee700 1 --2- 172.21.15.112:0/4228206674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696815c1a0 0x7f696806c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d9ee700 1 -- 172.21.15.112:0/4228206674 >> v1:172.21.15.133:6789/0 conn(0x7f69680cdeb0 legacy=0x7f6968070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.166+0000 7f696d9ee700 1 -- 172.21.15.112:0/4228206674 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680cc4a0 con 0x7f6968070790 2023-11-08T12:29:54.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696d9ee700 1 --2- 172.21.15.112:0/4228206674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070790 0x7f696806a010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6960009e50 tx=0x7f696000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb10e1f436ba98c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:54.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f695ffff700 1 -- 172.21.15.112:0/4228206674 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000e070 con 0x7f6968070790 2023-11-08T12:29:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f695ffff700 1 -- 172.21.15.112:0/4228206674 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696000b910 con 0x7f6968070790 2023-11-08T12:29:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f695ffff700 1 -- 172.21.15.112:0/4228206674 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000bcc0 con 0x7f6968070790 2023-11-08T12:29:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 -- 172.21.15.112:0/4228206674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070790 msgr2=0x7f696806a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 --2- 172.21.15.112:0/4228206674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070790 0x7f696806a010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6960009e50 tx=0x7f696000b330 comp rx=0 tx=0).stop 2023-11-08T12:29:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 -- 172.21.15.112:0/4228206674 shutdown_connections 2023-11-08T12:29:54.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 --2- 172.21.15.112:0/4228206674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070790 0x7f696806a010 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 --2- 172.21.15.112:0/4228206674 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696815c1a0 0x7f696806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 -- 172.21.15.112:0/4228206674 >> 172.21.15.112:0/4228206674 conn(0x7f69680b0f80 msgr2=0x7f69680ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 -- 172.21.15.112:0/4228206674 shutdown_connections 2023-11-08T12:29:54.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.170+0000 7f696e1ef700 1 -- 172.21.15.112:0/4228206674 wait complete. 2023-11-08T12:29:54.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 Processor -- start 2023-11-08T12:29:54.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 -- start start 2023-11-08T12:29:54.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6968070790 0x7f6968147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69680cdeb0 0x7f69680b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f696815c1a0 0x7f69680c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696815e310 con 0x7f696815c1a0 2023-11-08T12:29:54.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69680c5570 con 0x7f6968070790 2023-11-08T12:29:54.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696815d970 con 0x7f69680cdeb0 2023-11-08T12:29:54.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f696815c1a0 0x7f69680c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f696815c1a0 0x7f69680c1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50974/0 (socket says 172.21.15.112:50974) 2023-11-08T12:29:54.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 -- 172.21.15.112:0/2464658296 learned_addr learned my addr 172.21.15.112:0/2464658296 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:54.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d1ed700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6968070790 0x7f6968147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696c9ec700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69680cdeb0 0x7f69680b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 -- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69680cdeb0 msgr2=0x7f69680b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69680cdeb0 0x7f69680b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 -- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6968070790 msgr2=0x7f6968147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6968070790 0x7f6968147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 -- 172.21.15.112:0/2464658296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960009b30 con 0x7f696815c1a0 2023-11-08T12:29:54.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696d9ee700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f696815c1a0 0x7f69680c1ea0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6960012000 tx=0x7f6960004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f695dffb700 1 -- 172.21.15.112:0/2464658296 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960004960 con 0x7f696815c1a0 2023-11-08T12:29:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f695dffb700 1 -- 172.21.15.112:0/2464658296 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69600092e0 con 0x7f696815c1a0 2023-11-08T12:29:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696806cdf0 con 0x7f696815c1a0 2023-11-08T12:29:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.174+0000 7f695dffb700 1 -- 172.21.15.112:0/2464658296 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696001c660 con 0x7f696815c1a0 2023-11-08T12:29:54.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.178+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69680cc780 con 0x7f696815c1a0 2023-11-08T12:29:54.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.178+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696815c570 con 0x7f696815c1a0 2023-11-08T12:29:54.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.178+0000 7f695dffb700 1 -- 172.21.15.112:0/2464658296 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f696002c070 con 0x7f696815c1a0 2023-11-08T12:29:54.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.182+0000 7f695dffb700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f694c064ee0 0x7f694c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.182+0000 7f695dffb700 1 -- 172.21.15.112:0/2464658296 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6960083b50 con 0x7f696815c1a0 2023-11-08T12:29:54.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.182+0000 7f696d1ed700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f694c064ee0 0x7f694c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.182+0000 7f696d1ed700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f694c064ee0 0x7f694c067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6964009ae0 tx=0x7f6964008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.186+0000 7f695dffb700 1 -- 172.21.15.112:0/2464658296 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6960051b70 con 0x7f696815c1a0 2023-11-08T12:29:54.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.394+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6968073cb0 con 0x7f696815c1a0 2023-11-08T12:29:54.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f695dffb700 1 -- 172.21.15.112:0/2464658296 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f6960055190 con 0x7f696815c1a0 2023-11-08T12:29:54.402 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:54.403 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:54.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f694c064ee0 msgr2=0x7f694c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f694c064ee0 0x7f694c067390 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6964009ae0 tx=0x7f6964008040 comp rx=0 tx=0).stop 2023-11-08T12:29:54.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f696815c1a0 msgr2=0x7f69680c1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f696815c1a0 0x7f69680c1ea0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6960012000 tx=0x7f6960004af0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 shutdown_connections 2023-11-08T12:29:54.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f694c064ee0 0x7f694c067390 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f696815c1a0 0x7f69680c1ea0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69680cdeb0 0x7f69680b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 --2- 172.21.15.112:0/2464658296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6968070790 0x7f6968147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 >> 172.21.15.112:0/2464658296 conn(0x7f69680b0f80 msgr2=0x7f69680ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 shutdown_connections 2023-11-08T12:29:54.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.398+0000 7f696e1ef700 1 -- 172.21.15.112:0/2464658296 wait complete. 2023-11-08T12:29:54.408 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:54.426 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230f59e700 1 Processor -- start 2023-11-08T12:29:54.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230f59e700 1 -- start start 2023-11-08T12:29:54.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230f59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f231006afc0 0x7f2310070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f2310069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2310070a00 con 0x7f23100ced50 2023-11-08T12:29:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230f59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231006b440 con 0x7f231006afc0 2023-11-08T12:29:54.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100d24d0 con 0x7f23100705c0 2023-11-08T12:29:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f231006afc0 0x7f2310070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f231006afc0 0x7f2310070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50982/0 (socket says 172.21.15.112:50982) 2023-11-08T12:29:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230dd9b700 1 -- 172.21.15.112:0/2818586549 learned_addr learned my addr 172.21.15.112:0/2818586549 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.594+0000 7f230ed9d700 1 --2- 172.21.15.112:0/2818586549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f2310069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230dd9b700 1 -- 172.21.15.112:0/2818586549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 msgr2=0x7f2310069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230dd9b700 1 --2- 172.21.15.112:0/2818586549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f2310069cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230dd9b700 1 -- 172.21.15.112:0/2818586549 >> v1:172.21.15.133:6789/0 conn(0x7f23100ced50 legacy=0x7f2310160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230dd9b700 1 -- 172.21.15.112:0/2818586549 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23100d27b0 con 0x7f231006afc0 2023-11-08T12:29:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230dd9b700 1 --2- 172.21.15.112:0/2818586549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f231006afc0 0x7f2310070080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2304009910 tx=0x7f2304009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef42bc3c4fb4a3e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230d59a700 1 -- 172.21.15.112:0/2818586549 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304011830 con 0x7f231006afc0 2023-11-08T12:29:54.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230d59a700 1 -- 172.21.15.112:0/2818586549 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304011990 con 0x7f231006afc0 2023-11-08T12:29:54.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230d59a700 1 -- 172.21.15.112:0/2818586549 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304011d40 con 0x7f231006afc0 2023-11-08T12:29:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 -- 172.21.15.112:0/2818586549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f231006afc0 msgr2=0x7f2310070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 --2- 172.21.15.112:0/2818586549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f231006afc0 0x7f2310070080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2304009910 tx=0x7f2304009c20 comp rx=0 tx=0).stop 2023-11-08T12:29:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 -- 172.21.15.112:0/2818586549 shutdown_connections 2023-11-08T12:29:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 --2- 172.21.15.112:0/2818586549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f2310069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 --2- 172.21.15.112:0/2818586549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f231006afc0 0x7f2310070080 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 -- 172.21.15.112:0/2818586549 >> 172.21.15.112:0/2818586549 conn(0x7f23100b53a0 msgr2=0x7f23100d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 -- 172.21.15.112:0/2818586549 shutdown_connections 2023-11-08T12:29:54.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.598+0000 7f230f59e700 1 -- 172.21.15.112:0/2818586549 wait complete. 2023-11-08T12:29:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 Processor -- start 2023-11-08T12:29:54.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 -- start start 2023-11-08T12:29:54.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231006afc0 0x7f231015f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f23100c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23100ced50 0x7f231015e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100c6df0 con 0x7f23100ced50 2023-11-08T12:29:54.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100c7750 con 0x7f231006afc0 2023-11-08T12:29:54.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.602+0000 7f230f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100c81c0 con 0x7f23100705c0 2023-11-08T12:29:54.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23100ced50 0x7f231015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23100ced50 0x7f231015e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50998/0 (socket says 172.21.15.112:50998) 2023-11-08T12:29:54.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 -- 172.21.15.112:0/483003099 learned_addr learned my addr 172.21.15.112:0/483003099 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:54.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230e59c700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231006afc0 0x7f231015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230dd9b700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f23100c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 -- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 msgr2=0x7f23100c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f23100c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 -- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231006afc0 msgr2=0x7f231015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231006afc0 0x7f231015f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 -- 172.21.15.112:0/483003099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009570 con 0x7f23100ced50 2023-11-08T12:29:54.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230ed9d700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23100ced50 0x7f231015e700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f230800efc0 tx=0x7f230800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:54.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f22feffd700 1 -- 172.21.15.112:0/483003099 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308009ea0 con 0x7f23100ced50 2023-11-08T12:29:54.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f22feffd700 1 -- 172.21.15.112:0/483003099 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800f040 con 0x7f23100ced50 2023-11-08T12:29:54.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23100d0bb0 con 0x7f23100ced50 2023-11-08T12:29:54.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f22feffd700 1 -- 172.21.15.112:0/483003099 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800ced0 con 0x7f23100ced50 2023-11-08T12:29:54.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23100d08d0 con 0x7f23100ced50 2023-11-08T12:29:54.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.606+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23100cf120 con 0x7f23100ced50 2023-11-08T12:29:54.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.610+0000 7f22feffd700 1 -- 172.21.15.112:0/483003099 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2308014480 con 0x7f23100ced50 2023-11-08T12:29:54.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.610+0000 7f22feffd700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f22f0064ee0 0x7f22f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:54.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.610+0000 7f22feffd700 1 -- 172.21.15.112:0/483003099 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f2308082b80 con 0x7f23100ced50 2023-11-08T12:29:54.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.610+0000 7f230e59c700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f22f0064ee0 0x7f22f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:54.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.614+0000 7f230e59c700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f22f0064ee0 0x7f22f0067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f23100b4470 tx=0x7f2300009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:54.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.618+0000 7f22feffd700 1 -- 172.21.15.112:0/483003099 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f23080509d0 con 0x7f23100ced50 2023-11-08T12:29:54.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.794+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23100c6f30 con 0x7f23100ced50 2023-11-08T12:29:54.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f22feffd700 1 -- 172.21.15.112:0/483003099 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18232 (secure 0 0 0) 0x7f2308053ff0 con 0x7f23100ced50 2023-11-08T12:29:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:54.803 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:36.882358+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:29:19.858911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-08T12:29:20.777517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:54.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f22f0064ee0 msgr2=0x7f22f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f22f0064ee0 0x7f22f0067390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f23100b4470 tx=0x7f2300009040 comp rx=0 tx=0).stop 2023-11-08T12:29:54.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23100ced50 msgr2=0x7f231015e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:54.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23100ced50 0x7f231015e700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f230800efc0 tx=0x7f230800c3a0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 shutdown_connections 2023-11-08T12:29:54.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f22f0064ee0 0x7f22f0067390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23100ced50 0x7f231015e700 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23100705c0 0x7f23100c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 --2- 172.21.15.112:0/483003099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f231006afc0 0x7f231015f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:54.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 >> 172.21.15.112:0/483003099 conn(0x7f23100b53a0 msgr2=0x7f2310069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:54.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 shutdown_connections 2023-11-08T12:29:54.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.798+0000 7f230f59e700 1 -- 172.21.15.112:0/483003099 wait complete. 2023-11-08T12:29:54.827 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T12:29:54.828 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:55.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf22020700 1 Processor -- start 2023-11-08T12:29:55.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf22020700 1 -- start start 2023-11-08T12:29:55.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf22020700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf1c070a90 0x7faf1c1602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf22020700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c0ce7a0 con 0x7faf1c06a300 2023-11-08T12:29:55.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf22020700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c070ef0 con 0x7faf1c0cbe70 2023-11-08T12:29:55.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf22020700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c165160 con 0x7faf1c070a90 2023-11-08T12:29:55.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf2081d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faf1c06a300 0x7faf1c15fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38904/0 (socket says 172.21.15.112:38904) 2023-11-08T12:29:55.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf2081d700 1 -- 172.21.15.112:0/782343315 learned_addr learned my addr 172.21.15.112:0/782343315 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:55.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf2181f700 1 --2- 172.21.15.112:0/782343315 >> v2:172.21.15.133:3300/0 conn(0x7faf1c070a90 0x7faf1c1602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf13fff700 1 -- 172.21.15.112:0/782343315 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929703011 0 0) 0x7faf1c0ce7a0 con 0x7faf1c06a300 2023-11-08T12:29:55.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf13fff700 1 -- 172.21.15.112:0/782343315 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf080035d0 con 0x7faf1c06a300 2023-11-08T12:29:55.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf2181f700 1 -- 172.21.15.112:0/782343315 >> v1:172.21.15.133:6789/0 conn(0x7faf1c0cbe70 legacy=0x7faf1c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf2181f700 1 -- 172.21.15.112:0/782343315 >> v1:172.21.15.112:6789/0 conn(0x7faf1c06a300 legacy=0x7faf1c15fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:54.998+0000 7faf2181f700 1 -- 172.21.15.112:0/782343315 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c0ccae0 con 0x7faf1c070a90 2023-11-08T12:29:55.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf2181f700 1 --2- 172.21.15.112:0/782343315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 0x7faf1c1602e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf14009d90 tx=0x7faf1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f21891848d9de3a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf13fff700 1 -- 172.21.15.112:0/782343315 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1400e070 con 0x7faf1c070a90 2023-11-08T12:29:55.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf13fff700 1 -- 172.21.15.112:0/782343315 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1400bb20 con 0x7faf1c070a90 2023-11-08T12:29:55.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf13fff700 1 -- 172.21.15.112:0/782343315 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14012430 con 0x7faf1c070a90 2023-11-08T12:29:55.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf22020700 1 -- 172.21.15.112:0/782343315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 msgr2=0x7faf1c1602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf22020700 1 --2- 172.21.15.112:0/782343315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 0x7faf1c1602e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf14009d90 tx=0x7faf1400b330 comp rx=0 tx=0).stop 2023-11-08T12:29:55.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf22020700 1 -- 172.21.15.112:0/782343315 shutdown_connections 2023-11-08T12:29:55.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf22020700 1 --2- 172.21.15.112:0/782343315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 0x7faf1c1602e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf22020700 1 -- 172.21.15.112:0/782343315 >> 172.21.15.112:0/782343315 conn(0x7faf1c0b0a20 msgr2=0x7faf1c0b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:55.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf22020700 1 -- 172.21.15.112:0/782343315 shutdown_connections 2023-11-08T12:29:55.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.002+0000 7faf22020700 1 -- 172.21.15.112:0/782343315 wait complete. 2023-11-08T12:29:55.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 Processor -- start 2023-11-08T12:29:55.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 -- start start 2023-11-08T12:29:55.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1c06a300 0x7faf1c15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 0x7faf1c15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1c0cbe70 0x7faf1c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c1f6250 con 0x7faf1c06a300 2023-11-08T12:29:55.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c1f6530 con 0x7faf1c070a90 2023-11-08T12:29:55.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf22020700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c1f6810 con 0x7faf1c0cbe70 2023-11-08T12:29:55.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1c06a300 0x7faf1c15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1c06a300 0x7faf1c15a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51008/0 (socket says 172.21.15.112:51008) 2023-11-08T12:29:55.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 -- 172.21.15.112:0/390170226 learned_addr learned my addr 172.21.15.112:0/390170226 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:55.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2081d700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 0x7faf1c15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2181f700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1c0cbe70 0x7faf1c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 -- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1c0cbe70 msgr2=0x7faf1c156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1c0cbe70 0x7faf1c156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 -- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 msgr2=0x7faf1c15bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 0x7faf1c15bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.006+0000 7faf2101e700 1 -- 172.21.15.112:0/390170226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14009a70 con 0x7faf1c06a300 2023-11-08T12:29:55.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf2101e700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1c06a300 0x7faf1c15a3c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faf1800c500 tx=0x7faf1800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf11ffb700 1 -- 172.21.15.112:0/390170226 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180052d0 con 0x7faf1c06a300 2023-11-08T12:29:55.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf11ffb700 1 -- 172.21.15.112:0/390170226 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18005430 con 0x7faf1c06a300 2023-11-08T12:29:55.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1c161a00 con 0x7faf1c06a300 2023-11-08T12:29:55.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf11ffb700 1 -- 172.21.15.112:0/390170226 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180055a0 con 0x7faf1c06a300 2023-11-08T12:29:55.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c0cec80 con 0x7faf1c06a300 2023-11-08T12:29:55.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c0ccda0 con 0x7faf1c06a300 2023-11-08T12:29:55.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.010+0000 7faf11ffb700 1 -- 172.21.15.112:0/390170226 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faf18019030 con 0x7faf1c06a300 2023-11-08T12:29:55.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.014+0000 7faf11ffb700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf00064ee0 0x7faf00067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.014+0000 7faf11ffb700 1 -- 172.21.15.112:0/390170226 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7faf18081280 con 0x7faf1c06a300 2023-11-08T12:29:55.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.014+0000 7faf2081d700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf00064ee0 0x7faf00067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.014+0000 7faf2081d700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf00064ee0 0x7faf00067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faf1c15b130 tx=0x7faf0c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.022+0000 7faf11ffb700 1 -- 172.21.15.112:0/390170226 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faf1804f2a0 con 0x7faf1c06a300 2023-11-08T12:29:55.244 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.238+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf1c1f6390 con 0x7faf1c06a300 2023-11-08T12:29:55.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.238+0000 7faf11ffb700 1 -- 172.21.15.112:0/390170226 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7faf1c1f6390 con 0x7faf1c06a300 2023-11-08T12:29:55.245 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:55.245 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:55.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf00064ee0 msgr2=0x7faf00067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf00064ee0 0x7faf00067390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faf1c15b130 tx=0x7faf0c007de0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1c06a300 msgr2=0x7faf1c15a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1c06a300 0x7faf1c15a3c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faf1800c500 tx=0x7faf1800c810 comp rx=0 tx=0).stop 2023-11-08T12:29:55.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 shutdown_connections 2023-11-08T12:29:55.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faf00064ee0 0x7faf00067390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1c0cbe70 0x7faf1c156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf1c070a90 0x7faf1c15bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 --2- 172.21.15.112:0/390170226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1c06a300 0x7faf1c15a3c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 >> 172.21.15.112:0/390170226 conn(0x7faf1c0b0a20 msgr2=0x7faf1c160ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:55.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 shutdown_connections 2023-11-08T12:29:55.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.242+0000 7faf22020700 1 -- 172.21.15.112:0/390170226 wait complete. 2023-11-08T12:29:55.250 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:55.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:29:55.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d470c4700 1 Processor -- start 2023-11-08T12:29:55.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d470c4700 1 -- start start 2023-11-08T12:29:55.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d470c4700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d40070790 0x7f8d40164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d470c4700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4015a550 con 0x7f8d400b1640 2023-11-08T12:29:55.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d470c4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4006b0a0 con 0x7f8d400b43a0 2023-11-08T12:29:55.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d470c4700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d400caac0 con 0x7f8d40070790 2023-11-08T12:29:55.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d468c3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d40070790 0x7f8d40164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d458c1700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8d400b1640 0x7f8d40070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47632/0 (socket says 172.21.15.112:47632) 2023-11-08T12:29:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d458c1700 1 -- 172.21.15.112:0/3512539231 learned_addr learned my addr 172.21.15.112:0/3512539231 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d468c3700 1 -- 172.21.15.112:0/3512539231 >> v1:172.21.15.133:6789/0 conn(0x7f8d400b43a0 legacy=0x7f8d4015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d468c3700 1 -- 172.21.15.112:0/3512539231 >> v1:172.21.15.112:6789/0 conn(0x7f8d400b1640 legacy=0x7f8d40070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d450c0700 1 -- 172.21.15.112:0/3512539231 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278323985 0 0) 0x7f8d30001110 con 0x7f8d400b1640 2023-11-08T12:29:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.438+0000 7f8d468c3700 1 -- 172.21.15.112:0/3512539231 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400cada0 con 0x7f8d40070790 2023-11-08T12:29:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d468c3700 1 --2- 172.21.15.112:0/3512539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40164fa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009d90 tx=0x7f8d3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d77ade8c298ed6b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d450c0700 1 -- 172.21.15.112:0/3512539231 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800e070 con 0x7f8d40070790 2023-11-08T12:29:55.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d450c0700 1 -- 172.21.15.112:0/3512539231 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800bbd0 con 0x7f8d40070790 2023-11-08T12:29:55.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d450c0700 1 -- 172.21.15.112:0/3512539231 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38012430 con 0x7f8d40070790 2023-11-08T12:29:55.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d470c4700 1 -- 172.21.15.112:0/3512539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 msgr2=0x7f8d40164fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d470c4700 1 --2- 172.21.15.112:0/3512539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40164fa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009d90 tx=0x7f8d3800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:55.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d470c4700 1 -- 172.21.15.112:0/3512539231 shutdown_connections 2023-11-08T12:29:55.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d470c4700 1 --2- 172.21.15.112:0/3512539231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40164fa0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d470c4700 1 -- 172.21.15.112:0/3512539231 >> 172.21.15.112:0/3512539231 conn(0x7f8d400b0f80 msgr2=0x7f8d400ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:55.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d470c4700 1 -- 172.21.15.112:0/3512539231 shutdown_connections 2023-11-08T12:29:55.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.442+0000 7f8d470c4700 1 -- 172.21.15.112:0/3512539231 wait complete. 2023-11-08T12:29:55.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 Processor -- start 2023-11-08T12:29:55.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 -- start start 2023-11-08T12:29:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d400b1640 0x7f8d401567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d400b43a0 0x7f8d40156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400ab860 con 0x7f8d40070790 2023-11-08T12:29:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400ac870 con 0x7f8d400b43a0 2023-11-08T12:29:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d470c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40146680 con 0x7f8d400b1640 2023-11-08T12:29:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41376/0 (socket says 172.21.15.112:41376) 2023-11-08T12:29:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 -- 172.21.15.112:0/730204486 learned_addr learned my addr 172.21.15.112:0/730204486 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:55.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d458c1700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d400b1640 0x7f8d401567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d468c3700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d400b43a0 0x7f8d40156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 -- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d400b1640 msgr2=0x7f8d401567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d400b1640 0x7f8d401567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 -- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d400b43a0 msgr2=0x7f8d40156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d400b43a0 0x7f8d40156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d460c2700 1 -- 172.21.15.112:0/730204486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009a70 con 0x7f8d40070790 2023-11-08T12:29:55.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d458c1700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d400b1640 0x7f8d401567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:55.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.446+0000 7f8d468c3700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d400b43a0 0x7f8d40156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:55.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.450+0000 7f8d460c2700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40146140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00c500 tx=0x7f8d3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.450+0000 7f8d36ffd700 1 -- 172.21.15.112:0/730204486 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0052d0 con 0x7f8d40070790 2023-11-08T12:29:55.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.450+0000 7f8d36ffd700 1 -- 172.21.15.112:0/730204486 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c005430 con 0x7f8d40070790 2023-11-08T12:29:55.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.450+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4006b5d0 con 0x7f8d40070790 2023-11-08T12:29:55.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.450+0000 7f8d36ffd700 1 -- 172.21.15.112:0/730204486 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0055a0 con 0x7f8d40070790 2023-11-08T12:29:55.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.450+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4006b2f0 con 0x7f8d40070790 2023-11-08T12:29:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.450+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d400ca7b0 con 0x7f8d40070790 2023-11-08T12:29:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.454+0000 7f8d36ffd700 1 -- 172.21.15.112:0/730204486 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8d3c019030 con 0x7f8d40070790 2023-11-08T12:29:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.454+0000 7f8d36ffd700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d24064ee0 0x7f8d24067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.454+0000 7f8d36ffd700 1 -- 172.21.15.112:0/730204486 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8d3c081490 con 0x7f8d40070790 2023-11-08T12:29:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.454+0000 7f8d458c1700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d24064ee0 0x7f8d24067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.454+0000 7f8d458c1700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d24064ee0 0x7f8d24067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8d300079b0 tx=0x7f8d30007b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.458+0000 7f8d36ffd700 1 -- 172.21.15.112:0/730204486 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8d3c04f3c0 con 0x7f8d40070790 2023-11-08T12:29:55.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.662+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d40073cb0 con 0x7f8d40070790 2023-11-08T12:29:55.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.662+0000 7f8d36ffd700 1 -- 172.21.15.112:0/730204486 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f8d3c0529e0 con 0x7f8d40070790 2023-11-08T12:29:55.669 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:55.670 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:29:21.771466+0000","modified":"2023-11-08T12:29:24.784806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6837/2051824845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2051824845},{"type":"v1","addr":"172.21.15.112:6837","nonce":2051824845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-08T12:29:55.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d24064ee0 msgr2=0x7f8d24067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d24064ee0 0x7f8d24067390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8d300079b0 tx=0x7f8d30007b80 comp rx=0 tx=0).stop 2023-11-08T12:29:55.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 msgr2=0x7f8d40146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40146140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00c500 tx=0x7f8d3c00c8c0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 shutdown_connections 2023-11-08T12:29:55.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8d24064ee0 0x7f8d24067390 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d400b43a0 0x7f8d40156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d400b1640 0x7f8d401567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 --2- 172.21.15.112:0/730204486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d40070790 0x7f8d40146140 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 >> 172.21.15.112:0/730204486 conn(0x7f8d400b0f80 msgr2=0x7f8d400ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:55.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 shutdown_connections 2023-11-08T12:29:55.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.666+0000 7f8d470c4700 1 -- 172.21.15.112:0/730204486 wait complete. 2023-11-08T12:29:55.675 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 16 2023-11-08T12:29:55.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:29:55.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.862+0000 7fddc486c700 1 Processor -- start 2023-11-08T12:29:55.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.862+0000 7fddc486c700 1 -- start start 2023-11-08T12:29:55.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddc486c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fddc00b1640 0x7fddc0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddc486c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fddc00c9040 0x7fddc00705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddc486c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc015a550 con 0x7fddc00b43a0 2023-11-08T12:29:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddc486c700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc006b0a0 con 0x7fddc00c9040 2023-11-08T12:29:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddc486c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc00caac0 con 0x7fddc00b1640 2023-11-08T12:29:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbed9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fddc00b43a0 0x7fddc015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47636/0 (socket says 172.21.15.112:47636) 2023-11-08T12:29:55.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbed9d700 1 -- 172.21.15.112:0/1579916169 learned_addr learned my addr 172.21.15.112:0/1579916169 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:55.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbe59c700 1 --2- 172.21.15.112:0/1579916169 >> v2:172.21.15.133:3300/0 conn(0x7fddc00b1640 0x7fddc0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbf59e700 1 --2- 172.21.15.112:0/1579916169 >> v2:172.21.15.112:3300/0 conn(0x7fddc00c9040 0x7fddc00705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbdd9b700 1 -- 172.21.15.112:0/1579916169 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583884632 0 0) 0x7fddb0001110 con 0x7fddc00b43a0 2023-11-08T12:29:55.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbdd9b700 1 -- 172.21.15.112:0/1579916169 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda80035d0 con 0x7fddc00b43a0 2023-11-08T12:29:55.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbe59c700 1 -- 172.21.15.112:0/1579916169 >> v2:172.21.15.112:3300/0 conn(0x7fddc00c9040 msgr2=0x7fddc00705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbe59c700 1 --2- 172.21.15.112:0/1579916169 >> v2:172.21.15.112:3300/0 conn(0x7fddc00c9040 0x7fddc00705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbe59c700 1 -- 172.21.15.112:0/1579916169 >> v1:172.21.15.112:6789/0 conn(0x7fddc00b43a0 legacy=0x7fddc015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbe59c700 1 -- 172.21.15.112:0/1579916169 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00cada0 con 0x7fddc00b1640 2023-11-08T12:29:55.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbf59e700 1 --2- 172.21.15.112:0/1579916169 >> v2:172.21.15.112:3300/0 conn(0x7fddc00c9040 0x7fddc00705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbe59c700 1 --2- 172.21.15.112:0/1579916169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00b1640 0x7fddc0070080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddc0072d40 tx=0x7fddb4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c13ae243fcd18a5a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.866+0000 7fddbdd9b700 1 -- 172.21.15.112:0/1579916169 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4011830 con 0x7fddc00b1640 2023-11-08T12:29:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddbdd9b700 1 -- 172.21.15.112:0/1579916169 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4011990 con 0x7fddc00b1640 2023-11-08T12:29:55.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddbdd9b700 1 -- 172.21.15.112:0/1579916169 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4011d20 con 0x7fddc00b1640 2023-11-08T12:29:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 -- 172.21.15.112:0/1579916169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00b1640 msgr2=0x7fddc0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 --2- 172.21.15.112:0/1579916169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00b1640 0x7fddc0070080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddc0072d40 tx=0x7fddb4009b30 comp rx=0 tx=0).stop 2023-11-08T12:29:55.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 -- 172.21.15.112:0/1579916169 shutdown_connections 2023-11-08T12:29:55.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 --2- 172.21.15.112:0/1579916169 >> v2:172.21.15.112:3300/0 conn(0x7fddc00c9040 0x7fddc00705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 --2- 172.21.15.112:0/1579916169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00b1640 0x7fddc0070080 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 -- 172.21.15.112:0/1579916169 >> 172.21.15.112:0/1579916169 conn(0x7fddc00b0f80 msgr2=0x7fddc00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:55.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 -- 172.21.15.112:0/1579916169 shutdown_connections 2023-11-08T12:29:55.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.870+0000 7fddc486c700 1 -- 172.21.15.112:0/1579916169 wait complete. 2023-11-08T12:29:55.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 Processor -- start 2023-11-08T12:29:55.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 -- start start 2023-11-08T12:29:55.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddc00b1640 0x7fddc015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc00b43a0 0x7fddc00acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00c9040 0x7fddc01545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00ac6c0 con 0x7fddc00b43a0 2023-11-08T12:29:55.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00ab900 con 0x7fddc00c9040 2023-11-08T12:29:55.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddc486c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00abbe0 con 0x7fddc00b1640 2023-11-08T12:29:55.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddbe59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc00b43a0 0x7fddc00acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddbe59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc00b43a0 0x7fddc00acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41386/0 (socket says 172.21.15.112:41386) 2023-11-08T12:29:55.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.874+0000 7fddbe59c700 1 -- 172.21.15.112:0/1083071462 learned_addr learned my addr 172.21.15.112:0/1083071462 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:55.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbed9d700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddc00b1640 0x7fddc015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbf59e700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00c9040 0x7fddc01545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbe59c700 1 -- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddc00b1640 msgr2=0x7fddc015ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbe59c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddc00b1640 0x7fddc015ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbe59c700 1 -- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00c9040 msgr2=0x7fddc01545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:55.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbe59c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00c9040 0x7fddc01545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:55.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbe59c700 1 -- 172.21.15.112:0/1083071462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009a70 con 0x7fddc00b43a0 2023-11-08T12:29:55.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddbe59c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc00b43a0 0x7fddc00acba0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fddb4014040 tx=0x7fddb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fdda77fe700 1 -- 172.21.15.112:0/1083071462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40036c0 con 0x7fddc00b43a0 2023-11-08T12:29:55.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fdda77fe700 1 -- 172.21.15.112:0/1083071462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb401e070 con 0x7fddc00b43a0 2023-11-08T12:29:55.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb40094b0 con 0x7fddc00b43a0 2023-11-08T12:29:55.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fdda77fe700 1 -- 172.21.15.112:0/1083071462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4003a60 con 0x7fddc00b43a0 2023-11-08T12:29:55.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc006b5d0 con 0x7fddc00b43a0 2023-11-08T12:29:55.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc006b2f0 con 0x7fddc00b43a0 2023-11-08T12:29:55.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.878+0000 7fdda77fe700 1 -- 172.21.15.112:0/1083071462 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fddb400f050 con 0x7fddc00b43a0 2023-11-08T12:29:55.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.882+0000 7fdda77fe700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fddac064ee0 0x7fddac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:55.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.882+0000 7fdda77fe700 1 -- 172.21.15.112:0/1083071462 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fddb4083090 con 0x7fddc00b43a0 2023-11-08T12:29:55.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.882+0000 7fddbed9d700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fddac064ee0 0x7fddac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:55.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.882+0000 7fddbed9d700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fddac064ee0 0x7fddac067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fddb0001270 tx=0x7fddb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:55.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:55.890+0000 7fdda77fe700 1 -- 172.21.15.112:0/1083071462 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fddb40510b0 con 0x7fddc00b43a0 2023-11-08T12:29:56.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.062+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddc00ca7b0 con 0x7fddc00b43a0 2023-11-08T12:29:56.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.062+0000 7fdda77fe700 1 -- 172.21.15.112:0/1083071462 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18232 (secure 0 0 0) 0x7fddb40546d0 con 0x7fddc00b43a0 2023-11-08T12:29:56.068 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:29:56.068 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:29:36.882358+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:29:19.858911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-08T12:29:20.777517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:29:56.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fddac064ee0 msgr2=0x7fddac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:56.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fddac064ee0 0x7fddac067390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fddb0001270 tx=0x7fddb0009040 comp rx=0 tx=0).stop 2023-11-08T12:29:56.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc00b43a0 msgr2=0x7fddc00acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:56.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc00b43a0 0x7fddc00acba0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fddb4014040 tx=0x7fddb4004770 comp rx=0 tx=0).stop 2023-11-08T12:29:56.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 shutdown_connections 2023-11-08T12:29:56.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fddac064ee0 0x7fddac067390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc00c9040 0x7fddc01545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddc00b43a0 0x7fddc00acba0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 --2- 172.21.15.112:0/1083071462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddc00b1640 0x7fddc015ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 >> 172.21.15.112:0/1083071462 conn(0x7fddc00b0f80 msgr2=0x7fddc00af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:56.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 shutdown_connections 2023-11-08T12:29:56.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.066+0000 7fddc486c700 1 -- 172.21.15.112:0/1083071462 wait complete. 2023-11-08T12:29:56.095 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T12:29:56.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.266+0000 7fe3d64cf700 1 Processor -- start 2023-11-08T12:29:56.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.266+0000 7fe3d64cf700 1 -- start start 2023-11-08T12:29:56.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d64cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3d015a480 0x7fe3d00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:56.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d64cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d0069d60 0x7fe3d006a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:56.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d64cf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d015a850 con 0x7fe3d00c8d10 2023-11-08T12:29:56.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d64cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00ce060 con 0x7fe3d015a480 2023-11-08T12:29:56.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d64cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00ce300 con 0x7fe3d0069d60 2023-11-08T12:29:56.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d0069d60 0x7fe3d006a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:56.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d0069d60 0x7fe3d006a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:34912/0 (socket says 172.21.15.112:34912) 2023-11-08T12:29:56.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 -- 172.21.15.112:0/4014955659 learned_addr learned my addr 172.21.15.112:0/4014955659 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:56.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3cffff700 1 --2- 172.21.15.112:0/4014955659 >> v2:172.21.15.133:3300/0 conn(0x7fe3d015a480 0x7fe3d00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:56.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 -- 172.21.15.112:0/4014955659 >> v2:172.21.15.133:3300/0 conn(0x7fe3d015a480 msgr2=0x7fe3d00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:56.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 --2- 172.21.15.112:0/4014955659 >> v2:172.21.15.133:3300/0 conn(0x7fe3d015a480 0x7fe3d00cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 -- 172.21.15.112:0/4014955659 >> v1:172.21.15.133:6789/0 conn(0x7fe3d00c8d10 legacy=0x7fe3d00cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:56.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3cf7fe700 1 -- 172.21.15.112:0/4014955659 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415789230 0 0) 0x7fe3d015a850 con 0x7fe3d00c8d10 2023-11-08T12:29:56.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 -- 172.21.15.112:0/4014955659 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00cada0 con 0x7fe3d0069d60 2023-11-08T12:29:56.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.270+0000 7fe3d4a6c700 1 --2- 172.21.15.112:0/4014955659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d0069d60 0x7fe3d006a1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009e50 tx=0x7fe3c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beec54931f9abe2b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:56.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3cf7fe700 1 -- 172.21.15.112:0/4014955659 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800e070 con 0x7fe3d0069d60 2023-11-08T12:29:56.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3cf7fe700 1 -- 172.21.15.112:0/4014955659 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c800b910 con 0x7fe3d0069d60 2023-11-08T12:29:56.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3cf7fe700 1 -- 172.21.15.112:0/4014955659 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800bcc0 con 0x7fe3d0069d60 2023-11-08T12:29:56.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 -- 172.21.15.112:0/4014955659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d0069d60 msgr2=0x7fe3d006a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:56.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/4014955659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d0069d60 0x7fe3d006a1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009e50 tx=0x7fe3c800b330 comp rx=0 tx=0).stop 2023-11-08T12:29:56.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 -- 172.21.15.112:0/4014955659 shutdown_connections 2023-11-08T12:29:56.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/4014955659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d0069d60 0x7fe3d006a1e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/4014955659 >> v2:172.21.15.133:3300/0 conn(0x7fe3d015a480 0x7fe3d00cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 -- 172.21.15.112:0/4014955659 >> 172.21.15.112:0/4014955659 conn(0x7fe3d00cf350 msgr2=0x7fe3d00b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:56.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 -- 172.21.15.112:0/4014955659 shutdown_connections 2023-11-08T12:29:56.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.274+0000 7fe3d64cf700 1 -- 172.21.15.112:0/4014955659 wait complete. 2023-11-08T12:29:56.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 Processor -- start 2023-11-08T12:29:56.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 -- start start 2023-11-08T12:29:56.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d0069d60 0x7fe3d01f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:56.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d00c8d10 0x7fe3d0157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:56.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d015a480 0x7fe3d00acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:56.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01f2150 con 0x7fe3d0069d60 2023-11-08T12:29:56.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01f5c80 con 0x7fe3d00c8d10 2023-11-08T12:29:56.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d64cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01582c0 con 0x7fe3d015a480 2023-11-08T12:29:56.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d0069d60 0x7fe3d01f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:56.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d0069d60 0x7fe3d01f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41392/0 (socket says 172.21.15.112:41392) 2023-11-08T12:29:56.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 -- 172.21.15.112:0/2111807782 learned_addr learned my addr 172.21.15.112:0/2111807782 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:56.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3c7fff700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d00c8d10 0x7fe3d0157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:56.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3d4a6c700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d015a480 0x7fe3d00acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:56.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 -- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d015a480 msgr2=0x7fe3d00acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:56.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d015a480 0x7fe3d00acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 -- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d00c8d10 msgr2=0x7fe3d0157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d00c8d10 0x7fe3d0157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 -- 172.21.15.112:0/2111807782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009b30 con 0x7fe3d0069d60 2023-11-08T12:29:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.278+0000 7fe3cffff700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d0069d60 0x7fe3d01f5740 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000e870 tx=0x7fe3c000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.282+0000 7fe3cd7fa700 1 -- 172.21.15.112:0/2111807782 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00095c0 con 0x7fe3d0069d60 2023-11-08T12:29:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.282+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d00add50 con 0x7fe3d0069d60 2023-11-08T12:29:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.282+0000 7fe3cd7fa700 1 -- 172.21.15.112:0/2111807782 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0013680 con 0x7fe3d0069d60 2023-11-08T12:29:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.282+0000 7fe3cd7fa700 1 -- 172.21.15.112:0/2111807782 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0013a10 con 0x7fe3d0069d60 2023-11-08T12:29:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.282+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d00caa30 con 0x7fe3d0069d60 2023-11-08T12:29:56.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.282+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d00ca6e0 con 0x7fe3d0069d60 2023-11-08T12:29:56.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.282+0000 7fe3cd7fa700 1 -- 172.21.15.112:0/2111807782 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe3c0019030 con 0x7fe3d0069d60 2023-11-08T12:29:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.286+0000 7fe3cd7fa700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe3b0064ee0 0x7fe3b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.286+0000 7fe3cd7fa700 1 -- 172.21.15.112:0/2111807782 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe3c0081ed0 con 0x7fe3d0069d60 2023-11-08T12:29:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.286+0000 7fe3c7fff700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe3b0064ee0 0x7fe3b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:56.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.286+0000 7fe3c7fff700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe3b0064ee0 0x7fe3b0067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0156330 tx=0x7fe3b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.290+0000 7fe3cd7fa700 1 -- 172.21.15.112:0/2111807782 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe3c004fd80 con 0x7fe3d0069d60 2023-11-08T12:29:56.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:56.494+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe3d00ae100 con 0x7fe3d0069d60 2023-11-08T12:29:57.001 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-11-08T12:29:56.998+0000 7f2dc63f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T12:29:57.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.014+0000 7fe3cd7fa700 1 -- 172.21.15.112:0/2111807782 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe3c00533a0 con 0x7fe3d0069d60 2023-11-08T12:29:57.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe3b0064ee0 msgr2=0x7fe3b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:57.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe3b0064ee0 0x7fe3b0067390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0156330 tx=0x7fe3b8009040 comp rx=0 tx=0).stop 2023-11-08T12:29:57.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d0069d60 msgr2=0x7fe3d01f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d0069d60 0x7fe3d01f5740 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000e870 tx=0x7fe3c000eb80 comp rx=0 tx=0).stop 2023-11-08T12:29:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 shutdown_connections 2023-11-08T12:29:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe3b0064ee0 0x7fe3b0067390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe3d015a480 0x7fe3d00acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3d00c8d10 0x7fe3d0157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 --2- 172.21.15.112:0/2111807782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3d0069d60 0x7fe3d01f5740 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 >> 172.21.15.112:0/2111807782 conn(0x7fe3d00cf350 msgr2=0x7fe3d00b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 shutdown_connections 2023-11-08T12:29:57.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.018+0000 7fe3d64cf700 1 -- 172.21.15.112:0/2111807782 wait complete. 2023-11-08T12:29:57.026 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T12:29:57.034 INFO:tasks.ceph.mds.c.smithi112.stderr: -6400> 2023-11-08T12:29:24.263+0000 7fe72bfa6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:29:57.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T12:29:57.092 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-11-08T12:29:57.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.214+0000 7f034920f700 1 Processor -- start 2023-11-08T12:29:57.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.214+0000 7f034920f700 1 -- start start 2023-11-08T12:29:57.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f034920f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0344158840 0x7f03440ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:57.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f034920f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f034415c3b0 0x7f0344070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:57.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f034920f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034406b090 con 0x7f03440c8da0 2023-11-08T12:29:57.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f034920f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0344069bf0 con 0x7f034415c3b0 2023-11-08T12:29:57.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f034920f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034415c890 con 0x7f0344158840 2023-11-08T12:29:57.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f0348a0e700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f03440c8da0 0x7f034406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47648/0 (socket says 172.21.15.112:47648) 2023-11-08T12:29:57.226 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f0348a0e700 1 -- 172.21.15.112:0/1630640628 learned_addr learned my addr 172.21.15.112:0/1630640628 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:57.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f0343fff700 1 --2- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0344158840 0x7f03440ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:57.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.218+0000 7f033b7fe700 1 --2- 172.21.15.112:0/1630640628 >> v2:172.21.15.133:3300/0 conn(0x7f034415c3b0 0x7f0344070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:57.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f033b7fe700 1 -- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0344158840 msgr2=0x7f03440ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:57.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f033b7fe700 1 --2- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0344158840 0x7f03440ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f03437fe700 1 -- 172.21.15.112:0/1630640628 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805751406 0 0) 0x7f033c001490 con 0x7f03440c8da0 2023-11-08T12:29:57.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f033b7fe700 1 -- 172.21.15.112:0/1630640628 >> v1:172.21.15.112:6789/0 conn(0x7f03440c8da0 legacy=0x7f034406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:57.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f033b7fe700 1 -- 172.21.15.112:0/1630640628 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034415cb70 con 0x7f034415c3b0 2023-11-08T12:29:57.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f0343fff700 1 --2- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0344158840 0x7f03440ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:57.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f033b7fe700 1 --2- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034415c3b0 0x7f0344070080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f032c009850 tx=0x7f032c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15c61b692b4b40fc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:57.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f03437fe700 1 -- 172.21.15.112:0/1630640628 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00f8a0 con 0x7f034415c3b0 2023-11-08T12:29:57.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f03437fe700 1 -- 172.21.15.112:0/1630640628 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00fa00 con 0x7f034415c3b0 2023-11-08T12:29:57.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f03437fe700 1 -- 172.21.15.112:0/1630640628 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00fdb0 con 0x7f034415c3b0 2023-11-08T12:29:57.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 -- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034415c3b0 msgr2=0x7f0344070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:57.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 --2- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034415c3b0 0x7f0344070080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f032c009850 tx=0x7f032c009b60 comp rx=0 tx=0).stop 2023-11-08T12:29:57.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 -- 172.21.15.112:0/1630640628 shutdown_connections 2023-11-08T12:29:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 --2- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034415c3b0 0x7f0344070080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 --2- 172.21.15.112:0/1630640628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0344158840 0x7f03440ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 -- 172.21.15.112:0/1630640628 >> 172.21.15.112:0/1630640628 conn(0x7f03440b0f80 msgr2=0x7f03440ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 -- 172.21.15.112:0/1630640628 shutdown_connections 2023-11-08T12:29:57.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.222+0000 7f034920f700 1 -- 172.21.15.112:0/1630640628 wait complete. 2023-11-08T12:29:57.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 Processor -- start 2023-11-08T12:29:57.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 -- start start 2023-11-08T12:29:57.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03440c8da0 0x7f03441569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:57.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0344158840 0x7f03440c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:57.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f034415c3b0 0x7f03440c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:57.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034415b700 con 0x7f03440c8da0 2023-11-08T12:29:57.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344156ef0 con 0x7f0344158840 2023-11-08T12:29:57.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034415aa80 con 0x7f034415c3b0 2023-11-08T12:29:57.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03440c8da0 0x7f03441569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:57.235 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03440c8da0 0x7f03441569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41406/0 (socket says 172.21.15.112:41406) 2023-11-08T12:29:57.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 -- 172.21.15.112:0/3421028807 learned_addr learned my addr 172.21.15.112:0/3421028807 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:57.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f033b7fe700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0344158840 0x7f03440c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:57.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0348a0e700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f034415c3b0 0x7f03440c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:57.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 -- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f034415c3b0 msgr2=0x7f03440c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:57.236 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f034415c3b0 0x7f03440c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 -- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0344158840 msgr2=0x7f03440c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:57.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0344158840 0x7f03440c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:57.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 -- 172.21.15.112:0/3421028807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033400a650 con 0x7f03440c8da0 2023-11-08T12:29:57.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f033b7fe700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0344158840 0x7f03440c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:57.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0348a0e700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f034415c3b0 0x7f03440c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:29:57.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f0343fff700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03440c8da0 0x7f03441569b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f033400ea50 tx=0x7f033400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:57.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f03417fa700 1 -- 172.21.15.112:0/3421028807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400cbb0 con 0x7f03440c8da0 2023-11-08T12:29:57.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f03417fa700 1 -- 172.21.15.112:0/3421028807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033400cd10 con 0x7f03440c8da0 2023-11-08T12:29:57.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c0094b0 con 0x7f03440c8da0 2023-11-08T12:29:57.238 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f03417fa700 1 -- 172.21.15.112:0/3421028807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334011610 con 0x7f03440c8da0 2023-11-08T12:29:57.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.226+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034415d130 con 0x7f03440c8da0 2023-11-08T12:29:57.239 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.230+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034415ce50 con 0x7f03440c8da0 2023-11-08T12:29:57.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.230+0000 7f03417fa700 1 -- 172.21.15.112:0/3421028807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0334018030 con 0x7f03440c8da0 2023-11-08T12:29:57.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.230+0000 7f03417fa700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0324064ee0 0x7f0324067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:57.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.234+0000 7f03417fa700 1 -- 172.21.15.112:0/3421028807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f0334081dd0 con 0x7f03440c8da0 2023-11-08T12:29:57.240 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.234+0000 7f033b7fe700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0324064ee0 0x7f0324067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:57.241 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.234+0000 7f033b7fe700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0324064ee0 0x7f0324067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f034415c7c0 tx=0x7f032c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:57.242 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.238+0000 7f03417fa700 1 -- 172.21.15.112:0/3421028807 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f033404fcb0 con 0x7f03440c8da0 2023-11-08T12:29:57.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:57.442+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0344158c10 con 0x7f03440c8da0 2023-11-08T12:29:58.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.018+0000 7f03417fa700 1 -- 172.21.15.112:0/3421028807 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03340532d0 con 0x7f03440c8da0 2023-11-08T12:29:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0324064ee0 msgr2=0x7f0324067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0324064ee0 0x7f0324067390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f034415c7c0 tx=0x7f032c008030 comp rx=0 tx=0).stop 2023-11-08T12:29:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03440c8da0 msgr2=0x7f03441569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:58.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03440c8da0 0x7f03441569b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f033400ea50 tx=0x7f033400ee10 comp rx=0 tx=0).stop 2023-11-08T12:29:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 shutdown_connections 2023-11-08T12:29:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0324064ee0 0x7f0324067390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f034415c3b0 0x7f03440c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0344158840 0x7f03440c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 --2- 172.21.15.112:0/3421028807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03440c8da0 0x7f03441569b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 >> 172.21.15.112:0/3421028807 conn(0x7f03440b0f80 msgr2=0x7f03440c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 shutdown_connections 2023-11-08T12:29:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.022+0000 7f034920f700 1 -- 172.21.15.112:0/3421028807 wait complete. 2023-11-08T12:29:58.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T12:29:58.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.286+0000 7fcfd589f700 1 Processor -- start 2023-11-08T12:29:58.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.286+0000 7fcfd589f700 1 -- start start 2023-11-08T12:29:58.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd589f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd015c6e0 0x7fcfd0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd589f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcfd006a510 0x7fcfd006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd589f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd015cab0 con 0x7fcfd0071fe0 2023-11-08T12:29:58.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd589f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00d2800 con 0x7fcfd006a510 2023-11-08T12:29:58.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd589f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00702d0 con 0x7fcfd015c6e0 2023-11-08T12:29:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcfd0071fe0 0x7fcfd0069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47654/0 (socket says 172.21.15.112:47654) 2023-11-08T12:29:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcffff700 1 -- 172.21.15.112:0/1371250633 learned_addr learned my addr 172.21.15.112:0/1371250633 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd015c6e0 0x7fcfd0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd509e700 1 --2- 172.21.15.112:0/1371250633 >> v2:172.21.15.133:3300/0 conn(0x7fcfd006a510 0x7fcfd006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335488074 0 0) 0x7fcfd015cab0 con 0x7fcfd0071fe0 2023-11-08T12:29:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc00035d0 con 0x7fcfd0071fe0 2023-11-08T12:29:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485230376 0 0) 0x7fcfc00035d0 con 0x7fcfd0071fe0 2023-11-08T12:29:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd015c6e0 msgr2=0x7fcfd0071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd015c6e0 0x7fcfd0071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 >> v2:172.21.15.133:3300/0 conn(0x7fcfd006a510 msgr2=0x7fcfd006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 --2- 172.21.15.112:0/1371250633 >> v2:172.21.15.133:3300/0 conn(0x7fcfd006a510 0x7fcfd006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00d2a10 con 0x7fcfd0071fe0 2023-11-08T12:29:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fcfbc001670 con 0x7fcfd0071fe0 2023-11-08T12:29:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 >> v1:172.21.15.112:6789/0 conn(0x7fcfd0071fe0 legacy=0x7fcfd0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfc0003a20 0x7fcfc0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc0004450 0x7fcfc0004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0004f80 0x7fcfc000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00d2800 con 0x7fcfc0003a20 2023-11-08T12:29:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00702d0 con 0x7fcfc0004450 2023-11-08T12:29:58.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc000bf70 con 0x7fcfc0004f80 2023-11-08T12:29:58.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd509e700 1 --2- 172.21.15.112:0/1371250633 >> v2:172.21.15.133:3300/0 conn(0x7fcfd006a510 0x7fcfd006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:58.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfd015c6e0 0x7fcfd0071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:58.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfc0003a20 0x7fcfc0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfcffff700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc0004450 0x7fcfc0004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd509e700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0004f80 0x7fcfc000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd489d700 1 -- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0004f80 msgr2=0x7fcfc000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:58.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.290+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0004f80 0x7fcfc000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd489d700 1 -- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc0004450 msgr2=0x7fcfc0004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc0004450 0x7fcfc0004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd489d700 1 -- 172.21.15.112:0/1371250633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00035d0 con 0x7fcfc0003a20 2023-11-08T12:29:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfcffff700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc0004450 0x7fcfc0004910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:29:58.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfc0003a20 0x7fcfc0003e30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcfd006fda0 tx=0x7fcfc00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0eb2aecdaf4201d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4004030 con 0x7fcfc0003a20 2023-11-08T12:29:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc4004190 con 0x7fcfc0003a20 2023-11-08T12:29:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfcf7fe700 1 -- 172.21.15.112:0/1371250633 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4004540 con 0x7fcfc0003a20 2023-11-08T12:29:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd589f700 1 -- 172.21.15.112:0/1371250633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfc0003a20 msgr2=0x7fcfc0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:58.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd589f700 1 --2- 172.21.15.112:0/1371250633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfc0003a20 0x7fcfc0003e30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcfd006fda0 tx=0x7fcfc00058a0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd509e700 1 -- 172.21.15.112:0/1371250633 reap_dead start 2023-11-08T12:29:58.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd589f700 1 -- 172.21.15.112:0/1371250633 shutdown_connections 2023-11-08T12:29:58.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd589f700 1 -- 172.21.15.112:0/1371250633 >> 172.21.15.112:0/1371250633 conn(0x7fcfd00b65b0 msgr2=0x7fcfd0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:58.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd589f700 1 -- 172.21.15.112:0/1371250633 shutdown_connections 2023-11-08T12:29:58.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.294+0000 7fcfd589f700 1 -- 172.21.15.112:0/1371250633 wait complete. 2023-11-08T12:29:58.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.298+0000 7fcfd589f700 1 Processor -- start 2023-11-08T12:29:58.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.298+0000 7fcfd589f700 1 -- start start 2023-11-08T12:29:58.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0003a20 0x7fcfd00b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd00b1000 0x7fcfd00b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd00b48e0 0x7fcfd00b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00b1470 con 0x7fcfd00b1000 2023-11-08T12:29:58.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00c96f0 con 0x7fcfd00b48e0 2023-11-08T12:29:58.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00cbd50 con 0x7fcfc0003a20 2023-11-08T12:29:58.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfcffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd00b1000 0x7fcfd00b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfcffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd00b1000 0x7fcfd00b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41416/0 (socket says 172.21.15.112:41416) 2023-11-08T12:29:58.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfcffff700 1 -- 172.21.15.112:0/1325264215 learned_addr learned my addr 172.21.15.112:0/1325264215 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:58.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd509e700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd00b48e0 0x7fcfd00b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0003a20 0x7fcfd00b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd509e700 1 -- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0003a20 msgr2=0x7fcfd00b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:58.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd509e700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0003a20 0x7fcfd00b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd509e700 1 -- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd00b1000 msgr2=0x7fcfd00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:58.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd509e700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd00b1000 0x7fcfd00b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:58.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd509e700 1 -- 172.21.15.112:0/1325264215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00d2fd0 con 0x7fcfd00b48e0 2023-11-08T12:29:58.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfcffff700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd00b1000 0x7fcfd00b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:29:58.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd509e700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd00b48e0 0x7fcfd00b4d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfd006df30 tx=0x7fcfc8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:58.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfcd7fa700 1 -- 172.21.15.112:0/1325264215 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800e070 con 0x7fcfd00b48e0 2023-11-08T12:29:58.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd00d2cf0 con 0x7fcfd00b48e0 2023-11-08T12:29:58.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfcd7fa700 1 -- 172.21.15.112:0/1325264215 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc8003c50 con 0x7fcfd00b48e0 2023-11-08T12:29:58.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfcd7fa700 1 -- 172.21.15.112:0/1325264215 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8003de0 con 0x7fcfd00b48e0 2023-11-08T12:29:58.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.302+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd00d32b0 con 0x7fcfd00b48e0 2023-11-08T12:29:58.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.306+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd015b870 con 0x7fcfd00b48e0 2023-11-08T12:29:58.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.306+0000 7fcfcd7fa700 1 -- 172.21.15.112:0/1325264215 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcfc80119b0 con 0x7fcfd00b48e0 2023-11-08T12:29:58.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.306+0000 7fcfcd7fa700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcfb4064f10 0x7fcfb40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:58.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.306+0000 7fcfcd7fa700 1 -- 172.21.15.112:0/1325264215 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fcfc8082890 con 0x7fcfd00b48e0 2023-11-08T12:29:58.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.306+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcfb4064f10 0x7fcfb40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:58.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.310+0000 7fcfd489d700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcfb4064f10 0x7fcfb40673c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400a010 tx=0x7fcfc4020040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:58.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.314+0000 7fcfcd7fa700 1 -- 172.21.15.112:0/1325264215 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcfc80506f0 con 0x7fcfd00b48e0 2023-11-08T12:29:58.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:58.486+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcfd0073cb0 con 0x7fcfd00b48e0 2023-11-08T12:29:59.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.034+0000 7fcfcd7fa700 1 -- 172.21.15.112:0/1325264215 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcfc8053d10 con 0x7fcfd00b48e0 2023-11-08T12:29:59.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcfb4064f10 msgr2=0x7fcfb40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:59.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcfb4064f10 0x7fcfb40673c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400a010 tx=0x7fcfc4020040 comp rx=0 tx=0).stop 2023-11-08T12:29:59.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd00b48e0 msgr2=0x7fcfd00b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:59.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd00b48e0 0x7fcfd00b4d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfd006df30 tx=0x7fcfc8009f90 comp rx=0 tx=0).stop 2023-11-08T12:29:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 shutdown_connections 2023-11-08T12:29:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcfb4064f10 0x7fcfb40673c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd00b48e0 0x7fcfd00b4d50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfd00b1000 0x7fcfd00b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 --2- 172.21.15.112:0/1325264215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcfc0003a20 0x7fcfd00b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 >> 172.21.15.112:0/1325264215 conn(0x7fcfd00b65b0 msgr2=0x7fcfd015bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:59.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 shutdown_connections 2023-11-08T12:29:59.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.042+0000 7fcfd589f700 1 -- 172.21.15.112:0/1325264215 wait complete. 2023-11-08T12:29:59.053 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2023-11-08T12:29:59.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T12:29:59.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.250+0000 7f6171662700 1 Processor -- start 2023-11-08T12:29:59.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.250+0000 7f6171662700 1 -- start start 2023-11-08T12:29:59.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f6171662700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 0x7f616c06a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:59.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f6171662700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f616c06c630 0x7f616c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:59.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f6171662700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c06a790 con 0x7f616c15c6e0 2023-11-08T12:29:59.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f6171662700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0d2800 con 0x7f616c06c630 2023-11-08T12:29:59.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f6171662700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c15cab0 con 0x7f616c069e00 2023-11-08T12:29:59.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f616affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f616c15c6e0 0x7f616c071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47670/0 (socket says 172.21.15.112:47670) 2023-11-08T12:29:59.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f616affd700 1 -- 172.21.15.112:0/2866416385 learned_addr learned my addr 172.21.15.112:0/2866416385 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:29:59.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f616b7fe700 1 --2- 172.21.15.112:0/2866416385 >> v2:172.21.15.133:3300/0 conn(0x7f616c06c630 0x7f616c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:59.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.254+0000 7f616a7fc700 1 --2- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 0x7f616c06a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:59.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6169ffb700 1 -- 172.21.15.112:0/2866416385 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334278529 0 0) 0x7f615c001110 con 0x7f616c15c6e0 2023-11-08T12:29:59.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6169ffb700 1 -- 172.21.15.112:0/2866416385 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61540035d0 con 0x7f616c15c6e0 2023-11-08T12:29:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f616b7fe700 1 -- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 msgr2=0x7f616c06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:29:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f616b7fe700 1 --2- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 0x7f616c06a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f616b7fe700 1 -- 172.21.15.112:0/2866416385 >> v1:172.21.15.112:6789/0 conn(0x7f616c15c6e0 legacy=0x7f616c071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f616b7fe700 1 -- 172.21.15.112:0/2866416385 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0702d0 con 0x7f616c06c630 2023-11-08T12:29:59.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f616b7fe700 1 --2- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 0x7f616c06ca80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6164009d90 tx=0x7f616400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0feb2b0df14767 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:59.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6169ffb700 1 -- 172.21.15.112:0/2866416385 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616400e070 con 0x7f616c06c630 2023-11-08T12:29:59.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6169ffb700 1 -- 172.21.15.112:0/2866416385 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616400bb20 con 0x7f616c06c630 2023-11-08T12:29:59.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6169ffb700 1 -- 172.21.15.112:0/2866416385 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164012430 con 0x7f616c06c630 2023-11-08T12:29:59.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 -- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 msgr2=0x7f616c06ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:59.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 --2- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 0x7f616c06ca80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6164009d90 tx=0x7f616400b330 comp rx=0 tx=0).stop 2023-11-08T12:29:59.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 -- 172.21.15.112:0/2866416385 shutdown_connections 2023-11-08T12:29:59.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 --2- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 0x7f616c06ca80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 --2- 172.21.15.112:0/2866416385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 0x7f616c06a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 -- 172.21.15.112:0/2866416385 >> 172.21.15.112:0/2866416385 conn(0x7f616c0b65b0 msgr2=0x7f616c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:29:59.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 -- 172.21.15.112:0/2866416385 shutdown_connections 2023-11-08T12:29:59.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.258+0000 7f6171662700 1 -- 172.21.15.112:0/2866416385 wait complete. 2023-11-08T12:29:59.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 Processor -- start 2023-11-08T12:29:59.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 -- start start 2023-11-08T12:29:59.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 0x7f616c09bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:59.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 0x7f616c0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:59.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616c15c6e0 0x7f616c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:59.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c152330 con 0x7f616c15c6e0 2023-11-08T12:29:59.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c09c1b0 con 0x7f616c06c630 2023-11-08T12:29:59.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c151a90 con 0x7f616c069e00 2023-11-08T12:29:59.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616c15c6e0 0x7f616c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:59.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616c15c6e0 0x7f616c1558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41430/0 (socket says 172.21.15.112:41430) 2023-11-08T12:29:59.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 -- 172.21.15.112:0/1287234933 learned_addr learned my addr 172.21.15.112:0/1287234933 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:29:59.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 -- 172.21.15.112:0/1287234933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 msgr2=0x7f616c09bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:59.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 0x7f616c09bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616a7fc700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 0x7f616c0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:59.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 -- 172.21.15.112:0/1287234933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 msgr2=0x7f616c0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:29:59.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 0x7f616c0b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:29:59.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 -- 172.21.15.112:0/1287234933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164009a70 con 0x7f616c15c6e0 2023-11-08T12:29:59.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f616b7fe700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616c15c6e0 0x7f616c1558f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6164014040 tx=0x7f6164004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:59.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f61537fe700 1 -- 172.21.15.112:0/1287234933 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164004960 con 0x7f616c15c6e0 2023-11-08T12:29:59.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f61537fe700 1 -- 172.21.15.112:0/1287234933 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164020070 con 0x7f616c15c6e0 2023-11-08T12:29:59.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f61537fe700 1 -- 172.21.15.112:0/1287234933 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640276e0 con 0x7f616c15c6e0 2023-11-08T12:29:59.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.262+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c0d2cf0 con 0x7f616c15c6e0 2023-11-08T12:29:59.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.266+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c0d2a10 con 0x7f616c15c6e0 2023-11-08T12:29:59.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.266+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c0d2fd0 con 0x7f616c15c6e0 2023-11-08T12:29:59.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.266+0000 7f61537fe700 1 -- 172.21.15.112:0/1287234933 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f616402e070 con 0x7f616c15c6e0 2023-11-08T12:29:59.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.266+0000 7f61537fe700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6158064f10 0x7f61580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:29:59.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.270+0000 7f61537fe700 1 -- 172.21.15.112:0/1287234933 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6088+0+0 (secure 0 0 0) 0x7f6164022070 con 0x7f616c15c6e0 2023-11-08T12:29:59.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.270+0000 7f616affd700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6158064f10 0x7f61580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:29:59.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.270+0000 7f616affd700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6158064f10 0x7f61580673c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f615c005930 tx=0x7f615c001150 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:29:59.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.274+0000 7f61537fe700 1 -- 172.21.15.112:0/1287234933 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6164051cc0 con 0x7f616c15c6e0 2023-11-08T12:29:59.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:29:59.446+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f616c073cb0 con 0x7f616c15c6e0 2023-11-08T12:30:00.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.034+0000 7f61537fe700 1 -- 172.21.15.112:0/1287234933 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 169+0+0 (secure 0 0 0) 0x7f616402c0d0 con 0x7f616c15c6e0 2023-11-08T12:30:00.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6158064f10 msgr2=0x7f61580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6158064f10 0x7f61580673c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f615c005930 tx=0x7f615c001150 comp rx=0 tx=0).stop 2023-11-08T12:30:00.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616c15c6e0 msgr2=0x7f616c1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616c15c6e0 0x7f616c1558f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6164014040 tx=0x7f6164004af0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 shutdown_connections 2023-11-08T12:30:00.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6158064f10 0x7f61580673c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616c15c6e0 0x7f616c1558f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c06c630 0x7f616c0b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 --2- 172.21.15.112:0/1287234933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f616c069e00 0x7f616c09bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 >> 172.21.15.112:0/1287234933 conn(0x7f616c0b65b0 msgr2=0x7f616c159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:00.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 shutdown_connections 2023-11-08T12:30:00.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.042+0000 7f6171662700 1 -- 172.21.15.112:0/1287234933 wait complete. 2023-11-08T12:30:00.049 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2023-11-08T12:30:00.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T12:30:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f8355882700 1 Processor -- start 2023-11-08T12:30:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f8355882700 1 -- start start 2023-11-08T12:30:00.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f8355882700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83500b2130 0x7f835006a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f8355882700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500cd360 con 0x7f835015c700 2023-11-08T12:30:00.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f8355882700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8350160190 con 0x7f8350070a00 2023-11-08T12:30:00.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f8355882700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8350160470 con 0x7f83500b2130 2023-11-08T12:30:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f834effd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f835015c700 0x7f83500702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47678/0 (socket says 172.21.15.112:47678) 2023-11-08T12:30:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f834effd700 1 -- 172.21.15.112:0/1373761470 learned_addr learned my addr 172.21.15.112:0/1373761470 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f834f7fe700 1 --2- 172.21.15.112:0/1373761470 >> v2:172.21.15.133:3300/0 conn(0x7f83500b2130 0x7f835006a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.254+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234232956 0 0) 0x7f83500cd360 con 0x7f835015c700 2023-11-08T12:30:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83380035d0 con 0x7f835015c700 2023-11-08T12:30:00.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1840289966 0 0) 0x7f83380035d0 con 0x7f835015c700 2023-11-08T12:30:00.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 >> v2:172.21.15.133:3300/0 conn(0x7f83500b2130 msgr2=0x7f835006a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:00.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 --2- 172.21.15.112:0/1373761470 >> v2:172.21.15.133:3300/0 conn(0x7f83500b2130 0x7f835006a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 >> v1:172.21.15.133:6789/0 conn(0x7f8350070a00 legacy=0x7f8350069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350160750 con 0x7f835015c700 2023-11-08T12:30:00.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f8340001670 con 0x7f835015c700 2023-11-08T12:30:00.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 >> v1:172.21.15.112:6789/0 conn(0x7f835015c700 legacy=0x7f83500702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8338003a20 0x7f8338003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8338004870 0x7f8338004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338005220 0x7f833800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350160470 con 0x7f8338004870 2023-11-08T12:30:00.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833800c0a0 con 0x7f8338003a20 2023-11-08T12:30:00.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833800c260 con 0x7f8338005220 2023-11-08T12:30:00.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834effd700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8338003a20 0x7f8338003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834e7fc700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8338004870 0x7f8338004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834f7fe700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338005220 0x7f833800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834effd700 1 -- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338005220 msgr2=0x7f833800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:00.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834effd700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338005220 0x7f833800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834effd700 1 -- 172.21.15.112:0/1373761470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8338004870 msgr2=0x7f8338004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:00.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834effd700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8338004870 0x7f8338004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834effd700 1 -- 172.21.15.112:0/1373761470 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380035d0 con 0x7f8338003a20 2023-11-08T12:30:00.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.258+0000 7f834f7fe700 1 -- 172.21.15.112:0/1373761470 reap_dead start 2023-11-08T12:30:00.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.262+0000 7f834effd700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8338003a20 0x7f8338003e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f834000c320 tx=0x7f83380058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2f7da77109c9ce server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:00.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.266+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340007c30 con 0x7f8338003a20 2023-11-08T12:30:00.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.266+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000ce80 con 0x7f8338003a20 2023-11-08T12:30:00.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.266+0000 7f834dffb700 1 -- 172.21.15.112:0/1373761470 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340005bc0 con 0x7f8338003a20 2023-11-08T12:30:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.270+0000 7f8355882700 1 -- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8338003a20 msgr2=0x7f8338003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.270+0000 7f8355882700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8338003a20 0x7f8338003e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f834000c320 tx=0x7f83380058a0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.270+0000 7f8355882700 1 -- 172.21.15.112:0/1373761470 shutdown_connections 2023-11-08T12:30:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.270+0000 7f8355882700 1 --2- 172.21.15.112:0/1373761470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8338003a20 0x7f8338003e30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.270+0000 7f8355882700 1 -- 172.21.15.112:0/1373761470 >> 172.21.15.112:0/1373761470 conn(0x7f83500d2d10 msgr2=0x7f83500d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.270+0000 7f8355882700 1 -- 172.21.15.112:0/1373761470 shutdown_connections 2023-11-08T12:30:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.270+0000 7f8355882700 1 -- 172.21.15.112:0/1373761470 wait complete. 2023-11-08T12:30:00.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 Processor -- start 2023-11-08T12:30:00.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 -- start start 2023-11-08T12:30:00.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338003a20 0x7f83500c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500c72e0 0x7f835015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835015eb10 0x7f8350158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c8660 con 0x7f835015eb10 2023-11-08T12:30:00.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835015ef80 con 0x7f83500c72e0 2023-11-08T12:30:00.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.274+0000 7f8355882700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c98f0 con 0x7f8338003a20 2023-11-08T12:30:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500c72e0 0x7f835015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500c72e0 0x7f835015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:57484/0 (socket says 172.21.15.112:57484) 2023-11-08T12:30:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 -- 172.21.15.112:0/1914817779 learned_addr learned my addr 172.21.15.112:0/1914817779 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834effd700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338003a20 0x7f83500c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834f7fe700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835015eb10 0x7f8350158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 -- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338003a20 msgr2=0x7f83500c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338003a20 0x7f83500c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 -- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835015eb10 msgr2=0x7f8350158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835015eb10 0x7f8350158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 -- 172.21.15.112:0/1914817779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835006b530 con 0x7f83500c72e0 2023-11-08T12:30:00.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f834e7fc700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500c72e0 0x7f835015e5d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f834400f640 tx=0x7f834400f950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:00.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f8337fff700 1 -- 172.21.15.112:0/1914817779 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440052e0 con 0x7f83500c72e0 2023-11-08T12:30:00.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f8337fff700 1 -- 172.21.15.112:0/1914817779 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8344005460 con 0x7f83500c72e0 2023-11-08T12:30:00.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f8337fff700 1 -- 172.21.15.112:0/1914817779 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440038e0 con 0x7f83500c72e0 2023-11-08T12:30:00.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8350160a30 con 0x7f83500c72e0 2023-11-08T12:30:00.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.278+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83500b1be0 con 0x7f83500c72e0 2023-11-08T12:30:00.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.282+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83500726c0 con 0x7f83500c72e0 2023-11-08T12:30:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.282+0000 7f8337fff700 1 -- 172.21.15.112:0/1914817779 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8344038af0 con 0x7f83500c72e0 2023-11-08T12:30:00.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.282+0000 7f8337fff700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f833c064f10 0x7f833c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.282+0000 7f8337fff700 1 -- 172.21.15.112:0/1914817779 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8344081e00 con 0x7f83500c72e0 2023-11-08T12:30:00.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.286+0000 7f834effd700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f833c064f10 0x7f833c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.286+0000 7f834effd700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f833c064f10 0x7f833c0673c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8340001930 tx=0x7f8340007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:00.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.286+0000 7f8337fff700 1 -- 172.21.15.112:0/1914817779 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8344050110 con 0x7f83500c72e0 2023-11-08T12:30:00.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.450+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f835006b150 con 0x7f83500c72e0 2023-11-08T12:30:00.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.462+0000 7f8337fff700 1 -- 172.21.15.112:0/1914817779 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8344053730 con 0x7f83500c72e0 2023-11-08T12:30:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f833c064f10 msgr2=0x7f833c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f833c064f10 0x7f833c0673c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8340001930 tx=0x7f8340007000 comp rx=0 tx=0).stop 2023-11-08T12:30:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500c72e0 msgr2=0x7f835015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500c72e0 0x7f835015e5d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f834400f640 tx=0x7f834400f950 comp rx=0 tx=0).stop 2023-11-08T12:30:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 shutdown_connections 2023-11-08T12:30:00.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f833c064f10 0x7f833c0673c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f835015eb10 0x7f8350158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500c72e0 0x7f835015e5d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 --2- 172.21.15.112:0/1914817779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8338003a20 0x7f83500c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 >> 172.21.15.112:0/1914817779 conn(0x7f83500d2d10 msgr2=0x7f835015b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:00.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 shutdown_connections 2023-11-08T12:30:00.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.466+0000 7f8355882700 1 -- 172.21.15.112:0/1914817779 wait complete. 2023-11-08T12:30:00.496 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-08T12:30:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.670+0000 7fb46bfff700 1 Processor -- start 2023-11-08T12:30:00.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.670+0000 7fb46bfff700 1 -- start start 2023-11-08T12:30:00.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb46c071aa0 0x7fb46c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb46c069e00 0x7fb46c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46bfff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c06c600 con 0x7fb46c15c640 2023-11-08T12:30:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46bfff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c06cef0 con 0x7fb46c069e00 2023-11-08T12:30:00.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0d38f0 con 0x7fb46c071aa0 2023-11-08T12:30:00.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb46c069e00 0x7fb46c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb46c15c640 0x7fb46c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47688/0 (socket says 172.21.15.112:47688) 2023-11-08T12:30:00.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46affd700 1 -- 172.21.15.112:0/1411023324 learned_addr learned my addr 172.21.15.112:0/1411023324 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:00.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46a7fc700 1 --2- 172.21.15.112:0/1411023324 >> v2:172.21.15.133:3300/0 conn(0x7fb46c071aa0 0x7fb46c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46b7fe700 1 -- 172.21.15.112:0/1411023324 >> v2:172.21.15.133:3300/0 conn(0x7fb46c071aa0 msgr2=0x7fb46c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:00.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46b7fe700 1 --2- 172.21.15.112:0/1411023324 >> v2:172.21.15.133:3300/0 conn(0x7fb46c071aa0 0x7fb46c06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46b7fe700 1 -- 172.21.15.112:0/1411023324 >> v1:172.21.15.112:6789/0 conn(0x7fb46c15c640 legacy=0x7fb46c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46b7fe700 1 -- 172.21.15.112:0/1411023324 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0722f0 con 0x7fb46c069e00 2023-11-08T12:30:00.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb46b7fe700 1 --2- 172.21.15.112:0/1411023324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c06a280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb46c070e70 tx=0x7fb46400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2d25a4dd5321fc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:00.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb469ffb700 1 -- 172.21.15.112:0/1411023324 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400e070 con 0x7fb46c069e00 2023-11-08T12:30:00.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb469ffb700 1 -- 172.21.15.112:0/1411023324 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400bb20 con 0x7fb46c069e00 2023-11-08T12:30:00.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.674+0000 7fb469ffb700 1 -- 172.21.15.112:0/1411023324 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464012430 con 0x7fb46c069e00 2023-11-08T12:30:00.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 -- 172.21.15.112:0/1411023324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 msgr2=0x7fb46c06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 --2- 172.21.15.112:0/1411023324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c06a280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb46c070e70 tx=0x7fb46400b330 comp rx=0 tx=0).stop 2023-11-08T12:30:00.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 -- 172.21.15.112:0/1411023324 shutdown_connections 2023-11-08T12:30:00.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 --2- 172.21.15.112:0/1411023324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c06a280 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 --2- 172.21.15.112:0/1411023324 >> v2:172.21.15.133:3300/0 conn(0x7fb46c071aa0 0x7fb46c06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 -- 172.21.15.112:0/1411023324 >> 172.21.15.112:0/1411023324 conn(0x7fb46c0b6520 msgr2=0x7fb46c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:00.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 -- 172.21.15.112:0/1411023324 shutdown_connections 2023-11-08T12:30:00.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 -- 172.21.15.112:0/1411023324 wait complete. 2023-11-08T12:30:00.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 Processor -- start 2023-11-08T12:30:00.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.678+0000 7fb46bfff700 1 -- start start 2023-11-08T12:30:00.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb46c071aa0 0x7fb46c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb46c15c640 0x7fb46c1f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0cac70 con 0x7fb46c069e00 2023-11-08T12:30:00.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0cde30 con 0x7fb46c15c640 2023-11-08T12:30:00.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0cb690 con 0x7fb46c071aa0 2023-11-08T12:30:00.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c0caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41480/0 (socket says 172.21.15.112:41480) 2023-11-08T12:30:00.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 -- 172.21.15.112:0/2706060498 learned_addr learned my addr 172.21.15.112:0/2706060498 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:00.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46a7fc700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb46c071aa0 0x7fb46c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46b7fe700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb46c15c640 0x7fb46c1f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 -- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb46c071aa0 msgr2=0x7fb46c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb46c071aa0 0x7fb46c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 -- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb46c15c640 msgr2=0x7fb46c1f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:00.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb46c15c640 0x7fb46c1f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:00.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 -- 172.21.15.112:0/2706060498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009a70 con 0x7fb46c069e00 2023-11-08T12:30:00.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46affd700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c0caf90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00c700 tx=0x7fb45c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:00.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb4537fe700 1 -- 172.21.15.112:0/2706060498 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c005d90 con 0x7fb46c069e00 2023-11-08T12:30:00.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb4537fe700 1 -- 172.21.15.112:0/2706060498 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c0070d0 con 0x7fb46c069e00 2023-11-08T12:30:00.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c072010 con 0x7fb46c069e00 2023-11-08T12:30:00.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb4537fe700 1 -- 172.21.15.112:0/2706060498 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c007440 con 0x7fb46c069e00 2023-11-08T12:30:00.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.682+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c15ca10 con 0x7fb46c069e00 2023-11-08T12:30:00.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.686+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c06c830 con 0x7fb46c069e00 2023-11-08T12:30:00.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.686+0000 7fb4537fe700 1 -- 172.21.15.112:0/2706060498 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb45c019030 con 0x7fb46c069e00 2023-11-08T12:30:00.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.686+0000 7fb4537fe700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb458064f10 0x7fb4580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:00.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.686+0000 7fb4537fe700 1 -- 172.21.15.112:0/2706060498 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb45c081060 con 0x7fb46c069e00 2023-11-08T12:30:00.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.690+0000 7fb46a7fc700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb458064f10 0x7fb4580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:00.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.690+0000 7fb46a7fc700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb458064f10 0x7fb4580673c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb46c15bd80 tx=0x7fb460008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:00.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.694+0000 7fb4537fe700 1 -- 172.21.15.112:0/2706060498 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb45c04a400 con 0x7fb46c069e00 2023-11-08T12:30:00.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:00.918+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fb46c073cb0 con 0x7fb46c069e00 2023-11-08T12:30:01.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.038+0000 7fb4537fe700 1 -- 172.21.15.112:0/2706060498 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v137) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb45c04f3f0 con 0x7fb46c069e00 2023-11-08T12:30:01.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb458064f10 msgr2=0x7fb4580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:01.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb458064f10 0x7fb4580673c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb46c15bd80 tx=0x7fb460008040 comp rx=0 tx=0).stop 2023-11-08T12:30:01.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 msgr2=0x7fb46c0caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:01.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c0caf90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00c700 tx=0x7fb45c00cac0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 shutdown_connections 2023-11-08T12:30:01.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb458064f10 0x7fb4580673c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb46c15c640 0x7fb46c1f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb46c071aa0 0x7fb46c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 --2- 172.21.15.112:0/2706060498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46c069e00 0x7fb46c0caf90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 >> 172.21.15.112:0/2706060498 conn(0x7fb46c0b6520 msgr2=0x7fb46c0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:01.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 shutdown_connections 2023-11-08T12:30:01.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.042+0000 7fb46bfff700 1 -- 172.21.15.112:0/2706060498 wait complete. 2023-11-08T12:30:01.070 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-11-08T12:30:01.071 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-11-08T12:30:01.071 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T12:30:01.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-08T12:30:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.250+0000 7fefa18d5700 1 Processor -- start 2023-11-08T12:30:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.250+0000 7fefa18d5700 1 -- start start 2023-11-08T12:30:01.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fefa18d5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef9c156820 0x7fef9c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fefa18d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef9c15fe30 0x7fef9c160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fefa18d5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0d0670 con 0x7fef9c071640 2023-11-08T12:30:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fefa18d5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0d0c30 con 0x7fef9c156820 2023-11-08T12:30:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fefa18d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c160770 con 0x7fef9c15fe30 2023-11-08T12:30:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fef9bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fef9c071640 0x7fef9c0d2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47698/0 (socket says 172.21.15.112:47698) 2023-11-08T12:30:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fef9bfff700 1 -- 172.21.15.112:0/3732011866 learned_addr learned my addr 172.21.15.112:0/3732011866 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fefa08d3700 1 --2- 172.21.15.112:0/3732011866 >> v2:172.21.15.112:3300/0 conn(0x7fef9c156820 0x7fef9c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.254+0000 7fefa10d4700 1 --2- 172.21.15.112:0/3732011866 >> v2:172.21.15.133:3300/0 conn(0x7fef9c15fe30 0x7fef9c160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fef9b7fe700 1 -- 172.21.15.112:0/3732011866 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761146035 0 0) 0x7fef9c0d0670 con 0x7fef9c071640 2023-11-08T12:30:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fef9b7fe700 1 -- 172.21.15.112:0/3732011866 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef8c0035d0 con 0x7fef9c071640 2023-11-08T12:30:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa08d3700 1 -- 172.21.15.112:0/3732011866 >> v2:172.21.15.133:3300/0 conn(0x7fef9c15fe30 msgr2=0x7fef9c160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa08d3700 1 --2- 172.21.15.112:0/3732011866 >> v2:172.21.15.133:3300/0 conn(0x7fef9c15fe30 0x7fef9c160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa08d3700 1 -- 172.21.15.112:0/3732011866 >> v1:172.21.15.112:6789/0 conn(0x7fef9c071640 legacy=0x7fef9c0d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:01.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa08d3700 1 -- 172.21.15.112:0/3732011866 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c070b50 con 0x7fef9c156820 2023-11-08T12:30:01.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa08d3700 1 --2- 172.21.15.112:0/3732011866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c156820 0x7fef9c0b1ee0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0d1fc0 tx=0x7fef90009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d449587ae6389f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:01.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fef9b7fe700 1 -- 172.21.15.112:0/3732011866 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90011830 con 0x7fef9c156820 2023-11-08T12:30:01.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fef9b7fe700 1 -- 172.21.15.112:0/3732011866 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef90011990 con 0x7fef9c156820 2023-11-08T12:30:01.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fef9b7fe700 1 -- 172.21.15.112:0/3732011866 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90011d20 con 0x7fef9c156820 2023-11-08T12:30:01.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 -- 172.21.15.112:0/3732011866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c156820 msgr2=0x7fef9c0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:01.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 --2- 172.21.15.112:0/3732011866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c156820 0x7fef9c0b1ee0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0d1fc0 tx=0x7fef90009b30 comp rx=0 tx=0).stop 2023-11-08T12:30:01.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 -- 172.21.15.112:0/3732011866 shutdown_connections 2023-11-08T12:30:01.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 --2- 172.21.15.112:0/3732011866 >> v2:172.21.15.133:3300/0 conn(0x7fef9c15fe30 0x7fef9c160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 --2- 172.21.15.112:0/3732011866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c156820 0x7fef9c0b1ee0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 -- 172.21.15.112:0/3732011866 >> 172.21.15.112:0/3732011866 conn(0x7fef9c06cb80 msgr2=0x7fef9c0b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:01.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 -- 172.21.15.112:0/3732011866 shutdown_connections 2023-11-08T12:30:01.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.258+0000 7fefa18d5700 1 -- 172.21.15.112:0/3732011866 wait complete. 2023-11-08T12:30:01.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 Processor -- start 2023-11-08T12:30:01.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 -- start start 2023-11-08T12:30:01.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c071640 0x7fef9c151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:01.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c156820 0x7fef9c0d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:01.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef9c15fe30 0x7fef9c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:01.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0b7670 con 0x7fef9c071640 2023-11-08T12:30:01.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0b7b00 con 0x7fef9c156820 2023-11-08T12:30:01.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa18d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0b6a60 con 0x7fef9c15fe30 2023-11-08T12:30:01.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa08d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c071640 0x7fef9c151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:01.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa08d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c071640 0x7fef9c151520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41498/0 (socket says 172.21.15.112:41498) 2023-11-08T12:30:01.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa08d3700 1 -- 172.21.15.112:0/814998701 learned_addr learned my addr 172.21.15.112:0/814998701 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:01.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fef9bfff700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c156820 0x7fef9c0d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:01.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa10d4700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef9c15fe30 0x7fef9c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:01.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.262+0000 7fefa08d3700 1 -- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef9c15fe30 msgr2=0x7fef9c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:01.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa08d3700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef9c15fe30 0x7fef9c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa08d3700 1 -- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c156820 msgr2=0x7fef9c0d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:01.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa08d3700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c156820 0x7fef9c0d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:01.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa08d3700 1 -- 172.21.15.112:0/814998701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900094b0 con 0x7fef9c071640 2023-11-08T12:30:01.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fef9bfff700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c156820 0x7fef9c0d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:01.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa10d4700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef9c15fe30 0x7fef9c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:01.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa08d3700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c071640 0x7fef9c151520 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fef90009b70 tx=0x7fef90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:01.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fef997fa700 1 -- 172.21.15.112:0/814998701 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90004480 con 0x7fef9c071640 2023-11-08T12:30:01.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fef997fa700 1 -- 172.21.15.112:0/814998701 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9001f070 con 0x7fef9c071640 2023-11-08T12:30:01.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fef997fa700 1 -- 172.21.15.112:0/814998701 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef900038c0 con 0x7fef9c071640 2023-11-08T12:30:01.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c0d08c0 con 0x7fef9c071640 2023-11-08T12:30:01.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c070e30 con 0x7fef9c071640 2023-11-08T12:30:01.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.266+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c0b2420 con 0x7fef9c071640 2023-11-08T12:30:01.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.270+0000 7fef997fa700 1 -- 172.21.15.112:0/814998701 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef9002a020 con 0x7fef9c071640 2023-11-08T12:30:01.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.270+0000 7fef997fa700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef80064ee0 0x7fef80067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:01.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.270+0000 7fef997fa700 1 -- 172.21.15.112:0/814998701 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fef90083240 con 0x7fef9c071640 2023-11-08T12:30:01.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.270+0000 7fef9bfff700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef80064ee0 0x7fef80067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:01.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.270+0000 7fef9bfff700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef80064ee0 0x7fef80067390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0d00f0 tx=0x7fef88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:01.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.274+0000 7fef997fa700 1 -- 172.21.15.112:0/814998701 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef900514d0 con 0x7fef9c071640 2023-11-08T12:30:01.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:01.506+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fef9c073cb0 con 0x7fef9c071640 2023-11-08T12:30:02.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.042+0000 7fef997fa700 1 -- 172.21.15.112:0/814998701 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v138) v1 ==== 152+0+0 (secure 0 0 0) 0x7fef90054af0 con 0x7fef9c071640 2023-11-08T12:30:02.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef80064ee0 msgr2=0x7fef80067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef80064ee0 0x7fef80067390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0d00f0 tx=0x7fef88009040 comp rx=0 tx=0).stop 2023-11-08T12:30:02.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c071640 msgr2=0x7fef9c151520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c071640 0x7fef9c151520 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fef90009b70 tx=0x7fef90004770 comp rx=0 tx=0).stop 2023-11-08T12:30:02.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 shutdown_connections 2023-11-08T12:30:02.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef80064ee0 0x7fef80067390 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef9c15fe30 0x7fef9c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c156820 0x7fef9c0d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 --2- 172.21.15.112:0/814998701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef9c071640 0x7fef9c151520 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 >> 172.21.15.112:0/814998701 conn(0x7fef9c06cb80 msgr2=0x7fef9c0b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:02.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 shutdown_connections 2023-11-08T12:30:02.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.046+0000 7fefa18d5700 1 -- 172.21.15.112:0/814998701 wait complete. 2023-11-08T12:30:02.077 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T12:30:02.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.278+0000 7f9275377700 1 Processor -- start 2023-11-08T12:30:02.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.278+0000 7f9275377700 1 -- start start 2023-11-08T12:30:02.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9275377700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9270070620 0x7f92700b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9275377700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9270069bf0 0x7f9270069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9275377700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927015c520 con 0x7f927015c150 2023-11-08T12:30:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9275377700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92700b4240 con 0x7f9270069bf0 2023-11-08T12:30:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9275377700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927006cc50 con 0x7f9270070620 2023-11-08T12:30:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9270069bf0 0x7f9270069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9270069bf0 0x7f9270069ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41506/0 (socket says 172.21.15.112:41506) 2023-11-08T12:30:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 -- 172.21.15.112:0/234928649 learned_addr learned my addr 172.21.15.112:0/234928649 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f926f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9270070620 0x7f92700b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 -- 172.21.15.112:0/234928649 >> v2:172.21.15.133:3300/0 conn(0x7f9270070620 msgr2=0x7f92700b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 --2- 172.21.15.112:0/234928649 >> v2:172.21.15.133:3300/0 conn(0x7f9270070620 0x7f92700b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 -- 172.21.15.112:0/234928649 >> v1:172.21.15.133:6789/0 conn(0x7f927015c150 legacy=0x7f927006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 -- 172.21.15.112:0/234928649 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700d2450 con 0x7f9270069bf0 2023-11-08T12:30:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9274b76700 1 --2- 172.21.15.112:0/234928649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270069bf0 0x7f9270069ff0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9270066d30 tx=0x7f926800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e3a9cd27b50120 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f926effd700 1 -- 172.21.15.112:0/234928649 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926800e070 con 0x7f9270069bf0 2023-11-08T12:30:02.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f926effd700 1 -- 172.21.15.112:0/234928649 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926800b910 con 0x7f9270069bf0 2023-11-08T12:30:02.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f926effd700 1 -- 172.21.15.112:0/234928649 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926800bcc0 con 0x7f9270069bf0 2023-11-08T12:30:02.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9275377700 1 -- 172.21.15.112:0/234928649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270069bf0 msgr2=0x7f9270069ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.282+0000 7f9275377700 1 --2- 172.21.15.112:0/234928649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270069bf0 0x7f9270069ff0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9270066d30 tx=0x7f926800b330 comp rx=0 tx=0).stop 2023-11-08T12:30:02.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 -- 172.21.15.112:0/234928649 shutdown_connections 2023-11-08T12:30:02.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 --2- 172.21.15.112:0/234928649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270069bf0 0x7f9270069ff0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 --2- 172.21.15.112:0/234928649 >> v2:172.21.15.133:3300/0 conn(0x7f9270070620 0x7f92700b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 -- 172.21.15.112:0/234928649 >> 172.21.15.112:0/234928649 conn(0x7f92700d3680 msgr2=0x7f92700cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:02.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 -- 172.21.15.112:0/234928649 shutdown_connections 2023-11-08T12:30:02.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 -- 172.21.15.112:0/234928649 wait complete. 2023-11-08T12:30:02.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 Processor -- start 2023-11-08T12:30:02.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.286+0000 7f9275377700 1 -- start start 2023-11-08T12:30:02.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9270069bf0 0x7f92700b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9270070620 0x7f92700b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927015c150 0x7f9270150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9270150fb0 con 0x7f927015c150 2023-11-08T12:30:02.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9270150cd0 con 0x7f9270070620 2023-11-08T12:30:02.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700b5a80 con 0x7f9270069bf0 2023-11-08T12:30:02.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927015c150 0x7f9270150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f926f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9270070620 0x7f92700b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f926ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9270069bf0 0x7f92700b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927015c150 0x7f9270150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41510/0 (socket says 172.21.15.112:41510) 2023-11-08T12:30:02.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 -- 172.21.15.112:0/4271411126 learned_addr learned my addr 172.21.15.112:0/4271411126 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:02.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 -- 172.21.15.112:0/4271411126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9270069bf0 msgr2=0x7f92700b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9270069bf0 0x7f92700b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 -- 172.21.15.112:0/4271411126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9270070620 msgr2=0x7f92700b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9270070620 0x7f92700b83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 -- 172.21.15.112:0/4271411126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268009b30 con 0x7f927015c150 2023-11-08T12:30:02.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9274b76700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927015c150 0x7f9270150430 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9270073200 tx=0x7f9268004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:02.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f926cff9700 1 -- 172.21.15.112:0/4271411126 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268004880 con 0x7f927015c150 2023-11-08T12:30:02.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f926cff9700 1 -- 172.21.15.112:0/4271411126 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680099b0 con 0x7f927015c150 2023-11-08T12:30:02.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92700d05e0 con 0x7f927015c150 2023-11-08T12:30:02.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f926cff9700 1 -- 172.21.15.112:0/4271411126 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926801c680 con 0x7f927015c150 2023-11-08T12:30:02.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.290+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92700d2730 con 0x7f927015c150 2023-11-08T12:30:02.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.294+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92700d2140 con 0x7f927015c150 2023-11-08T12:30:02.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.294+0000 7f926cff9700 1 -- 172.21.15.112:0/4271411126 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f926802c070 con 0x7f927015c150 2023-11-08T12:30:02.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.298+0000 7f926cff9700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f925c064f10 0x7f925c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.298+0000 7f926cff9700 1 -- 172.21.15.112:0/4271411126 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9268083810 con 0x7f927015c150 2023-11-08T12:30:02.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.298+0000 7f926ffff700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f925c064f10 0x7f925c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.298+0000 7f926ffff700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f925c064f10 0x7f925c0673c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9260000f60 tx=0x7f9260009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:02.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.302+0000 7f926cff9700 1 -- 172.21.15.112:0/4271411126 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9268051aa0 con 0x7f927015c150 2023-11-08T12:30:02.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.474+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f927006d7e0 con 0x7f927015c150 2023-11-08T12:30:02.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.486+0000 7f926cff9700 1 -- 172.21.15.112:0/4271411126 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f92680550c0 con 0x7f927015c150 2023-11-08T12:30:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f925c064f10 msgr2=0x7f925c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f925c064f10 0x7f925c0673c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9260000f60 tx=0x7f9260009040 comp rx=0 tx=0).stop 2023-11-08T12:30:02.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927015c150 msgr2=0x7f9270150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927015c150 0x7f9270150430 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9270073200 tx=0x7f9268004af0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 shutdown_connections 2023-11-08T12:30:02.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f925c064f10 0x7f925c0673c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927015c150 0x7f9270150430 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9270070620 0x7f92700b83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 --2- 172.21.15.112:0/4271411126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9270069bf0 0x7f92700b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 >> 172.21.15.112:0/4271411126 conn(0x7f92700d3680 msgr2=0x7f927006ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:02.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 shutdown_connections 2023-11-08T12:30:02.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.490+0000 7f9275377700 1 -- 172.21.15.112:0/4271411126 wait complete. 2023-11-08T12:30:02.519 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T12:30:02.519 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:30:02.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:30:02.608 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T12:30:02.609 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:02.609 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:02.629 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:30:02.629 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:30:02.630 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:02.666 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:30:02.667 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:02.667 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:02.688 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:30:02.688 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:30:02.689 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:02.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:30:02.728 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T12:30:02.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:02.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.910+0000 7fd06359e700 1 Processor -- start 2023-11-08T12:30:02.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.910+0000 7fd06359e700 1 -- start start 2023-11-08T12:30:02.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd06359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 0x7fd064164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd06359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06415a550 con 0x7fd0640b43a0 2023-11-08T12:30:02.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd06359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06406b0a0 con 0x7fd0640b1640 2023-11-08T12:30:02.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd06359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640caac0 con 0x7fd064070790 2023-11-08T12:30:02.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd06259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd0640b43a0 0x7fd06415e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47706/0 (socket says 172.21.15.112:47706) 2023-11-08T12:30:02.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd06259c700 1 -- 172.21.15.112:0/25605297 learned_addr learned my addr 172.21.15.112:0/25605297 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:02.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 0x7fd064164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241761173 0 0) 0x7fd054001110 con 0x7fd0640b43a0 2023-11-08T12:30:02.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0500035d0 con 0x7fd0640b43a0 2023-11-08T12:30:02.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573477986 0 0) 0x7fd06406b0a0 con 0x7fd0640b1640 2023-11-08T12:30:02.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd054001110 con 0x7fd0640b1640 2023-11-08T12:30:02.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950441811 0 0) 0x7fd0500035d0 con 0x7fd0640b43a0 2023-11-08T12:30:02.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 msgr2=0x7fd064164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:02.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 0x7fd064164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 >> v1:172.21.15.133:6789/0 conn(0x7fd0640b1640 legacy=0x7fd064070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640cada0 con 0x7fd0640b43a0 2023-11-08T12:30:02.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fd054001800 con 0x7fd0640b43a0 2023-11-08T12:30:02.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 >> v1:172.21.15.112:6789/0 conn(0x7fd0640b43a0 legacy=0x7fd06415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd050003be0 0x7fd050003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 0x7fd050004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd050004db0 0x7fd050005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640caac0 con 0x7fd050004db0 2023-11-08T12:30:02.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05000bb60 con 0x7fd050003be0 2023-11-08T12:30:02.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05000bd20 con 0x7fd064070790 2023-11-08T12:30:02.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd050004db0 0x7fd050005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd059d9b700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 0x7fd050004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd06259c700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd050003be0 0x7fd050003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 -- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 msgr2=0x7fd050004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:02.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 0x7fd050004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 -- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd050003be0 msgr2=0x7fd050003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd050003be0 0x7fd050003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 -- 172.21.15.112:0/25605297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500035d0 con 0x7fd050004db0 2023-11-08T12:30:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd059d9b700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd064070790 0x7fd050004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:02.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.914+0000 7fd062d9d700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd050004db0 0x7fd050005220 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009b70 tx=0x7fd0500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a28b6f045640aa2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:02.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00e6c0 con 0x7fd050004db0 2023-11-08T12:30:02.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00e820 con 0x7fd050004db0 2023-11-08T12:30:02.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd061d9b700 1 -- 172.21.15.112:0/25605297 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00eb90 con 0x7fd050004db0 2023-11-08T12:30:02.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd06359e700 1 -- 172.21.15.112:0/25605297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd050004db0 msgr2=0x7fd050005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd06359e700 1 --2- 172.21.15.112:0/25605297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd050004db0 0x7fd050005220 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009b70 tx=0x7fd0500058a0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd062d9d700 1 -- 172.21.15.112:0/25605297 reap_dead start 2023-11-08T12:30:02.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd06359e700 1 -- 172.21.15.112:0/25605297 shutdown_connections 2023-11-08T12:30:02.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd06359e700 1 -- 172.21.15.112:0/25605297 >> 172.21.15.112:0/25605297 conn(0x7fd0640b0f80 msgr2=0x7fd0640ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:02.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd06359e700 1 -- 172.21.15.112:0/25605297 shutdown_connections 2023-11-08T12:30:02.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.918+0000 7fd06359e700 1 -- 172.21.15.112:0/25605297 wait complete. 2023-11-08T12:30:02.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 Processor -- start 2023-11-08T12:30:02.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 -- start start 2023-11-08T12:30:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd050004db0 0x7fd0640ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0641f2780 0x7fd0640b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0641f1310 0x7fd06415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640ab860 con 0x7fd0641f2780 2023-11-08T12:30:02.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640acdb0 con 0x7fd0641f1310 2023-11-08T12:30:02.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640abab0 con 0x7fd050004db0 2023-11-08T12:30:02.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0641f2780 0x7fd0640b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0641f2780 0x7fd0640b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41536/0 (socket says 172.21.15.112:41536) 2023-11-08T12:30:02.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 -- 172.21.15.112:0/383054977 learned_addr learned my addr 172.21.15.112:0/383054977 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:02.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06259c700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd050004db0 0x7fd0640ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd062d9d700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0641f1310 0x7fd06415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 -- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd050004db0 msgr2=0x7fd0640ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd050004db0 0x7fd0640ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 -- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0641f1310 msgr2=0x7fd06415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:02.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0641f1310 0x7fd06415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:02.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 -- 172.21.15.112:0/383054977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06406b5d0 con 0x7fd0641f2780 2023-11-08T12:30:02.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd059d9b700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0641f2780 0x7fd0640b2470 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd04c002100 tx=0x7fd04c00c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:02.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd05b7fe700 1 -- 172.21.15.112:0/383054977 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c00cc80 con 0x7fd0641f2780 2023-11-08T12:30:02.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd05b7fe700 1 -- 172.21.15.112:0/383054977 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c00cde0 con 0x7fd0641f2780 2023-11-08T12:30:02.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06406b2f0 con 0x7fd0641f2780 2023-11-08T12:30:02.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.922+0000 7fd05b7fe700 1 -- 172.21.15.112:0/383054977 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c003c20 con 0x7fd0641f2780 2023-11-08T12:30:02.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.926+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0640ca7b0 con 0x7fd0641f2780 2023-11-08T12:30:02.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.926+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd064073cb0 con 0x7fd0641f2780 2023-11-08T12:30:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.926+0000 7fd05b7fe700 1 -- 172.21.15.112:0/383054977 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd04c0050d0 con 0x7fd0641f2780 2023-11-08T12:30:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.930+0000 7fd05b7fe700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd044064f10 0x7fd0440673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.930+0000 7fd05b7fe700 1 -- 172.21.15.112:0/383054977 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd04c0824d0 con 0x7fd0641f2780 2023-11-08T12:30:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.930+0000 7fd06259c700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd044064f10 0x7fd0440673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:02.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.930+0000 7fd06259c700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd044064f10 0x7fd0440673c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd064157e00 tx=0x7fd054009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:02.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:02.938+0000 7fd05b7fe700 1 -- 172.21.15.112:0/383054977 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd04c050760 con 0x7fd0641f2780 2023-11-08T12:30:03.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.150+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd06404e1c0 con 0x7fd0641f2780 2023-11-08T12:30:03.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.150+0000 7fd05b7fe700 1 -- 172.21.15.112:0/383054977 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fd04c053d80 con 0x7fd0641f2780 2023-11-08T12:30:03.156 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:03.157 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/48692675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":48692675},{"type":"v1","addr":"172.21.15.133:6834","nonce":48692675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4973,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/4186974341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":4186974341},{"type":"v1","addr":"172.21.15.133:6835","nonce":4186974341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/4081144312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":4081144312},{"type":"v1","addr":"172.21.15.112:6835","nonce":4081144312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5742,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3599441703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3599441703},{"type":"v1","addr":"172.21.15.112:6837","nonce":3599441703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-11-08T12:30:03.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd044064f10 msgr2=0x7fd0440673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:03.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd044064f10 0x7fd0440673c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd064157e00 tx=0x7fd054009040 comp rx=0 tx=0).stop 2023-11-08T12:30:03.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0641f2780 msgr2=0x7fd0640b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:03.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0641f2780 0x7fd0640b2470 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd04c002100 tx=0x7fd04c00c3c0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 shutdown_connections 2023-11-08T12:30:03.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd044064f10 0x7fd0440673c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0641f1310 0x7fd06415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0641f2780 0x7fd0640b2470 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 --2- 172.21.15.112:0/383054977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd050004db0 0x7fd0640ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 >> 172.21.15.112:0/383054977 conn(0x7fd0640b0f80 msgr2=0x7fd0640ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:03.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 shutdown_connections 2023-11-08T12:30:03.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.154+0000 7fd06359e700 1 -- 172.21.15.112:0/383054977 wait complete. 2023-11-08T12:30:03.162 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 18 2023-11-08T12:30:03.184 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T12:30:03.184 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T12:30:03.184 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T12:30:03.184 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:03.185 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T12:30:03.185 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T12:30:03.185 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T12:30:03.186 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:03.186 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T12:30:03.186 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T12:30:03.187 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T12:30:03.187 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:03.187 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T12:30:03.187 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T12:30:03.188 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T12:30:03.188 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:03.206 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T12:30:03.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T12:30:03.207 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T12:30:03.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T12:30:03.210 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T12:30:03.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T12:30:03.212 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T12:30:03.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T12:30:03.260 INFO:tasks.ceph.mds.c:Started 2023-11-08T12:30:03.261 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:03.263 INFO:tasks.ceph.mds.b:Started 2023-11-08T12:30:03.264 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:03.266 INFO:tasks.ceph.mds.a:Started 2023-11-08T12:30:03.266 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:03.270 INFO:tasks.ceph.mds.d:Started 2023-11-08T12:30:03.270 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:03.271 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T12:30:03.374 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-11-08T12:30:03.377 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-11-08T12:30:03.387 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-11-08T12:30:03.389 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-11-08T12:30:03.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.446+0000 7f1476420700 1 Processor -- start 2023-11-08T12:30:03.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.446+0000 7f1476420700 1 -- start start 2023-11-08T12:30:03.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.446+0000 7f1476420700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 0x7f14700ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.446+0000 7f1476420700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f147015c3b0 0x7f1470070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.446+0000 7f1476420700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147006b090 con 0x7f14700c8da0 2023-11-08T12:30:03.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1476420700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1470069bf0 con 0x7f147015c3b0 2023-11-08T12:30:03.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1476420700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147015c890 con 0x7f1470158840 2023-11-08T12:30:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1475c1f700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f14700c8da0 0x7f147006bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47720/0 (socket says 172.21.15.112:47720) 2023-11-08T12:30:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1475c1f700 1 -- 172.21.15.112:0/3401392385 learned_addr learned my addr 172.21.15.112:0/3401392385 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3401392385 >> v2:172.21.15.133:3300/0 conn(0x7f147015c3b0 0x7f1470070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755249480 0 0) 0x7f1468001490 con 0x7f14700c8da0 2023-11-08T12:30:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f147541e700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 0x7f14700ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f145c0034d0 con 0x7f14700c8da0 2023-11-08T12:30:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2336540051 0 0) 0x7f145c0034d0 con 0x7f14700c8da0 2023-11-08T12:30:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 msgr2=0x7f14700ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 0x7f14700ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 >> v2:172.21.15.133:3300/0 conn(0x7f147015c3b0 msgr2=0x7f1470070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 --2- 172.21.15.112:0/3401392385 >> v2:172.21.15.133:3300/0 conn(0x7f147015c3b0 0x7f1470070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147015cb70 con 0x7f14700c8da0 2023-11-08T12:30:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f1468001b80 con 0x7f14700c8da0 2023-11-08T12:30:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 >> v1:172.21.15.112:6789/0 conn(0x7f14700c8da0 legacy=0x7f147006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c004b00 0x7f145c004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 0x7f145c003710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c003c50 0x7f145c0040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470069bf0 con 0x7f145c004b00 2023-11-08T12:30:03.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147015c890 con 0x7f145c003c50 2023-11-08T12:30:03.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c00fd80 con 0x7f1470158840 2023-11-08T12:30:03.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f147541e700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c004b00 0x7f145c004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 0x7f145c003710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1475c1f700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c003c50 0x7f145c0040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 -- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c003c50 msgr2=0x7f145c0040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:03.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f145c003c50 0x7f145c0040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 -- 172.21.15.112:0/3401392385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c004b00 msgr2=0x7f145c004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:03.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f145c004b00 0x7f145c004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 -- 172.21.15.112:0/3401392385 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c0034d0 con 0x7f1470158840 2023-11-08T12:30:03.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 0x7f145c003710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1460008120 tx=0x7f145c004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19196d99446f9645 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000f9d0 con 0x7f1470158840 2023-11-08T12:30:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146000fb30 con 0x7f1470158840 2023-11-08T12:30:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.450+0000 7f1467fff700 1 -- 172.21.15.112:0/3401392385 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000fea0 con 0x7f1470158840 2023-11-08T12:30:03.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1476420700 1 -- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 msgr2=0x7f145c003710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1476420700 1 --2- 172.21.15.112:0/3401392385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1470158840 0x7f145c003710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1460008120 tx=0x7f145c004790 comp rx=0 tx=0).stop 2023-11-08T12:30:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1475c1f700 1 -- 172.21.15.112:0/3401392385 reap_dead start 2023-11-08T12:30:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1476420700 1 -- 172.21.15.112:0/3401392385 shutdown_connections 2023-11-08T12:30:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1476420700 1 -- 172.21.15.112:0/3401392385 >> 172.21.15.112:0/3401392385 conn(0x7f14700b0f80 msgr2=0x7f14700ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:03.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1476420700 1 -- 172.21.15.112:0/3401392385 shutdown_connections 2023-11-08T12:30:03.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1476420700 1 -- 172.21.15.112:0/3401392385 wait complete. 2023-11-08T12:30:03.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.454+0000 7f1476420700 1 Processor -- start 2023-11-08T12:30:03.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 -- start start 2023-11-08T12:30:03.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1470158840 0x7f14700c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14700b3890 0x7f14700b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14700b4240 0x7f1470158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b46b0 con 0x7f1470158840 2023-11-08T12:30:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b2b80 con 0x7f14700b4240 2023-11-08T12:30:03.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147015a830 con 0x7f14700b3890 2023-11-08T12:30:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1470158840 0x7f14700c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1470158840 0x7f14700c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41578/0 (socket says 172.21.15.112:41578) 2023-11-08T12:30:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 -- 172.21.15.112:0/3057166926 learned_addr learned my addr 172.21.15.112:0/3057166926 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:03.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1475c1f700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14700b4240 0x7f1470158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14700b3890 0x7f14700b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 -- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14700b3890 msgr2=0x7f14700b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14700b3890 0x7f14700b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 -- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14700b4240 msgr2=0x7f1470158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14700b4240 0x7f1470158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 -- 172.21.15.112:0/3057166926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147015d130 con 0x7f1470158840 2023-11-08T12:30:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1475c1f700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14700b4240 0x7f1470158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f147541e700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1470158840 0x7f14700c5820 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f146c011a80 tx=0x7f146c011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:03.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1465ffb700 1 -- 172.21.15.112:0/3057166926 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00f9a0 con 0x7f1470158840 2023-11-08T12:30:03.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1465ffb700 1 -- 172.21.15.112:0/3057166926 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c00fb00 con 0x7f1470158840 2023-11-08T12:30:03.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1465ffb700 1 -- 172.21.15.112:0/3057166926 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00feb0 con 0x7f1470158840 2023-11-08T12:30:03.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.458+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147015ce50 con 0x7f1470158840 2023-11-08T12:30:03.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.462+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1470158c10 con 0x7f1470158840 2023-11-08T12:30:03.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.462+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1470073cb0 con 0x7f1470158840 2023-11-08T12:30:03.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.462+0000 7f1465ffb700 1 -- 172.21.15.112:0/3057166926 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f146c014440 con 0x7f1470158840 2023-11-08T12:30:03.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.462+0000 7f1465ffb700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1454064f10 0x7f14540673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:03.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.462+0000 7f1465ffb700 1 -- 172.21.15.112:0/3057166926 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f146c082420 con 0x7f1470158840 2023-11-08T12:30:03.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.462+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1454064f10 0x7f14540673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:03.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.466+0000 7f1474c1d700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1454064f10 0x7f14540673c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f14700ca630 tx=0x7f146001f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:03.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.470+0000 7f1465ffb700 1 -- 172.21.15.112:0/3057166926 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f146c050720 con 0x7f1470158840 2023-11-08T12:30:03.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:03.650+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f14700710b0 con 0x7f1470158840 2023-11-08T12:30:04.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.494+0000 7f1465ffb700 1 -- 172.21.15.112:0/3057166926 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7f146c022080 con 0x7f1470158840 2023-11-08T12:30:04.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1454064f10 msgr2=0x7f14540673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:04.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1454064f10 0x7f14540673c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f14700ca630 tx=0x7f146001f040 comp rx=0 tx=0).stop 2023-11-08T12:30:04.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1470158840 msgr2=0x7f14700c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:04.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1470158840 0x7f14700c5820 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f146c011a80 tx=0x7f146c011e40 comp rx=0 tx=0).stop 2023-11-08T12:30:04.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 shutdown_connections 2023-11-08T12:30:04.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1454064f10 0x7f14540673c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:04.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14700b4240 0x7f1470158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:04.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14700b3890 0x7f14700b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:04.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 --2- 172.21.15.112:0/3057166926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1470158840 0x7f14700c5820 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:04.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 >> 172.21.15.112:0/3057166926 conn(0x7f14700b0f80 msgr2=0x7f1470070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:04.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 shutdown_connections 2023-11-08T12:30:04.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.498+0000 7f1476420700 1 -- 172.21.15.112:0/3057166926 wait complete. 2023-11-08T12:30:04.507 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2023-11-08T12:30:04.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T12:30:04.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.698+0000 7f1f25d07700 1 Processor -- start 2023-11-08T12:30:04.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.698+0000 7f1f25d07700 1 -- start start 2023-11-08T12:30:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f25d07700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f200b1640 0x7f1f20070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f25d07700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2015a550 con 0x7f1f200b43a0 2023-11-08T12:30:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f25d07700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2006b0a0 con 0x7f1f200c9040 2023-11-08T12:30:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f25d07700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f200caac0 con 0x7f1f200b1640 2023-11-08T12:30:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f24d05700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1f200b43a0 0x7f1f2015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47734/0 (socket says 172.21.15.112:47734) 2023-11-08T12:30:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f24d05700 1 -- 172.21.15.112:0/388180354 learned_addr learned my addr 172.21.15.112:0/388180354 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:04.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f17fff700 1 --2- 172.21.15.112:0/388180354 >> v2:172.21.15.112:3300/0 conn(0x7f1f200b1640 0x7f1f20070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f17fff700 1 -- 172.21.15.112:0/388180354 >> v1:172.21.15.133:6789/0 conn(0x7f1f200c9040 legacy=0x7f1f2006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f17fff700 1 -- 172.21.15.112:0/388180354 >> v1:172.21.15.112:6789/0 conn(0x7f1f200b43a0 legacy=0x7f1f2015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:04.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f17fff700 1 -- 172.21.15.112:0/388180354 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f200cada0 con 0x7f1f200b1640 2023-11-08T12:30:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f177fe700 1 -- 172.21.15.112:0/388180354 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328582189 0 0) 0x7f1f1c001110 con 0x7f1f200b43a0 2023-11-08T12:30:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f17fff700 1 --2- 172.21.15.112:0/388180354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f20070080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009850 tx=0x7f1f10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53587aec5e7be9f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f177fe700 1 -- 172.21.15.112:0/388180354 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011830 con 0x7f1f200b1640 2023-11-08T12:30:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f177fe700 1 -- 172.21.15.112:0/388180354 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f10011990 con 0x7f1f200b1640 2023-11-08T12:30:04.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f177fe700 1 -- 172.21.15.112:0/388180354 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011d20 con 0x7f1f200b1640 2023-11-08T12:30:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f25d07700 1 -- 172.21.15.112:0/388180354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 msgr2=0x7f1f20070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:04.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.702+0000 7f1f25d07700 1 --2- 172.21.15.112:0/388180354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f20070080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009850 tx=0x7f1f10009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.706+0000 7f1f25d07700 1 -- 172.21.15.112:0/388180354 shutdown_connections 2023-11-08T12:30:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.706+0000 7f1f25d07700 1 --2- 172.21.15.112:0/388180354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f20070080 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.706+0000 7f1f25d07700 1 -- 172.21.15.112:0/388180354 >> 172.21.15.112:0/388180354 conn(0x7f1f200b0f80 msgr2=0x7f1f200ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.706+0000 7f1f25d07700 1 -- 172.21.15.112:0/388180354 shutdown_connections 2023-11-08T12:30:04.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.706+0000 7f1f25d07700 1 -- 172.21.15.112:0/388180354 wait complete. 2023-11-08T12:30:04.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.706+0000 7f1f25d07700 1 Processor -- start 2023-11-08T12:30:04.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.706+0000 7f1f25d07700 1 -- start start 2023-11-08T12:30:04.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f201f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:04.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f200b43a0 0x7f1f20154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:04.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f200c9040 0x7f1f200ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:04.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f200ad530 con 0x7f1f200b1640 2023-11-08T12:30:04.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f200cc320 con 0x7f1f200b43a0 2023-11-08T12:30:04.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f201f5de0 con 0x7f1f200c9040 2023-11-08T12:30:04.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f201f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:04.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f201f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41596/0 (socket says 172.21.15.112:41596) 2023-11-08T12:30:04.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 -- 172.21.15.112:0/2549355343 learned_addr learned my addr 172.21.15.112:0/2549355343 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:04.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f17fff700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f200b43a0 0x7f1f20154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:04.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25506700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f200c9040 0x7f1f200ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:04.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 -- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f200c9040 msgr2=0x7f1f200ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:04.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f200c9040 0x7f1f200ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:04.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 -- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f200b43a0 msgr2=0x7f1f20154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:04.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f200b43a0 0x7f1f20154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:04.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 -- 172.21.15.112:0/2549355343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f100094b0 con 0x7f1f200b1640 2023-11-08T12:30:04.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f24d05700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f201f58a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00c4a0 tx=0x7f1f1c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:04.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f157fa700 1 -- 172.21.15.112:0/2549355343 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c004ca0 con 0x7f1f200b1640 2023-11-08T12:30:04.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f157fa700 1 -- 172.21.15.112:0/2549355343 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c004e00 con 0x7f1f200b1640 2023-11-08T12:30:04.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2006b5d0 con 0x7f1f200b1640 2023-11-08T12:30:04.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f157fa700 1 -- 172.21.15.112:0/2549355343 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c007310 con 0x7f1f200b1640 2023-11-08T12:30:04.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.710+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2006b2f0 con 0x7f1f200b1640 2023-11-08T12:30:04.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.714+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f200ca7b0 con 0x7f1f200b1640 2023-11-08T12:30:04.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.714+0000 7f1f157fa700 1 -- 172.21.15.112:0/2549355343 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1f1c01a020 con 0x7f1f200b1640 2023-11-08T12:30:04.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.714+0000 7f1f157fa700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f0c064ee0 0x7f1f0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:04.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.718+0000 7f1f157fa700 1 -- 172.21.15.112:0/2549355343 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1f1c081550 con 0x7f1f200b1640 2023-11-08T12:30:04.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.718+0000 7f1f17fff700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f0c064ee0 0x7f1f0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:04.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.718+0000 7f1f17fff700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f0c064ee0 0x7f1f0c067390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f100090b0 tx=0x7f1f1001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:04.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.722+0000 7f1f157fa700 1 -- 172.21.15.112:0/2549355343 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1f1c04f840 con 0x7f1f200b1640 2023-11-08T12:30:04.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.958+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1f2015a530 con 0x7f1f200b1640 2023-11-08T12:30:04.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.958+0000 7f1f157fa700 1 -- 172.21.15.112:0/2549355343 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f1f1c052e60 con 0x7f1f200b1640 2023-11-08T12:30:04.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:04.965 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:30:04.965 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2023-11-08T12:30:04.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.966 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2023-11-08T12:30:04.966 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlRHRoFxAAyw1Nx0lpcoK2O0Mffhxa+Q==", 2023-11-08T12:30:04.966 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.966 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.966 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:04.967 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:04.967 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.968 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2023-11-08T12:30:04.968 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlJ/6NKhAA4JtSpMqfz11efoyViRsE9w==", 2023-11-08T12:30:04.968 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.968 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.968 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:04.969 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:04.969 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.969 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2023-11-08T12:30:04.970 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlxtc7IhAAMY7VdOn5spixCeT9mzaa7w==", 2023-11-08T12:30:04.970 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.970 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.970 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:04.970 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:04.971 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.971 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.971 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2023-11-08T12:30:04.972 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlk30kNhAAeSX6T/4QZc9cWY79qyTDvg==", 2023-11-08T12:30:04.972 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.972 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.972 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:04.972 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:04.973 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.973 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.973 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2023-11-08T12:30:04.974 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCEfktlLsnsJRAAFve4QGR18ZZEoiNJHRc/bg==", 2023-11-08T12:30:04.974 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.974 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.974 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.974 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.975 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.975 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2023-11-08T12:30:04.975 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCHfktlyiDmNhAAAmDd3WWs+eLtraPczzmkTA==", 2023-11-08T12:30:04.975 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.976 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.976 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.976 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.976 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.977 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2023-11-08T12:30:04.977 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCLfktl3wtACRAAjC1v7SBT82SZhX7/gihG2g==", 2023-11-08T12:30:04.977 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.977 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.978 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.978 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.978 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.979 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2023-11-08T12:30:04.979 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCOfktlD3FjFxAAIjzJfy66ntwKBw7jYTmQEQ==", 2023-11-08T12:30:04.979 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.979 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.979 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.980 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.981 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.982 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2023-11-08T12:30:04.982 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCUfktlPUqvKhAApaw64K+eVu+b7K5vRpIrzg==", 2023-11-08T12:30:04.982 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.982 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.982 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.983 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.983 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2023-11-08T12:30:04.984 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCYfktlWkjeCxAAwJdasGWtOKqaCqIooSo5+Q==", 2023-11-08T12:30:04.984 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.984 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.985 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.985 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.986 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2023-11-08T12:30:04.986 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCbfktlvK3vGRAADNtY8DuzQeaQ+lamxqnpxA==", 2023-11-08T12:30:04.986 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.986 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.986 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.987 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.987 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2023-11-08T12:30:04.988 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCefktl6KNCKRAAp5984rD5GU3VsLxxZPH9Sg==", 2023-11-08T12:30:04.988 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.988 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:04.988 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:04.988 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.989 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2023-11-08T12:30:04.989 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlKVzUARAA264fUIQ90p7D7mpBaFS5Iw==", 2023-11-08T12:30:04.989 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.990 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.990 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2023-11-08T12:30:04.990 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-08T12:30:04.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.991 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2023-11-08T12:30:04.991 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlvItzDhAAOIl7M/iJ+xzhTEWNIef+/A==", 2023-11-08T12:30:04.991 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.991 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.992 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:30:04.992 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:30:04.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:30:04.992 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.993 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2023-11-08T12:30:04.993 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlg7APCBAA4UD3EeuTRrU2hjW+ozVSnw==", 2023-11-08T12:30:04.993 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.993 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.993 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:30:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:30:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:30:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.995 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2023-11-08T12:30:04.995 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlskN+FBAA7JKk8gz0qAYvbt/9+mvqwg==", 2023-11-08T12:30:04.995 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.995 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:04.995 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:30:04.996 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:30:04.996 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:30:04.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.997 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2023-11-08T12:30:04.997 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB/fktljcX3JxAAlDmA6nydT/tOMoWhfxG67w==", 2023-11-08T12:30:04.997 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.997 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:30:04.997 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:04.997 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:04.998 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:04.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:04.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:04.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:04.998 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2023-11-08T12:30:04.999 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlRLDaDxAAlkslT/w/88ZbnIMNtISKSg==", 2023-11-08T12:30:04.999 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:04.999 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:30:04.999 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-11-08T12:30:04.999 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:05.000 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:05.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:05.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:05.000 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2023-11-08T12:30:05.000 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlutF6CRAAjM6KkWuj4y/Fl97qiak9Xw==", 2023-11-08T12:30:05.001 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:05.001 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:30:05.001 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-11-08T12:30:05.001 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:05.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:05.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:05.002 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-11-08T12:30:05.002 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:30:05.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f0c064ee0 msgr2=0x7f1f0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f0c064ee0 0x7f1f0c067390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f100090b0 tx=0x7f1f1001c040 comp rx=0 tx=0).stop 2023-11-08T12:30:05.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 msgr2=0x7f1f201f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f201f58a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00c4a0 tx=0x7f1f1c00c7b0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 shutdown_connections 2023-11-08T12:30:05.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f0c064ee0 0x7f1f0c067390 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f200c9040 0x7f1f200ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f200b43a0 0x7f1f20154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 --2- 172.21.15.112:0/2549355343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f200b1640 0x7f1f201f58a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 >> 172.21.15.112:0/2549355343 conn(0x7f1f200b0f80 msgr2=0x7f1f200af900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:05.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.962+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 shutdown_connections 2023-11-08T12:30:05.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:04.966+0000 7f1f25d07700 1 -- 172.21.15.112:0/2549355343 wait complete. 2023-11-08T12:30:05.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:05.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.182+0000 7f114dbe8700 1 Processor -- start 2023-11-08T12:30:05.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.182+0000 7f114dbe8700 1 -- start start 2023-11-08T12:30:05.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.182+0000 7f114dbe8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 0x7f1148164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114dbe8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114815a550 con 0x7f11480b43a0 2023-11-08T12:30:05.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114dbe8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114806b0a0 con 0x7f11480b1640 2023-11-08T12:30:05.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114dbe8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11480caac0 con 0x7f1148070790 2023-11-08T12:30:05.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114cbe6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f11480b43a0 0x7f114815e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47746/0 (socket says 172.21.15.112:47746) 2023-11-08T12:30:05.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114cbe6700 1 -- 172.21.15.112:0/1760930384 learned_addr learned my addr 172.21.15.112:0/1760930384 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:05.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754209545 0 0) 0x7f1144001110 con 0x7f11480b43a0 2023-11-08T12:30:05.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11300035d0 con 0x7f11480b43a0 2023-11-08T12:30:05.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114d3e7700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 0x7f1148164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1123299648 0 0) 0x7f11300035d0 con 0x7f11480b43a0 2023-11-08T12:30:05.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 msgr2=0x7f1148164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:05.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 0x7f1148164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 >> v1:172.21.15.133:6789/0 conn(0x7f11480b1640 legacy=0x7f1148070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480cada0 con 0x7f11480b43a0 2023-11-08T12:30:05.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f1144001800 con 0x7f11480b43a0 2023-11-08T12:30:05.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 >> v1:172.21.15.112:6789/0 conn(0x7f11480b43a0 legacy=0x7f114815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130003a50 0x7f1130003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 0x7f1130004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1130005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480caac0 con 0x7f1130004db0 2023-11-08T12:30:05.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113000bc20 con 0x7f1130003a50 2023-11-08T12:30:05.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113000bde0 con 0x7f1148070790 2023-11-08T12:30:05.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114d3e7700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1130005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f113ffff700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 0x7f1130004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114cbe6700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130003a50 0x7f1130003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114d3e7700 1 -- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 msgr2=0x7f1130004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:05.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114d3e7700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1148070790 0x7f1130004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114d3e7700 1 -- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130003a50 msgr2=0x7f1130003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:05.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114d3e7700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130003a50 0x7f1130003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.186+0000 7f114d3e7700 1 -- 172.21.15.112:0/1760930384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300035d0 con 0x7f1130004db0 2023-11-08T12:30:05.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114d3e7700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1130005220 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1140007360 tx=0x7f11300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb222e4b159554d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:05.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140007e80 con 0x7f1130004db0 2023-11-08T12:30:05.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1140014400 con 0x7f1130004db0 2023-11-08T12:30:05.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f113f7fe700 1 -- 172.21.15.112:0/1760930384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140014790 con 0x7f1130004db0 2023-11-08T12:30:05.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114dbe8700 1 -- 172.21.15.112:0/1760930384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 msgr2=0x7f1130005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114dbe8700 1 --2- 172.21.15.112:0/1760930384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1130005220 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1140007360 tx=0x7f11300058a0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114d3e7700 1 -- 172.21.15.112:0/1760930384 reap_dead start 2023-11-08T12:30:05.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114dbe8700 1 -- 172.21.15.112:0/1760930384 shutdown_connections 2023-11-08T12:30:05.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114dbe8700 1 -- 172.21.15.112:0/1760930384 >> 172.21.15.112:0/1760930384 conn(0x7f11480b0f80 msgr2=0x7f11480ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:05.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114dbe8700 1 -- 172.21.15.112:0/1760930384 shutdown_connections 2023-11-08T12:30:05.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.190+0000 7f114dbe8700 1 -- 172.21.15.112:0/1760930384 wait complete. 2023-11-08T12:30:05.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 Processor -- start 2023-11-08T12:30:05.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 -- start start 2023-11-08T12:30:05.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1148157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11480c4a90 0x7f11480c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11480c3500 0x7f11480c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11481578d0 con 0x7f1130004db0 2023-11-08T12:30:05.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480c5440 con 0x7f11480c3500 2023-11-08T12:30:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114dbe8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11480ab860 con 0x7f11480c4a90 2023-11-08T12:30:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1148157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1148157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41610/0 (socket says 172.21.15.112:41610) 2023-11-08T12:30:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 -- 172.21.15.112:0/3455924743 learned_addr learned my addr 172.21.15.112:0/3455924743 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114d3e7700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11480c3500 0x7f11480c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f113ffff700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11480c4a90 0x7f11480c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 -- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11480c4a90 msgr2=0x7f11480c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11480c4a90 0x7f11480c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 -- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11480c3500 msgr2=0x7f11480c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11480c3500 0x7f11480c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 -- 172.21.15.112:0/3455924743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114806b5d0 con 0x7f1130004db0 2023-11-08T12:30:05.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f113ffff700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11480c4a90 0x7f11480c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:05.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.194+0000 7f114cbe6700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1148157390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f114400eaf0 tx=0x7f114400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:05.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.198+0000 7f113d7fa700 1 -- 172.21.15.112:0/3455924743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400c7b0 con 0x7f1130004db0 2023-11-08T12:30:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.198+0000 7f113d7fa700 1 -- 172.21.15.112:0/3455924743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400c910 con 0x7f1130004db0 2023-11-08T12:30:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.198+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114806b2f0 con 0x7f1130004db0 2023-11-08T12:30:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.198+0000 7f113d7fa700 1 -- 172.21.15.112:0/3455924743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400ccc0 con 0x7f1130004db0 2023-11-08T12:30:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.198+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11480ca7b0 con 0x7f1130004db0 2023-11-08T12:30:05.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.198+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1148073cb0 con 0x7f1130004db0 2023-11-08T12:30:05.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.198+0000 7f113d7fa700 1 -- 172.21.15.112:0/3455924743 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f114401d460 con 0x7f1130004db0 2023-11-08T12:30:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.202+0000 7f113d7fa700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1134064ee0 0x7f1134067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.202+0000 7f113d7fa700 1 -- 172.21.15.112:0/3455924743 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1144081ba0 con 0x7f1130004db0 2023-11-08T12:30:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.202+0000 7f113ffff700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1134064ee0 0x7f1134067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.202+0000 7f113ffff700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1134064ee0 0x7f1134067390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:05.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.206+0000 7f113d7fa700 1 -- 172.21.15.112:0/3455924743 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f114404fef0 con 0x7f1130004db0 2023-11-08T12:30:05.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.386+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1148073cb0 con 0x7f1130004db0 2023-11-08T12:30:05.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.386+0000 7f113d7fa700 1 -- 172.21.15.112:0/3455924743 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+14424 (secure 0 0 0) 0x7f1144053510 con 0x7f1130004db0 2023-11-08T12:30:05.393 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:05.393 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":54,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:04.488565+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:05.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1134064ee0 msgr2=0x7f1134067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1134064ee0 0x7f1134067390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138009040 comp rx=0 tx=0).stop 2023-11-08T12:30:05.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 msgr2=0x7f1148157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1148157390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f114400eaf0 tx=0x7f114400eeb0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 shutdown_connections 2023-11-08T12:30:05.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1134064ee0 0x7f1134067390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11480c3500 0x7f11480c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11480c4a90 0x7f11480c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 --2- 172.21.15.112:0/3455924743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1130004db0 0x7f1148157390 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 >> 172.21.15.112:0/3455924743 conn(0x7f11480b0f80 msgr2=0x7f1148159d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:05.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 shutdown_connections 2023-11-08T12:30:05.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.390+0000 7f114dbe8700 1 -- 172.21.15.112:0/3455924743 wait complete. 2023-11-08T12:30:05.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:30:05.418 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:30:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798f1b1700 1 Processor -- start 2023-11-08T12:30:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798f1b1700 1 -- start start 2023-11-08T12:30:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798f1b1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79880af650 0x7f798806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798f1b1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798806c040 con 0x7f79880b4280 2023-11-08T12:30:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798f1b1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798815a920 con 0x7f79880adb20 2023-11-08T12:30:05.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798f1b1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798815eac0 con 0x7f79880af650 2023-11-08T12:30:05.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798cf4d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f79880b4280 0x7f79880aef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46482/0 (socket says 172.21.15.112:46482) 2023-11-08T12:30:05.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f798cf4d700 1 -- 172.21.15.112:0/96846022 learned_addr learned my addr 172.21.15.112:0/96846022 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:05.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f7987fff700 1 --2- 172.21.15.112:0/96846022 >> v2:172.21.15.112:3300/0 conn(0x7f79880af650 0x7f798806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.586+0000 7f79877fe700 1 -- 172.21.15.112:0/96846022 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652164567 0 0) 0x7f798806c040 con 0x7f79880b4280 2023-11-08T12:30:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f79877fe700 1 -- 172.21.15.112:0/96846022 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79780035d0 con 0x7f79880b4280 2023-11-08T12:30:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f7987fff700 1 -- 172.21.15.112:0/96846022 >> v1:172.21.15.133:6789/0 conn(0x7f79880adb20 legacy=0x7f798806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f79877fe700 1 -- 172.21.15.112:0/96846022 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325882602 0 0) 0x7f798815a920 con 0x7f79880adb20 2023-11-08T12:30:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f7987fff700 1 -- 172.21.15.112:0/96846022 >> v1:172.21.15.112:6789/0 conn(0x7f79880b4280 legacy=0x7f79880aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f7987fff700 1 -- 172.21.15.112:0/96846022 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880b4650 con 0x7f79880af650 2023-11-08T12:30:05.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f7987fff700 1 --2- 172.21.15.112:0/96846022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880af650 0x7f798806c4d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f7974009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3181dbd8430a0c2a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:05.598 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f79877fe700 1 -- 172.21.15.112:0/96846022 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011830 con 0x7f79880af650 2023-11-08T12:30:05.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f79877fe700 1 -- 172.21.15.112:0/96846022 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974011990 con 0x7f79880af650 2023-11-08T12:30:05.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f79877fe700 1 -- 172.21.15.112:0/96846022 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011d40 con 0x7f79880af650 2023-11-08T12:30:05.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f798f1b1700 1 -- 172.21.15.112:0/96846022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880af650 msgr2=0x7f798806c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f798f1b1700 1 --2- 172.21.15.112:0/96846022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880af650 0x7f798806c4d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f7974009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:05.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f798f1b1700 1 -- 172.21.15.112:0/96846022 shutdown_connections 2023-11-08T12:30:05.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f798f1b1700 1 --2- 172.21.15.112:0/96846022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880af650 0x7f798806c4d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f798f1b1700 1 -- 172.21.15.112:0/96846022 >> 172.21.15.112:0/96846022 conn(0x7f79880cf580 msgr2=0x7f79880cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:05.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f798f1b1700 1 -- 172.21.15.112:0/96846022 shutdown_connections 2023-11-08T12:30:05.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.590+0000 7f798f1b1700 1 -- 172.21.15.112:0/96846022 wait complete. 2023-11-08T12:30:05.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 Processor -- start 2023-11-08T12:30:05.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 -- start start 2023-11-08T12:30:05.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880adb20 0x7f798814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79880af650 0x7f798815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79880b4280 0x7f79880cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c23e0 con 0x7f79880adb20 2023-11-08T12:30:05.603 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c26c0 con 0x7f79880b4280 2023-11-08T12:30:05.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798f1b1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c29a0 con 0x7f79880af650 2023-11-08T12:30:05.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880adb20 0x7f798814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880adb20 0x7f798814dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46102/0 (socket says 172.21.15.112:46102) 2023-11-08T12:30:05.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f7987fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79880af650 0x7f798815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.604 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 -- 172.21.15.112:0/134284147 learned_addr learned my addr 172.21.15.112:0/134284147 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:05.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798d74e700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79880b4280 0x7f79880cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 -- 172.21.15.112:0/134284147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79880af650 msgr2=0x7f798815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79880af650 0x7f798815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 -- 172.21.15.112:0/134284147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79880b4280 msgr2=0x7f79880cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.605 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79880b4280 0x7f79880cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.594+0000 7f798cf4d700 1 -- 172.21.15.112:0/134284147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740094b0 con 0x7f79880adb20 2023-11-08T12:30:05.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f798cf4d700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880adb20 0x7f798814dcf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f797c00c4f0 tx=0x7f797c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:05.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f79857fa700 1 -- 172.21.15.112:0/134284147 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c005d90 con 0x7f79880adb20 2023-11-08T12:30:05.606 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f79857fa700 1 -- 172.21.15.112:0/134284147 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c0070d0 con 0x7f79880adb20 2023-11-08T12:30:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79880b1350 con 0x7f79880adb20 2023-11-08T12:30:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f79857fa700 1 -- 172.21.15.112:0/134284147 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c007440 con 0x7f79880adb20 2023-11-08T12:30:05.607 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798815ed60 con 0x7f79880adb20 2023-11-08T12:30:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79880b17e0 con 0x7f79880adb20 2023-11-08T12:30:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.598+0000 7f79857fa700 1 -- 172.21.15.112:0/134284147 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f797c019030 con 0x7f79880adb20 2023-11-08T12:30:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.602+0000 7f79857fa700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f796c064ee0 0x7f796c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.602+0000 7f79857fa700 1 -- 172.21.15.112:0/134284147 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f797c080f20 con 0x7f79880adb20 2023-11-08T12:30:05.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.602+0000 7f7987fff700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f796c064ee0 0x7f796c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.602+0000 7f7987fff700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f796c064ee0 0x7f796c067390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79740090b0 tx=0x7f7974008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:05.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.606+0000 7f79857fa700 1 -- 172.21.15.112:0/134284147 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f797c04a400 con 0x7f79880adb20 2023-11-08T12:30:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.782+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79880726c0 con 0x7f79880adb20 2023-11-08T12:30:05.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.782+0000 7f79857fa700 1 -- 172.21.15.112:0/134284147 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f797c0170a0 con 0x7f79880adb20 2023-11-08T12:30:05.787 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:30:05.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f796c064ee0 msgr2=0x7f796c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f796c064ee0 0x7f796c067390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79740090b0 tx=0x7f7974008030 comp rx=0 tx=0).stop 2023-11-08T12:30:05.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880adb20 msgr2=0x7f798814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880adb20 0x7f798814dcf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f797c00c4f0 tx=0x7f797c00c800 comp rx=0 tx=0).stop 2023-11-08T12:30:05.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 shutdown_connections 2023-11-08T12:30:05.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f796c064ee0 0x7f796c067390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79880b4280 0x7f79880cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79880af650 0x7f798815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 --2- 172.21.15.112:0/134284147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79880adb20 0x7f798814dcf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 >> 172.21.15.112:0/134284147 conn(0x7f79880cf580 msgr2=0x7f79880ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 shutdown_connections 2023-11-08T12:30:05.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.786+0000 7f798f1b1700 1 -- 172.21.15.112:0/134284147 wait complete. 2023-11-08T12:30:05.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:30:05.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.978+0000 7fd994f1e700 1 Processor -- start 2023-11-08T12:30:05.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.978+0000 7fd994f1e700 1 -- start start 2023-11-08T12:30:05.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd994f1e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd99015c700 0x7fd9900702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd994f1e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9900b1be0 0x7fd990070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd994f1e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99006ac00 con 0x7fd9900b2130 2023-11-08T12:30:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd994f1e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9900cd360 con 0x7fd9900b1be0 2023-11-08T12:30:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd994f1e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd990160190 con 0x7fd99015c700 2023-11-08T12:30:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98dd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd9900b2130 0x7fd99006c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46494/0 (socket says 172.21.15.112:46494) 2023-11-08T12:30:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98dd9b700 1 -- 172.21.15.112:0/4167304134 learned_addr learned my addr 172.21.15.112:0/4167304134 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888362781 0 0) 0x7fd99006ac00 con 0x7fd9900b2130 2023-11-08T12:30:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9780035d0 con 0x7fd9900b2130 2023-11-08T12:30:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101275807 0 0) 0x7fd9780035d0 con 0x7fd9900b2130 2023-11-08T12:30:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd99015c700 msgr2=0x7fd9900702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:05.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd99015c700 0x7fd9900702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 >> v2:172.21.15.133:3300/0 conn(0x7fd9900b1be0 msgr2=0x7fd990070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 --2- 172.21.15.112:0/4167304134 >> v2:172.21.15.133:3300/0 conn(0x7fd9900b1be0 0x7fd990070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd990160470 con 0x7fd9900b2130 2023-11-08T12:30:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fd984001670 con 0x7fd9900b2130 2023-11-08T12:30:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 >> v1:172.21.15.112:6789/0 conn(0x7fd9900b2130 legacy=0x7fd99006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978003a20 0x7fd978003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd978004870 0x7fd978004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd978005340 0x7fd97800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900cd360 con 0x7fd978005340 2023-11-08T12:30:05.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990160190 con 0x7fd978004870 2023-11-08T12:30:05.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97800c230 con 0x7fd978003a20 2023-11-08T12:30:05.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98ed9d700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd978005340 0x7fd97800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98ed9d700 1 -- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978003a20 msgr2=0x7fd978003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98e59c700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978003a20 0x7fd978003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98dd9b700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd978004870 0x7fd978004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98ed9d700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978003a20 0x7fd978003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98ed9d700 1 -- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd978004870 msgr2=0x7fd978004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98ed9d700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd978004870 0x7fd978004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98ed9d700 1 -- 172.21.15.112:0/4167304134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780035d0 con 0x7fd978005340 2023-11-08T12:30:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98e59c700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978003a20 0x7fd978003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.982+0000 7fd98dd9b700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd978004870 0x7fd978004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd98ed9d700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd978005340 0x7fd97800ba30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd988009e10 tx=0x7fd9780058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e0fff41407a9f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880098b0 con 0x7fd978005340 2023-11-08T12:30:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98800bac0 con 0x7fd978005340 2023-11-08T12:30:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd98d59a700 1 -- 172.21.15.112:0/4167304134 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800be70 con 0x7fd978005340 2023-11-08T12:30:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd994f1e700 1 -- 172.21.15.112:0/4167304134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd978005340 msgr2=0x7fd97800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd994f1e700 1 --2- 172.21.15.112:0/4167304134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd978005340 0x7fd97800ba30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd988009e10 tx=0x7fd9780058a0 comp rx=0 tx=0).stop 2023-11-08T12:30:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd98ed9d700 1 -- 172.21.15.112:0/4167304134 reap_dead start 2023-11-08T12:30:06.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd994f1e700 1 -- 172.21.15.112:0/4167304134 shutdown_connections 2023-11-08T12:30:06.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd994f1e700 1 -- 172.21.15.112:0/4167304134 >> 172.21.15.112:0/4167304134 conn(0x7fd9900d2d10 msgr2=0x7fd9900d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:06.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd994f1e700 1 -- 172.21.15.112:0/4167304134 shutdown_connections 2023-11-08T12:30:06.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.986+0000 7fd994f1e700 1 -- 172.21.15.112:0/4167304134 wait complete. 2023-11-08T12:30:06.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.990+0000 7fd994f1e700 1 Processor -- start 2023-11-08T12:30:06.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.990+0000 7fd994f1e700 1 -- start start 2023-11-08T12:30:06.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978005340 0x7fd9900d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b6c90 0x7fd9900b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9901f1190 0x7fd9901f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b6b30 con 0x7fd9901f1190 2023-11-08T12:30:06.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990150cd0 con 0x7fd9900b6c90 2023-11-08T12:30:06.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b5b40 con 0x7fd978005340 2023-11-08T12:30:06.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9901f1190 0x7fd9901f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9901f1190 0x7fd9901f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46120/0 (socket says 172.21.15.112:46120) 2023-11-08T12:30:06.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 -- 172.21.15.112:0/1428837612 learned_addr learned my addr 172.21.15.112:0/1428837612 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:06.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98e59c700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978005340 0x7fd9900d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 -- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978005340 msgr2=0x7fd9900d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978005340 0x7fd9900d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98dd9b700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b6c90 0x7fd9900b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 -- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b6c90 msgr2=0x7fd9900b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b6c90 0x7fd9900b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 -- 172.21.15.112:0/1428837612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd990160a30 con 0x7fd9901f1190 2023-11-08T12:30:06.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98dd9b700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b6c90 0x7fd9900b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:06.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd98ed9d700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9901f1190 0x7fd9901f1630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c180 tx=0x7fd988004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd97effd700 1 -- 172.21.15.112:0/1428837612 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988015960 con 0x7fd9901f1190 2023-11-08T12:30:06.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd97effd700 1 -- 172.21.15.112:0/1428837612 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd988015ac0 con 0x7fd9901f1190 2023-11-08T12:30:06.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd990160750 con 0x7fd9901f1190 2023-11-08T12:30:06.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd97effd700 1 -- 172.21.15.112:0/1428837612 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988015e30 con 0x7fd9901f1190 2023-11-08T12:30:06.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.994+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99006b530 con 0x7fd9901f1190 2023-11-08T12:30:06.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.998+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9900726c0 con 0x7fd9901f1190 2023-11-08T12:30:06.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:05.998+0000 7fd97effd700 1 -- 172.21.15.112:0/1428837612 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd988021470 con 0x7fd9901f1190 2023-11-08T12:30:06.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.002+0000 7fd97effd700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd970064ee0 0x7fd970067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.002+0000 7fd97effd700 1 -- 172.21.15.112:0/1428837612 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd988011070 con 0x7fd9901f1190 2023-11-08T12:30:06.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.002+0000 7fd98e59c700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd970064ee0 0x7fd970067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.002+0000 7fd98e59c700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd970064ee0 0x7fd970067390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd990071c30 tx=0x7fd980008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.006+0000 7fd97effd700 1 -- 172.21.15.112:0/1428837612 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd988052300 con 0x7fd9901f1190 2023-11-08T12:30:06.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.178+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd990072280 con 0x7fd9901f1190 2023-11-08T12:30:06.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.178+0000 7fd97effd700 1 -- 172.21.15.112:0/1428837612 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd988055920 con 0x7fd9901f1190 2023-11-08T12:30:06.185 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:30:06.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.182+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd970064ee0 msgr2=0x7fd970067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.182+0000 7fd994f1e700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd970064ee0 0x7fd970067390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd990071c30 tx=0x7fd980008040 comp rx=0 tx=0).stop 2023-11-08T12:30:06.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.182+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9901f1190 msgr2=0x7fd9901f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.182+0000 7fd994f1e700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9901f1190 0x7fd9901f1630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd97800c180 tx=0x7fd988004c00 comp rx=0 tx=0).stop 2023-11-08T12:30:06.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 shutdown_connections 2023-11-08T12:30:06.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd970064ee0 0x7fd970067390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9901f1190 0x7fd9901f1630 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b6c90 0x7fd9900b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 --2- 172.21.15.112:0/1428837612 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd978005340 0x7fd9900d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 >> 172.21.15.112:0/1428837612 conn(0x7fd9900d2d10 msgr2=0x7fd990069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:06.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 shutdown_connections 2023-11-08T12:30:06.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.186+0000 7fd994f1e700 1 -- 172.21.15.112:0/1428837612 wait complete. 2023-11-08T12:30:06.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T12:30:06.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.374+0000 7f8bc54b1700 1 Processor -- start 2023-11-08T12:30:06.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.374+0000 7f8bc54b1700 1 -- start start 2023-11-08T12:30:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc54b1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc015c640 0x7f8bc00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc54b1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8bc0069e00 0x7f8bc006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc54b1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc006c600 con 0x7f8bc0071aa0 2023-11-08T12:30:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc54b1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc006cef0 con 0x7f8bc0069e00 2023-11-08T12:30:06.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc54b1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc006a7c0 con 0x7f8bc015c640 2023-11-08T12:30:06.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bb77fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8bc0071aa0 0x7f8bc006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46506/0 (socket says 172.21.15.112:46506) 2023-11-08T12:30:06.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bb77fe700 1 -- 172.21.15.112:0/3510532853 learned_addr learned my addr 172.21.15.112:0/3510532853 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:06.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc4cb0700 1 --2- 172.21.15.112:0/3510532853 >> v2:172.21.15.112:3300/0 conn(0x7f8bc0069e00 0x7f8bc006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bbffff700 1 --2- 172.21.15.112:0/3510532853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc015c640 0x7f8bc00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bbf7fe700 1 -- 172.21.15.112:0/3510532853 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337989326 0 0) 0x7f8bc006c600 con 0x7f8bc0071aa0 2023-11-08T12:30:06.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bbf7fe700 1 -- 172.21.15.112:0/3510532853 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba00035d0 con 0x7f8bc0071aa0 2023-11-08T12:30:06.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc4cb0700 1 -- 172.21.15.112:0/3510532853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc015c640 msgr2=0x7f8bc00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:06.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc4cb0700 1 --2- 172.21.15.112:0/3510532853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc015c640 0x7f8bc00d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc4cb0700 1 -- 172.21.15.112:0/3510532853 >> v1:172.21.15.112:6789/0 conn(0x7f8bc0071aa0 legacy=0x7f8bc006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc4cb0700 1 -- 172.21.15.112:0/3510532853 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00722f0 con 0x7f8bc0069e00 2023-11-08T12:30:06.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bc4cb0700 1 --2- 172.21.15.112:0/3510532853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc006a280 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009d90 tx=0x7f8bb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4aa761813bf76a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bbf7fe700 1 -- 172.21.15.112:0/3510532853 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800e070 con 0x7f8bc0069e00 2023-11-08T12:30:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bbf7fe700 1 -- 172.21.15.112:0/3510532853 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb800bb20 con 0x7f8bc0069e00 2023-11-08T12:30:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.378+0000 7f8bbf7fe700 1 -- 172.21.15.112:0/3510532853 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8012430 con 0x7f8bc0069e00 2023-11-08T12:30:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 -- 172.21.15.112:0/3510532853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 msgr2=0x7f8bc006a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/3510532853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc006a280 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009d90 tx=0x7f8bb800b330 comp rx=0 tx=0).stop 2023-11-08T12:30:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 -- 172.21.15.112:0/3510532853 shutdown_connections 2023-11-08T12:30:06.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/3510532853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc006a280 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/3510532853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc015c640 0x7f8bc00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 -- 172.21.15.112:0/3510532853 >> 172.21.15.112:0/3510532853 conn(0x7f8bc00b6520 msgr2=0x7f8bc0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 -- 172.21.15.112:0/3510532853 shutdown_connections 2023-11-08T12:30:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 -- 172.21.15.112:0/3510532853 wait complete. 2023-11-08T12:30:06.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 Processor -- start 2023-11-08T12:30:06.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.382+0000 7f8bc54b1700 1 -- start start 2023-11-08T12:30:06.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc00d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc0071aa0 0x7f8bc00b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bc015c640 0x7f8bc015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00d1fd0 con 0x7f8bc0069e00 2023-11-08T12:30:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01595a0 con 0x7f8bc015c640 2023-11-08T12:30:06.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00c9260 con 0x7f8bc0071aa0 2023-11-08T12:30:06.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc00d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc00d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46142/0 (socket says 172.21.15.112:46142) 2023-11-08T12:30:06.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 -- 172.21.15.112:0/2053216791 learned_addr learned my addr 172.21.15.112:0/2053216791 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:06.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bb77fe700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc0071aa0 0x7f8bc00b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc4cb0700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bc015c640 0x7f8bc015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 -- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc0071aa0 msgr2=0x7f8bc00b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc0071aa0 0x7f8bc00b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 -- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bc015c640 msgr2=0x7f8bc015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bc015c640 0x7f8bc015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 -- 172.21.15.112:0/2053216791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8009a70 con 0x7f8bc0069e00 2023-11-08T12:30:06.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc4cb0700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bc015c640 0x7f8bc015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:06.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbffff700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc00d1a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000e840 tx=0x7f8bb000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbd7fa700 1 -- 172.21.15.112:0/2053216791 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00095a0 con 0x7f8bc0069e00 2023-11-08T12:30:06.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbd7fa700 1 -- 172.21.15.112:0/2053216791 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000c690 con 0x7f8bc0069e00 2023-11-08T12:30:06.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc015ca10 con 0x7f8bc0069e00 2023-11-08T12:30:06.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bbd7fa700 1 -- 172.21.15.112:0/2053216791 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000ca00 con 0x7f8bc0069e00 2023-11-08T12:30:06.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.386+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc006da20 con 0x7f8bc0069e00 2023-11-08T12:30:06.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.390+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc0072010 con 0x7f8bc0069e00 2023-11-08T12:30:06.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.390+0000 7f8bbd7fa700 1 -- 172.21.15.112:0/2053216791 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8bb0019030 con 0x7f8bc0069e00 2023-11-08T12:30:06.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.390+0000 7f8bbd7fa700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8ba4064ee0 0x7f8ba4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.390+0000 7f8bbd7fa700 1 -- 172.21.15.112:0/2053216791 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8bb0081b20 con 0x7f8bc0069e00 2023-11-08T12:30:06.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.394+0000 7f8bb77fe700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8ba4064ee0 0x7f8ba4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.394+0000 7f8bb77fe700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8ba4064ee0 0x7f8ba4067390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00cc340 tx=0x7f8ba8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.398+0000 7f8bbd7fa700 1 -- 172.21.15.112:0/2053216791 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8bb004fed0 con 0x7f8bc0069e00 2023-11-08T12:30:06.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8bc0073cb0 con 0x7f8bc0069e00 2023-11-08T12:30:06.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bbd7fa700 1 -- 172.21.15.112:0/2053216791 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8bb00534f0 con 0x7f8bc0069e00 2023-11-08T12:30:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:06.575 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-11-08T12:30:06.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-11-08T12:30:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-11-08T12:30:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:06.576 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2023-11-08T12:30:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2023-11-08T12:30:06.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:06.577 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-11-08T12:30:06.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8ba4064ee0 msgr2=0x7f8ba4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8ba4064ee0 0x7f8ba4067390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00cc340 tx=0x7f8ba8009040 comp rx=0 tx=0).stop 2023-11-08T12:30:06.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 msgr2=0x7f8bc00d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc00d1a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000e840 tx=0x7f8bb000ec00 comp rx=0 tx=0).stop 2023-11-08T12:30:06.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 shutdown_connections 2023-11-08T12:30:06.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.570+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8ba4064ee0 0x7f8ba4067390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.574+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bc015c640 0x7f8bc015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.574+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8bc0071aa0 0x7f8bc00b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.574+0000 7f8bc54b1700 1 --2- 172.21.15.112:0/2053216791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bc0069e00 0x7f8bc00d1a90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.574+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 >> 172.21.15.112:0/2053216791 conn(0x7f8bc00b6520 msgr2=0x7f8bc0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:06.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.574+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 shutdown_connections 2023-11-08T12:30:06.580 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.574+0000 7f8bc54b1700 1 -- 172.21.15.112:0/2053216791 wait complete. 2023-11-08T12:30:06.602 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T12:30:06.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T12:30:06.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.774+0000 7f73b0e51700 1 Processor -- start 2023-11-08T12:30:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.774+0000 7f73b0e51700 1 -- start start 2023-11-08T12:30:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73b0e51700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73b0e51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73ac141220 0x7f73ac15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73b0e51700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ac141d60 con 0x7f73ac15e5f0 2023-11-08T12:30:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73b0e51700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ac141670 con 0x7f73ac141220 2023-11-08T12:30:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73b0e51700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac15a790 con 0x7f73ac0b0d30 2023-11-08T12:30:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73aa59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73aad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f73ac15e5f0 0x7f73ac069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:59750/0 (socket says 172.21.15.112:59750) 2023-11-08T12:30:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a9d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73ac141220 0x7f73ac15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73aad9d700 1 -- 172.21.15.112:0/1070113909 learned_addr learned my addr 172.21.15.112:0/1070113909 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a959a700 1 -- 172.21.15.112:0/1070113909 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614610557 0 0) 0x7f73ac141d60 con 0x7f73ac15e5f0 2023-11-08T12:30:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a959a700 1 -- 172.21.15.112:0/1070113909 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73940035d0 con 0x7f73ac15e5f0 2023-11-08T12:30:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a9d9b700 1 -- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 msgr2=0x7f73ac140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a9d9b700 1 --2- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a9d9b700 1 -- 172.21.15.112:0/1070113909 >> v1:172.21.15.133:6789/0 conn(0x7f73ac15e5f0 legacy=0x7f73ac069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a9d9b700 1 -- 172.21.15.112:0/1070113909 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac0cbc10 con 0x7f73ac141220 2023-11-08T12:30:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73aa59c700 1 --2- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.778+0000 7f73a9d9b700 1 --2- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac15e0b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009850 tx=0x7f73a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d7a1fd703c472f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73a959a700 1 -- 172.21.15.112:0/1070113909 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0011830 con 0x7f73ac141220 2023-11-08T12:30:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73a959a700 1 -- 172.21.15.112:0/1070113909 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0011990 con 0x7f73ac141220 2023-11-08T12:30:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73a959a700 1 -- 172.21.15.112:0/1070113909 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0011d40 con 0x7f73ac141220 2023-11-08T12:30:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 -- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 msgr2=0x7f73ac15e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 --2- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac15e0b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009850 tx=0x7f73a0009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 -- 172.21.15.112:0/1070113909 shutdown_connections 2023-11-08T12:30:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 --2- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac15e0b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 --2- 172.21.15.112:0/1070113909 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 -- 172.21.15.112:0/1070113909 >> 172.21.15.112:0/1070113909 conn(0x7f73ac06bfc0 msgr2=0x7f73ac06c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 -- 172.21.15.112:0/1070113909 shutdown_connections 2023-11-08T12:30:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.782+0000 7f73b0e51700 1 -- 172.21.15.112:0/1070113909 wait complete. 2023-11-08T12:30:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 Processor -- start 2023-11-08T12:30:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 -- start start 2023-11-08T12:30:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac1400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac15e5f0 0x7f73ac0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac157560 con 0x7f73ac15e5f0 2023-11-08T12:30:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac156950 con 0x7f73ac141220 2023-11-08T12:30:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73b0e51700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac156c30 con 0x7f73ac0b0d30 2023-11-08T12:30:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac15e5f0 0x7f73ac0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac15e5f0 0x7f73ac0cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46154/0 (socket says 172.21.15.112:46154) 2023-11-08T12:30:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 -- 172.21.15.112:0/3711958786 learned_addr learned my addr 172.21.15.112:0/3711958786 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73a9d9b700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 -- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 msgr2=0x7f73ac1400e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-08T12:30:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac1400e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 -- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 msgr2=0x7f73ac155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 -- 172.21.15.112:0/3711958786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c0094b0 con 0x7f73ac15e5f0 2023-11-08T12:30:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73a9d9b700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f73aad9d700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac15e5f0 0x7f73ac0cce60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f73a400cb40 tx=0x7f73a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f739affd700 1 -- 172.21.15.112:0/3711958786 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400a9e0 con 0x7f73ac15e5f0 2023-11-08T12:30:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f739affd700 1 -- 172.21.15.112:0/3711958786 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a400ab40 con 0x7f73ac15e5f0 2023-11-08T12:30:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.786+0000 7f739affd700 1 -- 172.21.15.112:0/3711958786 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400ce60 con 0x7f73ac15e5f0 2023-11-08T12:30:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.790+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a00094b0 con 0x7f73ac15e5f0 2023-11-08T12:30:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.790+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ac15ad30 con 0x7f73ac15e5f0 2023-11-08T12:30:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.790+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ac15aa50 con 0x7f73ac15e5f0 2023-11-08T12:30:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.790+0000 7f739affd700 1 -- 172.21.15.112:0/3711958786 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f73a4019030 con 0x7f73ac15e5f0 2023-11-08T12:30:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.794+0000 7f739affd700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f738c064f10 0x7f738c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.794+0000 7f739affd700 1 -- 172.21.15.112:0/3711958786 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f73a4081630 con 0x7f73ac15e5f0 2023-11-08T12:30:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.794+0000 7f73aa59c700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f738c064f10 0x7f738c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.794+0000 7f73aa59c700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f738c064f10 0x7f738c0673c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73ac13e250 tx=0x7f739c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.802+0000 7f739affd700 1 -- 172.21.15.112:0/3711958786 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f73a404f9e0 con 0x7f73ac15e5f0 2023-11-08T12:30:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:06.970+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f73ac15b010 con 0x7f73ac15e5f0 2023-11-08T12:30:07.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.078+0000 7f739affd700 1 -- 172.21.15.112:0/3711958786 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) v1 ==== 138+0+0 (secure 0 0 0) 0x7f73a4053000 con 0x7f73ac15e5f0 2023-11-08T12:30:07.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f738c064f10 msgr2=0x7f738c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:07.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f738c064f10 0x7f738c0673c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73ac13e250 tx=0x7f739c009240 comp rx=0 tx=0).stop 2023-11-08T12:30:07.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac15e5f0 msgr2=0x7f73ac0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:07.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac15e5f0 0x7f73ac0cce60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f73a400cb40 tx=0x7f73a400cc20 comp rx=0 tx=0).stop 2023-11-08T12:30:07.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 shutdown_connections 2023-11-08T12:30:07.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f738c064f10 0x7f738c0673c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f73ac15e5f0 0x7f73ac0cce60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73ac141220 0x7f73ac155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 --2- 172.21.15.112:0/3711958786 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73ac0b0d30 0x7f73ac1400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 >> 172.21.15.112:0/3711958786 conn(0x7f73ac06bfc0 msgr2=0x7f73ac159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:07.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 shutdown_connections 2023-11-08T12:30:07.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.086+0000 7f73b0e51700 1 -- 172.21.15.112:0/3711958786 wait complete. 2023-11-08T12:30:07.095 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-11-08T12:30:07.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T12:30:07.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.286+0000 7f53d759e700 1 Processor -- start 2023-11-08T12:30:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.286+0000 7f53d759e700 1 -- start start 2023-11-08T12:30:07.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.286+0000 7f53d759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d815c7c0 0x7f53d806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.286+0000 7f53d759e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53d8161030 0x7f53d80cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.286+0000 7f53d759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80cdba0 con 0x7f53d80cd700 2023-11-08T12:30:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.286+0000 7f53d759e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d806c010 con 0x7f53d8161030 2023-11-08T12:30:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.286+0000 7f53d759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d806c2f0 con 0x7f53d815c7c0 2023-11-08T12:30:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d6d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f53d80cd700 0x7f53d80cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46520/0 (socket says 172.21.15.112:46520) 2023-11-08T12:30:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d6d9d700 1 -- 172.21.15.112:0/4244860502 learned_addr learned my addr 172.21.15.112:0/4244860502 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d5d9b700 1 --2- 172.21.15.112:0/4244860502 >> v2:172.21.15.112:3300/0 conn(0x7f53d8161030 0x7f53d80cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d659c700 1 --2- 172.21.15.112:0/4244860502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d815c7c0 0x7f53d806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d559a700 1 -- 172.21.15.112:0/4244860502 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943650361 0 0) 0x7f53d80cdba0 con 0x7f53d80cd700 2023-11-08T12:30:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d559a700 1 -- 172.21.15.112:0/4244860502 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c00035d0 con 0x7f53d80cd700 2023-11-08T12:30:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d659c700 1 -- 172.21.15.112:0/4244860502 >> v2:172.21.15.112:3300/0 conn(0x7f53d8161030 msgr2=0x7f53d80cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d659c700 1 --2- 172.21.15.112:0/4244860502 >> v2:172.21.15.112:3300/0 conn(0x7f53d8161030 0x7f53d80cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d659c700 1 -- 172.21.15.112:0/4244860502 >> v1:172.21.15.112:6789/0 conn(0x7f53d80cd700 legacy=0x7f53d80cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d659c700 1 -- 172.21.15.112:0/4244860502 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d806c5d0 con 0x7f53d815c7c0 2023-11-08T12:30:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d659c700 1 --2- 172.21.15.112:0/4244860502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d815c7c0 0x7f53d806cdd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009850 tx=0x7f53c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be872eeac018a18e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d559a700 1 -- 172.21.15.112:0/4244860502 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011830 con 0x7f53d815c7c0 2023-11-08T12:30:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d559a700 1 -- 172.21.15.112:0/4244860502 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8011990 con 0x7f53d815c7c0 2023-11-08T12:30:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d559a700 1 -- 172.21.15.112:0/4244860502 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011d40 con 0x7f53d815c7c0 2023-11-08T12:30:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d759e700 1 -- 172.21.15.112:0/4244860502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d815c7c0 msgr2=0x7f53d806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.290+0000 7f53d759e700 1 --2- 172.21.15.112:0/4244860502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d815c7c0 0x7f53d806cdd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009850 tx=0x7f53c8009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 -- 172.21.15.112:0/4244860502 shutdown_connections 2023-11-08T12:30:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 --2- 172.21.15.112:0/4244860502 >> v2:172.21.15.112:3300/0 conn(0x7f53d8161030 0x7f53d80cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 --2- 172.21.15.112:0/4244860502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d815c7c0 0x7f53d806cdd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 -- 172.21.15.112:0/4244860502 >> 172.21.15.112:0/4244860502 conn(0x7f53d80d3800 msgr2=0x7f53d80cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:07.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 -- 172.21.15.112:0/4244860502 shutdown_connections 2023-11-08T12:30:07.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 -- 172.21.15.112:0/4244860502 wait complete. 2023-11-08T12:30:07.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 Processor -- start 2023-11-08T12:30:07.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.294+0000 7f53d759e700 1 -- start start 2023-11-08T12:30:07.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80cd700 0x7f53d81477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d815c7c0 0x7f53d80b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d81581a0 0x7f53d8147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80b79b0 con 0x7f53d815c7c0 2023-11-08T12:30:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8147d00 con 0x7f53d80cd700 2023-11-08T12:30:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80b6da0 con 0x7f53d81581a0 2023-11-08T12:30:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d815c7c0 0x7f53d80b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d815c7c0 0x7f53d80b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46172/0 (socket says 172.21.15.112:46172) 2023-11-08T12:30:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 -- 172.21.15.112:0/2093843688 learned_addr learned my addr 172.21.15.112:0/2093843688 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d6d9d700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d81581a0 0x7f53d8147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d659c700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80cd700 0x7f53d81477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 -- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d81581a0 msgr2=0x7f53d8147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d81581a0 0x7f53d8147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 -- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80cd700 msgr2=0x7f53d81477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80cd700 0x7f53d81477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:07.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 -- 172.21.15.112:0/2093843688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80094b0 con 0x7f53d815c7c0 2023-11-08T12:30:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d5d9b700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d815c7c0 0x7f53d80b7e40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00e9d0 tx=0x7f53cc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53c6ffd700 1 -- 172.21.15.112:0/2093843688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc009720 con 0x7f53d815c7c0 2023-11-08T12:30:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53c6ffd700 1 -- 172.21.15.112:0/2093843688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc00c850 con 0x7f53d815c7c0 2023-11-08T12:30:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d815cb90 con 0x7f53d815c7c0 2023-11-08T12:30:07.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53c6ffd700 1 -- 172.21.15.112:0/2093843688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00cbc0 con 0x7f53d815c7c0 2023-11-08T12:30:07.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.298+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d806c8b0 con 0x7f53d815c7c0 2023-11-08T12:30:07.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.302+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80ce500 con 0x7f53d815c7c0 2023-11-08T12:30:07.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.302+0000 7f53c6ffd700 1 -- 172.21.15.112:0/2093843688 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f53cc019030 con 0x7f53d815c7c0 2023-11-08T12:30:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.302+0000 7f53c6ffd700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53b8064ee0 0x7f53b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.306+0000 7f53c6ffd700 1 -- 172.21.15.112:0/2093843688 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f53cc081f30 con 0x7f53d815c7c0 2023-11-08T12:30:07.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.306+0000 7f53d659c700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53b8064ee0 0x7f53b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:07.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.306+0000 7f53d659c700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53b8064ee0 0x7f53b8067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f53c80090b0 tx=0x7f53c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.310+0000 7f53c6ffd700 1 -- 172.21.15.112:0/2093843688 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f53cc050080 con 0x7f53d815c7c0 2023-11-08T12:30:07.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:07.478+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f53d8073cb0 con 0x7f53d815c7c0 2023-11-08T12:30:07.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:30:07.667 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:30:08.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.090+0000 7f53c6ffd700 1 -- 172.21.15.112:0/2093843688 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) v1 ==== 170+0+0 (secure 0 0 0) 0x7f53cc0536a0 con 0x7f53d815c7c0 2023-11-08T12:30:08.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.098+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53b8064ee0 msgr2=0x7f53b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.098+0000 7f53d759e700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53b8064ee0 0x7f53b8067390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f53c80090b0 tx=0x7f53c8008030 comp rx=0 tx=0).stop 2023-11-08T12:30:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.098+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d815c7c0 msgr2=0x7f53d80b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.098+0000 7f53d759e700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d815c7c0 0x7f53d80b7e40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00e9d0 tx=0x7f53cc00ed90 comp rx=0 tx=0).stop 2023-11-08T12:30:08.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 shutdown_connections 2023-11-08T12:30:08.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f53b8064ee0 0x7f53b8067390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53d81581a0 0x7f53d8147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53d815c7c0 0x7f53d80b7e40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 --2- 172.21.15.112:0/2093843688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80cd700 0x7f53d81477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 >> 172.21.15.112:0/2093843688 conn(0x7f53d80d3800 msgr2=0x7f53d8069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 shutdown_connections 2023-11-08T12:30:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.102+0000 7f53d759e700 1 -- 172.21.15.112:0/2093843688 wait complete. 2023-11-08T12:30:08.114 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-11-08T12:30:08.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T12:30:08.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.314+0000 7f45eb59e700 1 Processor -- start 2023-11-08T12:30:08.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.314+0000 7f45eb59e700 1 -- start start 2023-11-08T12:30:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45eb59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45ec070620 0x7f45ec0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45eb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec06a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45eb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec15c520 con 0x7f45ec15c150 2023-11-08T12:30:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45eb59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec0b4240 con 0x7f45ec070620 2023-11-08T12:30:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45eb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec06cc50 con 0x7f45ec069bf0 2023-11-08T12:30:08.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45ec070620 0x7f45ec0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45ec070620 0x7f45ec0b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46186/0 (socket says 172.21.15.112:46186) 2023-11-08T12:30:08.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 -- 172.21.15.112:0/1989217191 learned_addr learned my addr 172.21.15.112:0/1989217191 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:08.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45ea59c700 1 --1- 172.21.15.112:0/1989217191 >> v1:172.21.15.133:6789/0 conn(0x7f45ec15c150 0x7f45ec06ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:59756/0 (socket says 172.21.15.112:59756) 2023-11-08T12:30:08.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45ead9d700 1 --2- 172.21.15.112:0/1989217191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec06a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e959a700 1 -- 172.21.15.112:0/1989217191 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599998327 0 0) 0x7f45ec15c520 con 0x7f45ec15c150 2023-11-08T12:30:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e959a700 1 -- 172.21.15.112:0/1989217191 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d40035d0 con 0x7f45ec15c150 2023-11-08T12:30:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 -- 172.21.15.112:0/1989217191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 msgr2=0x7f45ec06a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 --2- 172.21.15.112:0/1989217191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec06a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 -- 172.21.15.112:0/1989217191 >> v1:172.21.15.133:6789/0 conn(0x7f45ec15c150 legacy=0x7f45ec06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 -- 172.21.15.112:0/1989217191 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0d2450 con 0x7f45ec070620 2023-11-08T12:30:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.318+0000 7f45e9d9b700 1 --2- 172.21.15.112:0/1989217191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec070620 0x7f45ec0b3d00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009910 tx=0x7f45e0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168f9c3a02752f8f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45e959a700 1 -- 172.21.15.112:0/1989217191 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0005e50 con 0x7f45ec070620 2023-11-08T12:30:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45e959a700 1 -- 172.21.15.112:0/1989217191 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0006030 con 0x7f45ec070620 2023-11-08T12:30:08.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45e959a700 1 -- 172.21.15.112:0/1989217191 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00063a0 con 0x7f45ec070620 2023-11-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 -- 172.21.15.112:0/1989217191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec070620 msgr2=0x7f45ec0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 --2- 172.21.15.112:0/1989217191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec070620 0x7f45ec0b3d00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009910 tx=0x7f45e0009c20 comp rx=0 tx=0).stop 2023-11-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 -- 172.21.15.112:0/1989217191 shutdown_connections 2023-11-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 --2- 172.21.15.112:0/1989217191 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec06a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 --2- 172.21.15.112:0/1989217191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec070620 0x7f45ec0b3d00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 -- 172.21.15.112:0/1989217191 >> 172.21.15.112:0/1989217191 conn(0x7f45ec0d3680 msgr2=0x7f45ec0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:08.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 -- 172.21.15.112:0/1989217191 shutdown_connections 2023-11-08T12:30:08.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 -- 172.21.15.112:0/1989217191 wait complete. 2023-11-08T12:30:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 Processor -- start 2023-11-08T12:30:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.322+0000 7f45eb59e700 1 -- start start 2023-11-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ec070620 0x7f45ec146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec15c150 0x7f45ec15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1472d0 con 0x7f45ec15c150 2023-11-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1460c0 con 0x7f45ec070620 2023-11-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1474c0 con 0x7f45ec069bf0 2023-11-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec15c150 0x7f45ec15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec15c150 0x7f45ec15ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46188/0 (socket says 172.21.15.112:46188) 2023-11-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 -- 172.21.15.112:0/2073182291 learned_addr learned my addr 172.21.15.112:0/2073182291 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:08.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45e9d9b700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ec070620 0x7f45ec146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ea59c700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 -- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 msgr2=0x7f45ec0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 -- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ec070620 msgr2=0x7f45ec146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ec070620 0x7f45ec146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 -- 172.21.15.112:0/2073182291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0009520 con 0x7f45ec15c150 2023-11-08T12:30:08.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45ead9d700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec15c150 0x7f45ec15ff00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f45e400efc0 tx=0x7f45e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:08.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45daffd700 1 -- 172.21.15.112:0/2073182291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400cd40 con 0x7f45ec15c150 2023-11-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45daffd700 1 -- 172.21.15.112:0/2073182291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e400f040 con 0x7f45ec15c150 2023-11-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45daffd700 1 -- 172.21.15.112:0/2073182291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40146c0 con 0x7f45ec15c150 2023-11-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec0d05e0 con 0x7f45ec15c150 2023-11-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.326+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec0d2730 con 0x7f45ec15c150 2023-11-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.330+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec0d2140 con 0x7f45ec15c150 2023-11-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.330+0000 7f45daffd700 1 -- 172.21.15.112:0/2073182291 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f45e4014820 con 0x7f45ec15c150 2023-11-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.334+0000 7f45daffd700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f45cc064ee0 0x7f45cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.334+0000 7f45daffd700 1 -- 172.21.15.112:0/2073182291 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f45e4082a00 con 0x7f45ec15c150 2023-11-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.334+0000 7f45ea59c700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f45cc064ee0 0x7f45cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.334+0000 7f45ea59c700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f45cc064ee0 0x7f45cc067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000f60 tx=0x7f45dc007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:08.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.338+0000 7f45daffd700 1 -- 172.21.15.112:0/2073182291 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f45e4050ac0 con 0x7f45ec15c150 2023-11-08T12:30:08.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.542+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45ec073d20 con 0x7f45ec15c150 2023-11-08T12:30:08.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.554+0000 7f45daffd700 1 -- 172.21.15.112:0/2073182291 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f45e400cea0 con 0x7f45ec15c150 2023-11-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f45cc064ee0 msgr2=0x7f45cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f45cc064ee0 0x7f45cc067390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000f60 tx=0x7f45dc007c00 comp rx=0 tx=0).stop 2023-11-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec15c150 msgr2=0x7f45ec15ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec15c150 0x7f45ec15ff00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f45e400efc0 tx=0x7f45e400c3a0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 shutdown_connections 2023-11-08T12:30:08.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f45cc064ee0 0x7f45cc067390 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000f60 tx=0x7f45dc007c00 comp rx=0 tx=0).stop 2023-11-08T12:30:08.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45ec15c150 0x7f45ec15ff00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ec070620 0x7f45ec146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 --2- 172.21.15.112:0/2073182291 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45ec069bf0 0x7f45ec0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.562+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 >> 172.21.15.112:0/2073182291 conn(0x7f45ec0d3680 msgr2=0x7f45ec0b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:08.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.566+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 shutdown_connections 2023-11-08T12:30:08.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.570+0000 7f45eb59e700 1 -- 172.21.15.112:0/2073182291 wait complete. 2023-11-08T12:30:08.576 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 8 and data pool 9 2023-11-08T12:30:08.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed3df2700 1 Processor -- start 2023-11-08T12:30:08.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed3df2700 1 -- start start 2023-11-08T12:30:08.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed3df2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efecc163cb0 0x7efecc164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed3df2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efecc06d4c0 0x7efecc06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed3df2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc164080 con 0x7efecc0cdfb0 2023-11-08T12:30:08.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed3df2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0cc290 con 0x7efecc06d4c0 2023-11-08T12:30:08.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed3df2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc069bf0 con 0x7efecc163cb0 2023-11-08T12:30:08.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed238f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efecc06d4c0 0x7efecc06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed238f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efecc06d4c0 0x7efecc06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46190/0 (socket says 172.21.15.112:46190) 2023-11-08T12:30:08.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.766+0000 7efed238f700 1 -- 172.21.15.112:0/636985160 learned_addr learned my addr 172.21.15.112:0/636985160 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:08.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed1b8e700 1 --2- 172.21.15.112:0/636985160 >> v2:172.21.15.133:3300/0 conn(0x7efecc163cb0 0x7efecc164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed238f700 1 -- 172.21.15.112:0/636985160 >> v2:172.21.15.133:3300/0 conn(0x7efecc163cb0 msgr2=0x7efecc164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:08.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed238f700 1 --2- 172.21.15.112:0/636985160 >> v2:172.21.15.133:3300/0 conn(0x7efecc163cb0 0x7efecc164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed238f700 1 -- 172.21.15.112:0/636985160 >> v1:172.21.15.112:6789/0 conn(0x7efecc0cdfb0 legacy=0x7efecc06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed238f700 1 -- 172.21.15.112:0/636985160 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc1651f0 con 0x7efecc06d4c0 2023-11-08T12:30:08.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed238f700 1 --2- 172.21.15.112:0/636985160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc06d4c0 0x7efecc06a640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7efecc06fbe0 tx=0x7efec400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab437fbb0be259eb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:08.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed0b8c700 1 -- 172.21.15.112:0/636985160 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400e070 con 0x7efecc06d4c0 2023-11-08T12:30:08.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed0b8c700 1 -- 172.21.15.112:0/636985160 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400b9c0 con 0x7efecc06d4c0 2023-11-08T12:30:08.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed0b8c700 1 -- 172.21.15.112:0/636985160 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400bd70 con 0x7efecc06d4c0 2023-11-08T12:30:08.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 -- 172.21.15.112:0/636985160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc06d4c0 msgr2=0x7efecc06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 --2- 172.21.15.112:0/636985160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc06d4c0 0x7efecc06a640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7efecc06fbe0 tx=0x7efec400b330 comp rx=0 tx=0).stop 2023-11-08T12:30:08.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 -- 172.21.15.112:0/636985160 shutdown_connections 2023-11-08T12:30:08.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 --2- 172.21.15.112:0/636985160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc06d4c0 0x7efecc06a640 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 --2- 172.21.15.112:0/636985160 >> v2:172.21.15.133:3300/0 conn(0x7efecc163cb0 0x7efecc164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 -- 172.21.15.112:0/636985160 >> 172.21.15.112:0/636985160 conn(0x7efecc0cf350 msgr2=0x7efecc0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:08.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 -- 172.21.15.112:0/636985160 shutdown_connections 2023-11-08T12:30:08.779 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.770+0000 7efed3df2700 1 -- 172.21.15.112:0/636985160 wait complete. 2023-11-08T12:30:08.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 Processor -- start 2023-11-08T12:30:08.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 -- start start 2023-11-08T12:30:08.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc06d4c0 0x7efecc0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc0cdfb0 0x7efecc0c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efecc163cb0 0x7efecc0c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc1f9ee0 con 0x7efecc0cdfb0 2023-11-08T12:30:08.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0c3730 con 0x7efecc06d4c0 2023-11-08T12:30:08.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.774+0000 7efed3df2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0c24e0 con 0x7efecc163cb0 2023-11-08T12:30:08.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc0cdfb0 0x7efecc0c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed1b8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc06d4c0 0x7efecc0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc0cdfb0 0x7efecc0c2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46202/0 (socket says 172.21.15.112:46202) 2023-11-08T12:30:08.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 -- 172.21.15.112:0/2232898764 learned_addr learned my addr 172.21.15.112:0/2232898764 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:08.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed1b8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc06d4c0 0x7efecc0af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:55634/0 (socket says 172.21.15.112:55634) 2023-11-08T12:30:08.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed238f700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efecc163cb0 0x7efecc0c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 -- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efecc163cb0 msgr2=0x7efecc0c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efecc163cb0 0x7efecc0c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 -- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc06d4c0 msgr2=0x7efecc0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc06d4c0 0x7efecc0af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 -- 172.21.15.112:0/2232898764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009b30 con 0x7efecc0cdfb0 2023-11-08T12:30:08.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed238f700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efecc163cb0 0x7efecc0c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:08.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed138d700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc0cdfb0 0x7efecc0c2b50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c500 tx=0x7efebc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:08.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efec27fc700 1 -- 172.21.15.112:0/2232898764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0052d0 con 0x7efecc0cdfb0 2023-11-08T12:30:08.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efec27fc700 1 -- 172.21.15.112:0/2232898764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc005430 con 0x7efecc0cdfb0 2023-11-08T12:30:08.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efec27fc700 1 -- 172.21.15.112:0/2232898764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0055a0 con 0x7efecc0cdfb0 2023-11-08T12:30:08.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc0cc780 con 0x7efecc0cdfb0 2023-11-08T12:30:08.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc0cc4a0 con 0x7efecc0cdfb0 2023-11-08T12:30:08.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.778+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc069e40 con 0x7efecc0cdfb0 2023-11-08T12:30:08.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.782+0000 7efec27fc700 1 -- 172.21.15.112:0/2232898764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efebc019030 con 0x7efecc0cdfb0 2023-11-08T12:30:08.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.782+0000 7efec27fc700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb0064f30 0x7efeb00673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:08.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.782+0000 7efec27fc700 1 -- 172.21.15.112:0/2232898764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efebc081720 con 0x7efecc0cdfb0 2023-11-08T12:30:08.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.782+0000 7efed1b8e700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb0064f30 0x7efeb00673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:08.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.782+0000 7efed1b8e700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb0064f30 0x7efeb00673e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efec8007a60 tx=0x7efec8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:08.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.786+0000 7efec27fc700 1 -- 172.21.15.112:0/2232898764 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efebc04f820 con 0x7efecc0cdfb0 2023-11-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.954+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efecc0affb0 con 0x7efecc0cdfb0 2023-11-08T12:30:08.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.958+0000 7efec27fc700 1 -- 172.21.15.112:0/2232898764 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18145 (secure 0 0 0) 0x7efebc052e40 con 0x7efecc0cdfb0 2023-11-08T12:30:08.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:08.964 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":57,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:08.547206+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:07.036289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:07.538745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:08.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.958+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb0064f30 msgr2=0x7efeb00673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.958+0000 7efed3df2700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb0064f30 0x7efeb00673e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efec8007a60 tx=0x7efec8008040 comp rx=0 tx=0).stop 2023-11-08T12:30:08.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.958+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc0cdfb0 msgr2=0x7efecc0c2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:08.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.958+0000 7efed3df2700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc0cdfb0 0x7efecc0c2b50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c500 tx=0x7efebc00c810 comp rx=0 tx=0).stop 2023-11-08T12:30:08.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 shutdown_connections 2023-11-08T12:30:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efeb0064f30 0x7efeb00673e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efecc163cb0 0x7efecc0c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efecc0cdfb0 0x7efecc0c2b50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 --2- 172.21.15.112:0/2232898764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc06d4c0 0x7efecc0af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:08.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 >> 172.21.15.112:0/2232898764 conn(0x7efecc0cf350 msgr2=0x7efecc06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:08.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 shutdown_connections 2023-11-08T12:30:08.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:08.962+0000 7efed3df2700 1 -- 172.21.15.112:0/2232898764 wait complete. 2023-11-08T12:30:08.987 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:09.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.146+0000 7f599526f700 1 Processor -- start 2023-11-08T12:30:09.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.146+0000 7f599526f700 1 -- start start 2023-11-08T12:30:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.146+0000 7f599526f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b43a0 0x7f599015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.146+0000 7f599526f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599015a550 con 0x7f5990070790 2023-11-08T12:30:09.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.146+0000 7f599526f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599006b0a0 con 0x7f59900b1640 2023-11-08T12:30:09.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.146+0000 7f599526f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59900caac0 con 0x7f59900b43a0 2023-11-08T12:30:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f59877fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f59900b1640 0x7f5990070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:59766/0 (socket says 172.21.15.112:59766) 2023-11-08T12:30:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f59877fe700 1 -- 172.21.15.112:0/4028538091 learned_addr learned my addr 172.21.15.112:0/4028538091 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b43a0 0x7f599015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f5994a6e700 1 --1- 172.21.15.112:0/4028538091 >> v1:172.21.15.112:6789/0 conn(0x7f5990070790 0x7f599006bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46540/0 (socket says 172.21.15.112:46540) 2023-11-08T12:30:09.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598f7fe700 1 -- 172.21.15.112:0/4028538091 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564636210 0 0) 0x7f599006b0a0 con 0x7f59900b1640 2023-11-08T12:30:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598f7fe700 1 -- 172.21.15.112:0/4028538091 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f597c0035d0 con 0x7f59900b1640 2023-11-08T12:30:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598f7fe700 1 -- 172.21.15.112:0/4028538091 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085415144 0 0) 0x7f5988001490 con 0x7f5990070790 2023-11-08T12:30:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598f7fe700 1 -- 172.21.15.112:0/4028538091 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f599006b0a0 con 0x7f5990070790 2023-11-08T12:30:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598ffff700 1 -- 172.21.15.112:0/4028538091 >> v1:172.21.15.133:6789/0 conn(0x7f59900b1640 legacy=0x7f5990070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598ffff700 1 -- 172.21.15.112:0/4028538091 >> v1:172.21.15.112:6789/0 conn(0x7f5990070790 legacy=0x7f599006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598ffff700 1 -- 172.21.15.112:0/4028538091 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900cada0 con 0x7f59900b43a0 2023-11-08T12:30:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598ffff700 1 --2- 172.21.15.112:0/4028538091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b43a0 0x7f599015e5d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5980009880 tx=0x7f5980009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feef9f934ff072c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:09.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598f7fe700 1 -- 172.21.15.112:0/4028538091 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980011830 con 0x7f59900b43a0 2023-11-08T12:30:09.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598f7fe700 1 -- 172.21.15.112:0/4028538091 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5980011990 con 0x7f59900b43a0 2023-11-08T12:30:09.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f598f7fe700 1 -- 172.21.15.112:0/4028538091 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980011d20 con 0x7f59900b43a0 2023-11-08T12:30:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f599526f700 1 -- 172.21.15.112:0/4028538091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b43a0 msgr2=0x7f599015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f599526f700 1 --2- 172.21.15.112:0/4028538091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b43a0 0x7f599015e5d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5980009880 tx=0x7f5980009b90 comp rx=0 tx=0).stop 2023-11-08T12:30:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f599526f700 1 -- 172.21.15.112:0/4028538091 shutdown_connections 2023-11-08T12:30:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f599526f700 1 --2- 172.21.15.112:0/4028538091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b43a0 0x7f599015e5d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f599526f700 1 -- 172.21.15.112:0/4028538091 >> 172.21.15.112:0/4028538091 conn(0x7f59900b0f80 msgr2=0x7f59900ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:09.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f599526f700 1 -- 172.21.15.112:0/4028538091 shutdown_connections 2023-11-08T12:30:09.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.150+0000 7f599526f700 1 -- 172.21.15.112:0/4028538091 wait complete. 2023-11-08T12:30:09.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.154+0000 7f599526f700 1 Processor -- start 2023-11-08T12:30:09.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.154+0000 7f599526f700 1 -- start start 2023-11-08T12:30:09.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.154+0000 7f599526f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5990070790 0x7f59900ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.154+0000 7f599526f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b1640 0x7f59901f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.154+0000 7f599526f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59900b43a0 0x7f599006c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.154+0000 7f599526f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599015bc00 con 0x7f5990070790 2023-11-08T12:30:09.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f599526f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599015bee0 con 0x7f59900b43a0 2023-11-08T12:30:09.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f599526f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599015c1c0 con 0x7f59900b1640 2023-11-08T12:30:09.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5990070790 0x7f59900ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5990070790 0x7f59900ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46212/0 (socket says 172.21.15.112:46212) 2023-11-08T12:30:09.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 -- 172.21.15.112:0/2057725537 learned_addr learned my addr 172.21.15.112:0/2057725537 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:09.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f59877fe700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b1640 0x7f59901f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f5994a6e700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59900b43a0 0x7f599006c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 -- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b1640 msgr2=0x7f59901f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b1640 0x7f59901f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 -- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59900b43a0 msgr2=0x7f599006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59900b43a0 0x7f599006c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 -- 172.21.15.112:0/2057725537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800094b0 con 0x7f5990070790 2023-11-08T12:30:09.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f59877fe700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b1640 0x7f59901f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:09.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f5994a6e700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59900b43a0 0x7f599006c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:09.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598ffff700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5990070790 0x7f59900ac790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5980009bd0 tx=0x7f5980004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:09.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598d7fa700 1 -- 172.21.15.112:0/2057725537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59800198d0 con 0x7f5990070790 2023-11-08T12:30:09.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598d7fa700 1 -- 172.21.15.112:0/2057725537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598001e070 con 0x7f5990070790 2023-11-08T12:30:09.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599006b5d0 con 0x7f5990070790 2023-11-08T12:30:09.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f598d7fa700 1 -- 172.21.15.112:0/2057725537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980019c70 con 0x7f5990070790 2023-11-08T12:30:09.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.158+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599006b2f0 con 0x7f5990070790 2023-11-08T12:30:09.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.162+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599015eb10 con 0x7f5990070790 2023-11-08T12:30:09.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.162+0000 7f598d7fa700 1 -- 172.21.15.112:0/2057725537 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f598000f050 con 0x7f5990070790 2023-11-08T12:30:09.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.162+0000 7f598d7fa700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5970064ee0 0x7f5970067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.162+0000 7f598d7fa700 1 -- 172.21.15.112:0/2057725537 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f59800831b0 con 0x7f5990070790 2023-11-08T12:30:09.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.162+0000 7f59877fe700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5970064ee0 0x7f5970067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.162+0000 7f59877fe700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5970064ee0 0x7f5970067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5978000f60 tx=0x7f5978009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:09.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.170+0000 7f598d7fa700 1 -- 172.21.15.112:0/2057725537 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f59800510a0 con 0x7f5990070790 2023-11-08T12:30:09.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.342+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5990073cb0 con 0x7f5990070790 2023-11-08T12:30:09.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.346+0000 7f598d7fa700 1 -- 172.21.15.112:0/2057725537 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18145 (secure 0 0 0) 0x7f59800546c0 con 0x7f5990070790 2023-11-08T12:30:09.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:09.352 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":57,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:08.547206+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:07.036289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:07.538745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:09.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5970064ee0 msgr2=0x7f5970067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5970064ee0 0x7f5970067390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5978000f60 tx=0x7f5978009040 comp rx=0 tx=0).stop 2023-11-08T12:30:09.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5990070790 msgr2=0x7f59900ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5990070790 0x7f59900ac790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5980009bd0 tx=0x7f5980004770 comp rx=0 tx=0).stop 2023-11-08T12:30:09.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 shutdown_connections 2023-11-08T12:30:09.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5970064ee0 0x7f5970067390 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59900b43a0 0x7f599006c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59900b1640 0x7f59901f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 --2- 172.21.15.112:0/2057725537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5990070790 0x7f59900ac790 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 >> 172.21.15.112:0/2057725537 conn(0x7f59900b0f80 msgr2=0x7f59900ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:09.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 shutdown_connections 2023-11-08T12:30:09.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.350+0000 7f599526f700 1 -- 172.21.15.112:0/2057725537 wait complete. 2023-11-08T12:30:09.376 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T12:30:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.546+0000 7f2cf5866700 1 Processor -- start 2023-11-08T12:30:09.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.546+0000 7f2cf5866700 1 -- start start 2023-11-08T12:30:09.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5866700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2cf006c3e0 0x7f2cf0158c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5866700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf00cbf30 0x7f2cf0060ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5866700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2cf0159e00 0x7f2cf00ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5866700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00cc380 con 0x7f2cf0159e00 2023-11-08T12:30:09.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5866700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf015c2c0 con 0x7f2cf006c3e0 2023-11-08T12:30:09.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5866700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0159250 con 0x7f2cf00cbf30 2023-11-08T12:30:09.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2cf0159e00 0x7f2cf00ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2cf0159e00 0x7f2cf00ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46216/0 (socket says 172.21.15.112:46216) 2023-11-08T12:30:09.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 -- 172.21.15.112:0/3109243491 learned_addr learned my addr 172.21.15.112:0/3109243491 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:09.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf4864700 1 --2- 172.21.15.112:0/3109243491 >> v2:172.21.15.133:3300/0 conn(0x7f2cf006c3e0 0x7f2cf0158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2ceffff700 1 --2- 172.21.15.112:0/3109243491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf00cbf30 0x7f2cf0060ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 -- 172.21.15.112:0/3109243491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf00cbf30 msgr2=0x7f2cf0060ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:09.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 --2- 172.21.15.112:0/3109243491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf00cbf30 0x7f2cf0060ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 -- 172.21.15.112:0/3109243491 >> v2:172.21.15.133:3300/0 conn(0x7f2cf006c3e0 msgr2=0x7f2cf0158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:09.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 --2- 172.21.15.112:0/3109243491 >> v2:172.21.15.133:3300/0 conn(0x7f2cf006c3e0 0x7f2cf0158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 -- 172.21.15.112:0/3109243491 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0159530 con 0x7f2cf0159e00 2023-11-08T12:30:09.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf4864700 1 --2- 172.21.15.112:0/3109243491 >> v2:172.21.15.133:3300/0 conn(0x7f2cf006c3e0 0x7f2cf0158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:09.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.550+0000 7f2cf5065700 1 --2- 172.21.15.112:0/3109243491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0159e00 0x7f2cf00ccdf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00706d0 tx=0x7f2ce800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750b62afa8cc1588 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:09.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cef7fe700 1 -- 172.21.15.112:0/3109243491 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800e070 con 0x7f2cf0159e00 2023-11-08T12:30:09.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cef7fe700 1 -- 172.21.15.112:0/3109243491 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800b9c0 con 0x7f2cf0159e00 2023-11-08T12:30:09.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cef7fe700 1 -- 172.21.15.112:0/3109243491 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800bd70 con 0x7f2cf0159e00 2023-11-08T12:30:09.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 -- 172.21.15.112:0/3109243491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0159e00 msgr2=0x7f2cf00ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3109243491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0159e00 0x7f2cf00ccdf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00706d0 tx=0x7f2ce800b330 comp rx=0 tx=0).stop 2023-11-08T12:30:09.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 -- 172.21.15.112:0/3109243491 shutdown_connections 2023-11-08T12:30:09.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3109243491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf00cbf30 0x7f2cf0060ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3109243491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf0159e00 0x7f2cf00ccdf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3109243491 >> v2:172.21.15.133:3300/0 conn(0x7f2cf006c3e0 0x7f2cf0158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 -- 172.21.15.112:0/3109243491 >> 172.21.15.112:0/3109243491 conn(0x7f2cf00cef60 msgr2=0x7f2cf00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:09.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 -- 172.21.15.112:0/3109243491 shutdown_connections 2023-11-08T12:30:09.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.554+0000 7f2cf5866700 1 -- 172.21.15.112:0/3109243491 wait complete. 2023-11-08T12:30:09.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 Processor -- start 2023-11-08T12:30:09.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 -- start start 2023-11-08T12:30:09.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf006c3e0 0x7f2cf01f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf00cbf30 0x7f2cf00afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf0159e00 0x7f2cf00b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00b1d90 con 0x7f2cf00cbf30 2023-11-08T12:30:09.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00c52f0 con 0x7f2cf006c3e0 2023-11-08T12:30:09.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5866700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00b1fe0 con 0x7f2cf0159e00 2023-11-08T12:30:09.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2ceffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf00cbf30 0x7f2cf00afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2ceffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf00cbf30 0x7f2cf00afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46228/0 (socket says 172.21.15.112:46228) 2023-11-08T12:30:09.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2ceffff700 1 -- 172.21.15.112:0/3147749455 learned_addr learned my addr 172.21.15.112:0/3147749455 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:09.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf4864700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf006c3e0 0x7f2cf01f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2cf5065700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf0159e00 0x7f2cf00b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.558+0000 7f2ceffff700 1 -- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf0159e00 msgr2=0x7f2cf00b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ceffff700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf0159e00 0x7f2cf00b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ceffff700 1 -- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf006c3e0 msgr2=0x7f2cf01f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:09.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ceffff700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf006c3e0 0x7f2cf01f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:09.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ceffff700 1 -- 172.21.15.112:0/3147749455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009b30 con 0x7f2cf00cbf30 2023-11-08T12:30:09.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2cf4864700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf006c3e0 0x7f2cf01f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:09.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ceffff700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf00cbf30 0x7f2cf00afb10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00e730 tx=0x7f2cdc00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:09.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ced7fa700 1 -- 172.21.15.112:0/3147749455 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc004220 con 0x7f2cf00cbf30 2023-11-08T12:30:09.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ced7fa700 1 -- 172.21.15.112:0/3147749455 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc004380 con 0x7f2cf00cbf30 2023-11-08T12:30:09.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf0159af0 con 0x7f2cf00cbf30 2023-11-08T12:30:09.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ced7fa700 1 -- 172.21.15.112:0/3147749455 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0036c0 con 0x7f2cf00cbf30 2023-11-08T12:30:09.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf0159810 con 0x7f2cf00cbf30 2023-11-08T12:30:09.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf006b3f0 con 0x7f2cf00cbf30 2023-11-08T12:30:09.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.562+0000 7f2ced7fa700 1 -- 172.21.15.112:0/3147749455 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2cdc022070 con 0x7f2cf00cbf30 2023-11-08T12:30:09.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.566+0000 7f2ced7fa700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064f10 0x7f2cd40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:09.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.566+0000 7f2ced7fa700 1 -- 172.21.15.112:0/3147749455 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2cdc0819b0 con 0x7f2cf00cbf30 2023-11-08T12:30:09.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.566+0000 7f2cf4864700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064f10 0x7f2cd40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:09.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.566+0000 7f2cf4864700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064f10 0x7f2cd40673c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4003950 tx=0x7f2ce4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:09.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.574+0000 7f2ced7fa700 1 -- 172.21.15.112:0/3147749455 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2cdc04f920 con 0x7f2cf00cbf30 2023-11-08T12:30:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:09.786+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2cf0073d20 con 0x7f2cf00cbf30 2023-11-08T12:30:10.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.574+0000 7f2ced7fa700 1 -- 172.21.15.112:0/3147749455 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2cdc052f40 con 0x7f2cf00cbf30 2023-11-08T12:30:10.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064f10 msgr2=0x7f2cd40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:10.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064f10 0x7f2cd40673c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4003950 tx=0x7f2ce4008040 comp rx=0 tx=0).stop 2023-11-08T12:30:10.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf00cbf30 msgr2=0x7f2cf00afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf00cbf30 0x7f2cf00afb10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00e730 tx=0x7f2cdc00eaf0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 shutdown_connections 2023-11-08T12:30:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2cd4064f10 0x7f2cd40673c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2cf0159e00 0x7f2cf00b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cf00cbf30 0x7f2cf00afb10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 --2- 172.21.15.112:0/3147749455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf006c3e0 0x7f2cf01f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 >> 172.21.15.112:0/3147749455 conn(0x7f2cf00cef60 msgr2=0x7f2cf006a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:10.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 shutdown_connections 2023-11-08T12:30:10.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.578+0000 7f2cf5866700 1 -- 172.21.15.112:0/3147749455 wait complete. 2023-11-08T12:30:10.609 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T12:30:10.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T12:30:10.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103b59e700 1 Processor -- start 2023-11-08T12:30:10.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103b59e700 1 -- start start 2023-11-08T12:30:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f103c15c360 0x7f103c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06cbc0 0x7f103c06be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:10.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103b59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0cd110 con 0x7f103c06c3c0 2023-11-08T12:30:10.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103b59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0c9a40 con 0x7f103c15c360 2023-11-08T12:30:10.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0cc4a0 con 0x7f103c06cbc0 2023-11-08T12:30:10.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f103c15c360 0x7f103c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:10.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103a59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f103c15c360 0x7f103c0ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46236/0 (socket says 172.21.15.112:46236) 2023-11-08T12:30:10.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103a59c700 1 -- 172.21.15.112:0/446751882 learned_addr learned my addr 172.21.15.112:0/446751882 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:10.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f103ad9d700 1 --1- 172.21.15.112:0/446751882 >> v1:172.21.15.112:6789/0 conn(0x7f103c06c3c0 0x7f103c15c9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46548/0 (socket says 172.21.15.112:46548) 2023-11-08T12:30:10.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.786+0000 7f1039d9b700 1 --2- 172.21.15.112:0/446751882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06cbc0 0x7f103c06be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:10.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103a59c700 1 -- 172.21.15.112:0/446751882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06cbc0 msgr2=0x7f103c06be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:10.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103a59c700 1 --2- 172.21.15.112:0/446751882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06cbc0 0x7f103c06be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103a59c700 1 -- 172.21.15.112:0/446751882 >> v1:172.21.15.112:6789/0 conn(0x7f103c06c3c0 legacy=0x7f103c15c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:10.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103a59c700 1 -- 172.21.15.112:0/446751882 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c06c800 con 0x7f103c15c360 2023-11-08T12:30:10.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103a59c700 1 --2- 172.21.15.112:0/446751882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0ccbd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f102c009910 tx=0x7f102c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749f81c9d587a243 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:10.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103959a700 1 -- 172.21.15.112:0/446751882 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c004230 con 0x7f103c15c360 2023-11-08T12:30:10.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103959a700 1 -- 172.21.15.112:0/446751882 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c004390 con 0x7f103c15c360 2023-11-08T12:30:10.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103959a700 1 -- 172.21.15.112:0/446751882 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0036c0 con 0x7f103c15c360 2023-11-08T12:30:10.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 -- 172.21.15.112:0/446751882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 msgr2=0x7f103c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:10.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 --2- 172.21.15.112:0/446751882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0ccbd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f102c009910 tx=0x7f102c009c20 comp rx=0 tx=0).stop 2023-11-08T12:30:10.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 -- 172.21.15.112:0/446751882 shutdown_connections 2023-11-08T12:30:10.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 --2- 172.21.15.112:0/446751882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06cbc0 0x7f103c06be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 --2- 172.21.15.112:0/446751882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0ccbd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 -- 172.21.15.112:0/446751882 >> 172.21.15.112:0/446751882 conn(0x7f103c0cf280 msgr2=0x7f103c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:10.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 -- 172.21.15.112:0/446751882 shutdown_connections 2023-11-08T12:30:10.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.790+0000 7f103b59e700 1 -- 172.21.15.112:0/446751882 wait complete. 2023-11-08T12:30:10.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 Processor -- start 2023-11-08T12:30:10.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 -- start start 2023-11-08T12:30:10.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06c3c0 0x7f103c1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:10.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c06cbc0 0x7f103c0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:10.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:10.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c14dbe0 con 0x7f103c15c360 2023-11-08T12:30:10.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0c5930 con 0x7f103c06cbc0 2023-11-08T12:30:10.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0c5c10 con 0x7f103c06c3c0 2023-11-08T12:30:10.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:10.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46240/0 (socket says 172.21.15.112:46240) 2023-11-08T12:30:10.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 -- 172.21.15.112:0/2590328136 learned_addr learned my addr 172.21.15.112:0/2590328136 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:10.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103a59c700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06c3c0 0x7f103c1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:10.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f1039d9b700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c06cbc0 0x7f103c0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:10.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 -- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06c3c0 msgr2=0x7f103c1f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:10.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06c3c0 0x7f103c1f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 -- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c06cbc0 msgr2=0x7f103c0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:10.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c06cbc0 0x7f103c0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:10.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.794+0000 7f103ad9d700 1 -- 172.21.15.112:0/2590328136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c009570 con 0x7f103c15c360 2023-11-08T12:30:10.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.798+0000 7f103ad9d700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0c6f10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f103400cca0 tx=0x7f103400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:10.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.798+0000 7f102affd700 1 -- 172.21.15.112:0/2590328136 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400cea0 con 0x7f103c15c360 2023-11-08T12:30:10.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.798+0000 7f102affd700 1 -- 172.21.15.112:0/2590328136 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400ada0 con 0x7f103c15c360 2023-11-08T12:30:10.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.798+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c0cd340 con 0x7f103c15c360 2023-11-08T12:30:10.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.798+0000 7f102affd700 1 -- 172.21.15.112:0/2590328136 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034007310 con 0x7f103c15c360 2023-11-08T12:30:10.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.798+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c0cae70 con 0x7f103c15c360 2023-11-08T12:30:10.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.798+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c0cd620 con 0x7f103c15c360 2023-11-08T12:30:10.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.802+0000 7f102affd700 1 -- 172.21.15.112:0/2590328136 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f103401a030 con 0x7f103c15c360 2023-11-08T12:30:10.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.802+0000 7f102affd700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f101c064f30 0x7f101c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:10.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.802+0000 7f102affd700 1 -- 172.21.15.112:0/2590328136 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1034081f10 con 0x7f103c15c360 2023-11-08T12:30:10.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.802+0000 7f103a59c700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f101c064f30 0x7f101c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:10.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.802+0000 7f103a59c700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f101c064f30 0x7f101c0673e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f102c009910 tx=0x7f102c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:10.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:10.806+0000 7f102affd700 1 -- 172.21.15.112:0/2590328136 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f103404ff00 con 0x7f103c15c360 2023-11-08T12:30:11.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.010+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f103c15bb90 con 0x7f103c15c360 2023-11-08T12:30:11.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.590+0000 7f102affd700 1 -- 172.21.15.112:0/2590328136 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1034018020 con 0x7f103c15c360 2023-11-08T12:30:11.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f101c064f30 msgr2=0x7f101c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:11.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f101c064f30 0x7f101c0673e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f102c009910 tx=0x7f102c008030 comp rx=0 tx=0).stop 2023-11-08T12:30:11.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 msgr2=0x7f103c0c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:11.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0c6f10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f103400cca0 tx=0x7f103400a340 comp rx=0 tx=0).stop 2023-11-08T12:30:11.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 shutdown_connections 2023-11-08T12:30:11.600 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f101c064f30 0x7f101c0673e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f103c15c360 0x7f103c0c6f10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f103c06cbc0 0x7f103c0c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 --2- 172.21.15.112:0/2590328136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f103c06c3c0 0x7f103c1f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 >> 172.21.15.112:0/2590328136 conn(0x7f103c0cf280 msgr2=0x7f103c0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:11.601 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 shutdown_connections 2023-11-08T12:30:11.602 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.594+0000 7f103b59e700 1 -- 172.21.15.112:0/2590328136 wait complete. 2023-11-08T12:30:11.622 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T12:30:11.623 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:11.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.802+0000 7f3661d07700 1 Processor -- start 2023-11-08T12:30:11.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.802+0000 7f3661d07700 1 -- start start 2023-11-08T12:30:11.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c0cdeb0 0x7f365c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:11.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f365c0705c0 0x7f365c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:11.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c0adf90 con 0x7f365c15c1a0 2023-11-08T12:30:11.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c069bf0 con 0x7f365c0705c0 2023-11-08T12:30:11.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c070a40 con 0x7f365c0cdeb0 2023-11-08T12:30:11.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f365c0705c0 0x7f365c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:11.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f365c0705c0 0x7f365c06a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46250/0 (socket says 172.21.15.112:46250) 2023-11-08T12:30:11.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 -- 172.21.15.112:0/331565317 learned_addr learned my addr 172.21.15.112:0/331565317 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:11.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3653fff700 1 --2- 172.21.15.112:0/331565317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c0cdeb0 0x7f365c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 -- 172.21.15.112:0/331565317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c0cdeb0 msgr2=0x7f365c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 --2- 172.21.15.112:0/331565317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c0cdeb0 0x7f365c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 -- 172.21.15.112:0/331565317 >> v1:172.21.15.133:6789/0 conn(0x7f365c15c1a0 legacy=0x7f365c06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:11.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 -- 172.21.15.112:0/331565317 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0ce370 con 0x7f365c0705c0 2023-11-08T12:30:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661506700 1 --2- 172.21.15.112:0/331565317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c06a010 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3654009e50 tx=0x7f365400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667d832cda6961bc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f36537fe700 1 -- 172.21.15.112:0/331565317 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365400e070 con 0x7f365c0705c0 2023-11-08T12:30:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f36537fe700 1 -- 172.21.15.112:0/331565317 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365400b9c0 con 0x7f365c0705c0 2023-11-08T12:30:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f36537fe700 1 -- 172.21.15.112:0/331565317 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365400bd70 con 0x7f365c0705c0 2023-11-08T12:30:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- 172.21.15.112:0/331565317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 msgr2=0x7f365c06a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:11.815 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 --2- 172.21.15.112:0/331565317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c06a010 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3654009e50 tx=0x7f365400b330 comp rx=0 tx=0).stop 2023-11-08T12:30:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- 172.21.15.112:0/331565317 shutdown_connections 2023-11-08T12:30:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 --2- 172.21.15.112:0/331565317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c06a010 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 --2- 172.21.15.112:0/331565317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c0cdeb0 0x7f365c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- 172.21.15.112:0/331565317 >> 172.21.15.112:0/331565317 conn(0x7f365c0b0f80 msgr2=0x7f365c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:11.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- 172.21.15.112:0/331565317 shutdown_connections 2023-11-08T12:30:11.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.806+0000 7f3661d07700 1 -- 172.21.15.112:0/331565317 wait complete. 2023-11-08T12:30:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 Processor -- start 2023-11-08T12:30:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 -- start start 2023-11-08T12:30:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c1f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f365c0cdeb0 0x7f365c0acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:11.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c15c1a0 0x7f365c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c1f52f0 con 0x7f365c0705c0 2023-11-08T12:30:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0ad050 con 0x7f365c0cdeb0 2023-11-08T12:30:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661d07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c150eb0 con 0x7f365c15c1a0 2023-11-08T12:30:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3660d05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c1f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:11.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3653fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f365c0cdeb0 0x7f365c0acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:11.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3653fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f365c0cdeb0 0x7f365c0acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:55682/0 (socket says 172.21.15.112:55682) 2023-11-08T12:30:11.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3653fff700 1 -- 172.21.15.112:0/3536586443 learned_addr learned my addr 172.21.15.112:0/3536586443 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:11.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3660d05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c1f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46264/0 (socket says 172.21.15.112:46264) 2023-11-08T12:30:11.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3661506700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c15c1a0 0x7f365c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:11.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3660d05700 1 -- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c15c1a0 msgr2=0x7f365c150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:11.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3660d05700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c15c1a0 0x7f365c150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3660d05700 1 -- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f365c0cdeb0 msgr2=0x7f365c0acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:11.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3660d05700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f365c0cdeb0 0x7f365c0acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:11.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3660d05700 1 -- 172.21.15.112:0/3536586443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3654009b30 con 0x7f365c0705c0 2023-11-08T12:30:11.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.810+0000 7f3653fff700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f365c0cdeb0 0x7f365c0acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:11.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f3660d05700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c1f4db0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f365800c480 tx=0x7f365800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:11.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f36517fa700 1 -- 172.21.15.112:0/3536586443 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580052d0 con 0x7f365c0705c0 2023-11-08T12:30:11.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f36517fa700 1 -- 172.21.15.112:0/3536586443 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3658005430 con 0x7f365c0705c0 2023-11-08T12:30:11.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c0cc780 con 0x7f365c0705c0 2023-11-08T12:30:11.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f36517fa700 1 -- 172.21.15.112:0/3536586443 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580055a0 con 0x7f365c0705c0 2023-11-08T12:30:11.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0cc4a0 con 0x7f365c0705c0 2023-11-08T12:30:11.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c15c570 con 0x7f365c0705c0 2023-11-08T12:30:11.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.814+0000 7f36517fa700 1 -- 172.21.15.112:0/3536586443 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3658019030 con 0x7f365c0705c0 2023-11-08T12:30:11.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.818+0000 7f36517fa700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3648064ee0 0x7f3648067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:11.825 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.818+0000 7f36517fa700 1 -- 172.21.15.112:0/3536586443 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3658081350 con 0x7f365c0705c0 2023-11-08T12:30:11.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.818+0000 7f3653fff700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3648064ee0 0x7f3648067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:11.826 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.818+0000 7f3653fff700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3648064ee0 0x7f3648067390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f365c1f4d10 tx=0x7f364c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:11.829 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:11.826+0000 7f36517fa700 1 -- 172.21.15.112:0/3536586443 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f365804f240 con 0x7f365c0705c0 2023-11-08T12:30:12.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.038+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f365c073cb0 con 0x7f365c0705c0 2023-11-08T12:30:12.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.038+0000 7f36517fa700 1 -- 172.21.15.112:0/3536586443 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f3658056e60 con 0x7f365c0705c0 2023-11-08T12:30:12.045 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:12.046 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:12.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3648064ee0 msgr2=0x7f3648067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3648064ee0 0x7f3648067390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f365c1f4d10 tx=0x7f364c008040 comp rx=0 tx=0).stop 2023-11-08T12:30:12.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 msgr2=0x7f365c1f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c1f4db0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f365800c480 tx=0x7f365800c790 comp rx=0 tx=0).stop 2023-11-08T12:30:12.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 shutdown_connections 2023-11-08T12:30:12.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3648064ee0 0x7f3648067390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f365c15c1a0 0x7f365c150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f365c0cdeb0 0x7f365c0acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 --2- 172.21.15.112:0/3536586443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f365c0705c0 0x7f365c1f4db0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 >> 172.21.15.112:0/3536586443 conn(0x7f365c0b0f80 msgr2=0x7f365c0ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:12.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 shutdown_connections 2023-11-08T12:30:12.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.042+0000 7f3661d07700 1 -- 172.21.15.112:0/3536586443 wait complete. 2023-11-08T12:30:12.051 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:12.070 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:12.245 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.238+0000 7fc96701e700 1 Processor -- start 2023-11-08T12:30:12.246 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.238+0000 7fc96701e700 1 -- start start 2023-11-08T12:30:12.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc96701e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96006ad70 0x7fc960165210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc96701e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96015a850 con 0x7fc96015a480 2023-11-08T12:30:12.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc96701e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600cada0 con 0x7fc9600c8d10 2023-11-08T12:30:12.248 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc96701e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600cd0b0 con 0x7fc96006ad70 2023-11-08T12:30:12.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc964dba700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc96015a480 0x7fc9600cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46558/0 (socket says 172.21.15.112:46558) 2023-11-08T12:30:12.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc964dba700 1 -- 172.21.15.112:0/478172529 learned_addr learned my addr 172.21.15.112:0/478172529 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:12.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9655bb700 1 --2- 172.21.15.112:0/478172529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96006ad70 0x7fc960165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9577fe700 1 -- 172.21.15.112:0/478172529 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704821121 0 0) 0x7fc96015a850 con 0x7fc96015a480 2023-11-08T12:30:12.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9577fe700 1 -- 172.21.15.112:0/478172529 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9480035d0 con 0x7fc96015a480 2023-11-08T12:30:12.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9577fe700 1 -- 172.21.15.112:0/478172529 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096239440 0 0) 0x7fc9600cada0 con 0x7fc9600c8d10 2023-11-08T12:30:12.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9577fe700 1 -- 172.21.15.112:0/478172529 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc96015a850 con 0x7fc9600c8d10 2023-11-08T12:30:12.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9655bb700 1 -- 172.21.15.112:0/478172529 >> v1:172.21.15.133:6789/0 conn(0x7fc9600c8d10 legacy=0x7fc9600cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9655bb700 1 -- 172.21.15.112:0/478172529 >> v1:172.21.15.112:6789/0 conn(0x7fc96015a480 legacy=0x7fc9600cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.242+0000 7fc9655bb700 1 -- 172.21.15.112:0/478172529 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600ce060 con 0x7fc96006ad70 2023-11-08T12:30:12.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc9655bb700 1 --2- 172.21.15.112:0/478172529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96006ad70 0x7fc960165210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc958009880 tx=0x7fc958009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1c22fbb0091e4c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:12.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc9577fe700 1 -- 172.21.15.112:0/478172529 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011830 con 0x7fc96006ad70 2023-11-08T12:30:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc9577fe700 1 -- 172.21.15.112:0/478172529 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958011990 con 0x7fc96006ad70 2023-11-08T12:30:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc9577fe700 1 -- 172.21.15.112:0/478172529 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011d20 con 0x7fc96006ad70 2023-11-08T12:30:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc96701e700 1 -- 172.21.15.112:0/478172529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96006ad70 msgr2=0x7fc960165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc96701e700 1 --2- 172.21.15.112:0/478172529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96006ad70 0x7fc960165210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc958009880 tx=0x7fc958009b90 comp rx=0 tx=0).stop 2023-11-08T12:30:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc96701e700 1 -- 172.21.15.112:0/478172529 shutdown_connections 2023-11-08T12:30:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc96701e700 1 --2- 172.21.15.112:0/478172529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96006ad70 0x7fc960165210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc96701e700 1 -- 172.21.15.112:0/478172529 >> 172.21.15.112:0/478172529 conn(0x7fc9600cf350 msgr2=0x7fc9600b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc96701e700 1 -- 172.21.15.112:0/478172529 shutdown_connections 2023-11-08T12:30:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.246+0000 7fc96701e700 1 -- 172.21.15.112:0/478172529 wait complete. 2023-11-08T12:30:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 Processor -- start 2023-11-08T12:30:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 -- start start 2023-11-08T12:30:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc96006ad70 0x7fc960154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9600c8d10 0x7fc9601efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96015a480 0x7fc9601f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600c6f90 con 0x7fc96006ad70 2023-11-08T12:30:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc960155520 con 0x7fc9600c8d10 2023-11-08T12:30:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601f0710 con 0x7fc96015a480 2023-11-08T12:30:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc96006ad70 0x7fc960154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc96006ad70 0x7fc960154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46268/0 (socket says 172.21.15.112:46268) 2023-11-08T12:30:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 -- 172.21.15.112:0/2805100992 learned_addr learned my addr 172.21.15.112:0/2805100992 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc957fff700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9600c8d10 0x7fc9601efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc9655bb700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96015a480 0x7fc9601f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 -- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96015a480 msgr2=0x7fc9601f00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96015a480 0x7fc9601f00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 -- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9600c8d10 msgr2=0x7fc9601efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9600c8d10 0x7fc9601efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 -- 172.21.15.112:0/2805100992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580094b0 con 0x7fc96006ad70 2023-11-08T12:30:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc964dba700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc96006ad70 0x7fc960154fe0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00cbf0 tx=0x7fc95c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc9557fa700 1 -- 172.21.15.112:0/2805100992 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00a770 con 0x7fc96006ad70 2023-11-08T12:30:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc9557fa700 1 -- 172.21.15.112:0/2805100992 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00a8d0 con 0x7fc96006ad70 2023-11-08T12:30:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc9557fa700 1 -- 172.21.15.112:0/2805100992 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00ac40 con 0x7fc96006ad70 2023-11-08T12:30:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.250+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600caa30 con 0x7fc96006ad70 2023-11-08T12:30:12.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.254+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9600ce300 con 0x7fc96006ad70 2023-11-08T12:30:12.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.254+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9600b38e0 con 0x7fc96006ad70 2023-11-08T12:30:12.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.254+0000 7fc9557fa700 1 -- 172.21.15.112:0/2805100992 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc95c019030 con 0x7fc96006ad70 2023-11-08T12:30:12.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.258+0000 7fc9557fa700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc94c064ee0 0x7fc94c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.258+0000 7fc9557fa700 1 -- 172.21.15.112:0/2805100992 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc95c0816e0 con 0x7fc96006ad70 2023-11-08T12:30:12.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.258+0000 7fc957fff700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc94c064ee0 0x7fc94c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.258+0000 7fc957fff700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc94c064ee0 0x7fc94c067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc96015d7c0 tx=0x7fc950009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:12.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.262+0000 7fc9557fa700 1 -- 172.21.15.112:0/2805100992 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc95c04a400 con 0x7fc96006ad70 2023-11-08T12:30:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.434+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9600add00 con 0x7fc96006ad70 2023-11-08T12:30:12.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.438+0000 7fc9557fa700 1 -- 172.21.15.112:0/2805100992 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18132 (secure 0 0 0) 0x7fc95c053220 con 0x7fc96006ad70 2023-11-08T12:30:12.444 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:12.445 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":58,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:09.553416+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:07.036289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:07.538745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:12.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc94c064ee0 msgr2=0x7fc94c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc94c064ee0 0x7fc94c067390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc96015d7c0 tx=0x7fc950009040 comp rx=0 tx=0).stop 2023-11-08T12:30:12.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc96006ad70 msgr2=0x7fc960154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc96006ad70 0x7fc960154fe0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00cbf0 tx=0x7fc95c00cc20 comp rx=0 tx=0).stop 2023-11-08T12:30:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 shutdown_connections 2023-11-08T12:30:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc94c064ee0 0x7fc94c067390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc96015a480 0x7fc9601f00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9600c8d10 0x7fc9601efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 --2- 172.21.15.112:0/2805100992 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc96006ad70 0x7fc960154fe0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 >> 172.21.15.112:0/2805100992 conn(0x7fc9600cf350 msgr2=0x7fc9600ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:12.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 shutdown_connections 2023-11-08T12:30:12.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.442+0000 7fc96701e700 1 -- 172.21.15.112:0/2805100992 wait complete. 2023-11-08T12:30:12.468 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T12:30:12.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:30:12.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.678+0000 7f148f59e700 1 Processor -- start 2023-11-08T12:30:12.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.678+0000 7f148f59e700 1 -- start start 2023-11-08T12:30:12.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 0x7f14900d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148f59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1490071aa0 0x7f149006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148f59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149006c600 con 0x7f1490069e00 2023-11-08T12:30:12.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148f59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149006cef0 con 0x7f1490071aa0 2023-11-08T12:30:12.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900722f0 con 0x7f149015c640 2023-11-08T12:30:12.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148dd9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1490071aa0 0x7f149006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148ed9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1490069e00 0x7f14900d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46568/0 (socket says 172.21.15.112:46568) 2023-11-08T12:30:12.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148ed9d700 1 -- 172.21.15.112:0/452963604 learned_addr learned my addr 172.21.15.112:0/452963604 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148e59c700 1 --2- 172.21.15.112:0/452963604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 0x7f14900d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148d59a700 1 -- 172.21.15.112:0/452963604 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940146187 0 0) 0x7f149006c600 con 0x7f1490069e00 2023-11-08T12:30:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148dd9b700 1 -- 172.21.15.112:0/452963604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 msgr2=0x7f14900d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148dd9b700 1 --2- 172.21.15.112:0/452963604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 0x7f14900d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148dd9b700 1 -- 172.21.15.112:0/452963604 >> v1:172.21.15.112:6789/0 conn(0x7f1490069e00 legacy=0x7f14900d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148dd9b700 1 -- 172.21.15.112:0/452963604 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149015ca10 con 0x7f1490071aa0 2023-11-08T12:30:12.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148dd9b700 1 --2- 172.21.15.112:0/452963604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f149006d310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1484009850 tx=0x7f1484009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c51832725e2f66 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:12.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148d59a700 1 -- 172.21.15.112:0/452963604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484011830 con 0x7f1490071aa0 2023-11-08T12:30:12.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148d59a700 1 -- 172.21.15.112:0/452963604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484011990 con 0x7f1490071aa0 2023-11-08T12:30:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.682+0000 7f148d59a700 1 -- 172.21.15.112:0/452963604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484011d40 con 0x7f1490071aa0 2023-11-08T12:30:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 -- 172.21.15.112:0/452963604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 msgr2=0x7f149006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 --2- 172.21.15.112:0/452963604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f149006d310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1484009850 tx=0x7f1484009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 -- 172.21.15.112:0/452963604 shutdown_connections 2023-11-08T12:30:12.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 --2- 172.21.15.112:0/452963604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f149006d310 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 --2- 172.21.15.112:0/452963604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 0x7f14900d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 -- 172.21.15.112:0/452963604 >> 172.21.15.112:0/452963604 conn(0x7f14900b6520 msgr2=0x7f1490071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:12.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 -- 172.21.15.112:0/452963604 shutdown_connections 2023-11-08T12:30:12.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.686+0000 7f148f59e700 1 -- 172.21.15.112:0/452963604 wait complete. 2023-11-08T12:30:12.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 Processor -- start 2023-11-08T12:30:12.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 -- start start 2023-11-08T12:30:12.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1490069e00 0x7f1490158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f14900b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 0x7f14900b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900c7ef0 con 0x7f1490071aa0 2023-11-08T12:30:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900b4ca0 con 0x7f1490069e00 2023-11-08T12:30:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900c8a10 con 0x7f149015c640 2023-11-08T12:30:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f14900b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f14900b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46284/0 (socket says 172.21.15.112:46284) 2023-11-08T12:30:12.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 -- 172.21.15.112:0/258072256 learned_addr learned my addr 172.21.15.112:0/258072256 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148e59c700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1490069e00 0x7f1490158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 -- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 msgr2=0x7f14900b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 0x7f14900b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 -- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1490069e00 msgr2=0x7f1490158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1490069e00 0x7f1490158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 -- 172.21.15.112:0/258072256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840094b0 con 0x7f1490071aa0 2023-11-08T12:30:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148e59c700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1490069e00 0x7f1490158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:12.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148dd9b700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f14900b3bb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1484000c00 tx=0x7f1484004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:12.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f147effd700 1 -- 172.21.15.112:0/258072256 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484019ab0 con 0x7f1490071aa0 2023-11-08T12:30:12.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f147effd700 1 -- 172.21.15.112:0/258072256 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148401e070 con 0x7f1490071aa0 2023-11-08T12:30:12.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149006c830 con 0x7f1490071aa0 2023-11-08T12:30:12.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f147effd700 1 -- 172.21.15.112:0/258072256 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484019e90 con 0x7f1490071aa0 2023-11-08T12:30:12.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.690+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1490072010 con 0x7f1490071aa0 2023-11-08T12:30:12.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.694+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149006cb10 con 0x7f1490071aa0 2023-11-08T12:30:12.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.694+0000 7f147effd700 1 -- 172.21.15.112:0/258072256 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f148400f050 con 0x7f1490071aa0 2023-11-08T12:30:12.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.698+0000 7f147effd700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1470064f10 0x7f14700673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:12.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.698+0000 7f147effd700 1 -- 172.21.15.112:0/258072256 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1484083140 con 0x7f1490071aa0 2023-11-08T12:30:12.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.698+0000 7f148e59c700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1470064f10 0x7f14700673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:12.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.698+0000 7f148e59c700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1470064f10 0x7f14700673c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1480009b70 tx=0x7f1480008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:12.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.702+0000 7f147effd700 1 -- 172.21.15.112:0/258072256 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f14840511a0 con 0x7f1490071aa0 2023-11-08T12:30:12.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.874+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1490073cb0 con 0x7f1470064f10 2023-11-08T12:30:12.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.894+0000 7f147effd700 1 -- 172.21.15.112:0/258072256 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308674 (secure 0 0 0) 0x7f1490073cb0 con 0x7f1470064f10 2023-11-08T12:30:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:12.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1470064f10 msgr2=0x7f14700673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1470064f10 0x7f14700673c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1480009b70 tx=0x7f1480008040 comp rx=0 tx=0).stop 2023-11-08T12:30:12.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 msgr2=0x7f14900b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:12.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f14900b3bb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1484000c00 tx=0x7f1484004770 comp rx=0 tx=0).stop 2023-11-08T12:30:12.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 shutdown_connections 2023-11-08T12:30:12.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1470064f10 0x7f14700673c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f149015c640 0x7f14900b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1490071aa0 0x7f14900b3bb0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 --2- 172.21.15.112:0/258072256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1490069e00 0x7f1490158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:12.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.898+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 >> 172.21.15.112:0/258072256 conn(0x7f14900b6520 msgr2=0x7f149006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:12.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.902+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 shutdown_connections 2023-11-08T12:30:12.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:12.902+0000 7f148f59e700 1 -- 172.21.15.112:0/258072256 wait complete. 2023-11-08T12:30:12.909 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:30:12.928 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-11-08T12:30:12.758318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76400,"kb_used_data":6512,"kb_used_omap":0,"kb_used_meta":69824,"kb_avail":754898320,"statfs":{"total":773094113280,"available":773015879680,"internally_reserved":0,"allocated":6668288,"data_stored":3681938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71499776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.676488"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.576006+0000","last_change":"2023-11-08T12:30:08.582350+0000","last_active":"2023-11-08T12:30:09.576006+0000","last_peered":"2023-11-08T12:30:09.576006+0000","last_clean":"2023-11-08T12:30:09.576006+0000","last_became_active":"2023-11-08T12:30:08.582094+0000","last_became_peered":"2023-11-08T12:30:08.582094+0000","last_unstale":"2023-11-08T12:30:09.576006+0000","last_undegraded":"2023-11-08T12:30:09.576006+0000","last_fullsized":"2023-11-08T12:30:09.576006+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:35:51.811830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574777+0000","last_change":"2023-11-08T12:30:08.584405+0000","last_active":"2023-11-08T12:30:09.574777+0000","last_peered":"2023-11-08T12:30:09.574777+0000","last_clean":"2023-11-08T12:30:09.574777+0000","last_became_active":"2023-11-08T12:30:08.584168+0000","last_became_peered":"2023-11-08T12:30:08.584168+0000","last_unstale":"2023-11-08T12:30:09.574777+0000","last_undegraded":"2023-11-08T12:30:09.574777+0000","last_fullsized":"2023-11-08T12:30:09.574777+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:37:24.595999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212388+0000","last_change":"2023-11-08T12:30:08.584220+0000","last_active":"2023-11-08T12:30:10.212388+0000","last_peered":"2023-11-08T12:30:10.212388+0000","last_clean":"2023-11-08T12:30:10.212388+0000","last_became_active":"2023-11-08T12:30:08.583878+0000","last_became_peered":"2023-11-08T12:30:08.583878+0000","last_unstale":"2023-11-08T12:30:10.212388+0000","last_undegraded":"2023-11-08T12:30:10.212388+0000","last_fullsized":"2023-11-08T12:30:10.212388+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:50.868181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573846+0000","last_change":"2023-11-08T12:30:08.588363+0000","last_active":"2023-11-08T12:30:09.573846+0000","last_peered":"2023-11-08T12:30:09.573846+0000","last_clean":"2023-11-08T12:30:09.573846+0000","last_became_active":"2023-11-08T12:30:08.587811+0000","last_became_peered":"2023-11-08T12:30:08.587811+0000","last_unstale":"2023-11-08T12:30:09.573846+0000","last_undegraded":"2023-11-08T12:30:09.573846+0000","last_fullsized":"2023-11-08T12:30:09.573846+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:30.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574643+0000","last_change":"2023-11-08T12:30:08.582119+0000","last_active":"2023-11-08T12:30:09.574643+0000","last_peered":"2023-11-08T12:30:09.574643+0000","last_clean":"2023-11-08T12:30:09.574643+0000","last_became_active":"2023-11-08T12:30:08.581851+0000","last_became_peered":"2023-11-08T12:30:08.581851+0000","last_unstale":"2023-11-08T12:30:09.574643+0000","last_undegraded":"2023-11-08T12:30:09.574643+0000","last_fullsized":"2023-11-08T12:30:09.574643+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:16:36.942302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295383+0000","last_change":"2023-11-08T12:30:08.586334+0000","last_active":"2023-11-08T12:30:10.295383+0000","last_peered":"2023-11-08T12:30:10.295383+0000","last_clean":"2023-11-08T12:30:10.295383+0000","last_became_active":"2023-11-08T12:30:08.586041+0000","last_became_peered":"2023-11-08T12:30:08.586041+0000","last_unstale":"2023-11-08T12:30:10.295383+0000","last_undegraded":"2023-11-08T12:30:10.295383+0000","last_fullsized":"2023-11-08T12:30:10.295383+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:41:23.814562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294527+0000","last_change":"2023-11-08T12:30:08.584729+0000","last_active":"2023-11-08T12:30:10.294527+0000","last_peered":"2023-11-08T12:30:10.294527+0000","last_clean":"2023-11-08T12:30:10.294527+0000","last_became_active":"2023-11-08T12:30:08.584444+0000","last_became_peered":"2023-11-08T12:30:08.584444+0000","last_unstale":"2023-11-08T12:30:10.294527+0000","last_undegraded":"2023-11-08T12:30:10.294527+0000","last_fullsized":"2023-11-08T12:30:10.294527+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:42.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573686+0000","last_change":"2023-11-08T12:30:08.576383+0000","last_active":"2023-11-08T12:30:09.573686+0000","last_peered":"2023-11-08T12:30:09.573686+0000","last_clean":"2023-11-08T12:30:09.573686+0000","last_became_active":"2023-11-08T12:30:08.576152+0000","last_became_peered":"2023-11-08T12:30:08.576152+0000","last_unstale":"2023-11-08T12:30:09.573686+0000","last_undegraded":"2023-11-08T12:30:09.573686+0000","last_fullsized":"2023-11-08T12:30:09.573686+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:49.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295314+0000","last_change":"2023-11-08T12:30:08.587582+0000","last_active":"2023-11-08T12:30:10.295314+0000","last_peered":"2023-11-08T12:30:10.295314+0000","last_clean":"2023-11-08T12:30:10.295314+0000","last_became_active":"2023-11-08T12:30:08.587264+0000","last_became_peered":"2023-11-08T12:30:08.587264+0000","last_unstale":"2023-11-08T12:30:10.295314+0000","last_undegraded":"2023-11-08T12:30:10.295314+0000","last_fullsized":"2023-11-08T12:30:10.295314+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:43.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705746+0000","last_change":"2023-11-08T12:30:08.596709+0000","last_active":"2023-11-08T12:30:09.705746+0000","last_peered":"2023-11-08T12:30:09.705746+0000","last_clean":"2023-11-08T12:30:09.705746+0000","last_became_active":"2023-11-08T12:30:08.596451+0000","last_became_peered":"2023-11-08T12:30:08.596451+0000","last_unstale":"2023-11-08T12:30:09.705746+0000","last_undegraded":"2023-11-08T12:30:09.705746+0000","last_fullsized":"2023-11-08T12:30:09.705746+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:41:08.548199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705565+0000","last_change":"2023-11-08T12:30:08.585224+0000","last_active":"2023-11-08T12:30:09.705565+0000","last_peered":"2023-11-08T12:30:09.705565+0000","last_clean":"2023-11-08T12:30:09.705565+0000","last_became_active":"2023-11-08T12:30:08.584964+0000","last_became_peered":"2023-11-08T12:30:08.584964+0000","last_unstale":"2023-11-08T12:30:09.705565+0000","last_undegraded":"2023-11-08T12:30:09.705565+0000","last_fullsized":"2023-11-08T12:30:09.705565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:45:05.091731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574043+0000","last_change":"2023-11-08T12:30:08.584676+0000","last_active":"2023-11-08T12:30:09.574043+0000","last_peered":"2023-11-08T12:30:09.574043+0000","last_clean":"2023-11-08T12:30:09.574043+0000","last_became_active":"2023-11-08T12:30:08.584421+0000","last_became_peered":"2023-11-08T12:30:08.584421+0000","last_unstale":"2023-11-08T12:30:09.574043+0000","last_undegraded":"2023-11-08T12:30:09.574043+0000","last_fullsized":"2023-11-08T12:30:09.574043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:28:35.460465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293738+0000","last_change":"2023-11-08T12:30:08.589260+0000","last_active":"2023-11-08T12:30:10.293738+0000","last_peered":"2023-11-08T12:30:10.293738+0000","last_clean":"2023-11-08T12:30:10.293738+0000","last_became_active":"2023-11-08T12:30:08.589002+0000","last_became_peered":"2023-11-08T12:30:08.589002+0000","last_unstale":"2023-11-08T12:30:10.293738+0000","last_undegraded":"2023-11-08T12:30:10.293738+0000","last_fullsized":"2023-11-08T12:30:10.293738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:38.611426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294713+0000","last_change":"2023-11-08T12:30:08.581152+0000","last_active":"2023-11-08T12:30:10.294713+0000","last_peered":"2023-11-08T12:30:10.294713+0000","last_clean":"2023-11-08T12:30:10.294713+0000","last_became_active":"2023-11-08T12:30:08.580835+0000","last_became_peered":"2023-11-08T12:30:08.580835+0000","last_unstale":"2023-11-08T12:30:10.294713+0000","last_undegraded":"2023-11-08T12:30:10.294713+0000","last_fullsized":"2023-11-08T12:30:10.294713+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:37:24.595999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294679+0000","last_change":"2023-11-08T12:30:08.577178+0000","last_active":"2023-11-08T12:30:10.294679+0000","last_peered":"2023-11-08T12:30:10.294679+0000","last_clean":"2023-11-08T12:30:10.294679+0000","last_became_active":"2023-11-08T12:30:08.576893+0000","last_became_peered":"2023-11-08T12:30:08.576893+0000","last_unstale":"2023-11-08T12:30:10.294679+0000","last_undegraded":"2023-11-08T12:30:10.294679+0000","last_fullsized":"2023-11-08T12:30:10.294679+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:46:39.202790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295855+0000","last_change":"2023-11-08T12:30:08.600496+0000","last_active":"2023-11-08T12:30:10.295855+0000","last_peered":"2023-11-08T12:30:10.295855+0000","last_clean":"2023-11-08T12:30:10.295855+0000","last_became_active":"2023-11-08T12:30:08.600234+0000","last_became_peered":"2023-11-08T12:30:08.600234+0000","last_unstale":"2023-11-08T12:30:10.295855+0000","last_undegraded":"2023-11-08T12:30:10.295855+0000","last_fullsized":"2023-11-08T12:30:10.295855+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:42.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575220+0000","last_change":"2023-11-08T12:30:08.596536+0000","last_active":"2023-11-08T12:30:09.575220+0000","last_peered":"2023-11-08T12:30:09.575220+0000","last_clean":"2023-11-08T12:30:09.575220+0000","last_became_active":"2023-11-08T12:30:08.596278+0000","last_became_peered":"2023-11-08T12:30:08.596278+0000","last_unstale":"2023-11-08T12:30:09.575220+0000","last_undegraded":"2023-11-08T12:30:09.575220+0000","last_fullsized":"2023-11-08T12:30:09.575220+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:42.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212374+0000","last_change":"2023-11-08T12:30:08.586170+0000","last_active":"2023-11-08T12:30:10.212374+0000","last_peered":"2023-11-08T12:30:10.212374+0000","last_clean":"2023-11-08T12:30:10.212374+0000","last_became_active":"2023-11-08T12:30:08.585921+0000","last_became_peered":"2023-11-08T12:30:08.585921+0000","last_unstale":"2023-11-08T12:30:10.212374+0000","last_undegraded":"2023-11-08T12:30:10.212374+0000","last_fullsized":"2023-11-08T12:30:10.212374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:35.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575160+0000","last_change":"2023-11-08T12:30:08.582334+0000","last_active":"2023-11-08T12:30:09.575160+0000","last_peered":"2023-11-08T12:30:09.575160+0000","last_clean":"2023-11-08T12:30:09.575160+0000","last_became_active":"2023-11-08T12:30:08.582078+0000","last_became_peered":"2023-11-08T12:30:08.582078+0000","last_unstale":"2023-11-08T12:30:09.575160+0000","last_undegraded":"2023-11-08T12:30:09.575160+0000","last_fullsized":"2023-11-08T12:30:09.575160+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:54:01.415506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574527+0000","last_change":"2023-11-08T12:30:08.587835+0000","last_active":"2023-11-08T12:30:09.574527+0000","last_peered":"2023-11-08T12:30:09.574527+0000","last_clean":"2023-11-08T12:30:09.574527+0000","last_became_active":"2023-11-08T12:30:08.587589+0000","last_became_peered":"2023-11-08T12:30:08.587589+0000","last_unstale":"2023-11-08T12:30:09.574527+0000","last_undegraded":"2023-11-08T12:30:09.574527+0000","last_fullsized":"2023-11-08T12:30:09.574527+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:22:31.239034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211718+0000","last_change":"2023-11-08T12:30:08.588536+0000","last_active":"2023-11-08T12:30:10.211718+0000","last_peered":"2023-11-08T12:30:10.211718+0000","last_clean":"2023-11-08T12:30:10.211718+0000","last_became_active":"2023-11-08T12:30:08.586938+0000","last_became_peered":"2023-11-08T12:30:08.586938+0000","last_unstale":"2023-11-08T12:30:10.211718+0000","last_undegraded":"2023-11-08T12:30:10.211718+0000","last_fullsized":"2023-11-08T12:30:10.211718+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:30.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573821+0000","last_change":"2023-11-08T12:30:08.571264+0000","last_active":"2023-11-08T12:30:09.573821+0000","last_peered":"2023-11-08T12:30:09.573821+0000","last_clean":"2023-11-08T12:30:09.573821+0000","last_became_active":"2023-11-08T12:30:08.570827+0000","last_became_peered":"2023-11-08T12:30:08.570827+0000","last_unstale":"2023-11-08T12:30:09.573821+0000","last_undegraded":"2023-11-08T12:30:09.573821+0000","last_fullsized":"2023-11-08T12:30:09.573821+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.298894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211726+0000","last_change":"2023-11-08T12:30:08.583499+0000","last_active":"2023-11-08T12:30:10.211726+0000","last_peered":"2023-11-08T12:30:10.211726+0000","last_clean":"2023-11-08T12:30:10.211726+0000","last_became_active":"2023-11-08T12:30:08.582860+0000","last_became_peered":"2023-11-08T12:30:08.582860+0000","last_unstale":"2023-11-08T12:30:10.211726+0000","last_undegraded":"2023-11-08T12:30:10.211726+0000","last_fullsized":"2023-11-08T12:30:10.211726+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:03.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293251+0000","last_change":"2023-11-08T12:30:08.588651+0000","last_active":"2023-11-08T12:30:10.293251+0000","last_peered":"2023-11-08T12:30:10.293251+0000","last_clean":"2023-11-08T12:30:10.293251+0000","last_became_active":"2023-11-08T12:30:08.588267+0000","last_became_peered":"2023-11-08T12:30:08.588267+0000","last_unstale":"2023-11-08T12:30:10.293251+0000","last_undegraded":"2023-11-08T12:30:10.293251+0000","last_fullsized":"2023-11-08T12:30:10.293251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:46:37.236843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575998+0000","last_change":"2023-11-08T12:30:08.592939+0000","last_active":"2023-11-08T12:30:09.575998+0000","last_peered":"2023-11-08T12:30:09.575998+0000","last_clean":"2023-11-08T12:30:09.575998+0000","last_became_active":"2023-11-08T12:30:08.592724+0000","last_became_peered":"2023-11-08T12:30:08.592724+0000","last_unstale":"2023-11-08T12:30:09.575998+0000","last_undegraded":"2023-11-08T12:30:09.575998+0000","last_fullsized":"2023-11-08T12:30:09.575998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:40:24.943449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574178+0000","last_change":"2023-11-08T12:30:08.583570+0000","last_active":"2023-11-08T12:30:09.574178+0000","last_peered":"2023-11-08T12:30:09.574178+0000","last_clean":"2023-11-08T12:30:09.574178+0000","last_became_active":"2023-11-08T12:30:08.583263+0000","last_became_peered":"2023-11-08T12:30:08.583263+0000","last_unstale":"2023-11-08T12:30:09.574178+0000","last_undegraded":"2023-11-08T12:30:09.574178+0000","last_fullsized":"2023-11-08T12:30:09.574178+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:17:45.931548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295549+0000","last_change":"2023-11-08T12:30:08.599024+0000","last_active":"2023-11-08T12:30:10.295549+0000","last_peered":"2023-11-08T12:30:10.295549+0000","last_clean":"2023-11-08T12:30:10.295549+0000","last_became_active":"2023-11-08T12:30:08.598725+0000","last_became_peered":"2023-11-08T12:30:08.598725+0000","last_unstale":"2023-11-08T12:30:10.295549+0000","last_undegraded":"2023-11-08T12:30:10.295549+0000","last_fullsized":"2023-11-08T12:30:10.295549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:43.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575102+0000","last_change":"2023-11-08T12:30:08.592138+0000","last_active":"2023-11-08T12:30:09.575102+0000","last_peered":"2023-11-08T12:30:09.575102+0000","last_clean":"2023-11-08T12:30:09.575102+0000","last_became_active":"2023-11-08T12:30:08.591859+0000","last_became_peered":"2023-11-08T12:30:08.591859+0000","last_unstale":"2023-11-08T12:30:09.575102+0000","last_undegraded":"2023-11-08T12:30:09.575102+0000","last_fullsized":"2023-11-08T12:30:09.575102+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:48:50.253408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574500+0000","last_change":"2023-11-08T12:30:08.583551+0000","last_active":"2023-11-08T12:30:09.574500+0000","last_peered":"2023-11-08T12:30:09.574500+0000","last_clean":"2023-11-08T12:30:09.574500+0000","last_became_active":"2023-11-08T12:30:08.583062+0000","last_became_peered":"2023-11-08T12:30:08.583062+0000","last_unstale":"2023-11-08T12:30:09.574500+0000","last_undegraded":"2023-11-08T12:30:09.574500+0000","last_fullsized":"2023-11-08T12:30:09.574500+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:58:32.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211793+0000","last_change":"2023-11-08T12:30:08.579341+0000","last_active":"2023-11-08T12:30:10.211793+0000","last_peered":"2023-11-08T12:30:10.211793+0000","last_clean":"2023-11-08T12:30:10.211793+0000","last_became_active":"2023-11-08T12:30:08.578618+0000","last_became_peered":"2023-11-08T12:30:08.578618+0000","last_unstale":"2023-11-08T12:30:10.211793+0000","last_undegraded":"2023-11-08T12:30:10.211793+0000","last_fullsized":"2023-11-08T12:30:10.211793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:16:54.204347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574546+0000","last_change":"2023-11-08T12:30:08.580835+0000","last_active":"2023-11-08T12:30:09.574546+0000","last_peered":"2023-11-08T12:30:09.574546+0000","last_clean":"2023-11-08T12:30:09.574546+0000","last_became_active":"2023-11-08T12:30:08.580577+0000","last_became_peered":"2023-11-08T12:30:08.580577+0000","last_unstale":"2023-11-08T12:30:09.574546+0000","last_undegraded":"2023-11-08T12:30:09.574546+0000","last_fullsized":"2023-11-08T12:30:09.574546+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:30.985290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295671+0000","last_change":"2023-11-08T12:30:08.587775+0000","last_active":"2023-11-08T12:30:10.295671+0000","last_peered":"2023-11-08T12:30:10.295671+0000","last_clean":"2023-11-08T12:30:10.295671+0000","last_became_active":"2023-11-08T12:30:08.587385+0000","last_became_peered":"2023-11-08T12:30:08.587385+0000","last_unstale":"2023-11-08T12:30:10.295671+0000","last_undegraded":"2023-11-08T12:30:10.295671+0000","last_fullsized":"2023-11-08T12:30:10.295671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:31.740666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296299+0000","last_change":"2023-11-08T12:30:08.586032+0000","last_active":"2023-11-08T12:30:10.296299+0000","last_peered":"2023-11-08T12:30:10.296299+0000","last_clean":"2023-11-08T12:30:10.296299+0000","last_became_active":"2023-11-08T12:30:08.585739+0000","last_became_peered":"2023-11-08T12:30:08.585739+0000","last_unstale":"2023-11-08T12:30:10.296299+0000","last_undegraded":"2023-11-08T12:30:10.296299+0000","last_fullsized":"2023-11-08T12:30:10.296299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:37:24.595999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296354+0000","last_change":"2023-11-08T12:30:08.119391+0000","last_active":"2023-11-08T12:30:10.296354+0000","last_peered":"2023-11-08T12:30:10.296354+0000","last_clean":"2023-11-08T12:30:10.296354+0000","last_became_active":"2023-11-08T12:30:08.118948+0000","last_became_peered":"2023-11-08T12:30:08.118948+0000","last_unstale":"2023-11-08T12:30:10.296354+0000","last_undegraded":"2023-11-08T12:30:10.296354+0000","last_fullsized":"2023-11-08T12:30:10.296354+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:55:30.314695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.706115+0000","last_change":"2023-11-08T12:30:08.585789+0000","last_active":"2023-11-08T12:30:09.706115+0000","last_peered":"2023-11-08T12:30:09.706115+0000","last_clean":"2023-11-08T12:30:09.706115+0000","last_became_active":"2023-11-08T12:30:08.585376+0000","last_became_peered":"2023-11-08T12:30:08.585376+0000","last_unstale":"2023-11-08T12:30:09.706115+0000","last_undegraded":"2023-11-08T12:30:09.706115+0000","last_fullsized":"2023-11-08T12:30:09.706115+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:49.413521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574991+0000","last_change":"2023-11-08T12:30:08.116121+0000","last_active":"2023-11-08T12:30:09.574991+0000","last_peered":"2023-11-08T12:30:09.574991+0000","last_clean":"2023-11-08T12:30:09.574991+0000","last_became_active":"2023-11-08T12:30:08.115855+0000","last_became_peered":"2023-11-08T12:30:08.115855+0000","last_unstale":"2023-11-08T12:30:09.574991+0000","last_undegraded":"2023-11-08T12:30:09.574991+0000","last_fullsized":"2023-11-08T12:30:09.574991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:49.855133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295549+0000","last_change":"2023-11-08T12:30:08.586375+0000","last_active":"2023-11-08T12:30:10.295549+0000","last_peered":"2023-11-08T12:30:10.295549+0000","last_clean":"2023-11-08T12:30:10.295549+0000","last_became_active":"2023-11-08T12:30:08.585553+0000","last_became_peered":"2023-11-08T12:30:08.585553+0000","last_unstale":"2023-11-08T12:30:10.295549+0000","last_undegraded":"2023-11-08T12:30:10.295549+0000","last_fullsized":"2023-11-08T12:30:10.295549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:46:39.202790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295763+0000","last_change":"2023-11-08T12:30:08.123609+0000","last_active":"2023-11-08T12:30:10.295763+0000","last_peered":"2023-11-08T12:30:10.295763+0000","last_clean":"2023-11-08T12:30:10.295763+0000","last_became_active":"2023-11-08T12:30:08.123143+0000","last_became_peered":"2023-11-08T12:30:08.123143+0000","last_unstale":"2023-11-08T12:30:10.295763+0000","last_undegraded":"2023-11-08T12:30:10.295763+0000","last_fullsized":"2023-11-08T12:30:10.295763+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:17:44.918499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296002+0000","last_change":"2023-11-08T12:30:08.588910+0000","last_active":"2023-11-08T12:30:10.296002+0000","last_peered":"2023-11-08T12:30:10.296002+0000","last_clean":"2023-11-08T12:30:10.296002+0000","last_became_active":"2023-11-08T12:30:08.588300+0000","last_became_peered":"2023-11-08T12:30:08.588300+0000","last_unstale":"2023-11-08T12:30:10.296002+0000","last_undegraded":"2023-11-08T12:30:10.296002+0000","last_fullsized":"2023-11-08T12:30:10.296002+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:22:31.239034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574073+0000","last_change":"2023-11-08T12:30:08.117785+0000","last_active":"2023-11-08T12:30:09.574073+0000","last_peered":"2023-11-08T12:30:09.574073+0000","last_clean":"2023-11-08T12:30:09.574073+0000","last_became_active":"2023-11-08T12:30:08.117537+0000","last_became_peered":"2023-11-08T12:30:08.117537+0000","last_unstale":"2023-11-08T12:30:09.574073+0000","last_undegraded":"2023-11-08T12:30:09.574073+0000","last_fullsized":"2023-11-08T12:30:09.574073+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:54:29.272416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574268+0000","last_change":"2023-11-08T12:30:08.570793+0000","last_active":"2023-11-08T12:30:09.574268+0000","last_peered":"2023-11-08T12:30:09.574268+0000","last_clean":"2023-11-08T12:30:09.574268+0000","last_became_active":"2023-11-08T12:30:08.570529+0000","last_became_peered":"2023-11-08T12:30:08.570529+0000","last_unstale":"2023-11-08T12:30:09.574268+0000","last_undegraded":"2023-11-08T12:30:09.574268+0000","last_fullsized":"2023-11-08T12:30:09.574268+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:15:09.415684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294923+0000","last_change":"2023-11-08T12:30:08.119322+0000","last_active":"2023-11-08T12:30:10.294923+0000","last_peered":"2023-11-08T12:30:10.294923+0000","last_clean":"2023-11-08T12:30:10.294923+0000","last_became_active":"2023-11-08T12:30:08.119050+0000","last_became_peered":"2023-11-08T12:30:08.119050+0000","last_unstale":"2023-11-08T12:30:10.294923+0000","last_undegraded":"2023-11-08T12:30:10.294923+0000","last_fullsized":"2023-11-08T12:30:10.294923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:46:31.489528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574384+0000","last_change":"2023-11-08T12:30:08.583328+0000","last_active":"2023-11-08T12:30:09.574384+0000","last_peered":"2023-11-08T12:30:09.574384+0000","last_clean":"2023-11-08T12:30:09.574384+0000","last_became_active":"2023-11-08T12:30:08.582602+0000","last_became_peered":"2023-11-08T12:30:08.582602+0000","last_unstale":"2023-11-08T12:30:09.574384+0000","last_undegraded":"2023-11-08T12:30:09.574384+0000","last_fullsized":"2023-11-08T12:30:09.574384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:41:23.814562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295937+0000","last_change":"2023-11-08T12:30:08.118268+0000","last_active":"2023-11-08T12:30:10.295937+0000","last_peered":"2023-11-08T12:30:10.295937+0000","last_clean":"2023-11-08T12:30:10.295937+0000","last_became_active":"2023-11-08T12:30:08.118011+0000","last_became_peered":"2023-11-08T12:30:08.118011+0000","last_unstale":"2023-11-08T12:30:10.295937+0000","last_undegraded":"2023-11-08T12:30:10.295937+0000","last_fullsized":"2023-11-08T12:30:10.295937+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:19:37.656426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293809+0000","last_change":"2023-11-08T12:30:08.588492+0000","last_active":"2023-11-08T12:30:10.293809+0000","last_peered":"2023-11-08T12:30:10.293809+0000","last_clean":"2023-11-08T12:30:10.293809+0000","last_became_active":"2023-11-08T12:30:08.587983+0000","last_became_peered":"2023-11-08T12:30:08.587983+0000","last_unstale":"2023-11-08T12:30:10.293809+0000","last_undegraded":"2023-11-08T12:30:10.293809+0000","last_fullsized":"2023-11-08T12:30:10.293809+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:34:40.451255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573680+0000","last_change":"2023-11-08T12:30:08.114618+0000","last_active":"2023-11-08T12:30:09.573680+0000","last_peered":"2023-11-08T12:30:09.573680+0000","last_clean":"2023-11-08T12:30:09.573680+0000","last_became_active":"2023-11-08T12:30:08.114289+0000","last_became_peered":"2023-11-08T12:30:08.114289+0000","last_unstale":"2023-11-08T12:30:09.573680+0000","last_undegraded":"2023-11-08T12:30:09.573680+0000","last_fullsized":"2023-11-08T12:30:09.573680+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:29:22.904407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574035+0000","last_change":"2023-11-08T12:30:08.592897+0000","last_active":"2023-11-08T12:30:09.574035+0000","last_peered":"2023-11-08T12:30:09.574035+0000","last_clean":"2023-11-08T12:30:09.574035+0000","last_became_active":"2023-11-08T12:30:08.592573+0000","last_became_peered":"2023-11-08T12:30:08.592573+0000","last_unstale":"2023-11-08T12:30:09.574035+0000","last_undegraded":"2023-11-08T12:30:09.574035+0000","last_fullsized":"2023-11-08T12:30:09.574035+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:31.740666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294572+0000","last_change":"2023-11-08T12:30:08.110267+0000","last_active":"2023-11-08T12:30:10.294572+0000","last_peered":"2023-11-08T12:30:10.294572+0000","last_clean":"2023-11-08T12:30:10.294572+0000","last_became_active":"2023-11-08T12:30:08.109966+0000","last_became_peered":"2023-11-08T12:30:08.109966+0000","last_unstale":"2023-11-08T12:30:10.294572+0000","last_undegraded":"2023-11-08T12:30:10.294572+0000","last_fullsized":"2023-11-08T12:30:10.294572+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:58:26.814028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295511+0000","last_change":"2023-11-08T12:30:08.585729+0000","last_active":"2023-11-08T12:30:10.295511+0000","last_peered":"2023-11-08T12:30:10.295511+0000","last_clean":"2023-11-08T12:30:10.295511+0000","last_became_active":"2023-11-08T12:30:08.585441+0000","last_became_peered":"2023-11-08T12:30:08.585441+0000","last_unstale":"2023-11-08T12:30:10.295511+0000","last_undegraded":"2023-11-08T12:30:10.295511+0000","last_fullsized":"2023-11-08T12:30:10.295511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:58:32.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212578+0000","last_change":"2023-11-08T12:30:08.123965+0000","last_active":"2023-11-08T12:30:10.212578+0000","last_peered":"2023-11-08T12:30:10.212578+0000","last_clean":"2023-11-08T12:30:10.212578+0000","last_became_active":"2023-11-08T12:30:08.122709+0000","last_became_peered":"2023-11-08T12:30:08.122709+0000","last_unstale":"2023-11-08T12:30:10.212578+0000","last_undegraded":"2023-11-08T12:30:10.212578+0000","last_fullsized":"2023-11-08T12:30:10.212578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:59:59.434658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212387+0000","last_change":"2023-11-08T12:30:08.591890+0000","last_active":"2023-11-08T12:30:10.212387+0000","last_peered":"2023-11-08T12:30:10.212387+0000","last_clean":"2023-11-08T12:30:10.212387+0000","last_became_active":"2023-11-08T12:30:08.591383+0000","last_became_peered":"2023-11-08T12:30:08.591383+0000","last_unstale":"2023-11-08T12:30:10.212387+0000","last_undegraded":"2023-11-08T12:30:10.212387+0000","last_fullsized":"2023-11-08T12:30:10.212387+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:59:25.307873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575127+0000","last_change":"2023-11-08T12:30:08.121370+0000","last_active":"2023-11-08T12:30:09.575127+0000","last_peered":"2023-11-08T12:30:09.575127+0000","last_clean":"2023-11-08T12:30:09.575127+0000","last_became_active":"2023-11-08T12:30:08.121084+0000","last_became_peered":"2023-11-08T12:30:08.121084+0000","last_unstale":"2023-11-08T12:30:09.575127+0000","last_undegraded":"2023-11-08T12:30:09.575127+0000","last_fullsized":"2023-11-08T12:30:09.575127+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:26:20.552379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705339+0000","last_change":"2023-11-08T12:30:08.590433+0000","last_active":"2023-11-08T12:30:09.705339+0000","last_peered":"2023-11-08T12:30:09.705339+0000","last_clean":"2023-11-08T12:30:09.705339+0000","last_became_active":"2023-11-08T12:30:08.590106+0000","last_became_peered":"2023-11-08T12:30:08.590106+0000","last_unstale":"2023-11-08T12:30:09.705339+0000","last_undegraded":"2023-11-08T12:30:09.705339+0000","last_fullsized":"2023-11-08T12:30:09.705339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:19:16.704018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212764+0000","last_change":"2023-11-08T12:30:08.117068+0000","last_active":"2023-11-08T12:30:10.212764+0000","last_peered":"2023-11-08T12:30:10.212764+0000","last_clean":"2023-11-08T12:30:10.212764+0000","last_became_active":"2023-11-08T12:30:08.116628+0000","last_became_peered":"2023-11-08T12:30:08.116628+0000","last_unstale":"2023-11-08T12:30:10.212764+0000","last_undegraded":"2023-11-08T12:30:10.212764+0000","last_fullsized":"2023-11-08T12:30:10.212764+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:54.446943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212610+0000","last_change":"2023-11-08T12:30:08.593234+0000","last_active":"2023-11-08T12:30:10.212610+0000","last_peered":"2023-11-08T12:30:10.212610+0000","last_clean":"2023-11-08T12:30:10.212610+0000","last_became_active":"2023-11-08T12:30:08.592657+0000","last_became_peered":"2023-11-08T12:30:08.592657+0000","last_unstale":"2023-11-08T12:30:10.212610+0000","last_undegraded":"2023-11-08T12:30:10.212610+0000","last_fullsized":"2023-11-08T12:30:10.212610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:42.001126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295227+0000","last_change":"2023-11-08T12:30:08.123237+0000","last_active":"2023-11-08T12:30:10.295227+0000","last_peered":"2023-11-08T12:30:10.295227+0000","last_clean":"2023-11-08T12:30:10.295227+0000","last_became_active":"2023-11-08T12:30:08.122929+0000","last_became_peered":"2023-11-08T12:30:08.122929+0000","last_unstale":"2023-11-08T12:30:10.295227+0000","last_undegraded":"2023-11-08T12:30:10.295227+0000","last_fullsized":"2023-11-08T12:30:10.295227+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:29.906441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573521+0000","last_change":"2023-11-08T12:30:08.593870+0000","last_active":"2023-11-08T12:30:09.573521+0000","last_peered":"2023-11-08T12:30:09.573521+0000","last_clean":"2023-11-08T12:30:09.573521+0000","last_became_active":"2023-11-08T12:30:08.591916+0000","last_became_peered":"2023-11-08T12:30:08.591916+0000","last_unstale":"2023-11-08T12:30:09.573521+0000","last_undegraded":"2023-11-08T12:30:09.573521+0000","last_fullsized":"2023-11-08T12:30:09.573521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:50.868181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574433+0000","last_change":"2023-11-08T12:30:08.122173+0000","last_active":"2023-11-08T12:30:09.574433+0000","last_peered":"2023-11-08T12:30:09.574433+0000","last_clean":"2023-11-08T12:30:09.574433+0000","last_became_active":"2023-11-08T12:30:08.121922+0000","last_became_peered":"2023-11-08T12:30:08.121922+0000","last_unstale":"2023-11-08T12:30:09.574433+0000","last_undegraded":"2023-11-08T12:30:09.574433+0000","last_fullsized":"2023-11-08T12:30:09.574433+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:59:24.294825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211980+0000","last_change":"2023-11-08T12:30:08.594382+0000","last_active":"2023-11-08T12:30:10.211980+0000","last_peered":"2023-11-08T12:30:10.211980+0000","last_clean":"2023-11-08T12:30:10.211980+0000","last_became_active":"2023-11-08T12:30:08.594106+0000","last_became_peered":"2023-11-08T12:30:08.594106+0000","last_unstale":"2023-11-08T12:30:10.211980+0000","last_undegraded":"2023-11-08T12:30:10.211980+0000","last_fullsized":"2023-11-08T12:30:10.211980+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:19:38.669475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293445+0000","last_change":"2023-11-08T12:30:08.120549+0000","last_active":"2023-11-08T12:30:10.293445+0000","last_peered":"2023-11-08T12:30:10.293445+0000","last_clean":"2023-11-08T12:30:10.293445+0000","last_became_active":"2023-11-08T12:30:08.120273+0000","last_became_peered":"2023-11-08T12:30:08.120273+0000","last_unstale":"2023-11-08T12:30:10.293445+0000","last_undegraded":"2023-11-08T12:30:10.293445+0000","last_fullsized":"2023-11-08T12:30:10.293445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:36:38.025698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294451+0000","last_change":"2023-11-08T12:30:08.586622+0000","last_active":"2023-11-08T12:30:10.294451+0000","last_peered":"2023-11-08T12:30:10.294451+0000","last_clean":"2023-11-08T12:30:10.294451+0000","last_became_active":"2023-11-08T12:30:08.584517+0000","last_became_peered":"2023-11-08T12:30:08.584517+0000","last_unstale":"2023-11-08T12:30:10.294451+0000","last_undegraded":"2023-11-08T12:30:10.294451+0000","last_fullsized":"2023-11-08T12:30:10.294451+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:49.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573753+0000","last_change":"2023-11-08T12:30:08.116865+0000","last_active":"2023-11-08T12:30:09.573753+0000","last_peered":"2023-11-08T12:30:09.573753+0000","last_clean":"2023-11-08T12:30:09.573753+0000","last_became_active":"2023-11-08T12:30:08.116381+0000","last_became_peered":"2023-11-08T12:30:08.116381+0000","last_unstale":"2023-11-08T12:30:09.573753+0000","last_undegraded":"2023-11-08T12:30:09.573753+0000","last_fullsized":"2023-11-08T12:30:09.573753+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:13:08.794185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211963+0000","last_change":"2023-11-08T12:30:08.583730+0000","last_active":"2023-11-08T12:30:10.211963+0000","last_peered":"2023-11-08T12:30:10.211963+0000","last_clean":"2023-11-08T12:30:10.211963+0000","last_became_active":"2023-11-08T12:30:08.583218+0000","last_became_peered":"2023-11-08T12:30:08.583218+0000","last_unstale":"2023-11-08T12:30:10.211963+0000","last_undegraded":"2023-11-08T12:30:10.211963+0000","last_fullsized":"2023-11-08T12:30:10.211963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:55:31.327743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211808+0000","last_change":"2023-11-08T12:30:08.122958+0000","last_active":"2023-11-08T12:30:10.211808+0000","last_peered":"2023-11-08T12:30:10.211808+0000","last_clean":"2023-11-08T12:30:10.211808+0000","last_became_active":"2023-11-08T12:30:08.122707+0000","last_became_peered":"2023-11-08T12:30:08.122707+0000","last_unstale":"2023-11-08T12:30:10.211808+0000","last_undegraded":"2023-11-08T12:30:10.211808+0000","last_fullsized":"2023-11-08T12:30:10.211808+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:19:15.690970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574180+0000","last_change":"2023-11-08T12:30:08.588816+0000","last_active":"2023-11-08T12:30:09.574180+0000","last_peered":"2023-11-08T12:30:09.574180+0000","last_clean":"2023-11-08T12:30:09.574180+0000","last_became_active":"2023-11-08T12:30:08.588271+0000","last_became_peered":"2023-11-08T12:30:08.588271+0000","last_unstale":"2023-11-08T12:30:09.574180+0000","last_undegraded":"2023-11-08T12:30:09.574180+0000","last_fullsized":"2023-11-08T12:30:09.574180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:03.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.706174+0000","last_change":"2023-11-08T12:30:08.109299+0000","last_active":"2023-11-08T12:30:09.706174+0000","last_peered":"2023-11-08T12:30:09.706174+0000","last_clean":"2023-11-08T12:30:09.706174+0000","last_became_active":"2023-11-08T12:30:08.109042+0000","last_became_peered":"2023-11-08T12:30:08.109042+0000","last_unstale":"2023-11-08T12:30:09.706174+0000","last_undegraded":"2023-11-08T12:30:09.706174+0000","last_fullsized":"2023-11-08T12:30:09.706174+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:34:39.438206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574437+0000","last_change":"2023-11-08T12:30:08.589963+0000","last_active":"2023-11-08T12:30:09.574437+0000","last_peered":"2023-11-08T12:30:09.574437+0000","last_clean":"2023-11-08T12:30:09.574437+0000","last_became_active":"2023-11-08T12:30:08.589668+0000","last_became_peered":"2023-11-08T12:30:08.589668+0000","last_unstale":"2023-11-08T12:30:09.574437+0000","last_undegraded":"2023-11-08T12:30:09.574437+0000","last_fullsized":"2023-11-08T12:30:09.574437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:19:38.669475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296251+0000","last_change":"2023-11-08T12:30:08.117647+0000","last_active":"2023-11-08T12:30:10.296251+0000","last_peered":"2023-11-08T12:30:10.296251+0000","last_clean":"2023-11-08T12:30:10.296251+0000","last_became_active":"2023-11-08T12:30:08.117074+0000","last_became_peered":"2023-11-08T12:30:08.117074+0000","last_unstale":"2023-11-08T12:30:10.296251+0000","last_undegraded":"2023-11-08T12:30:10.296251+0000","last_fullsized":"2023-11-08T12:30:10.296251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:02.064313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705510+0000","last_change":"2023-11-08T12:30:08.583420+0000","last_active":"2023-11-08T12:30:09.705510+0000","last_peered":"2023-11-08T12:30:09.705510+0000","last_clean":"2023-11-08T12:30:09.705510+0000","last_became_active":"2023-11-08T12:30:08.582110+0000","last_became_peered":"2023-11-08T12:30:08.582110+0000","last_unstale":"2023-11-08T12:30:09.705510+0000","last_undegraded":"2023-11-08T12:30:09.705510+0000","last_fullsized":"2023-11-08T12:30:09.705510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:57:01.914196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293837+0000","last_change":"2023-11-08T12:30:08.119964+0000","last_active":"2023-11-08T12:30:10.293837+0000","last_peered":"2023-11-08T12:30:10.293837+0000","last_clean":"2023-11-08T12:30:10.293837+0000","last_became_active":"2023-11-08T12:30:08.119485+0000","last_became_peered":"2023-11-08T12:30:08.119485+0000","last_unstale":"2023-11-08T12:30:10.293837+0000","last_undegraded":"2023-11-08T12:30:10.293837+0000","last_fullsized":"2023-11-08T12:30:10.293837+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:58:15.638430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295885+0000","last_change":"2023-11-08T12:30:08.588959+0000","last_active":"2023-11-08T12:30:10.295885+0000","last_peered":"2023-11-08T12:30:10.295885+0000","last_clean":"2023-11-08T12:30:10.295885+0000","last_became_active":"2023-11-08T12:30:08.588669+0000","last_became_peered":"2023-11-08T12:30:08.588669+0000","last_unstale":"2023-11-08T12:30:10.295885+0000","last_undegraded":"2023-11-08T12:30:10.295885+0000","last_fullsized":"2023-11-08T12:30:10.295885+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:15:09.415684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574198+0000","last_change":"2023-11-08T12:30:08.113392+0000","last_active":"2023-11-08T12:30:09.574198+0000","last_peered":"2023-11-08T12:30:09.574198+0000","last_clean":"2023-11-08T12:30:09.574198+0000","last_became_active":"2023-11-08T12:30:08.113084+0000","last_became_peered":"2023-11-08T12:30:08.113084+0000","last_unstale":"2023-11-08T12:30:09.574198+0000","last_undegraded":"2023-11-08T12:30:09.574198+0000","last_fullsized":"2023-11-08T12:30:09.574198+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:32:25.242523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574259+0000","last_change":"2023-11-08T12:30:08.577822+0000","last_active":"2023-11-08T12:30:09.574259+0000","last_peered":"2023-11-08T12:30:09.574259+0000","last_clean":"2023-11-08T12:30:09.574259+0000","last_became_active":"2023-11-08T12:30:08.577555+0000","last_became_peered":"2023-11-08T12:30:08.577555+0000","last_unstale":"2023-11-08T12:30:09.574259+0000","last_undegraded":"2023-11-08T12:30:09.574259+0000","last_fullsized":"2023-11-08T12:30:09.574259+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:15:31.145343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.704957+0000","last_change":"2023-11-08T12:30:08.118004+0000","last_active":"2023-11-08T12:30:09.704957+0000","last_peered":"2023-11-08T12:30:09.704957+0000","last_clean":"2023-11-08T12:30:09.704957+0000","last_became_active":"2023-11-08T12:30:08.117650+0000","last_became_peered":"2023-11-08T12:30:08.117650+0000","last_unstale":"2023-11-08T12:30:09.704957+0000","last_undegraded":"2023-11-08T12:30:09.704957+0000","last_fullsized":"2023-11-08T12:30:09.704957+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:20:39.706967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212177+0000","last_change":"2023-11-08T12:30:08.583940+0000","last_active":"2023-11-08T12:30:10.212177+0000","last_peered":"2023-11-08T12:30:10.212177+0000","last_clean":"2023-11-08T12:30:10.212177+0000","last_became_active":"2023-11-08T12:30:08.583157+0000","last_became_peered":"2023-11-08T12:30:08.583157+0000","last_unstale":"2023-11-08T12:30:10.212177+0000","last_undegraded":"2023-11-08T12:30:10.212177+0000","last_fullsized":"2023-11-08T12:30:10.212177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:28:35.460465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294920+0000","last_change":"2023-11-08T12:30:08.121097+0000","last_active":"2023-11-08T12:30:10.294920+0000","last_peered":"2023-11-08T12:30:10.294920+0000","last_clean":"2023-11-08T12:30:10.294920+0000","last_became_active":"2023-11-08T12:30:08.120423+0000","last_became_peered":"2023-11-08T12:30:08.120423+0000","last_unstale":"2023-11-08T12:30:10.294920+0000","last_undegraded":"2023-11-08T12:30:10.294920+0000","last_fullsized":"2023-11-08T12:30:10.294920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:28:34.447416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.704874+0000","last_change":"2023-11-08T12:30:08.600600+0000","last_active":"2023-11-08T12:30:09.704874+0000","last_peered":"2023-11-08T12:30:09.704874+0000","last_clean":"2023-11-08T12:30:09.704874+0000","last_became_active":"2023-11-08T12:30:08.600380+0000","last_became_peered":"2023-11-08T12:30:08.600380+0000","last_unstale":"2023-11-08T12:30:09.704874+0000","last_undegraded":"2023-11-08T12:30:09.704874+0000","last_fullsized":"2023-11-08T12:30:09.704874+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:55.459991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705093+0000","last_change":"2023-11-08T12:30:08.125976+0000","last_active":"2023-11-08T12:30:09.705093+0000","last_peered":"2023-11-08T12:30:09.705093+0000","last_clean":"2023-11-08T12:30:09.705093+0000","last_became_active":"2023-11-08T12:30:08.123083+0000","last_became_peered":"2023-11-08T12:30:08.123083+0000","last_unstale":"2023-11-08T12:30:09.705093+0000","last_undegraded":"2023-11-08T12:30:09.705093+0000","last_fullsized":"2023-11-08T12:30:09.705093+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:24:03.313079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573974+0000","last_change":"2023-11-08T12:30:08.592915+0000","last_active":"2023-11-08T12:30:09.573974+0000","last_peered":"2023-11-08T12:30:09.573974+0000","last_clean":"2023-11-08T12:30:09.573974+0000","last_became_active":"2023-11-08T12:30:08.592679+0000","last_became_peered":"2023-11-08T12:30:08.592679+0000","last_unstale":"2023-11-08T12:30:09.573974+0000","last_undegraded":"2023-11-08T12:30:09.573974+0000","last_fullsized":"2023-11-08T12:30:09.573974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:43.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573860+0000","last_change":"2023-11-08T12:30:08.113222+0000","last_active":"2023-11-08T12:30:09.573860+0000","last_peered":"2023-11-08T12:30:09.573860+0000","last_clean":"2023-11-08T12:30:09.573860+0000","last_became_active":"2023-11-08T12:30:08.112822+0000","last_became_peered":"2023-11-08T12:30:08.112822+0000","last_unstale":"2023-11-08T12:30:09.573860+0000","last_undegraded":"2023-11-08T12:30:09.573860+0000","last_fullsized":"2023-11-08T12:30:09.573860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:16:53.191299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574670+0000","last_change":"2023-11-08T12:30:08.578858+0000","last_active":"2023-11-08T12:30:09.574670+0000","last_peered":"2023-11-08T12:30:09.574670+0000","last_clean":"2023-11-08T12:30:09.574670+0000","last_became_active":"2023-11-08T12:30:08.578592+0000","last_became_peered":"2023-11-08T12:30:08.578592+0000","last_unstale":"2023-11-08T12:30:09.574670+0000","last_undegraded":"2023-11-08T12:30:09.574670+0000","last_fullsized":"2023-11-08T12:30:09.574670+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:46:39.202790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574195+0000","last_change":"2023-11-08T12:30:08.116736+0000","last_active":"2023-11-08T12:30:09.574195+0000","last_peered":"2023-11-08T12:30:09.574195+0000","last_clean":"2023-11-08T12:30:09.574195+0000","last_became_active":"2023-11-08T12:30:08.116460+0000","last_became_peered":"2023-11-08T12:30:08.116460+0000","last_unstale":"2023-11-08T12:30:09.574195+0000","last_undegraded":"2023-11-08T12:30:09.574195+0000","last_fullsized":"2023-11-08T12:30:09.574195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:20:52.461236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566362+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:30:08.566362+0000","last_peered":"2023-11-08T12:30:08.566362+0000","last_clean":"2023-11-08T12:30:08.566362+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:30:08.566362+0000","last_undegraded":"2023-11-08T12:30:08.566362+0000","last_fullsized":"2023-11-08T12:30:08.566362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212608+0000","last_change":"2023-11-08T12:30:08.593409+0000","last_active":"2023-11-08T12:30:10.212608+0000","last_peered":"2023-11-08T12:30:10.212608+0000","last_clean":"2023-11-08T12:30:10.212608+0000","last_became_active":"2023-11-08T12:30:08.592997+0000","last_became_peered":"2023-11-08T12:30:08.592997+0000","last_unstale":"2023-11-08T12:30:10.212608+0000","last_undegraded":"2023-11-08T12:30:10.212608+0000","last_fullsized":"2023-11-08T12:30:10.212608+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:26:21.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296102+0000","last_change":"2023-11-08T12:30:08.116076+0000","last_active":"2023-11-08T12:30:10.296102+0000","last_peered":"2023-11-08T12:30:10.296102+0000","last_clean":"2023-11-08T12:30:10.296102+0000","last_became_active":"2023-11-08T12:30:08.115543+0000","last_became_peered":"2023-11-08T12:30:08.115543+0000","last_unstale":"2023-11-08T12:30:10.296102+0000","last_undegraded":"2023-11-08T12:30:10.296102+0000","last_fullsized":"2023-11-08T12:30:10.296102+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:34.590941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.574707+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:30:08.574707+0000","last_peered":"2023-11-08T12:30:08.574707+0000","last_clean":"2023-11-08T12:30:08.574707+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:30:08.574707+0000","last_undegraded":"2023-11-08T12:30:08.574707+0000","last_fullsized":"2023-11-08T12:30:08.574707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212381+0000","last_change":"2023-11-08T12:30:08.580506+0000","last_active":"2023-11-08T12:30:10.212381+0000","last_peered":"2023-11-08T12:30:10.212381+0000","last_clean":"2023-11-08T12:30:10.212381+0000","last_became_active":"2023-11-08T12:30:08.580164+0000","last_became_peered":"2023-11-08T12:30:08.580164+0000","last_unstale":"2023-11-08T12:30:10.212381+0000","last_undegraded":"2023-11-08T12:30:10.212381+0000","last_fullsized":"2023-11-08T12:30:10.212381+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:17:45.931548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575484+0000","last_change":"2023-11-08T12:30:08.119615+0000","last_active":"2023-11-08T12:30:09.575484+0000","last_peered":"2023-11-08T12:30:09.575484+0000","last_clean":"2023-11-08T12:30:09.575484+0000","last_became_active":"2023-11-08T12:30:08.119314+0000","last_became_peered":"2023-11-08T12:30:08.119314+0000","last_unstale":"2023-11-08T12:30:09.575484+0000","last_undegraded":"2023-11-08T12:30:09.575484+0000","last_fullsized":"2023-11-08T12:30:09.575484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:40.988078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.568606+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:30:08.568606+0000","last_peered":"2023-11-08T12:30:08.568606+0000","last_clean":"2023-11-08T12:30:08.568606+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:30:08.568606+0000","last_undegraded":"2023-11-08T12:30:08.568606+0000","last_fullsized":"2023-11-08T12:30:08.568606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574362+0000","last_change":"2023-11-08T12:30:08.596810+0000","last_active":"2023-11-08T12:30:09.574362+0000","last_peered":"2023-11-08T12:30:09.574362+0000","last_clean":"2023-11-08T12:30:09.574362+0000","last_became_active":"2023-11-08T12:30:08.596470+0000","last_became_peered":"2023-11-08T12:30:08.596470+0000","last_unstale":"2023-11-08T12:30:09.574362+0000","last_undegraded":"2023-11-08T12:30:09.574362+0000","last_fullsized":"2023-11-08T12:30:09.574362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:55:31.327743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296041+0000","last_change":"2023-11-08T12:30:08.122100+0000","last_active":"2023-11-08T12:30:10.296041+0000","last_peered":"2023-11-08T12:30:10.296041+0000","last_clean":"2023-11-08T12:30:10.296041+0000","last_became_active":"2023-11-08T12:30:08.121795+0000","last_became_peered":"2023-11-08T12:30:08.121795+0000","last_unstale":"2023-11-08T12:30:10.296041+0000","last_undegraded":"2023-11-08T12:30:10.296041+0000","last_fullsized":"2023-11-08T12:30:10.296041+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:49.855133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.573590+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:30:08.573590+0000","last_peered":"2023-11-08T12:30:08.573590+0000","last_clean":"2023-11-08T12:30:08.573590+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:30:08.573590+0000","last_undegraded":"2023-11-08T12:30:08.573590+0000","last_fullsized":"2023-11-08T12:30:08.573590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295399+0000","last_change":"2023-11-08T12:30:08.590076+0000","last_active":"2023-11-08T12:30:10.295399+0000","last_peered":"2023-11-08T12:30:10.295399+0000","last_clean":"2023-11-08T12:30:10.295399+0000","last_became_active":"2023-11-08T12:30:08.582039+0000","last_became_peered":"2023-11-08T12:30:08.582039+0000","last_unstale":"2023-11-08T12:30:10.295399+0000","last_undegraded":"2023-11-08T12:30:10.295399+0000","last_fullsized":"2023-11-08T12:30:10.295399+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:49.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573524+0000","last_change":"2023-11-08T12:30:08.111564+0000","last_active":"2023-11-08T12:30:09.573524+0000","last_peered":"2023-11-08T12:30:09.573524+0000","last_clean":"2023-11-08T12:30:09.573524+0000","last_became_active":"2023-11-08T12:30:08.111100+0000","last_became_peered":"2023-11-08T12:30:08.111100+0000","last_unstale":"2023-11-08T12:30:09.573524+0000","last_undegraded":"2023-11-08T12:30:09.573524+0000","last_fullsized":"2023-11-08T12:30:09.573524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:04.678232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.575319+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:30:08.575319+0000","last_peered":"2023-11-08T12:30:08.575319+0000","last_clean":"2023-11-08T12:30:08.575319+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:30:08.575319+0000","last_undegraded":"2023-11-08T12:30:08.575319+0000","last_fullsized":"2023-11-08T12:30:08.575319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573565+0000","last_change":"2023-11-08T12:30:08.592202+0000","last_active":"2023-11-08T12:30:09.573565+0000","last_peered":"2023-11-08T12:30:09.573565+0000","last_clean":"2023-11-08T12:30:09.573565+0000","last_became_active":"2023-11-08T12:30:08.591572+0000","last_became_peered":"2023-11-08T12:30:08.591572+0000","last_unstale":"2023-11-08T12:30:09.573565+0000","last_undegraded":"2023-11-08T12:30:09.573565+0000","last_fullsized":"2023-11-08T12:30:09.573565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:35.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574520+0000","last_change":"2023-11-08T12:30:08.108146+0000","last_active":"2023-11-08T12:30:09.574520+0000","last_peered":"2023-11-08T12:30:09.574520+0000","last_clean":"2023-11-08T12:30:09.574520+0000","last_became_active":"2023-11-08T12:30:08.107888+0000","last_became_peered":"2023-11-08T12:30:08.107888+0000","last_unstale":"2023-11-08T12:30:09.574520+0000","last_undegraded":"2023-11-08T12:30:09.574520+0000","last_fullsized":"2023-11-08T12:30:09.574520+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:34.590941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566969+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:30:08.566969+0000","last_peered":"2023-11-08T12:30:08.566969+0000","last_clean":"2023-11-08T12:30:08.566969+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:30:08.566969+0000","last_undegraded":"2023-11-08T12:30:08.566969+0000","last_fullsized":"2023-11-08T12:30:08.566969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296276+0000","last_change":"2023-11-08T12:30:08.596947+0000","last_active":"2023-11-08T12:30:10.296276+0000","last_peered":"2023-11-08T12:30:10.296276+0000","last_clean":"2023-11-08T12:30:10.296276+0000","last_became_active":"2023-11-08T12:30:08.596656+0000","last_became_peered":"2023-11-08T12:30:08.596656+0000","last_unstale":"2023-11-08T12:30:10.296276+0000","last_undegraded":"2023-11-08T12:30:10.296276+0000","last_fullsized":"2023-11-08T12:30:10.296276+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:58:32.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705274+0000","last_change":"2023-11-08T12:30:08.121352+0000","last_active":"2023-11-08T12:30:09.705274+0000","last_peered":"2023-11-08T12:30:09.705274+0000","last_clean":"2023-11-08T12:30:09.705274+0000","last_became_active":"2023-11-08T12:30:08.121079+0000","last_became_peered":"2023-11-08T12:30:08.121079+0000","last_unstale":"2023-11-08T12:30:09.705274+0000","last_undegraded":"2023-11-08T12:30:09.705274+0000","last_fullsized":"2023-11-08T12:30:09.705274+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:17.364182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566625+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:30:08.566625+0000","last_peered":"2023-11-08T12:30:08.566625+0000","last_clean":"2023-11-08T12:30:08.566625+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:30:08.566625+0000","last_undegraded":"2023-11-08T12:30:08.566625+0000","last_fullsized":"2023-11-08T12:30:08.566625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573744+0000","last_change":"2023-11-08T12:30:08.585325+0000","last_active":"2023-11-08T12:30:09.573744+0000","last_peered":"2023-11-08T12:30:09.573744+0000","last_clean":"2023-11-08T12:30:09.573744+0000","last_became_active":"2023-11-08T12:30:08.581798+0000","last_became_peered":"2023-11-08T12:30:08.581798+0000","last_unstale":"2023-11-08T12:30:09.573744+0000","last_undegraded":"2023-11-08T12:30:09.573744+0000","last_fullsized":"2023-11-08T12:30:09.573744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:51:48.465793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293421+0000","last_change":"2023-11-08T12:30:08.116101+0000","last_active":"2023-11-08T12:30:10.293421+0000","last_peered":"2023-11-08T12:30:10.293421+0000","last_clean":"2023-11-08T12:30:10.293421+0000","last_became_active":"2023-11-08T12:30:08.115727+0000","last_became_peered":"2023-11-08T12:30:08.115727+0000","last_unstale":"2023-11-08T12:30:10.293421+0000","last_undegraded":"2023-11-08T12:30:10.293421+0000","last_fullsized":"2023-11-08T12:30:10.293421+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:20:54.851051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.575592+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:30:08.575592+0000","last_peered":"2023-11-08T12:30:08.575592+0000","last_clean":"2023-11-08T12:30:08.575592+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:30:08.575592+0000","last_undegraded":"2023-11-08T12:30:08.575592+0000","last_fullsized":"2023-11-08T12:30:08.575592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566711+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:30:08.566711+0000","last_peered":"2023-11-08T12:30:08.566711+0000","last_clean":"2023-11-08T12:30:08.566711+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:30:08.566711+0000","last_undegraded":"2023-11-08T12:30:08.566711+0000","last_fullsized":"2023-11-08T12:30:08.566711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476770,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9184,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362656,"statfs":{"total":96636764160,"available":96627359744,"internally_reserved":0,"allocated":679936,"data_stored":313811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.1599999999999999,"15min":1.127},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.4889999999999999,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.1319999999999999,"15min":1.1040000000000001},"min":{"1min":0.77500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.1799999999999997,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.1359999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1719999999999999,"15min":1.1579999999999999},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.278},{"interface":"front","average":{"1min":1.149,"5min":1.117,"15min":1.111},"min":{"1min":0.90200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.0369999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0509999999999999,"15min":1.0529999999999999},"min":{"1min":0.75800000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.288,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.2829999999999999,"15min":1.274},"min":{"1min":0.80600000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.397}]},{"osd":3,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3540000000000001,"15min":1.347},"min":{"1min":0.86199999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":5.601,"5min":5.601,"15min":5.601},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2350000000000001,"15min":1.2390000000000001},"min":{"1min":0.98699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.4990000000000001,"5min":1.73,"15min":1.73},"last":1.3029999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.3240000000000001,"15min":1.3320000000000001},"min":{"1min":0.754,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":3.9119999999999999,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.359,"15min":1.373},"min":{"1min":1.0049999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.8819999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2649999999999999,"15min":1.2849999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.579,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.472,"15min":1.474},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":4.0720000000000001,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.347}]},{"osd":7,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4750000000000001,"15min":1.488},"min":{"1min":1.004,"5min":0.752,"15min":0.752},"max":{"1min":1.8080000000000001,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.25},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.4279999999999999,"15min":1.4450000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7649999999999999,"5min":2.121,"15min":2.121},"last":1.425}]}]},{"osd":4,"up_from":16,"seq":68719476770,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":692224,"data_stored":315359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.99199999999999999,"15min":0.99299999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4390000000000001,"5min":1.454,"15min":1.454},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.0680000000000001,"15min":1.0569999999999999},"min":{"1min":0.71499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5600000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.411}]},{"osd":1,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.1779999999999999,"15min":1.1659999999999999},"min":{"1min":0.77100000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5269999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1990000000000001,"15min":1.2070000000000001},"min":{"1min":0.84999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7649999999999999,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.216,"15min":1.22},"min":{"1min":0.97799999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.401,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.206,"15min":1.2},"min":{"1min":1.03,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.583,"5min":3.129,"15min":3.129},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2210000000000001,"15min":1.224},"min":{"1min":0.86699999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5720000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.325,"15min":1.327},"min":{"1min":1.0680000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.665,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.3759999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2809999999999999,"15min":1.3089999999999999},"min":{"1min":0.82899999999999996,"5min":0.754,"15min":0.754},"max":{"1min":1.4390000000000001,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.2370000000000001,"15min":1.226},"min":{"1min":1.0189999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.6200000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.1859999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.395,"15min":1.3959999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7509999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4239999999999999,"15min":1.4339999999999999},"min":{"1min":1.014,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.706,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.4119999999999999,"15min":1.419},"min":{"1min":0.97999999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6779999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4530000000000001,"15min":1.456},"min":{"1min":1.008,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.6839999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3129999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509474,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10336,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361504,"statfs":{"total":96636764160,"available":96626180096,"internally_reserved":0,"allocated":1269760,"data_stored":897366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.143,"15min":1.155},"min":{"1min":0.73399999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.357,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5549999999999999,"5min":1.7,"15min":1.7},"last":1.2829999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.325,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.006},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0469999999999999,"15min":1.0449999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4490000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.409}]},{"osd":2,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.82399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.593,"5min":1.597,"15min":1.597},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.448,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.266}]},{"osd":3,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2230000000000001,"15min":1.2310000000000001},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.542,"5min":1.984,"15min":1.984},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.86299999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.758,"5min":2.137,"15min":2.137},"last":1.129}]},{"osd":4,"last update":"Wed Nov 8 12:29:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2849999999999999,"15min":1.2969999999999999},"min":{"1min":0.86599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.681,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.248,"5min":1.256,"15min":1.2569999999999999},"min":{"1min":0.93600000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8260000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.284,"15min":1.2849999999999999},"min":{"1min":0.92300000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.657,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.27,"15min":1.274},"min":{"1min":0.85399999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.502,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.365}]},{"osd":6,"last update":"Wed Nov 8 12:29:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.369,"15min":1.369},"min":{"1min":0.91800000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.819,"5min":1.956,"15min":1.956},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":1.032,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6439999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.94199999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":688128,"data_stored":314447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.9710000000000001,"15min":2.1349999999999998},"min":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5640000000000001,"5min":20.099,"15min":20.099},"last":1.415},{"interface":"front","average":{"1min":1.042,"5min":2.0489999999999999,"15min":2.2170000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3799999999999999,"5min":21.238,"15min":21.238},"last":1.1319999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.198,"15min":1.2250000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.643,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.498,"15min":1.573},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.296,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":0.99099999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.673,"15min":1.7689999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.4670000000000001,"5min":11.843,"15min":11.843},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.724,"15min":1.8180000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8979999999999999,"5min":11.907,"15min":11.907},"last":0.80500000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.389,"15min":1.425},"min":{"1min":0.88,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.6899999999999999,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.466,"15min":1.514},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.8240000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.228}]},{"osd":4,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2230000000000001,"15min":1.2190000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2809999999999999,"15min":1.292},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7130000000000001,"5min":2.073,"15min":2.073},"last":1.3380000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.286,"15min":1.3109999999999999},"min":{"1min":0.83899999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.746,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.3759999999999999,"15min":1.3879999999999999},"min":{"1min":0.92800000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.6359999999999999,"5min":1.948,"15min":1.948},"last":1.2729999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.7430000000000001,"15min":1.8240000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.5780000000000001,"5min":8.109,"15min":8.109},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.647,"15min":1.6930000000000001},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.784,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.3720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9384,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362456,"statfs":{"total":96636764160,"available":96627154944,"internally_reserved":0,"allocated":688128,"data_stored":313867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.236,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.58699999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.306,"5min":1.53,"15min":1.53},"last":1.165}]},{"osd":1,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.88700000000000001,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2210000000000001,"5min":1.51,"15min":1.51},"last":0.997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":1.0780000000000001,"15min":1.1140000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1890000000000001,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1220000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.194,"15min":1.2370000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3140000000000001,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4159999999999999,"5min":1.972,"15min":1.972},"last":1.044}]},{"osd":4,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.246,"15min":1.26},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7210000000000001,"5min":1.837,"15min":1.837},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.484}]},{"osd":5,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.296,"15min":1.3109999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.841,"5min":1.897,"15min":1.897},"last":1.649},{"interface":"front","average":{"1min":1.254,"5min":1.458,"15min":1.492},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.794,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.5449999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3440000000000001,"15min":1.3560000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.651,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3320000000000001,"15min":1.3420000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.7490000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4590000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.45,"15min":1.47},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.71,"5min":2.194,"15min":2.194},"last":1.9890000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.4910000000000001,"15min":1.512},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":2.472,"15min":2.472},"last":1.554}]}]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9252,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362588,"statfs":{"total":96636764160,"available":96627290112,"internally_reserved":0,"allocated":684032,"data_stored":313901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.98099999999999998,"15min":0.99399999999999999},"min":{"1min":0.55300000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.21,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.875},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0349999999999999,"15min":1.048},"min":{"1min":0.69299999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2290000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.228}]},{"osd":2,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0289999999999999,"15min":1.044},"min":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5940000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.127,"15min":1.141},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4179999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.159}]},{"osd":3,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0960000000000001,"15min":1.1180000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.2629999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.0649999999999999,"15min":1.099},"min":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.373,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.97599999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.264,"15min":1.2789999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.472,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.3129999999999999,"15min":1.3320000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.353,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.3180000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.385,"15min":1.4139999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5289999999999999,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.337},{"interface":"front","average":{"1min":1.274,"5min":1.446,"15min":1.4750000000000001},"min":{"1min":0.997,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.633,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.458}]},{"osd":6,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.361,"15min":1.375},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.502,"5min":1.885,"15min":1.885},"last":1.252},{"interface":"front","average":{"1min":1.282,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.99299999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.6439999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2849999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.514,"15min":1.538},"min":{"1min":1.1020000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.8109999999999999,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.4670000000000001,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.2729999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10420,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361420,"statfs":{"total":96636764160,"available":96626094080,"internally_reserved":0,"allocated":1290240,"data_stored":906293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":1.085,"15min":1.137},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0589999999999999,"5min":6.54,"15min":6.54},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":1.103,"15min":1.1499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2290000000000001,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0249999999999999,"15min":1.0409999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4410000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":3.069,"15min":3.069},"last":0.623}]},{"osd":3,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.071,"15min":1.101},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.413,"5min":2.673,"15min":2.673},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.355,"15min":1.409},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4850000000000001,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":0.82799999999999996}]},{"osd":4,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.371,"15min":1.409},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.369,"5min":2.927,"15min":2.927},"last":1.111},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.3879999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5429999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.1870000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.3899999999999999,"15min":1.4259999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5109999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.5209999999999999,"15min":1.5669999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.6040000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.238}]},{"osd":6,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.5629999999999999,"15min":1.6060000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.6870000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.506,"15min":1.542},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6599999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.254}]},{"osd":7,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.512,"15min":1.546},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.7310000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.544,"15min":1.595},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.5660000000000001,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.214}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9180,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362660,"statfs":{"total":96636764160,"available":96627363840,"internally_reserved":0,"allocated":675840,"data_stored":306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1659999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.1000000000000001,"15min":1.127},"min":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.423,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":0.91900000000000004},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.3160000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.415}]},{"osd":3,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4730000000000001,"5min":1.837,"15min":1.837},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.101,"15min":1.129},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2010000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1850000000000001,"15min":1.1950000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.3320000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.224},{"interface":"front","average":{"1min":1.212,"5min":1.363,"15min":1.3879999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.585,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.179}]},{"osd":5,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3700000000000001,"15min":1.4019999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.542,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.26},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3089999999999999,"15min":1.3360000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.389,"5min":3.052,"15min":3.052},"last":1.107}]},{"osd":6,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.3520000000000001,"15min":1.3859999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5009999999999999,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.294},{"interface":"front","average":{"1min":1.208,"5min":1.391,"15min":1.421},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.472,"5min":2.254,"15min":2.254},"last":1.3149999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.488,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.446,"15min":1.476},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.5700000000000001,"5min":3.5,"15min":3.5},"last":1.373}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:30:12.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:30:13.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.138+0000 7fb02e556700 1 Processor -- start 2023-11-08T12:30:13.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.138+0000 7fb02e556700 1 -- start start 2023-11-08T12:30:13.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02e556700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb028160710 0x7fb0280cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02e556700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0280cc860 0x7fb028070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02e556700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0280705c0 0x7fb028069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02e556700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb028070a60 con 0x7fb0280705c0 2023-11-08T12:30:13.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02e556700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02806b1c0 con 0x7fb028160710 2023-11-08T12:30:13.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02e556700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280ad6c0 con 0x7fb0280cc860 2023-11-08T12:30:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0280705c0 0x7fb028069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb0280705c0 0x7fb028069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46292/0 (socket says 172.21.15.112:46292) 2023-11-08T12:30:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02d554700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb028160710 0x7fb0280cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 -- 172.21.15.112:0/3749264918 learned_addr learned my addr 172.21.15.112:0/3749264918 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02cd53700 1 --2- 172.21.15.112:0/3749264918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0280cc860 0x7fb028070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 -- 172.21.15.112:0/3749264918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0280cc860 msgr2=0x7fb028070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:13.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 --2- 172.21.15.112:0/3749264918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0280cc860 0x7fb028070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 -- 172.21.15.112:0/3749264918 >> v2:172.21.15.133:3300/0 conn(0x7fb028160710 msgr2=0x7fb0280cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:13.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 --2- 172.21.15.112:0/3749264918 >> v2:172.21.15.133:3300/0 conn(0x7fb028160710 0x7fb0280cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02dd55700 1 -- 172.21.15.112:0/3749264918 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280adc60 con 0x7fb0280705c0 2023-11-08T12:30:13.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.142+0000 7fb02d554700 1 --2- 172.21.15.112:0/3749264918 >> v2:172.21.15.133:3300/0 conn(0x7fb028160710 0x7fb0280cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:13.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02dd55700 1 --2- 172.21.15.112:0/3749264918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb028069bf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb028072ed0 tx=0x7fb02000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a919664ce3e1a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:13.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb01ffff700 1 -- 172.21.15.112:0/3749264918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000e070 con 0x7fb0280705c0 2023-11-08T12:30:13.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb01ffff700 1 -- 172.21.15.112:0/3749264918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000b910 con 0x7fb0280705c0 2023-11-08T12:30:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb01ffff700 1 -- 172.21.15.112:0/3749264918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000bcc0 con 0x7fb0280705c0 2023-11-08T12:30:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 -- 172.21.15.112:0/3749264918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 msgr2=0x7fb028069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 --2- 172.21.15.112:0/3749264918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb028069bf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb028072ed0 tx=0x7fb02000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 -- 172.21.15.112:0/3749264918 shutdown_connections 2023-11-08T12:30:13.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 --2- 172.21.15.112:0/3749264918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0280cc860 0x7fb028070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 --2- 172.21.15.112:0/3749264918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb028069bf0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 --2- 172.21.15.112:0/3749264918 >> v2:172.21.15.133:3300/0 conn(0x7fb028160710 0x7fb0280cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 -- 172.21.15.112:0/3749264918 >> 172.21.15.112:0/3749264918 conn(0x7fb0280b0f80 msgr2=0x7fb0280ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 -- 172.21.15.112:0/3749264918 shutdown_connections 2023-11-08T12:30:13.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.146+0000 7fb02e556700 1 -- 172.21.15.112:0/3749264918 wait complete. 2023-11-08T12:30:13.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 Processor -- start 2023-11-08T12:30:13.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 -- start start 2023-11-08T12:30:13.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb02815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0280cc860 0x7fb028159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb028160710 0x7fb02815f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280b3dc0 con 0x7fb0280705c0 2023-11-08T12:30:13.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280b3140 con 0x7fb0280cc860 2023-11-08T12:30:13.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02e556700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280b3420 con 0x7fb028160710 2023-11-08T12:30:13.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb02815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb02815d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46304/0 (socket says 172.21.15.112:46304) 2023-11-08T12:30:13.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 -- 172.21.15.112:0/724783354 learned_addr learned my addr 172.21.15.112:0/724783354 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:13.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02cd53700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0280cc860 0x7fb028159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 -- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb028160710 msgr2=0x7fb02815f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb028160710 0x7fb02815f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 -- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0280cc860 msgr2=0x7fb028159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0280cc860 0x7fb028159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 -- 172.21.15.112:0/724783354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240094b0 con 0x7fb0280705c0 2023-11-08T12:30:13.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02cd53700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0280cc860 0x7fb028159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:13.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.150+0000 7fb02d554700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb02815d420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb02400ebe0 tx=0x7fb024009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:13.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.154+0000 7fb01dffb700 1 -- 172.21.15.112:0/724783354 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400c8b0 con 0x7fb0280705c0 2023-11-08T12:30:13.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.154+0000 7fb01dffb700 1 -- 172.21.15.112:0/724783354 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02400ca10 con 0x7fb0280705c0 2023-11-08T12:30:13.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.154+0000 7fb01dffb700 1 -- 172.21.15.112:0/724783354 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400cda0 con 0x7fb0280705c0 2023-11-08T12:30:13.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.154+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb020009b30 con 0x7fb0280705c0 2023-11-08T12:30:13.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.154+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02806b6b0 con 0x7fb0280705c0 2023-11-08T12:30:13.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.154+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02806b3d0 con 0x7fb0280705c0 2023-11-08T12:30:13.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.154+0000 7fb01dffb700 1 -- 172.21.15.112:0/724783354 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb024019030 con 0x7fb0280705c0 2023-11-08T12:30:13.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.158+0000 7fb01dffb700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb00c064ee0 0x7fb00c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.158+0000 7fb01dffb700 1 -- 172.21.15.112:0/724783354 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb024081ff0 con 0x7fb0280705c0 2023-11-08T12:30:13.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.158+0000 7fb02cd53700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb00c064ee0 0x7fb00c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.158+0000 7fb02cd53700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb00c064ee0 0x7fb00c067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0280afbf0 tx=0x7fb018008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:13.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.162+0000 7fb01dffb700 1 -- 172.21.15.112:0/724783354 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb02404fff0 con 0x7fb0280705c0 2023-11-08T12:30:13.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.330+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0280ad8f0 con 0x7fb00c064ee0 2023-11-08T12:30:13.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.338+0000 7fb01dffb700 1 -- 172.21.15.112:0/724783354 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308674 (secure 0 0 0) 0x7fb0280ad8f0 con 0x7fb00c064ee0 2023-11-08T12:30:13.351 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:13.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb00c064ee0 msgr2=0x7fb00c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb00c064ee0 0x7fb00c067390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0280afbf0 tx=0x7fb018008040 comp rx=0 tx=0).stop 2023-11-08T12:30:13.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 msgr2=0x7fb02815d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb02815d420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb02400ebe0 tx=0x7fb024009e30 comp rx=0 tx=0).stop 2023-11-08T12:30:13.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 shutdown_connections 2023-11-08T12:30:13.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb00c064ee0 0x7fb00c067390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb028160710 0x7fb02815f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0280cc860 0x7fb028159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 --2- 172.21.15.112:0/724783354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0280705c0 0x7fb02815d420 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 >> 172.21.15.112:0/724783354 conn(0x7fb0280b0f80 msgr2=0x7fb028160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:13.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 shutdown_connections 2023-11-08T12:30:13.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.346+0000 7fb02e556700 1 -- 172.21.15.112:0/724783354 wait complete. 2023-11-08T12:30:13.356 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:30:13.377 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-11-08T12:30:12.758318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76400,"kb_used_data":6512,"kb_used_omap":0,"kb_used_meta":69824,"kb_avail":754898320,"statfs":{"total":773094113280,"available":773015879680,"internally_reserved":0,"allocated":6668288,"data_stored":3681938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71499776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.676488"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.576006+0000","last_change":"2023-11-08T12:30:08.582350+0000","last_active":"2023-11-08T12:30:09.576006+0000","last_peered":"2023-11-08T12:30:09.576006+0000","last_clean":"2023-11-08T12:30:09.576006+0000","last_became_active":"2023-11-08T12:30:08.582094+0000","last_became_peered":"2023-11-08T12:30:08.582094+0000","last_unstale":"2023-11-08T12:30:09.576006+0000","last_undegraded":"2023-11-08T12:30:09.576006+0000","last_fullsized":"2023-11-08T12:30:09.576006+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:35:51.811830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574777+0000","last_change":"2023-11-08T12:30:08.584405+0000","last_active":"2023-11-08T12:30:09.574777+0000","last_peered":"2023-11-08T12:30:09.574777+0000","last_clean":"2023-11-08T12:30:09.574777+0000","last_became_active":"2023-11-08T12:30:08.584168+0000","last_became_peered":"2023-11-08T12:30:08.584168+0000","last_unstale":"2023-11-08T12:30:09.574777+0000","last_undegraded":"2023-11-08T12:30:09.574777+0000","last_fullsized":"2023-11-08T12:30:09.574777+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:37:24.595999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212388+0000","last_change":"2023-11-08T12:30:08.584220+0000","last_active":"2023-11-08T12:30:10.212388+0000","last_peered":"2023-11-08T12:30:10.212388+0000","last_clean":"2023-11-08T12:30:10.212388+0000","last_became_active":"2023-11-08T12:30:08.583878+0000","last_became_peered":"2023-11-08T12:30:08.583878+0000","last_unstale":"2023-11-08T12:30:10.212388+0000","last_undegraded":"2023-11-08T12:30:10.212388+0000","last_fullsized":"2023-11-08T12:30:10.212388+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:50.868181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573846+0000","last_change":"2023-11-08T12:30:08.588363+0000","last_active":"2023-11-08T12:30:09.573846+0000","last_peered":"2023-11-08T12:30:09.573846+0000","last_clean":"2023-11-08T12:30:09.573846+0000","last_became_active":"2023-11-08T12:30:08.587811+0000","last_became_peered":"2023-11-08T12:30:08.587811+0000","last_unstale":"2023-11-08T12:30:09.573846+0000","last_undegraded":"2023-11-08T12:30:09.573846+0000","last_fullsized":"2023-11-08T12:30:09.573846+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:30.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574643+0000","last_change":"2023-11-08T12:30:08.582119+0000","last_active":"2023-11-08T12:30:09.574643+0000","last_peered":"2023-11-08T12:30:09.574643+0000","last_clean":"2023-11-08T12:30:09.574643+0000","last_became_active":"2023-11-08T12:30:08.581851+0000","last_became_peered":"2023-11-08T12:30:08.581851+0000","last_unstale":"2023-11-08T12:30:09.574643+0000","last_undegraded":"2023-11-08T12:30:09.574643+0000","last_fullsized":"2023-11-08T12:30:09.574643+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:16:36.942302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295383+0000","last_change":"2023-11-08T12:30:08.586334+0000","last_active":"2023-11-08T12:30:10.295383+0000","last_peered":"2023-11-08T12:30:10.295383+0000","last_clean":"2023-11-08T12:30:10.295383+0000","last_became_active":"2023-11-08T12:30:08.586041+0000","last_became_peered":"2023-11-08T12:30:08.586041+0000","last_unstale":"2023-11-08T12:30:10.295383+0000","last_undegraded":"2023-11-08T12:30:10.295383+0000","last_fullsized":"2023-11-08T12:30:10.295383+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:41:23.814562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294527+0000","last_change":"2023-11-08T12:30:08.584729+0000","last_active":"2023-11-08T12:30:10.294527+0000","last_peered":"2023-11-08T12:30:10.294527+0000","last_clean":"2023-11-08T12:30:10.294527+0000","last_became_active":"2023-11-08T12:30:08.584444+0000","last_became_peered":"2023-11-08T12:30:08.584444+0000","last_unstale":"2023-11-08T12:30:10.294527+0000","last_undegraded":"2023-11-08T12:30:10.294527+0000","last_fullsized":"2023-11-08T12:30:10.294527+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:42.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573686+0000","last_change":"2023-11-08T12:30:08.576383+0000","last_active":"2023-11-08T12:30:09.573686+0000","last_peered":"2023-11-08T12:30:09.573686+0000","last_clean":"2023-11-08T12:30:09.573686+0000","last_became_active":"2023-11-08T12:30:08.576152+0000","last_became_peered":"2023-11-08T12:30:08.576152+0000","last_unstale":"2023-11-08T12:30:09.573686+0000","last_undegraded":"2023-11-08T12:30:09.573686+0000","last_fullsized":"2023-11-08T12:30:09.573686+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:49.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295314+0000","last_change":"2023-11-08T12:30:08.587582+0000","last_active":"2023-11-08T12:30:10.295314+0000","last_peered":"2023-11-08T12:30:10.295314+0000","last_clean":"2023-11-08T12:30:10.295314+0000","last_became_active":"2023-11-08T12:30:08.587264+0000","last_became_peered":"2023-11-08T12:30:08.587264+0000","last_unstale":"2023-11-08T12:30:10.295314+0000","last_undegraded":"2023-11-08T12:30:10.295314+0000","last_fullsized":"2023-11-08T12:30:10.295314+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:43.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705746+0000","last_change":"2023-11-08T12:30:08.596709+0000","last_active":"2023-11-08T12:30:09.705746+0000","last_peered":"2023-11-08T12:30:09.705746+0000","last_clean":"2023-11-08T12:30:09.705746+0000","last_became_active":"2023-11-08T12:30:08.596451+0000","last_became_peered":"2023-11-08T12:30:08.596451+0000","last_unstale":"2023-11-08T12:30:09.705746+0000","last_undegraded":"2023-11-08T12:30:09.705746+0000","last_fullsized":"2023-11-08T12:30:09.705746+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:41:08.548199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705565+0000","last_change":"2023-11-08T12:30:08.585224+0000","last_active":"2023-11-08T12:30:09.705565+0000","last_peered":"2023-11-08T12:30:09.705565+0000","last_clean":"2023-11-08T12:30:09.705565+0000","last_became_active":"2023-11-08T12:30:08.584964+0000","last_became_peered":"2023-11-08T12:30:08.584964+0000","last_unstale":"2023-11-08T12:30:09.705565+0000","last_undegraded":"2023-11-08T12:30:09.705565+0000","last_fullsized":"2023-11-08T12:30:09.705565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:45:05.091731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574043+0000","last_change":"2023-11-08T12:30:08.584676+0000","last_active":"2023-11-08T12:30:09.574043+0000","last_peered":"2023-11-08T12:30:09.574043+0000","last_clean":"2023-11-08T12:30:09.574043+0000","last_became_active":"2023-11-08T12:30:08.584421+0000","last_became_peered":"2023-11-08T12:30:08.584421+0000","last_unstale":"2023-11-08T12:30:09.574043+0000","last_undegraded":"2023-11-08T12:30:09.574043+0000","last_fullsized":"2023-11-08T12:30:09.574043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:28:35.460465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293738+0000","last_change":"2023-11-08T12:30:08.589260+0000","last_active":"2023-11-08T12:30:10.293738+0000","last_peered":"2023-11-08T12:30:10.293738+0000","last_clean":"2023-11-08T12:30:10.293738+0000","last_became_active":"2023-11-08T12:30:08.589002+0000","last_became_peered":"2023-11-08T12:30:08.589002+0000","last_unstale":"2023-11-08T12:30:10.293738+0000","last_undegraded":"2023-11-08T12:30:10.293738+0000","last_fullsized":"2023-11-08T12:30:10.293738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:11:38.611426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294713+0000","last_change":"2023-11-08T12:30:08.581152+0000","last_active":"2023-11-08T12:30:10.294713+0000","last_peered":"2023-11-08T12:30:10.294713+0000","last_clean":"2023-11-08T12:30:10.294713+0000","last_became_active":"2023-11-08T12:30:08.580835+0000","last_became_peered":"2023-11-08T12:30:08.580835+0000","last_unstale":"2023-11-08T12:30:10.294713+0000","last_undegraded":"2023-11-08T12:30:10.294713+0000","last_fullsized":"2023-11-08T12:30:10.294713+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:37:24.595999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294679+0000","last_change":"2023-11-08T12:30:08.577178+0000","last_active":"2023-11-08T12:30:10.294679+0000","last_peered":"2023-11-08T12:30:10.294679+0000","last_clean":"2023-11-08T12:30:10.294679+0000","last_became_active":"2023-11-08T12:30:08.576893+0000","last_became_peered":"2023-11-08T12:30:08.576893+0000","last_unstale":"2023-11-08T12:30:10.294679+0000","last_undegraded":"2023-11-08T12:30:10.294679+0000","last_fullsized":"2023-11-08T12:30:10.294679+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:46:39.202790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295855+0000","last_change":"2023-11-08T12:30:08.600496+0000","last_active":"2023-11-08T12:30:10.295855+0000","last_peered":"2023-11-08T12:30:10.295855+0000","last_clean":"2023-11-08T12:30:10.295855+0000","last_became_active":"2023-11-08T12:30:08.600234+0000","last_became_peered":"2023-11-08T12:30:08.600234+0000","last_unstale":"2023-11-08T12:30:10.295855+0000","last_undegraded":"2023-11-08T12:30:10.295855+0000","last_fullsized":"2023-11-08T12:30:10.295855+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:42.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575220+0000","last_change":"2023-11-08T12:30:08.596536+0000","last_active":"2023-11-08T12:30:09.575220+0000","last_peered":"2023-11-08T12:30:09.575220+0000","last_clean":"2023-11-08T12:30:09.575220+0000","last_became_active":"2023-11-08T12:30:08.596278+0000","last_became_peered":"2023-11-08T12:30:08.596278+0000","last_unstale":"2023-11-08T12:30:09.575220+0000","last_undegraded":"2023-11-08T12:30:09.575220+0000","last_fullsized":"2023-11-08T12:30:09.575220+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:42.700390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212374+0000","last_change":"2023-11-08T12:30:08.586170+0000","last_active":"2023-11-08T12:30:10.212374+0000","last_peered":"2023-11-08T12:30:10.212374+0000","last_clean":"2023-11-08T12:30:10.212374+0000","last_became_active":"2023-11-08T12:30:08.585921+0000","last_became_peered":"2023-11-08T12:30:08.585921+0000","last_unstale":"2023-11-08T12:30:10.212374+0000","last_undegraded":"2023-11-08T12:30:10.212374+0000","last_fullsized":"2023-11-08T12:30:10.212374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:35.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575160+0000","last_change":"2023-11-08T12:30:08.582334+0000","last_active":"2023-11-08T12:30:09.575160+0000","last_peered":"2023-11-08T12:30:09.575160+0000","last_clean":"2023-11-08T12:30:09.575160+0000","last_became_active":"2023-11-08T12:30:08.582078+0000","last_became_peered":"2023-11-08T12:30:08.582078+0000","last_unstale":"2023-11-08T12:30:09.575160+0000","last_undegraded":"2023-11-08T12:30:09.575160+0000","last_fullsized":"2023-11-08T12:30:09.575160+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:54:01.415506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574527+0000","last_change":"2023-11-08T12:30:08.587835+0000","last_active":"2023-11-08T12:30:09.574527+0000","last_peered":"2023-11-08T12:30:09.574527+0000","last_clean":"2023-11-08T12:30:09.574527+0000","last_became_active":"2023-11-08T12:30:08.587589+0000","last_became_peered":"2023-11-08T12:30:08.587589+0000","last_unstale":"2023-11-08T12:30:09.574527+0000","last_undegraded":"2023-11-08T12:30:09.574527+0000","last_fullsized":"2023-11-08T12:30:09.574527+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:22:31.239034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211718+0000","last_change":"2023-11-08T12:30:08.588536+0000","last_active":"2023-11-08T12:30:10.211718+0000","last_peered":"2023-11-08T12:30:10.211718+0000","last_clean":"2023-11-08T12:30:10.211718+0000","last_became_active":"2023-11-08T12:30:08.586938+0000","last_became_peered":"2023-11-08T12:30:08.586938+0000","last_unstale":"2023-11-08T12:30:10.211718+0000","last_undegraded":"2023-11-08T12:30:10.211718+0000","last_fullsized":"2023-11-08T12:30:10.211718+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:30.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573821+0000","last_change":"2023-11-08T12:30:08.571264+0000","last_active":"2023-11-08T12:30:09.573821+0000","last_peered":"2023-11-08T12:30:09.573821+0000","last_clean":"2023-11-08T12:30:09.573821+0000","last_became_active":"2023-11-08T12:30:08.570827+0000","last_became_peered":"2023-11-08T12:30:08.570827+0000","last_unstale":"2023-11-08T12:30:09.573821+0000","last_undegraded":"2023-11-08T12:30:09.573821+0000","last_fullsized":"2023-11-08T12:30:09.573821+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:37:37.298894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211726+0000","last_change":"2023-11-08T12:30:08.583499+0000","last_active":"2023-11-08T12:30:10.211726+0000","last_peered":"2023-11-08T12:30:10.211726+0000","last_clean":"2023-11-08T12:30:10.211726+0000","last_became_active":"2023-11-08T12:30:08.582860+0000","last_became_peered":"2023-11-08T12:30:08.582860+0000","last_unstale":"2023-11-08T12:30:10.211726+0000","last_undegraded":"2023-11-08T12:30:10.211726+0000","last_fullsized":"2023-11-08T12:30:10.211726+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:03.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293251+0000","last_change":"2023-11-08T12:30:08.588651+0000","last_active":"2023-11-08T12:30:10.293251+0000","last_peered":"2023-11-08T12:30:10.293251+0000","last_clean":"2023-11-08T12:30:10.293251+0000","last_became_active":"2023-11-08T12:30:08.588267+0000","last_became_peered":"2023-11-08T12:30:08.588267+0000","last_unstale":"2023-11-08T12:30:10.293251+0000","last_undegraded":"2023-11-08T12:30:10.293251+0000","last_fullsized":"2023-11-08T12:30:10.293251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:46:37.236843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575998+0000","last_change":"2023-11-08T12:30:08.592939+0000","last_active":"2023-11-08T12:30:09.575998+0000","last_peered":"2023-11-08T12:30:09.575998+0000","last_clean":"2023-11-08T12:30:09.575998+0000","last_became_active":"2023-11-08T12:30:08.592724+0000","last_became_peered":"2023-11-08T12:30:08.592724+0000","last_unstale":"2023-11-08T12:30:09.575998+0000","last_undegraded":"2023-11-08T12:30:09.575998+0000","last_fullsized":"2023-11-08T12:30:09.575998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:40:24.943449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574178+0000","last_change":"2023-11-08T12:30:08.583570+0000","last_active":"2023-11-08T12:30:09.574178+0000","last_peered":"2023-11-08T12:30:09.574178+0000","last_clean":"2023-11-08T12:30:09.574178+0000","last_became_active":"2023-11-08T12:30:08.583263+0000","last_became_peered":"2023-11-08T12:30:08.583263+0000","last_unstale":"2023-11-08T12:30:09.574178+0000","last_undegraded":"2023-11-08T12:30:09.574178+0000","last_fullsized":"2023-11-08T12:30:09.574178+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:17:45.931548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295549+0000","last_change":"2023-11-08T12:30:08.599024+0000","last_active":"2023-11-08T12:30:10.295549+0000","last_peered":"2023-11-08T12:30:10.295549+0000","last_clean":"2023-11-08T12:30:10.295549+0000","last_became_active":"2023-11-08T12:30:08.598725+0000","last_became_peered":"2023-11-08T12:30:08.598725+0000","last_unstale":"2023-11-08T12:30:10.295549+0000","last_undegraded":"2023-11-08T12:30:10.295549+0000","last_fullsized":"2023-11-08T12:30:10.295549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:43.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575102+0000","last_change":"2023-11-08T12:30:08.592138+0000","last_active":"2023-11-08T12:30:09.575102+0000","last_peered":"2023-11-08T12:30:09.575102+0000","last_clean":"2023-11-08T12:30:09.575102+0000","last_became_active":"2023-11-08T12:30:08.591859+0000","last_became_peered":"2023-11-08T12:30:08.591859+0000","last_unstale":"2023-11-08T12:30:09.575102+0000","last_undegraded":"2023-11-08T12:30:09.575102+0000","last_fullsized":"2023-11-08T12:30:09.575102+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:48:50.253408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574500+0000","last_change":"2023-11-08T12:30:08.583551+0000","last_active":"2023-11-08T12:30:09.574500+0000","last_peered":"2023-11-08T12:30:09.574500+0000","last_clean":"2023-11-08T12:30:09.574500+0000","last_became_active":"2023-11-08T12:30:08.583062+0000","last_became_peered":"2023-11-08T12:30:08.583062+0000","last_unstale":"2023-11-08T12:30:09.574500+0000","last_undegraded":"2023-11-08T12:30:09.574500+0000","last_fullsized":"2023-11-08T12:30:09.574500+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:58:32.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211793+0000","last_change":"2023-11-08T12:30:08.579341+0000","last_active":"2023-11-08T12:30:10.211793+0000","last_peered":"2023-11-08T12:30:10.211793+0000","last_clean":"2023-11-08T12:30:10.211793+0000","last_became_active":"2023-11-08T12:30:08.578618+0000","last_became_peered":"2023-11-08T12:30:08.578618+0000","last_unstale":"2023-11-08T12:30:10.211793+0000","last_undegraded":"2023-11-08T12:30:10.211793+0000","last_fullsized":"2023-11-08T12:30:10.211793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:16:54.204347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574546+0000","last_change":"2023-11-08T12:30:08.580835+0000","last_active":"2023-11-08T12:30:09.574546+0000","last_peered":"2023-11-08T12:30:09.574546+0000","last_clean":"2023-11-08T12:30:09.574546+0000","last_became_active":"2023-11-08T12:30:08.580577+0000","last_became_peered":"2023-11-08T12:30:08.580577+0000","last_unstale":"2023-11-08T12:30:09.574546+0000","last_undegraded":"2023-11-08T12:30:09.574546+0000","last_fullsized":"2023-11-08T12:30:09.574546+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:05:30.985290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295671+0000","last_change":"2023-11-08T12:30:08.587775+0000","last_active":"2023-11-08T12:30:10.295671+0000","last_peered":"2023-11-08T12:30:10.295671+0000","last_clean":"2023-11-08T12:30:10.295671+0000","last_became_active":"2023-11-08T12:30:08.587385+0000","last_became_peered":"2023-11-08T12:30:08.587385+0000","last_unstale":"2023-11-08T12:30:10.295671+0000","last_undegraded":"2023-11-08T12:30:10.295671+0000","last_fullsized":"2023-11-08T12:30:10.295671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:31.740666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296299+0000","last_change":"2023-11-08T12:30:08.586032+0000","last_active":"2023-11-08T12:30:10.296299+0000","last_peered":"2023-11-08T12:30:10.296299+0000","last_clean":"2023-11-08T12:30:10.296299+0000","last_became_active":"2023-11-08T12:30:08.585739+0000","last_became_peered":"2023-11-08T12:30:08.585739+0000","last_unstale":"2023-11-08T12:30:10.296299+0000","last_undegraded":"2023-11-08T12:30:10.296299+0000","last_fullsized":"2023-11-08T12:30:10.296299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:37:24.595999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296354+0000","last_change":"2023-11-08T12:30:08.119391+0000","last_active":"2023-11-08T12:30:10.296354+0000","last_peered":"2023-11-08T12:30:10.296354+0000","last_clean":"2023-11-08T12:30:10.296354+0000","last_became_active":"2023-11-08T12:30:08.118948+0000","last_became_peered":"2023-11-08T12:30:08.118948+0000","last_unstale":"2023-11-08T12:30:10.296354+0000","last_undegraded":"2023-11-08T12:30:10.296354+0000","last_fullsized":"2023-11-08T12:30:10.296354+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:55:30.314695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.706115+0000","last_change":"2023-11-08T12:30:08.585789+0000","last_active":"2023-11-08T12:30:09.706115+0000","last_peered":"2023-11-08T12:30:09.706115+0000","last_clean":"2023-11-08T12:30:09.706115+0000","last_became_active":"2023-11-08T12:30:08.585376+0000","last_became_peered":"2023-11-08T12:30:08.585376+0000","last_unstale":"2023-11-08T12:30:09.706115+0000","last_undegraded":"2023-11-08T12:30:09.706115+0000","last_fullsized":"2023-11-08T12:30:09.706115+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:49.413521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574991+0000","last_change":"2023-11-08T12:30:08.116121+0000","last_active":"2023-11-08T12:30:09.574991+0000","last_peered":"2023-11-08T12:30:09.574991+0000","last_clean":"2023-11-08T12:30:09.574991+0000","last_became_active":"2023-11-08T12:30:08.115855+0000","last_became_peered":"2023-11-08T12:30:08.115855+0000","last_unstale":"2023-11-08T12:30:09.574991+0000","last_undegraded":"2023-11-08T12:30:09.574991+0000","last_fullsized":"2023-11-08T12:30:09.574991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:49.855133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295549+0000","last_change":"2023-11-08T12:30:08.586375+0000","last_active":"2023-11-08T12:30:10.295549+0000","last_peered":"2023-11-08T12:30:10.295549+0000","last_clean":"2023-11-08T12:30:10.295549+0000","last_became_active":"2023-11-08T12:30:08.585553+0000","last_became_peered":"2023-11-08T12:30:08.585553+0000","last_unstale":"2023-11-08T12:30:10.295549+0000","last_undegraded":"2023-11-08T12:30:10.295549+0000","last_fullsized":"2023-11-08T12:30:10.295549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:46:39.202790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295763+0000","last_change":"2023-11-08T12:30:08.123609+0000","last_active":"2023-11-08T12:30:10.295763+0000","last_peered":"2023-11-08T12:30:10.295763+0000","last_clean":"2023-11-08T12:30:10.295763+0000","last_became_active":"2023-11-08T12:30:08.123143+0000","last_became_peered":"2023-11-08T12:30:08.123143+0000","last_unstale":"2023-11-08T12:30:10.295763+0000","last_undegraded":"2023-11-08T12:30:10.295763+0000","last_fullsized":"2023-11-08T12:30:10.295763+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:17:44.918499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296002+0000","last_change":"2023-11-08T12:30:08.588910+0000","last_active":"2023-11-08T12:30:10.296002+0000","last_peered":"2023-11-08T12:30:10.296002+0000","last_clean":"2023-11-08T12:30:10.296002+0000","last_became_active":"2023-11-08T12:30:08.588300+0000","last_became_peered":"2023-11-08T12:30:08.588300+0000","last_unstale":"2023-11-08T12:30:10.296002+0000","last_undegraded":"2023-11-08T12:30:10.296002+0000","last_fullsized":"2023-11-08T12:30:10.296002+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:22:31.239034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574073+0000","last_change":"2023-11-08T12:30:08.117785+0000","last_active":"2023-11-08T12:30:09.574073+0000","last_peered":"2023-11-08T12:30:09.574073+0000","last_clean":"2023-11-08T12:30:09.574073+0000","last_became_active":"2023-11-08T12:30:08.117537+0000","last_became_peered":"2023-11-08T12:30:08.117537+0000","last_unstale":"2023-11-08T12:30:09.574073+0000","last_undegraded":"2023-11-08T12:30:09.574073+0000","last_fullsized":"2023-11-08T12:30:09.574073+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:54:29.272416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574268+0000","last_change":"2023-11-08T12:30:08.570793+0000","last_active":"2023-11-08T12:30:09.574268+0000","last_peered":"2023-11-08T12:30:09.574268+0000","last_clean":"2023-11-08T12:30:09.574268+0000","last_became_active":"2023-11-08T12:30:08.570529+0000","last_became_peered":"2023-11-08T12:30:08.570529+0000","last_unstale":"2023-11-08T12:30:09.574268+0000","last_undegraded":"2023-11-08T12:30:09.574268+0000","last_fullsized":"2023-11-08T12:30:09.574268+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:15:09.415684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294923+0000","last_change":"2023-11-08T12:30:08.119322+0000","last_active":"2023-11-08T12:30:10.294923+0000","last_peered":"2023-11-08T12:30:10.294923+0000","last_clean":"2023-11-08T12:30:10.294923+0000","last_became_active":"2023-11-08T12:30:08.119050+0000","last_became_peered":"2023-11-08T12:30:08.119050+0000","last_unstale":"2023-11-08T12:30:10.294923+0000","last_undegraded":"2023-11-08T12:30:10.294923+0000","last_fullsized":"2023-11-08T12:30:10.294923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:46:31.489528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574384+0000","last_change":"2023-11-08T12:30:08.583328+0000","last_active":"2023-11-08T12:30:09.574384+0000","last_peered":"2023-11-08T12:30:09.574384+0000","last_clean":"2023-11-08T12:30:09.574384+0000","last_became_active":"2023-11-08T12:30:08.582602+0000","last_became_peered":"2023-11-08T12:30:08.582602+0000","last_unstale":"2023-11-08T12:30:09.574384+0000","last_undegraded":"2023-11-08T12:30:09.574384+0000","last_fullsized":"2023-11-08T12:30:09.574384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:41:23.814562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295937+0000","last_change":"2023-11-08T12:30:08.118268+0000","last_active":"2023-11-08T12:30:10.295937+0000","last_peered":"2023-11-08T12:30:10.295937+0000","last_clean":"2023-11-08T12:30:10.295937+0000","last_became_active":"2023-11-08T12:30:08.118011+0000","last_became_peered":"2023-11-08T12:30:08.118011+0000","last_unstale":"2023-11-08T12:30:10.295937+0000","last_undegraded":"2023-11-08T12:30:10.295937+0000","last_fullsized":"2023-11-08T12:30:10.295937+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:19:37.656426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293809+0000","last_change":"2023-11-08T12:30:08.588492+0000","last_active":"2023-11-08T12:30:10.293809+0000","last_peered":"2023-11-08T12:30:10.293809+0000","last_clean":"2023-11-08T12:30:10.293809+0000","last_became_active":"2023-11-08T12:30:08.587983+0000","last_became_peered":"2023-11-08T12:30:08.587983+0000","last_unstale":"2023-11-08T12:30:10.293809+0000","last_undegraded":"2023-11-08T12:30:10.293809+0000","last_fullsized":"2023-11-08T12:30:10.293809+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:34:40.451255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573680+0000","last_change":"2023-11-08T12:30:08.114618+0000","last_active":"2023-11-08T12:30:09.573680+0000","last_peered":"2023-11-08T12:30:09.573680+0000","last_clean":"2023-11-08T12:30:09.573680+0000","last_became_active":"2023-11-08T12:30:08.114289+0000","last_became_peered":"2023-11-08T12:30:08.114289+0000","last_unstale":"2023-11-08T12:30:09.573680+0000","last_undegraded":"2023-11-08T12:30:09.573680+0000","last_fullsized":"2023-11-08T12:30:09.573680+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:29:22.904407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574035+0000","last_change":"2023-11-08T12:30:08.592897+0000","last_active":"2023-11-08T12:30:09.574035+0000","last_peered":"2023-11-08T12:30:09.574035+0000","last_clean":"2023-11-08T12:30:09.574035+0000","last_became_active":"2023-11-08T12:30:08.592573+0000","last_became_peered":"2023-11-08T12:30:08.592573+0000","last_unstale":"2023-11-08T12:30:09.574035+0000","last_undegraded":"2023-11-08T12:30:09.574035+0000","last_fullsized":"2023-11-08T12:30:09.574035+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:31.740666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294572+0000","last_change":"2023-11-08T12:30:08.110267+0000","last_active":"2023-11-08T12:30:10.294572+0000","last_peered":"2023-11-08T12:30:10.294572+0000","last_clean":"2023-11-08T12:30:10.294572+0000","last_became_active":"2023-11-08T12:30:08.109966+0000","last_became_peered":"2023-11-08T12:30:08.109966+0000","last_unstale":"2023-11-08T12:30:10.294572+0000","last_undegraded":"2023-11-08T12:30:10.294572+0000","last_fullsized":"2023-11-08T12:30:10.294572+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:58:26.814028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295511+0000","last_change":"2023-11-08T12:30:08.585729+0000","last_active":"2023-11-08T12:30:10.295511+0000","last_peered":"2023-11-08T12:30:10.295511+0000","last_clean":"2023-11-08T12:30:10.295511+0000","last_became_active":"2023-11-08T12:30:08.585441+0000","last_became_peered":"2023-11-08T12:30:08.585441+0000","last_unstale":"2023-11-08T12:30:10.295511+0000","last_undegraded":"2023-11-08T12:30:10.295511+0000","last_fullsized":"2023-11-08T12:30:10.295511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:58:32.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212578+0000","last_change":"2023-11-08T12:30:08.123965+0000","last_active":"2023-11-08T12:30:10.212578+0000","last_peered":"2023-11-08T12:30:10.212578+0000","last_clean":"2023-11-08T12:30:10.212578+0000","last_became_active":"2023-11-08T12:30:08.122709+0000","last_became_peered":"2023-11-08T12:30:08.122709+0000","last_unstale":"2023-11-08T12:30:10.212578+0000","last_undegraded":"2023-11-08T12:30:10.212578+0000","last_fullsized":"2023-11-08T12:30:10.212578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:59:59.434658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212387+0000","last_change":"2023-11-08T12:30:08.591890+0000","last_active":"2023-11-08T12:30:10.212387+0000","last_peered":"2023-11-08T12:30:10.212387+0000","last_clean":"2023-11-08T12:30:10.212387+0000","last_became_active":"2023-11-08T12:30:08.591383+0000","last_became_peered":"2023-11-08T12:30:08.591383+0000","last_unstale":"2023-11-08T12:30:10.212387+0000","last_undegraded":"2023-11-08T12:30:10.212387+0000","last_fullsized":"2023-11-08T12:30:10.212387+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:59:25.307873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575127+0000","last_change":"2023-11-08T12:30:08.121370+0000","last_active":"2023-11-08T12:30:09.575127+0000","last_peered":"2023-11-08T12:30:09.575127+0000","last_clean":"2023-11-08T12:30:09.575127+0000","last_became_active":"2023-11-08T12:30:08.121084+0000","last_became_peered":"2023-11-08T12:30:08.121084+0000","last_unstale":"2023-11-08T12:30:09.575127+0000","last_undegraded":"2023-11-08T12:30:09.575127+0000","last_fullsized":"2023-11-08T12:30:09.575127+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:26:20.552379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705339+0000","last_change":"2023-11-08T12:30:08.590433+0000","last_active":"2023-11-08T12:30:09.705339+0000","last_peered":"2023-11-08T12:30:09.705339+0000","last_clean":"2023-11-08T12:30:09.705339+0000","last_became_active":"2023-11-08T12:30:08.590106+0000","last_became_peered":"2023-11-08T12:30:08.590106+0000","last_unstale":"2023-11-08T12:30:09.705339+0000","last_undegraded":"2023-11-08T12:30:09.705339+0000","last_fullsized":"2023-11-08T12:30:09.705339+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:19:16.704018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212764+0000","last_change":"2023-11-08T12:30:08.117068+0000","last_active":"2023-11-08T12:30:10.212764+0000","last_peered":"2023-11-08T12:30:10.212764+0000","last_clean":"2023-11-08T12:30:10.212764+0000","last_became_active":"2023-11-08T12:30:08.116628+0000","last_became_peered":"2023-11-08T12:30:08.116628+0000","last_unstale":"2023-11-08T12:30:10.212764+0000","last_undegraded":"2023-11-08T12:30:10.212764+0000","last_fullsized":"2023-11-08T12:30:10.212764+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:54.446943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212610+0000","last_change":"2023-11-08T12:30:08.593234+0000","last_active":"2023-11-08T12:30:10.212610+0000","last_peered":"2023-11-08T12:30:10.212610+0000","last_clean":"2023-11-08T12:30:10.212610+0000","last_became_active":"2023-11-08T12:30:08.592657+0000","last_became_peered":"2023-11-08T12:30:08.592657+0000","last_unstale":"2023-11-08T12:30:10.212610+0000","last_undegraded":"2023-11-08T12:30:10.212610+0000","last_fullsized":"2023-11-08T12:30:10.212610+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:42.001126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295227+0000","last_change":"2023-11-08T12:30:08.123237+0000","last_active":"2023-11-08T12:30:10.295227+0000","last_peered":"2023-11-08T12:30:10.295227+0000","last_clean":"2023-11-08T12:30:10.295227+0000","last_became_active":"2023-11-08T12:30:08.122929+0000","last_became_peered":"2023-11-08T12:30:08.122929+0000","last_unstale":"2023-11-08T12:30:10.295227+0000","last_undegraded":"2023-11-08T12:30:10.295227+0000","last_fullsized":"2023-11-08T12:30:10.295227+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:49:29.906441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573521+0000","last_change":"2023-11-08T12:30:08.593870+0000","last_active":"2023-11-08T12:30:09.573521+0000","last_peered":"2023-11-08T12:30:09.573521+0000","last_clean":"2023-11-08T12:30:09.573521+0000","last_became_active":"2023-11-08T12:30:08.591916+0000","last_became_peered":"2023-11-08T12:30:08.591916+0000","last_unstale":"2023-11-08T12:30:09.573521+0000","last_undegraded":"2023-11-08T12:30:09.573521+0000","last_fullsized":"2023-11-08T12:30:09.573521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:50.868181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574433+0000","last_change":"2023-11-08T12:30:08.122173+0000","last_active":"2023-11-08T12:30:09.574433+0000","last_peered":"2023-11-08T12:30:09.574433+0000","last_clean":"2023-11-08T12:30:09.574433+0000","last_became_active":"2023-11-08T12:30:08.121922+0000","last_became_peered":"2023-11-08T12:30:08.121922+0000","last_unstale":"2023-11-08T12:30:09.574433+0000","last_undegraded":"2023-11-08T12:30:09.574433+0000","last_fullsized":"2023-11-08T12:30:09.574433+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:59:24.294825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211980+0000","last_change":"2023-11-08T12:30:08.594382+0000","last_active":"2023-11-08T12:30:10.211980+0000","last_peered":"2023-11-08T12:30:10.211980+0000","last_clean":"2023-11-08T12:30:10.211980+0000","last_became_active":"2023-11-08T12:30:08.594106+0000","last_became_peered":"2023-11-08T12:30:08.594106+0000","last_unstale":"2023-11-08T12:30:10.211980+0000","last_undegraded":"2023-11-08T12:30:10.211980+0000","last_fullsized":"2023-11-08T12:30:10.211980+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:19:38.669475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293445+0000","last_change":"2023-11-08T12:30:08.120549+0000","last_active":"2023-11-08T12:30:10.293445+0000","last_peered":"2023-11-08T12:30:10.293445+0000","last_clean":"2023-11-08T12:30:10.293445+0000","last_became_active":"2023-11-08T12:30:08.120273+0000","last_became_peered":"2023-11-08T12:30:08.120273+0000","last_unstale":"2023-11-08T12:30:10.293445+0000","last_undegraded":"2023-11-08T12:30:10.293445+0000","last_fullsized":"2023-11-08T12:30:10.293445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:36:38.025698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294451+0000","last_change":"2023-11-08T12:30:08.586622+0000","last_active":"2023-11-08T12:30:10.294451+0000","last_peered":"2023-11-08T12:30:10.294451+0000","last_clean":"2023-11-08T12:30:10.294451+0000","last_became_active":"2023-11-08T12:30:08.584517+0000","last_became_peered":"2023-11-08T12:30:08.584517+0000","last_unstale":"2023-11-08T12:30:10.294451+0000","last_undegraded":"2023-11-08T12:30:10.294451+0000","last_fullsized":"2023-11-08T12:30:10.294451+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:49.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573753+0000","last_change":"2023-11-08T12:30:08.116865+0000","last_active":"2023-11-08T12:30:09.573753+0000","last_peered":"2023-11-08T12:30:09.573753+0000","last_clean":"2023-11-08T12:30:09.573753+0000","last_became_active":"2023-11-08T12:30:08.116381+0000","last_became_peered":"2023-11-08T12:30:08.116381+0000","last_unstale":"2023-11-08T12:30:09.573753+0000","last_undegraded":"2023-11-08T12:30:09.573753+0000","last_fullsized":"2023-11-08T12:30:09.573753+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:13:08.794185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211963+0000","last_change":"2023-11-08T12:30:08.583730+0000","last_active":"2023-11-08T12:30:10.211963+0000","last_peered":"2023-11-08T12:30:10.211963+0000","last_clean":"2023-11-08T12:30:10.211963+0000","last_became_active":"2023-11-08T12:30:08.583218+0000","last_became_peered":"2023-11-08T12:30:08.583218+0000","last_unstale":"2023-11-08T12:30:10.211963+0000","last_undegraded":"2023-11-08T12:30:10.211963+0000","last_fullsized":"2023-11-08T12:30:10.211963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:55:31.327743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.211808+0000","last_change":"2023-11-08T12:30:08.122958+0000","last_active":"2023-11-08T12:30:10.211808+0000","last_peered":"2023-11-08T12:30:10.211808+0000","last_clean":"2023-11-08T12:30:10.211808+0000","last_became_active":"2023-11-08T12:30:08.122707+0000","last_became_peered":"2023-11-08T12:30:08.122707+0000","last_unstale":"2023-11-08T12:30:10.211808+0000","last_undegraded":"2023-11-08T12:30:10.211808+0000","last_fullsized":"2023-11-08T12:30:10.211808+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:19:15.690970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574180+0000","last_change":"2023-11-08T12:30:08.588816+0000","last_active":"2023-11-08T12:30:09.574180+0000","last_peered":"2023-11-08T12:30:09.574180+0000","last_clean":"2023-11-08T12:30:09.574180+0000","last_became_active":"2023-11-08T12:30:08.588271+0000","last_became_peered":"2023-11-08T12:30:08.588271+0000","last_unstale":"2023-11-08T12:30:09.574180+0000","last_undegraded":"2023-11-08T12:30:09.574180+0000","last_fullsized":"2023-11-08T12:30:09.574180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:03.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.706174+0000","last_change":"2023-11-08T12:30:08.109299+0000","last_active":"2023-11-08T12:30:09.706174+0000","last_peered":"2023-11-08T12:30:09.706174+0000","last_clean":"2023-11-08T12:30:09.706174+0000","last_became_active":"2023-11-08T12:30:08.109042+0000","last_became_peered":"2023-11-08T12:30:08.109042+0000","last_unstale":"2023-11-08T12:30:09.706174+0000","last_undegraded":"2023-11-08T12:30:09.706174+0000","last_fullsized":"2023-11-08T12:30:09.706174+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:34:39.438206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574437+0000","last_change":"2023-11-08T12:30:08.589963+0000","last_active":"2023-11-08T12:30:09.574437+0000","last_peered":"2023-11-08T12:30:09.574437+0000","last_clean":"2023-11-08T12:30:09.574437+0000","last_became_active":"2023-11-08T12:30:08.589668+0000","last_became_peered":"2023-11-08T12:30:08.589668+0000","last_unstale":"2023-11-08T12:30:09.574437+0000","last_undegraded":"2023-11-08T12:30:09.574437+0000","last_fullsized":"2023-11-08T12:30:09.574437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:19:38.669475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296251+0000","last_change":"2023-11-08T12:30:08.117647+0000","last_active":"2023-11-08T12:30:10.296251+0000","last_peered":"2023-11-08T12:30:10.296251+0000","last_clean":"2023-11-08T12:30:10.296251+0000","last_became_active":"2023-11-08T12:30:08.117074+0000","last_became_peered":"2023-11-08T12:30:08.117074+0000","last_unstale":"2023-11-08T12:30:10.296251+0000","last_undegraded":"2023-11-08T12:30:10.296251+0000","last_fullsized":"2023-11-08T12:30:10.296251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:02.064313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705510+0000","last_change":"2023-11-08T12:30:08.583420+0000","last_active":"2023-11-08T12:30:09.705510+0000","last_peered":"2023-11-08T12:30:09.705510+0000","last_clean":"2023-11-08T12:30:09.705510+0000","last_became_active":"2023-11-08T12:30:08.582110+0000","last_became_peered":"2023-11-08T12:30:08.582110+0000","last_unstale":"2023-11-08T12:30:09.705510+0000","last_undegraded":"2023-11-08T12:30:09.705510+0000","last_fullsized":"2023-11-08T12:30:09.705510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:57:01.914196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293837+0000","last_change":"2023-11-08T12:30:08.119964+0000","last_active":"2023-11-08T12:30:10.293837+0000","last_peered":"2023-11-08T12:30:10.293837+0000","last_clean":"2023-11-08T12:30:10.293837+0000","last_became_active":"2023-11-08T12:30:08.119485+0000","last_became_peered":"2023-11-08T12:30:08.119485+0000","last_unstale":"2023-11-08T12:30:10.293837+0000","last_undegraded":"2023-11-08T12:30:10.293837+0000","last_fullsized":"2023-11-08T12:30:10.293837+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:58:15.638430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295885+0000","last_change":"2023-11-08T12:30:08.588959+0000","last_active":"2023-11-08T12:30:10.295885+0000","last_peered":"2023-11-08T12:30:10.295885+0000","last_clean":"2023-11-08T12:30:10.295885+0000","last_became_active":"2023-11-08T12:30:08.588669+0000","last_became_peered":"2023-11-08T12:30:08.588669+0000","last_unstale":"2023-11-08T12:30:10.295885+0000","last_undegraded":"2023-11-08T12:30:10.295885+0000","last_fullsized":"2023-11-08T12:30:10.295885+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:15:09.415684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574198+0000","last_change":"2023-11-08T12:30:08.113392+0000","last_active":"2023-11-08T12:30:09.574198+0000","last_peered":"2023-11-08T12:30:09.574198+0000","last_clean":"2023-11-08T12:30:09.574198+0000","last_became_active":"2023-11-08T12:30:08.113084+0000","last_became_peered":"2023-11-08T12:30:08.113084+0000","last_unstale":"2023-11-08T12:30:09.574198+0000","last_undegraded":"2023-11-08T12:30:09.574198+0000","last_fullsized":"2023-11-08T12:30:09.574198+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:32:25.242523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574259+0000","last_change":"2023-11-08T12:30:08.577822+0000","last_active":"2023-11-08T12:30:09.574259+0000","last_peered":"2023-11-08T12:30:09.574259+0000","last_clean":"2023-11-08T12:30:09.574259+0000","last_became_active":"2023-11-08T12:30:08.577555+0000","last_became_peered":"2023-11-08T12:30:08.577555+0000","last_unstale":"2023-11-08T12:30:09.574259+0000","last_undegraded":"2023-11-08T12:30:09.574259+0000","last_fullsized":"2023-11-08T12:30:09.574259+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:15:31.145343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.704957+0000","last_change":"2023-11-08T12:30:08.118004+0000","last_active":"2023-11-08T12:30:09.704957+0000","last_peered":"2023-11-08T12:30:09.704957+0000","last_clean":"2023-11-08T12:30:09.704957+0000","last_became_active":"2023-11-08T12:30:08.117650+0000","last_became_peered":"2023-11-08T12:30:08.117650+0000","last_unstale":"2023-11-08T12:30:09.704957+0000","last_undegraded":"2023-11-08T12:30:09.704957+0000","last_fullsized":"2023-11-08T12:30:09.704957+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:20:39.706967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212177+0000","last_change":"2023-11-08T12:30:08.583940+0000","last_active":"2023-11-08T12:30:10.212177+0000","last_peered":"2023-11-08T12:30:10.212177+0000","last_clean":"2023-11-08T12:30:10.212177+0000","last_became_active":"2023-11-08T12:30:08.583157+0000","last_became_peered":"2023-11-08T12:30:08.583157+0000","last_unstale":"2023-11-08T12:30:10.212177+0000","last_undegraded":"2023-11-08T12:30:10.212177+0000","last_fullsized":"2023-11-08T12:30:10.212177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:28:35.460465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.294920+0000","last_change":"2023-11-08T12:30:08.121097+0000","last_active":"2023-11-08T12:30:10.294920+0000","last_peered":"2023-11-08T12:30:10.294920+0000","last_clean":"2023-11-08T12:30:10.294920+0000","last_became_active":"2023-11-08T12:30:08.120423+0000","last_became_peered":"2023-11-08T12:30:08.120423+0000","last_unstale":"2023-11-08T12:30:10.294920+0000","last_undegraded":"2023-11-08T12:30:10.294920+0000","last_fullsized":"2023-11-08T12:30:10.294920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:28:34.447416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.704874+0000","last_change":"2023-11-08T12:30:08.600600+0000","last_active":"2023-11-08T12:30:09.704874+0000","last_peered":"2023-11-08T12:30:09.704874+0000","last_clean":"2023-11-08T12:30:09.704874+0000","last_became_active":"2023-11-08T12:30:08.600380+0000","last_became_peered":"2023-11-08T12:30:08.600380+0000","last_unstale":"2023-11-08T12:30:09.704874+0000","last_undegraded":"2023-11-08T12:30:09.704874+0000","last_fullsized":"2023-11-08T12:30:09.704874+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:41:55.459991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705093+0000","last_change":"2023-11-08T12:30:08.125976+0000","last_active":"2023-11-08T12:30:09.705093+0000","last_peered":"2023-11-08T12:30:09.705093+0000","last_clean":"2023-11-08T12:30:09.705093+0000","last_became_active":"2023-11-08T12:30:08.123083+0000","last_became_peered":"2023-11-08T12:30:08.123083+0000","last_unstale":"2023-11-08T12:30:09.705093+0000","last_undegraded":"2023-11-08T12:30:09.705093+0000","last_fullsized":"2023-11-08T12:30:09.705093+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:24:03.313079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573974+0000","last_change":"2023-11-08T12:30:08.592915+0000","last_active":"2023-11-08T12:30:09.573974+0000","last_peered":"2023-11-08T12:30:09.573974+0000","last_clean":"2023-11-08T12:30:09.573974+0000","last_became_active":"2023-11-08T12:30:08.592679+0000","last_became_peered":"2023-11-08T12:30:08.592679+0000","last_unstale":"2023-11-08T12:30:09.573974+0000","last_undegraded":"2023-11-08T12:30:09.573974+0000","last_fullsized":"2023-11-08T12:30:09.573974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:09:43.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573860+0000","last_change":"2023-11-08T12:30:08.113222+0000","last_active":"2023-11-08T12:30:09.573860+0000","last_peered":"2023-11-08T12:30:09.573860+0000","last_clean":"2023-11-08T12:30:09.573860+0000","last_became_active":"2023-11-08T12:30:08.112822+0000","last_became_peered":"2023-11-08T12:30:08.112822+0000","last_unstale":"2023-11-08T12:30:09.573860+0000","last_undegraded":"2023-11-08T12:30:09.573860+0000","last_fullsized":"2023-11-08T12:30:09.573860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:16:53.191299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574670+0000","last_change":"2023-11-08T12:30:08.578858+0000","last_active":"2023-11-08T12:30:09.574670+0000","last_peered":"2023-11-08T12:30:09.574670+0000","last_clean":"2023-11-08T12:30:09.574670+0000","last_became_active":"2023-11-08T12:30:08.578592+0000","last_became_peered":"2023-11-08T12:30:08.578592+0000","last_unstale":"2023-11-08T12:30:09.574670+0000","last_undegraded":"2023-11-08T12:30:09.574670+0000","last_fullsized":"2023-11-08T12:30:09.574670+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:46:39.202790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574195+0000","last_change":"2023-11-08T12:30:08.116736+0000","last_active":"2023-11-08T12:30:09.574195+0000","last_peered":"2023-11-08T12:30:09.574195+0000","last_clean":"2023-11-08T12:30:09.574195+0000","last_became_active":"2023-11-08T12:30:08.116460+0000","last_became_peered":"2023-11-08T12:30:08.116460+0000","last_unstale":"2023-11-08T12:30:09.574195+0000","last_undegraded":"2023-11-08T12:30:09.574195+0000","last_fullsized":"2023-11-08T12:30:09.574195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:20:52.461236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566362+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:30:08.566362+0000","last_peered":"2023-11-08T12:30:08.566362+0000","last_clean":"2023-11-08T12:30:08.566362+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:30:08.566362+0000","last_undegraded":"2023-11-08T12:30:08.566362+0000","last_fullsized":"2023-11-08T12:30:08.566362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212608+0000","last_change":"2023-11-08T12:30:08.593409+0000","last_active":"2023-11-08T12:30:10.212608+0000","last_peered":"2023-11-08T12:30:10.212608+0000","last_clean":"2023-11-08T12:30:10.212608+0000","last_became_active":"2023-11-08T12:30:08.592997+0000","last_became_peered":"2023-11-08T12:30:08.592997+0000","last_unstale":"2023-11-08T12:30:10.212608+0000","last_undegraded":"2023-11-08T12:30:10.212608+0000","last_fullsized":"2023-11-08T12:30:10.212608+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:26:21.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296102+0000","last_change":"2023-11-08T12:30:08.116076+0000","last_active":"2023-11-08T12:30:10.296102+0000","last_peered":"2023-11-08T12:30:10.296102+0000","last_clean":"2023-11-08T12:30:10.296102+0000","last_became_active":"2023-11-08T12:30:08.115543+0000","last_became_peered":"2023-11-08T12:30:08.115543+0000","last_unstale":"2023-11-08T12:30:10.296102+0000","last_undegraded":"2023-11-08T12:30:10.296102+0000","last_fullsized":"2023-11-08T12:30:10.296102+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:34.590941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.574707+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:30:08.574707+0000","last_peered":"2023-11-08T12:30:08.574707+0000","last_clean":"2023-11-08T12:30:08.574707+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:30:08.574707+0000","last_undegraded":"2023-11-08T12:30:08.574707+0000","last_fullsized":"2023-11-08T12:30:08.574707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.212381+0000","last_change":"2023-11-08T12:30:08.580506+0000","last_active":"2023-11-08T12:30:10.212381+0000","last_peered":"2023-11-08T12:30:10.212381+0000","last_clean":"2023-11-08T12:30:10.212381+0000","last_became_active":"2023-11-08T12:30:08.580164+0000","last_became_peered":"2023-11-08T12:30:08.580164+0000","last_unstale":"2023-11-08T12:30:10.212381+0000","last_undegraded":"2023-11-08T12:30:10.212381+0000","last_fullsized":"2023-11-08T12:30:10.212381+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:17:45.931548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.575484+0000","last_change":"2023-11-08T12:30:08.119615+0000","last_active":"2023-11-08T12:30:09.575484+0000","last_peered":"2023-11-08T12:30:09.575484+0000","last_clean":"2023-11-08T12:30:09.575484+0000","last_became_active":"2023-11-08T12:30:08.119314+0000","last_became_peered":"2023-11-08T12:30:08.119314+0000","last_unstale":"2023-11-08T12:30:09.575484+0000","last_undegraded":"2023-11-08T12:30:09.575484+0000","last_fullsized":"2023-11-08T12:30:09.575484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:33:40.988078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.568606+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:30:08.568606+0000","last_peered":"2023-11-08T12:30:08.568606+0000","last_clean":"2023-11-08T12:30:08.568606+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:30:08.568606+0000","last_undegraded":"2023-11-08T12:30:08.568606+0000","last_fullsized":"2023-11-08T12:30:08.568606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574362+0000","last_change":"2023-11-08T12:30:08.596810+0000","last_active":"2023-11-08T12:30:09.574362+0000","last_peered":"2023-11-08T12:30:09.574362+0000","last_clean":"2023-11-08T12:30:09.574362+0000","last_became_active":"2023-11-08T12:30:08.596470+0000","last_became_peered":"2023-11-08T12:30:08.596470+0000","last_unstale":"2023-11-08T12:30:09.574362+0000","last_undegraded":"2023-11-08T12:30:09.574362+0000","last_fullsized":"2023-11-08T12:30:09.574362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:55:31.327743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296041+0000","last_change":"2023-11-08T12:30:08.122100+0000","last_active":"2023-11-08T12:30:10.296041+0000","last_peered":"2023-11-08T12:30:10.296041+0000","last_clean":"2023-11-08T12:30:10.296041+0000","last_became_active":"2023-11-08T12:30:08.121795+0000","last_became_peered":"2023-11-08T12:30:08.121795+0000","last_unstale":"2023-11-08T12:30:10.296041+0000","last_undegraded":"2023-11-08T12:30:10.296041+0000","last_fullsized":"2023-11-08T12:30:10.296041+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:02:49.855133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.573590+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:30:08.573590+0000","last_peered":"2023-11-08T12:30:08.573590+0000","last_clean":"2023-11-08T12:30:08.573590+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:30:08.573590+0000","last_undegraded":"2023-11-08T12:30:08.573590+0000","last_fullsized":"2023-11-08T12:30:08.573590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.295399+0000","last_change":"2023-11-08T12:30:08.590076+0000","last_active":"2023-11-08T12:30:10.295399+0000","last_peered":"2023-11-08T12:30:10.295399+0000","last_clean":"2023-11-08T12:30:10.295399+0000","last_became_active":"2023-11-08T12:30:08.582039+0000","last_became_peered":"2023-11-08T12:30:08.582039+0000","last_unstale":"2023-11-08T12:30:10.295399+0000","last_undegraded":"2023-11-08T12:30:10.295399+0000","last_fullsized":"2023-11-08T12:30:10.295399+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:18:49.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573524+0000","last_change":"2023-11-08T12:30:08.111564+0000","last_active":"2023-11-08T12:30:09.573524+0000","last_peered":"2023-11-08T12:30:09.573524+0000","last_clean":"2023-11-08T12:30:09.573524+0000","last_became_active":"2023-11-08T12:30:08.111100+0000","last_became_peered":"2023-11-08T12:30:08.111100+0000","last_unstale":"2023-11-08T12:30:09.573524+0000","last_undegraded":"2023-11-08T12:30:09.573524+0000","last_fullsized":"2023-11-08T12:30:09.573524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:30:04.678232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.575319+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:30:08.575319+0000","last_peered":"2023-11-08T12:30:08.575319+0000","last_clean":"2023-11-08T12:30:08.575319+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:30:08.575319+0000","last_undegraded":"2023-11-08T12:30:08.575319+0000","last_fullsized":"2023-11-08T12:30:08.575319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573565+0000","last_change":"2023-11-08T12:30:08.592202+0000","last_active":"2023-11-08T12:30:09.573565+0000","last_peered":"2023-11-08T12:30:09.573565+0000","last_clean":"2023-11-08T12:30:09.573565+0000","last_became_active":"2023-11-08T12:30:08.591572+0000","last_became_peered":"2023-11-08T12:30:08.591572+0000","last_unstale":"2023-11-08T12:30:09.573565+0000","last_undegraded":"2023-11-08T12:30:09.573565+0000","last_fullsized":"2023-11-08T12:30:09.573565+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:35.603989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.574520+0000","last_change":"2023-11-08T12:30:08.108146+0000","last_active":"2023-11-08T12:30:09.574520+0000","last_peered":"2023-11-08T12:30:09.574520+0000","last_clean":"2023-11-08T12:30:09.574520+0000","last_became_active":"2023-11-08T12:30:08.107888+0000","last_became_peered":"2023-11-08T12:30:08.107888+0000","last_unstale":"2023-11-08T12:30:09.574520+0000","last_undegraded":"2023-11-08T12:30:09.574520+0000","last_fullsized":"2023-11-08T12:30:09.574520+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:34.590941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566969+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:30:08.566969+0000","last_peered":"2023-11-08T12:30:08.566969+0000","last_clean":"2023-11-08T12:30:08.566969+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:30:08.566969+0000","last_undegraded":"2023-11-08T12:30:08.566969+0000","last_fullsized":"2023-11-08T12:30:08.566969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.296276+0000","last_change":"2023-11-08T12:30:08.596947+0000","last_active":"2023-11-08T12:30:10.296276+0000","last_peered":"2023-11-08T12:30:10.296276+0000","last_clean":"2023-11-08T12:30:10.296276+0000","last_became_active":"2023-11-08T12:30:08.596656+0000","last_became_peered":"2023-11-08T12:30:08.596656+0000","last_unstale":"2023-11-08T12:30:10.296276+0000","last_undegraded":"2023-11-08T12:30:10.296276+0000","last_fullsized":"2023-11-08T12:30:10.296276+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:58:32.871482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.705274+0000","last_change":"2023-11-08T12:30:08.121352+0000","last_active":"2023-11-08T12:30:09.705274+0000","last_peered":"2023-11-08T12:30:09.705274+0000","last_clean":"2023-11-08T12:30:09.705274+0000","last_became_active":"2023-11-08T12:30:08.121079+0000","last_became_peered":"2023-11-08T12:30:08.121079+0000","last_unstale":"2023-11-08T12:30:09.705274+0000","last_undegraded":"2023-11-08T12:30:09.705274+0000","last_fullsized":"2023-11-08T12:30:09.705274+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:17.364182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566625+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:30:08.566625+0000","last_peered":"2023-11-08T12:30:08.566625+0000","last_clean":"2023-11-08T12:30:08.566625+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:30:08.566625+0000","last_undegraded":"2023-11-08T12:30:08.566625+0000","last_fullsized":"2023-11-08T12:30:08.566625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:09.573744+0000","last_change":"2023-11-08T12:30:08.585325+0000","last_active":"2023-11-08T12:30:09.573744+0000","last_peered":"2023-11-08T12:30:09.573744+0000","last_clean":"2023-11-08T12:30:09.573744+0000","last_became_active":"2023-11-08T12:30:08.581798+0000","last_became_peered":"2023-11-08T12:30:08.581798+0000","last_unstale":"2023-11-08T12:30:09.573744+0000","last_undegraded":"2023-11-08T12:30:09.573744+0000","last_fullsized":"2023-11-08T12:30:09.573744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:08.081095+0000","last_clean_scrub_stamp":"2023-11-08T12:30:08.081095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:51:48.465793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-08T12:30:10.293421+0000","last_change":"2023-11-08T12:30:08.116101+0000","last_active":"2023-11-08T12:30:10.293421+0000","last_peered":"2023-11-08T12:30:10.293421+0000","last_clean":"2023-11-08T12:30:10.293421+0000","last_became_active":"2023-11-08T12:30:08.115727+0000","last_became_peered":"2023-11-08T12:30:08.115727+0000","last_unstale":"2023-11-08T12:30:10.293421+0000","last_undegraded":"2023-11-08T12:30:10.293421+0000","last_fullsized":"2023-11-08T12:30:10.293421+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:07.068046+0000","last_clean_scrub_stamp":"2023-11-08T12:30:07.068046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:20:54.851051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.575592+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:30:08.575592+0000","last_peered":"2023-11-08T12:30:08.575592+0000","last_clean":"2023-11-08T12:30:08.575592+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:30:08.575592+0000","last_undegraded":"2023-11-08T12:30:08.575592+0000","last_fullsized":"2023-11-08T12:30:08.575592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-08T12:30:08.566711+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:30:08.566711+0000","last_peered":"2023-11-08T12:30:08.566711+0000","last_clean":"2023-11-08T12:30:08.566711+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:30:08.566711+0000","last_undegraded":"2023-11-08T12:30:08.566711+0000","last_fullsized":"2023-11-08T12:30:08.566711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476770,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9184,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362656,"statfs":{"total":96636764160,"available":96627359744,"internally_reserved":0,"allocated":679936,"data_stored":313811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.1599999999999999,"15min":1.127},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.4889999999999999,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.1319999999999999,"15min":1.1040000000000001},"min":{"1min":0.77500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.1799999999999997,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.1359999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1719999999999999,"15min":1.1579999999999999},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.278},{"interface":"front","average":{"1min":1.149,"5min":1.117,"15min":1.111},"min":{"1min":0.90200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.0369999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0509999999999999,"15min":1.0529999999999999},"min":{"1min":0.75800000000000001,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.288,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.2829999999999999,"15min":1.274},"min":{"1min":0.80600000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.397}]},{"osd":3,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.3540000000000001,"15min":1.347},"min":{"1min":0.86199999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":5.601,"5min":5.601,"15min":5.601},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2350000000000001,"15min":1.2390000000000001},"min":{"1min":0.98699999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.4990000000000001,"5min":1.73,"15min":1.73},"last":1.3029999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.3240000000000001,"15min":1.3320000000000001},"min":{"1min":0.754,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":3.9119999999999999,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.359,"15min":1.373},"min":{"1min":1.0049999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.8819999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.2649999999999999,"15min":1.2849999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.579,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.472,"15min":1.474},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":4.0720000000000001,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.347}]},{"osd":7,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4750000000000001,"15min":1.488},"min":{"1min":1.004,"5min":0.752,"15min":0.752},"max":{"1min":1.8080000000000001,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.25},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.4279999999999999,"15min":1.4450000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7649999999999999,"5min":2.121,"15min":2.121},"last":1.425}]}]},{"osd":4,"up_from":16,"seq":68719476770,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":692224,"data_stored":315359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.99199999999999999,"15min":0.99299999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4390000000000001,"5min":1.454,"15min":1.454},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.0680000000000001,"15min":1.0569999999999999},"min":{"1min":0.71499999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5600000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.411}]},{"osd":1,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.1779999999999999,"15min":1.1659999999999999},"min":{"1min":0.77100000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5269999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1990000000000001,"15min":1.2070000000000001},"min":{"1min":0.84999999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7649999999999999,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.216,"15min":1.22},"min":{"1min":0.97799999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.401,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.206,"15min":1.2},"min":{"1min":1.03,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.583,"5min":3.129,"15min":3.129},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2210000000000001,"15min":1.224},"min":{"1min":0.86699999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5720000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.325,"15min":1.327},"min":{"1min":1.0680000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.665,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.3759999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2809999999999999,"15min":1.3089999999999999},"min":{"1min":0.82899999999999996,"5min":0.754,"15min":0.754},"max":{"1min":1.4390000000000001,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.2370000000000001,"15min":1.226},"min":{"1min":1.0189999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.6200000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.1859999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.395,"15min":1.3959999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.7509999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.4239999999999999,"15min":1.4339999999999999},"min":{"1min":1.014,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.706,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.4119999999999999,"15min":1.419},"min":{"1min":0.97999999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6779999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4530000000000001,"15min":1.456},"min":{"1min":1.008,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.6839999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3129999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509474,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10336,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361504,"statfs":{"total":96636764160,"available":96626180096,"internally_reserved":0,"allocated":1269760,"data_stored":897366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.143,"15min":1.155},"min":{"1min":0.73399999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.357,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.5549999999999999,"5min":1.7,"15min":1.7},"last":1.2829999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.325,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.006},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0469999999999999,"15min":1.0449999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4490000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.409}]},{"osd":2,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.82399999999999995,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.593,"5min":1.597,"15min":1.597},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.448,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.266}]},{"osd":3,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2230000000000001,"15min":1.2310000000000001},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.542,"5min":1.984,"15min":1.984},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.86299999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.758,"5min":2.137,"15min":2.137},"last":1.129}]},{"osd":4,"last update":"Wed Nov 8 12:29:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2849999999999999,"15min":1.2969999999999999},"min":{"1min":0.86599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.681,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.248,"5min":1.256,"15min":1.2569999999999999},"min":{"1min":0.93600000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.8260000000000001,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.284,"15min":1.2849999999999999},"min":{"1min":0.92300000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.657,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.27,"15min":1.274},"min":{"1min":0.85399999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.502,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.365}]},{"osd":6,"last update":"Wed Nov 8 12:29:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.369,"15min":1.369},"min":{"1min":0.91800000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.819,"5min":1.956,"15min":1.956},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":1.032,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6439999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.94199999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":688128,"data_stored":314447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.9710000000000001,"15min":2.1349999999999998},"min":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5640000000000001,"5min":20.099,"15min":20.099},"last":1.415},{"interface":"front","average":{"1min":1.042,"5min":2.0489999999999999,"15min":2.2170000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3799999999999999,"5min":21.238,"15min":21.238},"last":1.1319999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.198,"15min":1.2250000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.643,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.498,"15min":1.573},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.296,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":0.99099999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.673,"15min":1.7689999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.4670000000000001,"5min":11.843,"15min":11.843},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.724,"15min":1.8180000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8979999999999999,"5min":11.907,"15min":11.907},"last":0.80500000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.389,"15min":1.425},"min":{"1min":0.88,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.6899999999999999,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.466,"15min":1.514},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.8240000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.228}]},{"osd":4,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2230000000000001,"15min":1.2190000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2809999999999999,"15min":1.292},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7130000000000001,"5min":2.073,"15min":2.073},"last":1.3380000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.286,"15min":1.3109999999999999},"min":{"1min":0.83899999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.746,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.3759999999999999,"15min":1.3879999999999999},"min":{"1min":0.92800000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.6359999999999999,"5min":1.948,"15min":1.948},"last":1.2729999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.7430000000000001,"15min":1.8240000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.5780000000000001,"5min":8.109,"15min":8.109},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.647,"15min":1.6930000000000001},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.784,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.3720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9384,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362456,"statfs":{"total":96636764160,"available":96627154944,"internally_reserved":0,"allocated":688128,"data_stored":313867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.236,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.58699999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.306,"5min":1.53,"15min":1.53},"last":1.165}]},{"osd":1,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.88700000000000001,"15min":0.90100000000000002},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2210000000000001,"5min":1.51,"15min":1.51},"last":0.997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":1.0780000000000001,"15min":1.1140000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1890000000000001,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1220000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.194,"15min":1.2370000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3140000000000001,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4159999999999999,"5min":1.972,"15min":1.972},"last":1.044}]},{"osd":4,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.246,"15min":1.26},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7210000000000001,"5min":1.837,"15min":1.837},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.3340000000000001,"15min":1.347},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.484}]},{"osd":5,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.296,"15min":1.3109999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.841,"5min":1.897,"15min":1.897},"last":1.649},{"interface":"front","average":{"1min":1.254,"5min":1.458,"15min":1.492},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.794,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.5449999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3440000000000001,"15min":1.3560000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.651,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.3320000000000001,"15min":1.3420000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.7490000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4590000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:29:44 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.45,"15min":1.47},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.71,"5min":2.194,"15min":2.194},"last":1.9890000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.4910000000000001,"15min":1.512},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.891,"5min":2.472,"15min":2.472},"last":1.554}]}]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9252,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362588,"statfs":{"total":96636764160,"available":96627290112,"internally_reserved":0,"allocated":684032,"data_stored":313901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.98099999999999998,"15min":0.99399999999999999},"min":{"1min":0.55300000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.21,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.875},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0349999999999999,"15min":1.048},"min":{"1min":0.69299999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2290000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.228}]},{"osd":2,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0289999999999999,"15min":1.044},"min":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5940000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.127,"15min":1.141},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.4179999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.159}]},{"osd":3,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0960000000000001,"15min":1.1180000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.2629999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.0649999999999999,"15min":1.099},"min":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.373,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.97599999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.264,"15min":1.2789999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.472,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.3129999999999999,"15min":1.3320000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.353,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.3180000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.385,"15min":1.4139999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.5289999999999999,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.337},{"interface":"front","average":{"1min":1.274,"5min":1.446,"15min":1.4750000000000001},"min":{"1min":0.997,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.633,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.458}]},{"osd":6,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.361,"15min":1.375},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":1.502,"5min":1.885,"15min":1.885},"last":1.252},{"interface":"front","average":{"1min":1.282,"5min":1.3939999999999999,"15min":1.4119999999999999},"min":{"1min":0.99299999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.6439999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2849999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:29:42 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.514,"15min":1.538},"min":{"1min":1.1020000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":1.8109999999999999,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.454,"15min":1.4810000000000001},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.4670000000000001,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.2729999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10420,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361420,"statfs":{"total":96636764160,"available":96626094080,"internally_reserved":0,"allocated":1290240,"data_stored":906293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":1.085,"15min":1.137},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0589999999999999,"5min":6.54,"15min":6.54},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":1.103,"15min":1.1499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2290000000000001,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.57199999999999995}]},{"osd":2,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0249999999999999,"15min":1.0409999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4410000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0449999999999999,"15min":1.0669999999999999},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":3.069,"15min":3.069},"last":0.623}]},{"osd":3,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.071,"15min":1.101},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.413,"5min":2.673,"15min":2.673},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.355,"15min":1.409},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4850000000000001,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":0.82799999999999996}]},{"osd":4,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.371,"15min":1.409},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.369,"5min":2.927,"15min":2.927},"last":1.111},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.3879999999999999,"15min":1.4239999999999999},"min":{"1min":0.93100000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5429999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.1870000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.3899999999999999,"15min":1.4259999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.5109999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.5209999999999999,"15min":1.5669999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.6040000000000001,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.238}]},{"osd":6,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.5629999999999999,"15min":1.6060000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.6870000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.506,"15min":1.542},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.6599999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.254}]},{"osd":7,"last update":"Wed Nov 8 12:29:47 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.512,"15min":1.546},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.7310000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.544,"15min":1.595},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.5660000000000001,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.214}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9180,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362660,"statfs":{"total":96636764160,"available":96627363840,"internally_reserved":0,"allocated":675840,"data_stored":306894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1659999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97799999999999998,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.1000000000000001,"15min":1.127},"min":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.423,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":0.91900000000000004},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":1.3160000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.415}]},{"osd":3,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4730000000000001,"5min":1.837,"15min":1.837},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.101,"15min":1.129},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2010000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1850000000000001,"15min":1.1950000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.3320000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.224},{"interface":"front","average":{"1min":1.212,"5min":1.363,"15min":1.3879999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.585,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.179}]},{"osd":5,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3700000000000001,"15min":1.4019999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.542,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.26},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3089999999999999,"15min":1.3360000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.389,"5min":3.052,"15min":3.052},"last":1.107}]},{"osd":6,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.3520000000000001,"15min":1.3859999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5009999999999999,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.294},{"interface":"front","average":{"1min":1.208,"5min":1.391,"15min":1.421},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.472,"5min":2.254,"15min":2.254},"last":1.3149999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3919999999999999,"15min":1.4199999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.488,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.329},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.446,"15min":1.476},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.5700000000000001,"5min":3.5,"15min":3.5},"last":1.373}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:30:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T12:30:13.386 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-08T12:30:13.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5d5d5700 1 Processor -- start 2023-11-08T12:30:13.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5d5d5700 1 -- start start 2023-11-08T12:30:13.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5d5d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb5815c7c0 0x7fdb5806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5d5d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5d5d5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580ce750 con 0x7fdb58161030 2023-11-08T12:30:13.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5d5d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580cdba0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5d5d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580cd8d0 con 0x7fdb580cddf0 2023-11-08T12:30:13.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb5cdd4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb57fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb5815c7c0 0x7fdb5806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb577fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdb58161030 0x7fdb580cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:59792/0 (socket says 172.21.15.112:59792) 2023-11-08T12:30:13.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb577fe700 1 -- 172.21.15.112:0/1560679869 learned_addr learned my addr 172.21.15.112:0/1560679869 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:13.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb57fff700 1 -- 172.21.15.112:0/1560679869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 msgr2=0x7fdb580ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:13.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb57fff700 1 --2- 172.21.15.112:0/1560679869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb57fff700 1 -- 172.21.15.112:0/1560679869 >> v1:172.21.15.133:6789/0 conn(0x7fdb58161030 legacy=0x7fdb580cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.610+0000 7fdb57fff700 1 -- 172.21.15.112:0/1560679869 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5806c010 con 0x7fdb5815c7c0 2023-11-08T12:30:13.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb57fff700 1 --2- 172.21.15.112:0/1560679869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb5815c7c0 0x7fdb5806cdd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009850 tx=0x7fdb48009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0a49e368ca8ec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:13.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb56ffd700 1 -- 172.21.15.112:0/1560679869 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48011830 con 0x7fdb5815c7c0 2023-11-08T12:30:13.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb56ffd700 1 -- 172.21.15.112:0/1560679869 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48011990 con 0x7fdb5815c7c0 2023-11-08T12:30:13.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb56ffd700 1 -- 172.21.15.112:0/1560679869 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48011d40 con 0x7fdb5815c7c0 2023-11-08T12:30:13.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/1560679869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb5815c7c0 msgr2=0x7fdb5806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/1560679869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb5815c7c0 0x7fdb5806cdd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009850 tx=0x7fdb48009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:13.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/1560679869 shutdown_connections 2023-11-08T12:30:13.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/1560679869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/1560679869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb5815c7c0 0x7fdb5806cdd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/1560679869 >> 172.21.15.112:0/1560679869 conn(0x7fdb580d3800 msgr2=0x7fdb580cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:13.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/1560679869 shutdown_connections 2023-11-08T12:30:13.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.614+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/1560679869 wait complete. 2023-11-08T12:30:13.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 Processor -- start 2023-11-08T12:30:13.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 -- start start 2023-11-08T12:30:13.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb5815c7c0 0x7fdb580b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb580b8450 0x7fdb580b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580caec0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580cb160 con 0x7fdb580b8450 2023-11-08T12:30:13.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5d5d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580cb440 con 0x7fdb580cddf0 2023-11-08T12:30:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb5815c7c0 0x7fdb580b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb5815c7c0 0x7fdb580b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46320/0 (socket says 172.21.15.112:46320) 2023-11-08T12:30:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 -- 172.21.15.112:0/645120416 learned_addr learned my addr 172.21.15.112:0/645120416 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:13.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb57fff700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb5cdd4700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb580b8450 0x7fdb580b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 -- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 msgr2=0x7fdb580cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 -- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb580b8450 msgr2=0x7fdb580b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb580b8450 0x7fdb580b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.618+0000 7fdb577fe700 1 -- 172.21.15.112:0/645120416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480094b0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.622+0000 7fdb577fe700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb5815c7c0 0x7fdb580b59e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00c700 tx=0x7fdb4c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:13.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.622+0000 7fdb54ff9700 1 -- 172.21.15.112:0/645120416 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c005d90 con 0x7fdb5815c7c0 2023-11-08T12:30:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.622+0000 7fdb54ff9700 1 -- 172.21.15.112:0/645120416 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c0070d0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.622+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5806c5d0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.622+0000 7fdb54ff9700 1 -- 172.21.15.112:0/645120416 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c007440 con 0x7fdb5815c7c0 2023-11-08T12:30:13.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.622+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5806c2f0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.622+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5806c8b0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.626+0000 7fdb54ff9700 1 -- 172.21.15.112:0/645120416 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdb4c019030 con 0x7fdb5815c7c0 2023-11-08T12:30:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.626+0000 7fdb54ff9700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb44064ee0 0x7fdb44067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:13.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.626+0000 7fdb54ff9700 1 -- 172.21.15.112:0/645120416 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdb4c0811b0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.626+0000 7fdb57fff700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb44064ee0 0x7fdb44067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:13.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.626+0000 7fdb57fff700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb44064ee0 0x7fdb44067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb480090b0 tx=0x7fdb48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:13.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.634+0000 7fdb54ff9700 1 -- 172.21.15.112:0/645120416 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdb4c04a400 con 0x7fdb5815c7c0 2023-11-08T12:30:13.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.866+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fdb580b55c0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.874+0000 7fdb54ff9700 1 -- 172.21.15.112:0/645120416 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdb4c04f1d0 con 0x7fdb5815c7c0 2023-11-08T12:30:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb44064ee0 msgr2=0x7fdb44067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb44064ee0 0x7fdb44067390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb480090b0 tx=0x7fdb48008030 comp rx=0 tx=0).stop 2023-11-08T12:30:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb5815c7c0 msgr2=0x7fdb580b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:13.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb5815c7c0 0x7fdb580b59e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00c700 tx=0x7fdb4c00ca10 comp rx=0 tx=0).stop 2023-11-08T12:30:13.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 shutdown_connections 2023-11-08T12:30:13.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdb44064ee0 0x7fdb44067390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb580b8450 0x7fdb580b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb5815c7c0 0x7fdb580b59e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 --2- 172.21.15.112:0/645120416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdb580cddf0 0x7fdb580cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 >> 172.21.15.112:0/645120416 conn(0x7fdb580d3800 msgr2=0x7fdb58060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 shutdown_connections 2023-11-08T12:30:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:13.878+0000 7fdb5d5d5700 1 -- 172.21.15.112:0/645120416 wait complete. 2023-11-08T12:30:13.885 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2023-11-08T12:30:13.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:14.066 INFO:tasks.ceph.mds.d.smithi133.stderr:2023-11-08T12:30:14.062+0000 7febfe9d8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:30:14.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c222d1700 1 Processor -- start 2023-11-08T12:30:14.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c222d1700 1 -- start start 2023-11-08T12:30:14.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c222d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 0x7f2c1c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c222d1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c15a550 con 0x7f2c1c0b43a0 2023-11-08T12:30:14.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c222d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c06b0a0 con 0x7f2c1c0c9040 2023-11-08T12:30:14.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c222d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0caac0 con 0x7f2c1c0b1640 2023-11-08T12:30:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c212cf700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2c1c0b43a0 0x7f2c1c15e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:46582/0 (socket says 172.21.15.112:46582) 2023-11-08T12:30:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c212cf700 1 -- 172.21.15.112:0/1515836727 learned_addr learned my addr 172.21.15.112:0/1515836727 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:14.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c20ace700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 0x7f2c1c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539989822 0 0) 0x7f2c0c001110 con 0x7f2c1c0b43a0 2023-11-08T12:30:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.066+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c040035d0 con 0x7f2c1c0b43a0 2023-11-08T12:30:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773409239 0 0) 0x7f2c1c06b0a0 con 0x7f2c1c0c9040 2023-11-08T12:30:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c001110 con 0x7f2c1c0c9040 2023-11-08T12:30:14.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2974026096 0 0) 0x7f2c040035d0 con 0x7f2c1c0b43a0 2023-11-08T12:30:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 msgr2=0x7f2c1c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 0x7f2c1c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 >> v1:172.21.15.133:6789/0 conn(0x7f2c1c0c9040 legacy=0x7f2c1c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0cada0 con 0x7f2c1c0b43a0 2023-11-08T12:30:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f2c0c001800 con 0x7f2c1c0b43a0 2023-11-08T12:30:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 >> v1:172.21.15.112:6789/0 conn(0x7f2c1c0b43a0 legacy=0x7f2c1c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c04003be0 0x7f2c04003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 0x7f2c04004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04004db0 0x7f2c04005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0caac0 con 0x7f2c04004db0 2023-11-08T12:30:14.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0400bb30 con 0x7f2c04003be0 2023-11-08T12:30:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0400bcf0 con 0x7f2c1c0b1640 2023-11-08T12:30:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c21ad0700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04004db0 0x7f2c04005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c212cf700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c04003be0 0x7f2c04003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c20ace700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 0x7f2c04004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c212cf700 1 -- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 msgr2=0x7f2c04004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c212cf700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 0x7f2c04004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c212cf700 1 -- 172.21.15.112:0/1515836727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04004db0 msgr2=0x7f2c04005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c212cf700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04004db0 0x7f2c04005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c212cf700 1 -- 172.21.15.112:0/1515836727 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040035d0 con 0x7f2c04003be0 2023-11-08T12:30:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c20ace700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c0b1640 0x7f2c04004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:14.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c212cf700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c04003be0 0x7f2c04003fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c1c0 tx=0x7f2c040058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6818af3e38d114f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00cd60 con 0x7f2c04003be0 2023-11-08T12:30:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c005980 con 0x7f2c04003be0 2023-11-08T12:30:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c1bfff700 1 -- 172.21.15.112:0/1515836727 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005d30 con 0x7f2c04003be0 2023-11-08T12:30:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c222d1700 1 -- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c04003be0 msgr2=0x7f2c04003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c222d1700 1 --2- 172.21.15.112:0/1515836727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c04003be0 0x7f2c04003fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c1c0 tx=0x7f2c040058a0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c21ad0700 1 -- 172.21.15.112:0/1515836727 reap_dead start 2023-11-08T12:30:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c222d1700 1 -- 172.21.15.112:0/1515836727 shutdown_connections 2023-11-08T12:30:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.070+0000 7f2c222d1700 1 -- 172.21.15.112:0/1515836727 >> 172.21.15.112:0/1515836727 conn(0x7f2c1c0b0f80 msgr2=0x7f2c1c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:14.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.074+0000 7f2c222d1700 1 -- 172.21.15.112:0/1515836727 shutdown_connections 2023-11-08T12:30:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.074+0000 7f2c222d1700 1 -- 172.21.15.112:0/1515836727 wait complete. 2023-11-08T12:30:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.074+0000 7f2c222d1700 1 Processor -- start 2023-11-08T12:30:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.074+0000 7f2c222d1700 1 -- start start 2023-11-08T12:30:14.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04003be0 0x7f2c1c0ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1c0cc390 0x7f2c1c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c157d40 0x7f2c1c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c150140 con 0x7f2c04003be0 2023-11-08T12:30:14.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0cdde0 con 0x7f2c1c0cc390 2023-11-08T12:30:14.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0cc800 con 0x7f2c1c157d40 2023-11-08T12:30:14.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04003be0 0x7f2c1c0ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04003be0 0x7f2c1c0ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46330/0 (socket says 172.21.15.112:46330) 2023-11-08T12:30:14.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 -- 172.21.15.112:0/4222527713 learned_addr learned my addr 172.21.15.112:0/4222527713 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:14.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c20ace700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1c0cc390 0x7f2c1c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c21ad0700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c157d40 0x7f2c1c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 -- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c157d40 msgr2=0x7f2c1c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c157d40 0x7f2c1c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 -- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1c0cc390 msgr2=0x7f2c1c14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1c0cc390 0x7f2c1c14fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 -- 172.21.15.112:0/4222527713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c06b5d0 con 0x7f2c04003be0 2023-11-08T12:30:14.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c21ad0700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c157d40 0x7f2c1c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:14.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c20ace700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1c0cc390 0x7f2c1c14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:14.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c212cf700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04003be0 0x7f2c1c0ac990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400bcc0 tx=0x7f2c1c0c94c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c19ffb700 1 -- 172.21.15.112:0/4222527713 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0070d0 con 0x7f2c04003be0 2023-11-08T12:30:14.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c19ffb700 1 -- 172.21.15.112:0/4222527713 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c007230 con 0x7f2c04003be0 2023-11-08T12:30:14.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c06b2f0 con 0x7f2c04003be0 2023-11-08T12:30:14.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c19ffb700 1 -- 172.21.15.112:0/4222527713 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0075e0 con 0x7f2c04003be0 2023-11-08T12:30:14.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c0ca7b0 con 0x7f2c04003be0 2023-11-08T12:30:14.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.078+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c073cb0 con 0x7f2c04003be0 2023-11-08T12:30:14.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.082+0000 7f2c19ffb700 1 -- 172.21.15.112:0/4222527713 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2c0c010070 con 0x7f2c04003be0 2023-11-08T12:30:14.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.082+0000 7f2c19ffb700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c08064ee0 0x7f2c08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.082+0000 7f2c19ffb700 1 -- 172.21.15.112:0/4222527713 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2c0c083450 con 0x7f2c04003be0 2023-11-08T12:30:14.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.082+0000 7f2c20ace700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c08064ee0 0x7f2c08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.082+0000 7f2c20ace700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c08064ee0 0x7f2c08067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0c5240 tx=0x7f2c10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.086+0000 7f2c19ffb700 1 -- 172.21.15.112:0/4222527713 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2c0c0514b0 con 0x7f2c04003be0 2023-11-08T12:30:14.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.302+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c1c15a550 con 0x7f2c04003be0 2023-11-08T12:30:14.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.302+0000 7f2c19ffb700 1 -- 172.21.15.112:0/4222527713 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f2c1c15a550 con 0x7f2c04003be0 2023-11-08T12:30:14.308 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:14.308 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:14.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c08064ee0 msgr2=0x7f2c08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c08064ee0 0x7f2c08067390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0c5240 tx=0x7f2c10008040 comp rx=0 tx=0).stop 2023-11-08T12:30:14.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04003be0 msgr2=0x7f2c1c0ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04003be0 0x7f2c1c0ac990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400bcc0 tx=0x7f2c1c0c94c0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 shutdown_connections 2023-11-08T12:30:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2c08064ee0 0x7f2c08067390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c1c157d40 0x7f2c1c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1c0cc390 0x7f2c1c14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 --2- 172.21.15.112:0/4222527713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c04003be0 0x7f2c1c0ac990 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 >> 172.21.15.112:0/4222527713 conn(0x7f2c1c0b0f80 msgr2=0x7f2c1c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:14.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 shutdown_connections 2023-11-08T12:30:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.306+0000 7f2c222d1700 1 -- 172.21.15.112:0/4222527713 wait complete. 2023-11-08T12:30:14.313 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:14.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T12:30:08.547994+0000', 'modified': '2023-11-08T12:30:11.575341+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5820}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5820': {'gid': 5820, 'name': 'd', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6833/4144675081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 4144675081}, {'type': 'v1', 'addr': '172.21.15.133:6833', 'nonce': 4144675081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T12:30:14.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T12:30:14.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-08T12:30:14.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.910+0000 7f864b59e700 1 Processor -- start 2023-11-08T12:30:14.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.910+0000 7f864b59e700 1 -- start start 2023-11-08T12:30:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f864c15c650 0x7f864c06b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f864c0cd0d0 0x7f864c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c0b1b80 0x7f864c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864b59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c06b140 con 0x7f864c0cd0d0 2023-11-08T12:30:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0c9d40 con 0x7f864c15c650 2023-11-08T12:30:14.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c06b820 con 0x7f864c0b1b80 2023-11-08T12:30:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f864c0cd0d0 0x7f864c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f864c0cd0d0 0x7f864c0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46338/0 (socket says 172.21.15.112:46338) 2023-11-08T12:30:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 -- 172.21.15.112:0/2058155491 learned_addr learned my addr 172.21.15.112:0/2058155491 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:14.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864a59c700 1 --2- 172.21.15.112:0/2058155491 >> v2:172.21.15.133:3300/0 conn(0x7f864c15c650 0x7f864c06b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864ad9d700 1 --2- 172.21.15.112:0/2058155491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c0b1b80 0x7f864c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 -- 172.21.15.112:0/2058155491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c0b1b80 msgr2=0x7f864c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 --2- 172.21.15.112:0/2058155491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c0b1b80 0x7f864c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 -- 172.21.15.112:0/2058155491 >> v2:172.21.15.133:3300/0 conn(0x7f864c15c650 msgr2=0x7f864c06b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 --2- 172.21.15.112:0/2058155491 >> v2:172.21.15.133:3300/0 conn(0x7f864c15c650 0x7f864c06b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 -- 172.21.15.112:0/2058155491 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0cd5d0 con 0x7f864c0cd0d0 2023-11-08T12:30:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f8649d9b700 1 --2- 172.21.15.112:0/2058155491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0b1640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f864c0cc1e0 tx=0x7f8640009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b9c17d8bb57db0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.914+0000 7f864959a700 1 -- 172.21.15.112:0/2058155491 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640011830 con 0x7f864c0cd0d0 2023-11-08T12:30:14.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864959a700 1 -- 172.21.15.112:0/2058155491 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640011990 con 0x7f864c0cd0d0 2023-11-08T12:30:14.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864959a700 1 -- 172.21.15.112:0/2058155491 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640011d20 con 0x7f864c0cd0d0 2023-11-08T12:30:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 -- 172.21.15.112:0/2058155491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 msgr2=0x7f864c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 --2- 172.21.15.112:0/2058155491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0b1640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f864c0cc1e0 tx=0x7f8640009bf0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 -- 172.21.15.112:0/2058155491 shutdown_connections 2023-11-08T12:30:14.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 --2- 172.21.15.112:0/2058155491 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c0b1b80 0x7f864c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 --2- 172.21.15.112:0/2058155491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0b1640 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 --2- 172.21.15.112:0/2058155491 >> v2:172.21.15.133:3300/0 conn(0x7f864c15c650 0x7f864c06b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 -- 172.21.15.112:0/2058155491 >> 172.21.15.112:0/2058155491 conn(0x7f864c0b0f80 msgr2=0x7f864c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 -- 172.21.15.112:0/2058155491 shutdown_connections 2023-11-08T12:30:14.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 -- 172.21.15.112:0/2058155491 wait complete. 2023-11-08T12:30:14.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 Processor -- start 2023-11-08T12:30:14.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.918+0000 7f864b59e700 1 -- start start 2023-11-08T12:30:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f864c0b1b80 0x7f864c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c15c650 0x7f864c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c7810 con 0x7f864c0cd0d0 2023-11-08T12:30:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c7250 con 0x7f864c0b1b80 2023-11-08T12:30:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c7530 con 0x7f864c15c650 2023-11-08T12:30:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46348/0 (socket says 172.21.15.112:46348) 2023-11-08T12:30:14.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 -- 172.21.15.112:0/1225036305 learned_addr learned my addr 172.21.15.112:0/1225036305 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864ad9d700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c15c650 0x7f864c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864a59c700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f864c0b1b80 0x7f864c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 -- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c15c650 msgr2=0x7f864c1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c15c650 0x7f864c1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 -- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f864c0b1b80 msgr2=0x7f864c1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f864c0b1b80 0x7f864c1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 -- 172.21.15.112:0/1225036305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640009570 con 0x7f864c0cd0d0 2023-11-08T12:30:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f8649d9b700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0c6870 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f864c06bc30 tx=0x7f8640004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f863affd700 1 -- 172.21.15.112:0/1225036305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640004240 con 0x7f864c0cd0d0 2023-11-08T12:30:14.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f863affd700 1 -- 172.21.15.112:0/1225036305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864001f070 con 0x7f864c0cd0d0 2023-11-08T12:30:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c0c99d0 con 0x7f864c0cd0d0 2023-11-08T12:30:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f863affd700 1 -- 172.21.15.112:0/1225036305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86400045e0 con 0x7f864c0cd0d0 2023-11-08T12:30:14.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.922+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c0cd8b0 con 0x7f864c0cd0d0 2023-11-08T12:30:14.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.926+0000 7f863affd700 1 -- 172.21.15.112:0/1225036305 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f864000f050 con 0x7f864c0cd0d0 2023-11-08T12:30:14.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.930+0000 7f863affd700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f862c064f10 0x7f862c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.930+0000 7f863affd700 1 -- 172.21.15.112:0/1225036305 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f86400831a0 con 0x7f864c0cd0d0 2023-11-08T12:30:14.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.930+0000 7f864a59c700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f862c064f10 0x7f862c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.930+0000 7f864a59c700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f862c064f10 0x7f862c0673c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f863c009ae0 tx=0x7f863c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.930+0000 7f8653d96740 1 Processor -- start 2023-11-08T12:30:14.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.930+0000 7f8653d96740 1 -- start start 2023-11-08T12:30:14.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 0x1528e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278710 0x1529340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x1529880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x13e7ae0 con 0x1278710 2023-11-08T12:30:14.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1457bd0 con 0x1278ae0 2023-11-08T12:30:14.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1450ed0 con 0x12c3790 2023-11-08T12:30:14.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278710 0x1529340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278710 0x1529340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46362/0 (socket says 172.21.15.112:46362) 2023-11-08T12:30:14.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 -- 172.21.15.112:0/4134947533 learned_addr learned my addr 172.21.15.112:0/4134947533 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:14.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f864a59c700 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 0x1528e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f864ad9d700 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x1529880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 -- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 msgr2=0x1529880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x1529880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 -- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 msgr2=0x1528e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 0x1528e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 -- 172.21.15.112:0/4134947533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1476cc0 con 0x1278710 2023-11-08T12:30:14.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8649d9b700 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278710 0x1529340 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8640054960 tx=0x7f8640054990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480c4a9d1dbd38e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f862bfff700 1 -- 172.21.15.112:0/4134947533 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640053320 con 0x1278710 2023-11-08T12:30:14.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f862bfff700 1 -- 172.21.15.112:0/4134947533 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86400812c0 con 0x1278710 2023-11-08T12:30:14.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f862bfff700 1 -- 172.21.15.112:0/4134947533 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640054690 con 0x1278710 2023-11-08T12:30:14.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- 172.21.15.112:0/4134947533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278710 msgr2=0x1529340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278710 0x1529340 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8640054960 tx=0x7f8640054990 comp rx=0 tx=0).stop 2023-11-08T12:30:14.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- 172.21.15.112:0/4134947533 shutdown_connections 2023-11-08T12:30:14.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x1529880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278710 0x1529340 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 --2- 172.21.15.112:0/4134947533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 0x1528e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- 172.21.15.112:0/4134947533 >> 172.21.15.112:0/4134947533 conn(0x1278eb0 msgr2=0x1511700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:14.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- 172.21.15.112:0/4134947533 shutdown_connections 2023-11-08T12:30:14.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.934+0000 7f8653d96740 1 -- 172.21.15.112:0/4134947533 wait complete. 2023-11-08T12:30:14.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 -- start start 2023-11-08T12:30:14.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 Processor -- start 2023-11-08T12:30:14.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x150fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278ae0 0x14ea500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x14eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x12fdb20 con 0x12c3790 2023-11-08T12:30:14.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x14e83f0 con 0x1278710 2023-11-08T12:30:14.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x15100d0 con 0x1278ae0 2023-11-08T12:30:14.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8653d96740 10 client.0 _ll_register_callbacks cb 0x14ad0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:30:14.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x14eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x14eaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46378/0 (socket says 172.21.15.112:46378) 2023-11-08T12:30:14.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f864ad9d700 1 -- 172.21.15.112:0/1953354355 learned_addr learned my addr 172.21.15.112:0/1953354355 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:14.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f8649d9b700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278ae0 0x14ea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.938+0000 7f864a59c700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x150fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864ad9d700 1 -- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278ae0 msgr2=0x14ea500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864ad9d700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278ae0 0x14ea500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864ad9d700 1 -- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 msgr2=0x150fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864ad9d700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x150fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864ad9d700 1 -- 172.21.15.112:0/1953354355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c0cd8b0 con 0x12c3790 2023-11-08T12:30:14.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864a59c700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x150fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:14.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8649d9b700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278ae0 0x14ea500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:14.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864ad9d700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x14eaa40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f86440042f0 tx=0x7f86440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea5475f8f4d3340 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f86297fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:30:14.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f86297fa700 1 -- 172.21.15.112:0/1953354355 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440076c0 con 0x12c3790 2023-11-08T12:30:14.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f86297fa700 1 -- 172.21.15.112:0/1953354355 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8644007820 con 0x12c3790 2023-11-08T12:30:14.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1449f50 con 0x12c3790 2023-11-08T12:30:14.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f86297fa700 1 -- 172.21.15.112:0/1953354355 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86440079e0 con 0x12c3790 2023-11-08T12:30:14.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 10 client.5964 fetch_fsmap learned FSMap version 24 2023-11-08T12:30:14.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x12c49e0 con 0x12c3790 2023-11-08T12:30:14.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f86297fa700 1 -- 172.21.15.112:0/1953354355 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1449f50 con 0x12c3790 2023-11-08T12:30:14.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f86297fa700 1 -- 172.21.15.112:0/1953354355 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f8644007b40 con 0x12c3790 2023-11-08T12:30:14.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 10 client.5964 fetch_fsmap finished waiting for FSMap version 24 2023-11-08T12:30:14.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 10 client.5964 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T12:30:14.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 20 client.5964 populate_metadata read hostname 'smithi112' 2023-11-08T12:30:14.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14eaf80 0x14e7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 4 client.5964 mds_command: new command op to 5820 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:30:14.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 --> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1449c70 con 0x14eaf80 2023-11-08T12:30:14.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.942+0000 7f864a59c700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14eaf80 0x14e7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f86297fa700 10 client.5964 ms_handle_connect on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:14.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f864a59c700 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14eaf80 0x14e7b70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4400c7c60ea1792 server_cookie=3193e0c480c43c74 in_seq=0 out_seq=0 2023-11-08T12:30:14.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f86297fa700 1 -- 172.21.15.112:0/1953354355 <== mds.0 v2:172.21.15.133:6832/4144675081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1449c70 con 0x14eaf80 2023-11-08T12:30:14.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f86297fa700 10 client.5964 handle_command_reply: tid=0 2023-11-08T12:30:14.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 client.5964 shutdown 2023-11-08T12:30:14.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 msgr2=0x14eaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x14eaa40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f86440042f0 tx=0x7f86440046b0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 shutdown_connections 2023-11-08T12:30:14.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x14eaa40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278ae0 0x14ea500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14eaf80 0x14e7b70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 --2- 172.21.15.112:0/1953354355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x150fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 >> 172.21.15.112:0/1953354355 conn(0x1278eb0 msgr2=0x1511740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:14.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f86297fa700 0 client.5964 ms_handle_reset on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:14.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 shutdown_connections 2023-11-08T12:30:14.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 1 -- 172.21.15.112:0/1953354355 wait complete. 2023-11-08T12:30:14.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.946+0000 7f8653d96740 20 client.5964 trim_cache size 0 max 16384 2023-11-08T12:30:14.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 Processor -- start 2023-11-08T12:30:14.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 -- start start 2023-11-08T12:30:14.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x1526120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278ae0 0x153ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x153f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x13fb5f0 con 0x1278ae0 2023-11-08T12:30:14.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1406a40 con 0x1278710 2023-11-08T12:30:14.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1454190 con 0x12c3790 2023-11-08T12:30:14.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278ae0 0x153ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278ae0 0x153ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46386/0 (socket says 172.21.15.112:46386) 2023-11-08T12:30:14.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 -- 172.21.15.112:0/3133581875 learned_addr learned my addr 172.21.15.112:0/3133581875 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:14.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f864ad9d700 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x153f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f864a59c700 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x1526120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 -- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 msgr2=0x153f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x153f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 -- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 msgr2=0x1526120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x1526120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.970+0000 7f8649d9b700 1 -- 172.21.15.112:0/3133581875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c157ee0 con 0x1278ae0 2023-11-08T12:30:14.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8649d9b700 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278ae0 0x153ee20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8640081720 tx=0x7f864007d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f5ce8001ba7f5c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8638ff9700 1 -- 172.21.15.112:0/3133581875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640067070 con 0x1278ae0 2023-11-08T12:30:14.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8638ff9700 1 -- 172.21.15.112:0/3133581875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640081430 con 0x1278ae0 2023-11-08T12:30:14.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8638ff9700 1 -- 172.21.15.112:0/3133581875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640054cf0 con 0x1278ae0 2023-11-08T12:30:14.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 -- 172.21.15.112:0/3133581875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278ae0 msgr2=0x153ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278ae0 0x153ee20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8640081720 tx=0x7f864007d000 comp rx=0 tx=0).stop 2023-11-08T12:30:14.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 -- 172.21.15.112:0/3133581875 shutdown_connections 2023-11-08T12:30:14.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x12c3790 0x153f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1278ae0 0x153ee20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 --2- 172.21.15.112:0/3133581875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278710 0x1526120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 -- 172.21.15.112:0/3133581875 >> 172.21.15.112:0/3133581875 conn(0x1278eb0 msgr2=0x150eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:14.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 -- 172.21.15.112:0/3133581875 shutdown_connections 2023-11-08T12:30:14.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.974+0000 7f8653d96740 1 -- 172.21.15.112:0/3133581875 wait complete. 2023-11-08T12:30:14.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 -- start start 2023-11-08T12:30:14.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 Processor -- start 2023-11-08T12:30:14.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278710 0x153f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 0x1594270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x15947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x15423a0 con 0x12c3790 2023-11-08T12:30:14.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x150dcb0 con 0x1278ae0 2023-11-08T12:30:14.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x153fc70 con 0x1278710 2023-11-08T12:30:14.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f8653d96740 10 client.0 _ll_register_callbacks cb 0x13fd2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:30:14.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x15947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x15947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46402/0 (socket says 172.21.15.112:46402) 2023-11-08T12:30:14.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 -- 172.21.15.112:0/3806802811 learned_addr learned my addr 172.21.15.112:0/3806802811 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:14.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 -- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278710 msgr2=0x153f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278710 0x153f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 -- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 msgr2=0x1594270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:14.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 0x1594270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 -- 172.21.15.112:0/3806802811 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1476cc0 con 0x12c3790 2023-11-08T12:30:14.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f864ad9d700 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x15947b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8644000f80 tx=0x7f8644015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81322e9e865ee562 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:14.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.978+0000 7f86297fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:30:14.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 1 -- 172.21.15.112:0/3806802811 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644007000 con 0x12c3790 2023-11-08T12:30:14.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 1 -- 172.21.15.112:0/3806802811 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f86440078d0 con 0x12c3790 2023-11-08T12:30:14.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86400812c0 con 0x12c3790 2023-11-08T12:30:14.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 1 -- 172.21.15.112:0/3806802811 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8644007ad0 con 0x12c3790 2023-11-08T12:30:14.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 10 client.5970 fetch_fsmap learned FSMap version 24 2023-11-08T12:30:14.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x13fda20 con 0x12c3790 2023-11-08T12:30:14.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 1 -- 172.21.15.112:0/3806802811 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86400812c0 con 0x12c3790 2023-11-08T12:30:14.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 1 -- 172.21.15.112:0/3806802811 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f864402f030 con 0x12c3790 2023-11-08T12:30:14.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 10 client.5970 fetch_fsmap finished waiting for FSMap version 24 2023-11-08T12:30:14.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 10 client.5970 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-08T12:30:14.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 20 client.5970 populate_metadata read hostname 'smithi112' 2023-11-08T12:30:14.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14e6300 0x14e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:14.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 4 client.5970 mds_command: new command op to 5820 tid=0[{"prefix": "status"}] 2023-11-08T12:30:14.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 --> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] -- command(tid 0: {"prefix": "status"}) v1 -- 0x12f5260 con 0x14e6300 2023-11-08T12:30:14.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f864a59c700 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14e6300 0x14e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:14.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 10 client.5970 ms_handle_connect on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:14.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f864a59c700 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14e6300 0x14e66d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec4cfd07b3bfbf30 server_cookie=c402c655944e6ec3 in_seq=0 out_seq=0 2023-11-08T12:30:14.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 1 -- 172.21.15.112:0/3806802811 <== mds.0 v2:172.21.15.133:6832/4144675081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x12f5260 con 0x14e6300 2023-11-08T12:30:14.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f86297fa700 10 client.5970 handle_command_reply: tid=0 2023-11-08T12:30:14.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.982+0000 7f8653d96740 1 client.5970 shutdown 2023-11-08T12:30:14.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 msgr2=0x15947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:14.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x15947b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8644000f80 tx=0x7f8644015000 comp rx=0 tx=0).stop 2023-11-08T12:30:14.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 shutdown_connections 2023-11-08T12:30:14.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x12c3790 0x15947b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x14e6300 0x14e66d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1278ae0 0x1594270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 --2- 172.21.15.112:0/3806802811 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1278710 0x153f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:14.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f86297fa700 0 client.5970 ms_handle_reset on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:14.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 >> 172.21.15.112:0/3806802811 conn(0x1278eb0 msgr2=0x150eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:14.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 shutdown_connections 2023-11-08T12:30:14.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 1 -- 172.21.15.112:0/3806802811 wait complete. 2023-11-08T12:30:14.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f8653d96740 20 client.5970 trim_cache size 0 max 16384 2023-11-08T12:30:14.998 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:30:14.999 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "c14663df-4425-4498-9232-3ffa5f578bfa", 2023-11-08T12:30:14.999 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-11-08T12:30:14.999 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5820, 2023-11-08T12:30:14.999 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-11-08T12:30:14.999 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-11-08T12:30:15.000 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-11-08T12:30:15.000 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.4342949489999999, 2023-11-08T12:30:15.000 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 24, 2023-11-08T12:30:15.000 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 58, 2023-11-08T12:30:15.000 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 58, 2023-11-08T12:30:15.001 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 11.597516906999999 2023-11-08T12:30:15.001 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:30:15.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f862c064f10 msgr2=0x7f862c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:15.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f862c064f10 0x7f862c0673c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f863c009ae0 tx=0x7f863c008040 comp rx=0 tx=0).stop 2023-11-08T12:30:15.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 msgr2=0x7f864c0c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:15.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0c6870 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f864c06bc30 tx=0x7f8640004770 comp rx=0 tx=0).stop 2023-11-08T12:30:15.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 shutdown_connections 2023-11-08T12:30:15.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f862c064f10 0x7f862c0673c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c15c650 0x7f864c1581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f864c0cd0d0 0x7f864c0c6870 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 --2- 172.21.15.112:0/1225036305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f864c0b1b80 0x7f864c1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 >> 172.21.15.112:0/1225036305 conn(0x7f864c0b0f80 msgr2=0x7f864c0af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:15.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 shutdown_connections 2023-11-08T12:30:15.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:14.986+0000 7f864b59e700 1 -- 172.21.15.112:0/1225036305 wait complete. 2023-11-08T12:30:15.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:30:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 Processor -- start 2023-11-08T12:30:15.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 -- start start 2023-11-08T12:30:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c15a480 0x7f831c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f831c0c8d10 0x7f831c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:15.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f831c0ccd10 0x7f831c15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c15a850 con 0x7f831c0ccd10 2023-11-08T12:30:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0cada0 con 0x7f831c0c8d10 2023-11-08T12:30:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832317f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0ce060 con 0x7f831c15a480 2023-11-08T12:30:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832171c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f831c0ccd10 0x7f831c15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:15.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832171c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f831c0ccd10 0x7f831c15dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46410/0 (socket says 172.21.15.112:46410) 2023-11-08T12:30:15.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.202+0000 7f832171c700 1 -- 172.21.15.112:0/3133718501 learned_addr learned my addr 172.21.15.112:0/3133718501 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:15.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f831bfff700 1 --2- 172.21.15.112:0/3133718501 >> v2:172.21.15.133:3300/0 conn(0x7f831c0c8d10 0x7f831c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f8320f1b700 1 --2- 172.21.15.112:0/3133718501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c15a480 0x7f831c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832171c700 1 -- 172.21.15.112:0/3133718501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c15a480 msgr2=0x7f831c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832171c700 1 --2- 172.21.15.112:0/3133718501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c15a480 0x7f831c0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832171c700 1 -- 172.21.15.112:0/3133718501 >> v2:172.21.15.133:3300/0 conn(0x7f831c0c8d10 msgr2=0x7f831c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:15.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832171c700 1 --2- 172.21.15.112:0/3133718501 >> v2:172.21.15.133:3300/0 conn(0x7f831c0c8d10 0x7f831c0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832171c700 1 -- 172.21.15.112:0/3133718501 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0ce300 con 0x7f831c0ccd10 2023-11-08T12:30:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832171c700 1 --2- 172.21.15.112:0/3133718501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0ccd10 0x7f831c15dee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f831c06b8b0 tx=0x7f831400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2323f8c9929681 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f831b7fe700 1 -- 172.21.15.112:0/3133718501 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400e070 con 0x7f831c0ccd10 2023-11-08T12:30:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f831b7fe700 1 -- 172.21.15.112:0/3133718501 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831400b9c0 con 0x7f831c0ccd10 2023-11-08T12:30:15.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f831b7fe700 1 -- 172.21.15.112:0/3133718501 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400bd70 con 0x7f831c0ccd10 2023-11-08T12:30:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 -- 172.21.15.112:0/3133718501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0ccd10 msgr2=0x7f831c15dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 --2- 172.21.15.112:0/3133718501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0ccd10 0x7f831c15dee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f831c06b8b0 tx=0x7f831400b330 comp rx=0 tx=0).stop 2023-11-08T12:30:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 -- 172.21.15.112:0/3133718501 shutdown_connections 2023-11-08T12:30:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 --2- 172.21.15.112:0/3133718501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0ccd10 0x7f831c15dee0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 --2- 172.21.15.112:0/3133718501 >> v2:172.21.15.133:3300/0 conn(0x7f831c0c8d10 0x7f831c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 --2- 172.21.15.112:0/3133718501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c15a480 0x7f831c0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 -- 172.21.15.112:0/3133718501 >> 172.21.15.112:0/3133718501 conn(0x7f831c0cf350 msgr2=0x7f831c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 -- 172.21.15.112:0/3133718501 shutdown_connections 2023-11-08T12:30:15.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.206+0000 7f832317f700 1 -- 172.21.15.112:0/3133718501 wait complete. 2023-11-08T12:30:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 Processor -- start 2023-11-08T12:30:15.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 -- start start 2023-11-08T12:30:15.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0c8d10 0x7f831c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:15.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c0ccd10 0x7f831c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:15.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f831c15a480 0x7f831c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:15.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0c5e00 con 0x7f831c0c8d10 2023-11-08T12:30:15.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1f00e0 con 0x7f831c15a480 2023-11-08T12:30:15.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832317f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c1f0e60 con 0x7f831c0ccd10 2023-11-08T12:30:15.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0c8d10 0x7f831c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:15.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0c8d10 0x7f831c0c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46426/0 (socket says 172.21.15.112:46426) 2023-11-08T12:30:15.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 -- 172.21.15.112:0/2802429688 learned_addr learned my addr 172.21.15.112:0/2802429688 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:15.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f832171c700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f831c15a480 0x7f831c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:15.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f831bfff700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c0ccd10 0x7f831c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:15.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 -- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c0ccd10 msgr2=0x7f831c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:15.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c0ccd10 0x7f831c151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 -- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f831c15a480 msgr2=0x7f831c0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:15.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f831c15a480 0x7f831c0c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f8320f1b700 1 -- 172.21.15.112:0/2802429688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314009b30 con 0x7f831c0c8d10 2023-11-08T12:30:15.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.210+0000 7f831bfff700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c0ccd10 0x7f831c151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:15.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.214+0000 7f8320f1b700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0c8d10 0x7f831c0c5790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f831000d800 tx=0x7f831000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:15.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.214+0000 7f83197fa700 1 -- 172.21.15.112:0/2802429688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100125f0 con 0x7f831c0c8d10 2023-11-08T12:30:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.214+0000 7f83197fa700 1 -- 172.21.15.112:0/2802429688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310012750 con 0x7f831c0c8d10 2023-11-08T12:30:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.214+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c0add50 con 0x7f831c0c8d10 2023-11-08T12:30:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.214+0000 7f83197fa700 1 -- 172.21.15.112:0/2802429688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310012ac0 con 0x7f831c0c8d10 2023-11-08T12:30:15.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.214+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c0caa30 con 0x7f831c0c8d10 2023-11-08T12:30:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.214+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c0ca6e0 con 0x7f831c0c8d10 2023-11-08T12:30:15.224 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.218+0000 7f83197fa700 1 -- 172.21.15.112:0/2802429688 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f8310012c20 con 0x7f831c0c8d10 2023-11-08T12:30:15.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.218+0000 7f83197fa700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8308064ee0 0x7f8308067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:15.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.218+0000 7f83197fa700 1 -- 172.21.15.112:0/2802429688 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f83100822f0 con 0x7f831c0c8d10 2023-11-08T12:30:15.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.218+0000 7f831bfff700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8308064ee0 0x7f8308067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:15.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.218+0000 7f831bfff700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8308064ee0 0x7f8308067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f831c06add0 tx=0x7f830c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:15.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.222+0000 7f83197fa700 1 -- 172.21.15.112:0/2802429688 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f8310050260 con 0x7f831c0c8d10 2023-11-08T12:30:15.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.430+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f831c0726c0 con 0x7f831c0c8d10 2023-11-08T12:30:15.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.430+0000 7f83197fa700 1 -- 172.21.15.112:0/2802429688 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8310053880 con 0x7f831c0c8d10 2023-11-08T12:30:15.437 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T12:30:15.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8308064ee0 msgr2=0x7f8308067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:15.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8308064ee0 0x7f8308067390 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f831c06add0 tx=0x7f830c008040 comp rx=0 tx=0).stop 2023-11-08T12:30:15.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0c8d10 msgr2=0x7f831c0c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:15.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0c8d10 0x7f831c0c5790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f831000d800 tx=0x7f831000db10 comp rx=0 tx=0).stop 2023-11-08T12:30:15.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 shutdown_connections 2023-11-08T12:30:15.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8308064ee0 0x7f8308067390 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f831c15a480 0x7f831c0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f831c0ccd10 0x7f831c151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 --2- 172.21.15.112:0/2802429688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f831c0c8d10 0x7f831c0c5790 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:15.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 >> 172.21.15.112:0/2802429688 conn(0x7f831c0cf350 msgr2=0x7f831c0adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:15.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 shutdown_connections 2023-11-08T12:30:15.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:15.434+0000 7f832317f700 1 -- 172.21.15.112:0/2802429688 wait complete. 2023-11-08T12:30:15.463 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T12:30:15.464 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:30:15.464 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-11-08T12:30:15.465 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T12:30:15.465 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T12:30:15.465 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T12:30:15.466 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T12:30:15.466 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:30:15.466 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:30:15.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:15.467 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-11-08T12:30:15.485 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:30:15.486 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:30:15.486 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:30:15.486 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:30:15.487 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.487 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:30:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:30:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-11-08T12:30:15.488 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:30:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-11-08T12:30:15.488 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-11-08T12:30:15.489 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:30:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:30:15.489 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:30:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:30:15.489 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:30:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42215sec preferred_lft 42215sec 2023-11-08T12:30:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-11-08T12:30:15.490 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.490 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:30:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:61:4e:41:39 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:30:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:30:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.491 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:30:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:b3:c1:35:93:6c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:30:15.491 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T12:30:15.492 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.492 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::e41f:52ff:fe23:f36d/64 scope link 2023-11-08T12:30:15.492 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.492 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:30:15.492 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2e:62:07:0d:fa:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T12:30:15.493 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2c62:7ff:fe0d:fa29/64 scope link 2023-11-08T12:30:15.493 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.493 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:30:15.493 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:b3:c1:35:93:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T12:30:15.493 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::24b3:c1ff:fe35:936c/64 scope link 2023-11-08T12:30:15.494 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:30:15.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:15.495 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:30:15.574 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-11-08T12:30:15.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:15.578 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-11-08T12:30:15.646 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-11-08T12:30:15.646 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:30:15.647 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:30:15.647 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:30:15.647 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:30:15.647 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:30:15.648 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:30:15.648 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:30:15.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:15.649 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:30:15.650 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:30:15.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:30:15.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:30:15.651 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:30:15.651 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:30:15.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:15.783 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:30:15.798 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T12:30:15.799 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T12:30:15.800 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:30:15.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:15.800 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-11-08T12:30:15.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:30:15.880 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T12:30:15.943 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:30:15.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:30:15.944 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:30:16.007 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-08T12:30:16.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:16.008 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:30:16.142 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:30:16.143 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:30:16.168 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:30:16.169 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:30:16.169 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-11-08T12:30:16.169 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@c14663df-4425-4498-9232-3ffa5f578bfa.cephfs=/ 2023-11-08T12:30:16.169 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-11-08T12:30:16.177 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T12:30:16.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:16.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:30:16.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:16.211 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:30:16.294 INFO:teuthology.orchestra.run.smithi112.stdout:client5800 2023-11-08T12:30:16.294 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:16.295 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:16.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:16.357 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-11-08T12:30:16.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:16.435 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-11-08T12:30:16.503 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:30:16.504 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:30:16.504 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:30:16.505 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:30:16.505 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-11-08T12:30:16.505 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:30:16.649 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627777 2023-11-08T12:30:16.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.058+0000 7fc3460fc700 1 Processor -- start 2023-11-08T12:30:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.058+0000 7fc3460fc700 1 -- start start 2023-11-08T12:30:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3460fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc340160710 0x7fc3400cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3460fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc340070790 0x7fc340164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3460fc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400ad6c0 con 0x7fc3400cc860 2023-11-08T12:30:17.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3460fc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34006b1c0 con 0x7fc340160710 2023-11-08T12:30:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3460fc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400adc60 con 0x7fc340070790 2023-11-08T12:30:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc340160710 0x7fc3400cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3458fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc340070790 0x7fc340164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc340160710 0x7fc3400cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52712/0 (socket says 172.21.15.112:52712) 2023-11-08T12:30:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 -- 172.21.15.112:0/671758945 learned_addr learned my addr 172.21.15.112:0/671758945 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 -- 172.21.15.112:0/671758945 >> v2:172.21.15.133:3300/0 conn(0x7fc340070790 msgr2=0x7fc340164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 --2- 172.21.15.112:0/671758945 >> v2:172.21.15.133:3300/0 conn(0x7fc340070790 0x7fc340164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 -- 172.21.15.112:0/671758945 >> v1:172.21.15.133:6789/0 conn(0x7fc3400cc860 legacy=0x7fc340070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 -- 172.21.15.112:0/671758945 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34006b3d0 con 0x7fc340160710 2023-11-08T12:30:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc337fff700 1 -- 172.21.15.112:0/671758945 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306371627 0 0) 0x7fc3400ad6c0 con 0x7fc3400cc860 2023-11-08T12:30:17.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc3450fa700 1 --2- 172.21.15.112:0/671758945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340160710 0x7fc3400cc320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc3400cdbb0 tx=0x7fc33c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19aeeec2f0bf295d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc337fff700 1 -- 172.21.15.112:0/671758945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00e070 con 0x7fc340160710 2023-11-08T12:30:17.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc337fff700 1 -- 172.21.15.112:0/671758945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c00b910 con 0x7fc340160710 2023-11-08T12:30:17.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.062+0000 7fc337fff700 1 -- 172.21.15.112:0/671758945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00bcc0 con 0x7fc340160710 2023-11-08T12:30:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 -- 172.21.15.112:0/671758945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340160710 msgr2=0x7fc3400cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 --2- 172.21.15.112:0/671758945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340160710 0x7fc3400cc320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc3400cdbb0 tx=0x7fc33c00b330 comp rx=0 tx=0).stop 2023-11-08T12:30:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 -- 172.21.15.112:0/671758945 shutdown_connections 2023-11-08T12:30:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 --2- 172.21.15.112:0/671758945 >> v2:172.21.15.133:3300/0 conn(0x7fc340070790 0x7fc340164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 --2- 172.21.15.112:0/671758945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340160710 0x7fc3400cc320 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 -- 172.21.15.112:0/671758945 >> 172.21.15.112:0/671758945 conn(0x7fc3400b0f80 msgr2=0x7fc3400ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:17.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 -- 172.21.15.112:0/671758945 shutdown_connections 2023-11-08T12:30:17.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.066+0000 7fc3460fc700 1 -- 172.21.15.112:0/671758945 wait complete. 2023-11-08T12:30:17.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 Processor -- start 2023-11-08T12:30:17.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 -- start start 2023-11-08T12:30:17.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340070790 0x7fc3400c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3400cc860 0x7fc34015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc340160710 0x7fc3401f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34015bb80 con 0x7fc340070790 2023-11-08T12:30:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401f98a0 con 0x7fc340160710 2023-11-08T12:30:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3460fc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401f9ae0 con 0x7fc3400cc860 2023-11-08T12:30:17.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3450fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340070790 0x7fc3400c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3450fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340070790 0x7fc3400c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52718/0 (socket says 172.21.15.112:52718) 2023-11-08T12:30:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3450fa700 1 -- 172.21.15.112:0/3784858465 learned_addr learned my addr 172.21.15.112:0/3784858465 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3448f9700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3400cc860 0x7fc34015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3458fb700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc340160710 0x7fc3401f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3450fa700 1 -- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3400cc860 msgr2=0x7fc34015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3450fa700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3400cc860 0x7fc34015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3450fa700 1 -- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc340160710 msgr2=0x7fc3401f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.070+0000 7fc3450fa700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc340160710 0x7fc3401f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc3450fa700 1 -- 172.21.15.112:0/3784858465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c009b30 con 0x7fc340070790 2023-11-08T12:30:17.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc3450fa700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340070790 0x7fc3400c36f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00b680 tx=0x7fc33c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc335ffb700 1 -- 172.21.15.112:0/3784858465 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c004250 con 0x7fc340070790 2023-11-08T12:30:17.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc335ffb700 1 -- 172.21.15.112:0/3784858465 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c0043f0 con 0x7fc340070790 2023-11-08T12:30:17.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc335ffb700 1 -- 172.21.15.112:0/3784858465 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0047a0 con 0x7fc340070790 2023-11-08T12:30:17.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3400ad8f0 con 0x7fc340070790 2023-11-08T12:30:17.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34006b6b0 con 0x7fc340070790 2023-11-08T12:30:17.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.074+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc340160ae0 con 0x7fc340070790 2023-11-08T12:30:17.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.078+0000 7fc335ffb700 1 -- 172.21.15.112:0/3784858465 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc33c01b430 con 0x7fc340070790 2023-11-08T12:30:17.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.078+0000 7fc335ffb700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc324064ee0 0x7fc324067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.078+0000 7fc335ffb700 1 -- 172.21.15.112:0/3784858465 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc33c083390 con 0x7fc340070790 2023-11-08T12:30:17.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.078+0000 7fc3448f9700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc324064ee0 0x7fc324067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.078+0000 7fc3448f9700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc324064ee0 0x7fc324067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3400c3280 tx=0x7fc330009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.082+0000 7fc335ffb700 1 -- 172.21.15.112:0/3784858465 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc33c051440 con 0x7fc340070790 2023-11-08T12:30:17.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.294+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc340073cb0 con 0x7fc340070790 2023-11-08T12:30:17.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.294+0000 7fc335ffb700 1 -- 172.21.15.112:0/3784858465 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fc33c01f090 con 0x7fc340070790 2023-11-08T12:30:17.300 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:17.300 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:17.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc324064ee0 msgr2=0x7fc324067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc324064ee0 0x7fc324067390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3400c3280 tx=0x7fc330009040 comp rx=0 tx=0).stop 2023-11-08T12:30:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340070790 msgr2=0x7fc3400c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340070790 0x7fc3400c36f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00b680 tx=0x7fc33c004af0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 shutdown_connections 2023-11-08T12:30:17.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc324064ee0 0x7fc324067390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc340160710 0x7fc3401f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3400cc860 0x7fc34015b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 --2- 172.21.15.112:0/3784858465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340070790 0x7fc3400c36f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 >> 172.21.15.112:0/3784858465 conn(0x7fc3400b0f80 msgr2=0x7fc340069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:17.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 shutdown_connections 2023-11-08T12:30:17.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.298+0000 7fc3460fc700 1 -- 172.21.15.112:0/3784858465 wait complete. 2023-11-08T12:30:17.305 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:17.323 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-08T12:30:17.544 INFO:teuthology.orchestra.run.smithi133.stdout:{"message":"","return_code":0} 2023-11-08T12:30:17.545 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-08T12:30:17.545 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-08T12:30:17.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 Processor -- start 2023-11-08T12:30:17.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 -- start start 2023-11-08T12:30:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 0x556372fc5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fc3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 0x556373063fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x556372f31640 con 0x556372f36980 2023-11-08T12:30:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556372fc5680 con 0x556372fc1830 2023-11-08T12:30:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213e729140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x556372f33730 con 0x556372f03700 2023-11-08T12:30:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fc3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fc3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52728/0 (socket says 172.21.15.112:52728) 2023-11-08T12:30:17.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 -- 172.21.15.112:0/663480317 learned_addr learned my addr 172.21.15.112:0/663480317 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:17.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 -- 172.21.15.112:0/663480317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 msgr2=0x556372fc5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:17.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 --2- 172.21.15.112:0/663480317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 0x556372fc5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 -- 172.21.15.112:0/663480317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 msgr2=0x556373063fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 --2- 172.21.15.112:0/663480317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 0x556373063fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 -- 172.21.15.112:0/663480317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134005de0 con 0x556372f36980 2023-11-08T12:30:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213ba5d700 1 --2- 172.21.15.112:0/663480317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fc3ec0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f213000a7a0 tx=0x7f213000aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628b02af1e9000e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213aa5b700 1 -- 172.21.15.112:0/663480317 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000f070 con 0x556372f36980 2023-11-08T12:30:17.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213aa5b700 1 -- 172.21.15.112:0/663480317 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130008520 con 0x556372f36980 2023-11-08T12:30:17.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.614+0000 7f213aa5b700 1 -- 172.21.15.112:0/663480317 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130008890 con 0x556372f36980 2023-11-08T12:30:17.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 -- 172.21.15.112:0/663480317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 msgr2=0x556372fc3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 --2- 172.21.15.112:0/663480317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fc3ec0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f213000a7a0 tx=0x7f213000aab0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 -- 172.21.15.112:0/663480317 shutdown_connections 2023-11-08T12:30:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 --2- 172.21.15.112:0/663480317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 0x556373063fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 --2- 172.21.15.112:0/663480317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fc3ec0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 --2- 172.21.15.112:0/663480317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 0x556372fc5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 -- 172.21.15.112:0/663480317 >> 172.21.15.112:0/663480317 conn(0x556372f09c30 msgr2=0x556372f4fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:17.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 -- 172.21.15.112:0/663480317 shutdown_connections 2023-11-08T12:30:17.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 -- 172.21.15.112:0/663480317 wait complete. 2023-11-08T12:30:17.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 Processor -- start 2023-11-08T12:30:17.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.618+0000 7f213e729140 1 -- start start 2023-11-08T12:30:17.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 0x5563730641c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fdce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 0x556372fdd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637306b350 con 0x556372f36980 2023-11-08T12:30:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637306b5f0 con 0x556372fc1830 2023-11-08T12:30:17.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55637306b890 con 0x556372f03700 2023-11-08T12:30:17.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fdce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fdce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52738/0 (socket says 172.21.15.112:52738) 2023-11-08T12:30:17.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 -- 172.21.15.112:0/2546136378 learned_addr learned my addr 172.21.15.112:0/2546136378 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:17.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ca5f700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 0x556372fdd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213c25e700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 0x5563730641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 -- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 msgr2=0x5563730641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556372f03700 0x5563730641c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 -- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 msgr2=0x556372fdd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556372fc1830 0x556372fdd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 -- 172.21.15.112:0/2546136378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213000a420 con 0x556372f36980 2023-11-08T12:30:17.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213ba5d700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fdce90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f213000aaf0 tx=0x7f2130003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f2139a59700 1 -- 172.21.15.112:0/2546136378 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130020830 con 0x556372f36980 2023-11-08T12:30:17.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f2139a59700 1 -- 172.21.15.112:0/2546136378 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130020990 con 0x556372f36980 2023-11-08T12:30:17.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f2139a59700 1 -- 172.21.15.112:0/2546136378 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130020d40 con 0x556372f36980 2023-11-08T12:30:17.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556372e5d760 con 0x556372f36980 2023-11-08T12:30:17.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.622+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556372e43390 con 0x556372f36980 2023-11-08T12:30:17.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.626+0000 7f2139a59700 1 -- 172.21.15.112:0/2546136378 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2130026030 con 0x556372f36980 2023-11-08T12:30:17.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.626+0000 7f2139a59700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2128063810 0x7f2128065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f2139a59700 1 -- 172.21.15.112:0/2546136378 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f21300821f0 con 0x556372f36980 2023-11-08T12:30:17.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213c25e700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2128063810 0x7f2128065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213e729140 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x556373064700 0x55637306a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58) v8 -- 0x556372f51bd0 con 0x556373064700 2023-11-08T12:30:17.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213c25e700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2128063810 0x7f2128065cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f212c005fd0 tx=0x7f212c0033e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213ca5f700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x556373064700 0x55637306a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213ca5f700 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x556373064700 0x55637306a4a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213ca5f700 1 -- 172.21.15.112:0/2546136378 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f2134008a70 con 0x556373064700 2023-11-08T12:30:17.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x556373064700 msgr2=0x55637306a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.630+0000 7f213e729140 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x556373064700 0x55637306a4a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2128063810 msgr2=0x7f2128065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2128063810 0x7f2128065cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f212c005fd0 tx=0x7f212c0033e0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 msgr2=0x556372fdce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 --2- 172.21.15.112:0/2546136378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556372f36980 0x556372fdce90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f213000aaf0 tx=0x7f2130003020 comp rx=0 tx=0).stop 2023-11-08T12:30:17.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213ca5f700 1 -- 172.21.15.112:0/2546136378 reap_dead start 2023-11-08T12:30:17.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 shutdown_connections 2023-11-08T12:30:17.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 >> 172.21.15.112:0/2546136378 conn(0x556372f09c30 msgr2=0x556372fc3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:17.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 shutdown_connections 2023-11-08T12:30:17.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.634+0000 7f213e729140 1 -- 172.21.15.112:0/2546136378 wait complete. 2023-11-08T12:30:17.647 INFO:teuthology.orchestra.run.smithi112.stdout:Yalphaparent_a 2023-11-08T12:30:17.647 DEBUG:teuthology.orchestra.run.smithi112:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-08T12:30:17.733 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:30:17.733 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 1099511627777, 2023-11-08T12:30:17.734 INFO:teuthology.orchestra.run.smithi112.stdout: "ancestors": [ 2023-11-08T12:30:17.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:17.734 INFO:teuthology.orchestra.run.smithi112.stdout: "dirino": 1099511627776, 2023-11-08T12:30:17.734 INFO:teuthology.orchestra.run.smithi112.stdout: "dname": "alpha", 2023-11-08T12:30:17.735 INFO:teuthology.orchestra.run.smithi112.stdout: "version": 2 2023-11-08T12:30:17.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:17.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:17.735 INFO:teuthology.orchestra.run.smithi112.stdout: "dirino": 1, 2023-11-08T12:30:17.735 INFO:teuthology.orchestra.run.smithi112.stdout: "dname": "parent_a", 2023-11-08T12:30:17.736 INFO:teuthology.orchestra.run.smithi112.stdout: "version": 4 2023-11-08T12:30:17.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:17.736 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-11-08T12:30:17.736 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 9, 2023-11-08T12:30:17.736 INFO:teuthology.orchestra.run.smithi112.stdout: "old_pools": [] 2023-11-08T12:30:17.737 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:30:17.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:17.739 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-11-08T12:30:17.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 Processor -- start 2023-11-08T12:30:17.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 -- start start 2023-11-08T12:30:17.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a08329710 0x555a083eb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a0835c990 0x555a08377850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a083e7f50 0x555a0834fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a08251240 con 0x555a083e7f50 2023-11-08T12:30:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a083e8f20 con 0x555a0835c990 2023-11-08T12:30:17.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f254bb6b140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a083e6b20 con 0x555a08329710 2023-11-08T12:30:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a083e7f50 0x555a0834fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a083e7f50 0x555a0834fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52748/0 (socket says 172.21.15.112:52748) 2023-11-08T12:30:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 -- 172.21.15.112:0/518468969 learned_addr learned my addr 172.21.15.112:0/518468969 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:17.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f25496a0700 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a08329710 0x555a083eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 -- 172.21.15.112:0/518468969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a08329710 msgr2=0x555a083eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a08329710 0x555a083eb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 -- 172.21.15.112:0/518468969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a0835c990 msgr2=0x555a08377850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a0835c990 0x555a08377850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.846+0000 7f2549ea1700 1 -- 172.21.15.112:0/518468969 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534005d20 con 0x555a083e7f50 2023-11-08T12:30:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f2549ea1700 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a083e7f50 0x555a0834fb70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f254400a770 tx=0x7f254400aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb85279d57eb08a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f2543fff700 1 -- 172.21.15.112:0/518468969 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400f070 con 0x555a083e7f50 2023-11-08T12:30:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f2543fff700 1 -- 172.21.15.112:0/518468969 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25440084c0 con 0x555a083e7f50 2023-11-08T12:30:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f2543fff700 1 -- 172.21.15.112:0/518468969 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544008850 con 0x555a083e7f50 2023-11-08T12:30:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 -- 172.21.15.112:0/518468969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a083e7f50 msgr2=0x555a0834fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a083e7f50 0x555a0834fb70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f254400a770 tx=0x7f254400aa80 comp rx=0 tx=0).stop 2023-11-08T12:30:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 -- 172.21.15.112:0/518468969 shutdown_connections 2023-11-08T12:30:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a083e7f50 0x555a0834fb70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a0835c990 0x555a08377850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 --2- 172.21.15.112:0/518468969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a08329710 0x555a083eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 -- 172.21.15.112:0/518468969 >> 172.21.15.112:0/518468969 conn(0x555a0832fc40 msgr2=0x555a08404030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 -- 172.21.15.112:0/518468969 shutdown_connections 2023-11-08T12:30:17.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 -- 172.21.15.112:0/518468969 wait complete. 2023-11-08T12:30:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 Processor -- start 2023-11-08T12:30:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.850+0000 7f254bb6b140 1 -- start start 2023-11-08T12:30:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a08329710 0x555a0848ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a0835c990 0x555a08330200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a083e7f50 0x555a08401020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0848b8b0 con 0x555a0835c990 2023-11-08T12:30:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0848bb50 con 0x555a08329710 2023-11-08T12:30:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a0848bdf0 con 0x555a083e7f50 2023-11-08T12:30:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2540e9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a0835c990 0x555a08330200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2540e9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a0835c990 0x555a08330200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52764/0 (socket says 172.21.15.112:52764) 2023-11-08T12:30:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2540e9f700 1 -- 172.21.15.112:0/1221754554 learned_addr learned my addr 172.21.15.112:0/1221754554 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2549ea1700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a083e7f50 0x555a08401020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f25496a0700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a08329710 0x555a0848ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2549ea1700 1 -- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a08329710 msgr2=0x555a0848ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2549ea1700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555a08329710 0x555a0848ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2549ea1700 1 -- 172.21.15.112:0/1221754554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a0835c990 msgr2=0x555a08330200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2549ea1700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a0835c990 0x555a08330200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2549ea1700 1 -- 172.21.15.112:0/1221754554 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254400a420 con 0x555a083e7f50 2023-11-08T12:30:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2549ea1700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a083e7f50 0x555a08401020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f254400a770 tx=0x7f2544003020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2542ffd700 1 -- 172.21.15.112:0/1221754554 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544021670 con 0x555a083e7f50 2023-11-08T12:30:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2542ffd700 1 -- 172.21.15.112:0/1221754554 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25440217d0 con 0x555a083e7f50 2023-11-08T12:30:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555a08269390 con 0x555a083e7f50 2023-11-08T12:30:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f2542ffd700 1 -- 172.21.15.112:0/1221754554 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544021b80 con 0x555a083e7f50 2023-11-08T12:30:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.854+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a0825c8b0 con 0x555a083e7f50 2023-11-08T12:30:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.858+0000 7f2542ffd700 1 -- 172.21.15.112:0/1221754554 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2544021ce0 con 0x555a083e7f50 2023-11-08T12:30:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f2542ffd700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f252c063840 0x7f252c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f2542ffd700 1 -- 172.21.15.112:0/1221754554 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2544082cc0 con 0x555a083e7f50 2023-11-08T12:30:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f25496a0700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f252c063840 0x7f252c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f254bb6b140 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x555a08330740 0x555a084a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) v8 -- 0x555a0848b410 con 0x555a08330740 2023-11-08T12:30:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f2540e9f700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x555a08330740 0x555a084a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f25496a0700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f252c063840 0x7f252c065cf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f80 tx=0x7f253c006310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.862+0000 7f2540e9f700 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x555a08330740 0x555a084a30e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f2540e9f700 1 -- 172.21.15.112:0/1221754554 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v58'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2534019040 con 0x555a08330740 2023-11-08T12:30:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x555a08330740 msgr2=0x555a084a30e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x555a08330740 0x555a084a30e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f252c063840 msgr2=0x7f252c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f252c063840 0x7f252c065cf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f80 tx=0x7f253c006310 comp rx=0 tx=0).stop 2023-11-08T12:30:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a083e7f50 msgr2=0x555a08401020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 --2- 172.21.15.112:0/1221754554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x555a083e7f50 0x555a08401020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f254400a770 tx=0x7f2544003020 comp rx=0 tx=0).stop 2023-11-08T12:30:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f2549ea1700 1 -- 172.21.15.112:0/1221754554 reap_dead start 2023-11-08T12:30:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 shutdown_connections 2023-11-08T12:30:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 >> 172.21.15.112:0/1221754554 conn(0x555a0832fc40 msgr2=0x555a08404030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 shutdown_connections 2023-11-08T12:30:17.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:17.866+0000 7f254bb6b140 1 -- 172.21.15.112:0/1221754554 wait complete. 2023-11-08T12:30:17.879 DEBUG:teuthology.orchestra.run.smithi112:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-08T12:30:17.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-11-08T12:30:18.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cf4c4700 1 Processor -- start 2023-11-08T12:30:18.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cf4c4700 1 -- start start 2023-11-08T12:30:18.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cf4c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43c815c6e0 0x7f43c8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cf4c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c806a510 0x7f43c806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cf4c4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c815cab0 con 0x7f43c8071fe0 2023-11-08T12:30:18.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cf4c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c80d2800 con 0x7f43c815c6e0 2023-11-08T12:30:18.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cf4c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80702d0 con 0x7f43c806a510 2023-11-08T12:30:18.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43ce4c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43c815c6e0 0x7f43c8071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cecc3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c806a510 0x7f43c806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cdcc1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f43c8071fe0 0x7f43c8069e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:57388/0 (socket says 172.21.15.112:57388) 2023-11-08T12:30:18.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2602377192 learned_addr learned my addr 172.21.15.112:0/2602377192 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:18.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cecc3700 1 -- 172.21.15.112:0/2602377192 >> v2:172.21.15.133:3300/0 conn(0x7f43c815c6e0 msgr2=0x7f43c8071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cecc3700 1 --2- 172.21.15.112:0/2602377192 >> v2:172.21.15.133:3300/0 conn(0x7f43c815c6e0 0x7f43c8071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cd4c0700 1 -- 172.21.15.112:0/2602377192 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936951232 0 0) 0x7f43c815cab0 con 0x7f43c8071fe0 2023-11-08T12:30:18.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cecc3700 1 -- 172.21.15.112:0/2602377192 >> v1:172.21.15.133:6789/0 conn(0x7f43c8071fe0 legacy=0x7f43c8069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.046+0000 7f43cecc3700 1 -- 172.21.15.112:0/2602377192 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80d2a10 con 0x7f43c806a510 2023-11-08T12:30:18.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cecc3700 1 --2- 172.21.15.112:0/2602377192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c806a510 0x7f43c806c630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009d90 tx=0x7f43c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=197da2e0a8aa93d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cd4c0700 1 -- 172.21.15.112:0/2602377192 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000e070 con 0x7f43c806a510 2023-11-08T12:30:18.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cd4c0700 1 -- 172.21.15.112:0/2602377192 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c000bb20 con 0x7f43c806a510 2023-11-08T12:30:18.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cd4c0700 1 -- 172.21.15.112:0/2602377192 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0012430 con 0x7f43c806a510 2023-11-08T12:30:18.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2602377192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c806a510 msgr2=0x7f43c806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2602377192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c806a510 0x7f43c806c630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009d90 tx=0x7f43c000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:18.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2602377192 shutdown_connections 2023-11-08T12:30:18.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2602377192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c806a510 0x7f43c806c630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2602377192 >> v2:172.21.15.133:3300/0 conn(0x7f43c815c6e0 0x7f43c8071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2602377192 >> 172.21.15.112:0/2602377192 conn(0x7f43c80b65b0 msgr2=0x7f43c8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2602377192 shutdown_connections 2023-11-08T12:30:18.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.050+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2602377192 wait complete. 2023-11-08T12:30:18.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.054+0000 7f43cf4c4700 1 Processor -- start 2023-11-08T12:30:18.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.054+0000 7f43cf4c4700 1 -- start start 2023-11-08T12:30:18.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43c806a510 0x7f43c80c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8071fe0 0x7f43c809b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c815c6e0 0x7f43c809b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c81550b0 con 0x7f43c8071fe0 2023-11-08T12:30:18.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80b3510 con 0x7f43c806a510 2023-11-08T12:30:18.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c81541e0 con 0x7f43c815c6e0 2023-11-08T12:30:18.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8071fe0 0x7f43c809b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43ce4c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43c806a510 0x7f43c80c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43ce4c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43c806a510 0x7f43c80c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38128/0 (socket says 172.21.15.112:38128) 2023-11-08T12:30:18.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8071fe0 0x7f43c809b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52768/0 (socket says 172.21.15.112:52768) 2023-11-08T12:30:18.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43ce4c2700 1 -- 172.21.15.112:0/2791913457 learned_addr learned my addr 172.21.15.112:0/2791913457 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cecc3700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c815c6e0 0x7f43c809b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2791913457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c815c6e0 msgr2=0x7f43c809b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c815c6e0 0x7f43c809b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2791913457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43c806a510 msgr2=0x7f43c80c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43c806a510 0x7f43c80c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2791913457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009a70 con 0x7f43c8071fe0 2023-11-08T12:30:18.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8071fe0 0x7f43c809b450 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f43b80011e0 tx=0x7f43b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43beffd700 1 -- 172.21.15.112:0/2791913457 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8004ca0 con 0x7f43c8071fe0 2023-11-08T12:30:18.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43beffd700 1 -- 172.21.15.112:0/2791913457 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b8004e00 con 0x7f43c8071fe0 2023-11-08T12:30:18.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43beffd700 1 -- 172.21.15.112:0/2791913457 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8007310 con 0x7f43c8071fe0 2023-11-08T12:30:18.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c80d2fd0 con 0x7f43c8071fe0 2023-11-08T12:30:18.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.058+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c80d2cf0 con 0x7f43c8071fe0 2023-11-08T12:30:18.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.062+0000 7f43beffd700 1 -- 172.21.15.112:0/2791913457 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f43b801a020 con 0x7f43c8071fe0 2023-11-08T12:30:18.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.062+0000 7f43d39b1740 1 Processor -- start 2023-11-08T12:30:18.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.062+0000 7f43d39b1740 1 -- start start 2023-11-08T12:30:18.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.062+0000 7f43beffd700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f43ac064ee0 0x7f43ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.062+0000 7f43beffd700 1 -- 172.21.15.112:0/2791913457 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f43b8081b60 con 0x7f43c8071fe0 2023-11-08T12:30:18.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.062+0000 7f43cecc3700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f43ac064ee0 0x7f43ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcdfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xce8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xce9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xba0c80 con 0xa31d80 2023-11-08T12:30:18.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xc10d60 con 0xa319b0 2023-11-08T12:30:18.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xc0a060 con 0xa7ca30 2023-11-08T12:30:18.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcdfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcdfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52770/0 (socket says 172.21.15.112:52770) 2023-11-08T12:30:18.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 -- 172.21.15.112:0/1161228423 learned_addr learned my addr 172.21.15.112:0/1161228423 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43cecc3700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f43ac064ee0 0x7f43ac067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43c806f060 tx=0x7f43c0011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xce8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43cecc3700 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xce9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 -- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 msgr2=0xce9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xce9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 -- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 msgr2=0xce8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xce8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 -- 172.21.15.112:0/1161228423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc2f4e0 con 0xa31d80 2023-11-08T12:30:18.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xce8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:18.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcdfd70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009e30 tx=0x7f43c40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76532e51c4c11b52 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43abfff700 1 -- 172.21.15.112:0/1161228423 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4011dc0 con 0xa31d80 2023-11-08T12:30:18.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43abfff700 1 -- 172.21.15.112:0/1161228423 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4014440 con 0xa31d80 2023-11-08T12:30:18.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43abfff700 1 -- 172.21.15.112:0/1161228423 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40147b0 con 0xa31d80 2023-11-08T12:30:18.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- 172.21.15.112:0/1161228423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 msgr2=0xcdfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcdfd70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009e30 tx=0x7f43c40115a0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- 172.21.15.112:0/1161228423 shutdown_connections 2023-11-08T12:30:18.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xce9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xce8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1161228423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcdfd70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- 172.21.15.112:0/1161228423 >> 172.21.15.112:0/1161228423 conn(0xa32150 msgr2=0xcca350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- 172.21.15.112:0/1161228423 shutdown_connections 2023-11-08T12:30:18.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.066+0000 7f43d39b1740 1 -- 172.21.15.112:0/1161228423 wait complete. 2023-11-08T12:30:18.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 -- start start 2023-11-08T12:30:18.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 Processor -- start 2023-11-08T12:30:18.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xc9f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcee400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xab6dc0 con 0xa31d80 2023-11-08T12:30:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xcc9920 con 0xa319b0 2023-11-08T12:30:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xc9f580 con 0xa7ca30 2023-11-08T12:30:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43d39b1740 10 client.0 _ll_register_callbacks cb 0xc65b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:30:18.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcee400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52784/0 (socket says 172.21.15.112:52784) 2023-11-08T12:30:18.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2559230765 learned_addr learned my addr 172.21.15.112:0/2559230765 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cecc3700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xc9f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 msgr2=0xcca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 msgr2=0xc9f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xc9f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 -- 172.21.15.112:0/2559230765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c4009a30 con 0xa31d80 2023-11-08T12:30:18.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xc9f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:18.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcee400 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f43b804fbc0 tx=0x7f43b8019380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e35924d455a63f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.070+0000 7f43a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:30:18.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43a97fa700 1 -- 172.21.15.112:0/2559230765 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8052ed0 con 0xa31d80 2023-11-08T12:30:18.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43a97fa700 1 -- 172.21.15.112:0/2559230765 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f43b805b510 con 0xa31d80 2023-11-08T12:30:18.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc030e0 con 0xa31d80 2023-11-08T12:30:18.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43a97fa700 1 -- 172.21.15.112:0/2559230765 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b8007470 con 0xa31d80 2023-11-08T12:30:18.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 10 client.6012 fetch_fsmap learned FSMap version 24 2023-11-08T12:30:18.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0xa7dc80 con 0xa31d80 2023-11-08T12:30:18.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43a97fa700 1 -- 172.21.15.112:0/2559230765 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc030e0 con 0xa31d80 2023-11-08T12:30:18.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43a97fa700 1 -- 172.21.15.112:0/2559230765 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f43b80075d0 con 0xa31d80 2023-11-08T12:30:18.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 10 client.6012 fetch_fsmap finished waiting for FSMap version 24 2023-11-08T12:30:18.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 10 client.6012 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-08T12:30:18.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 20 client.6012 populate_metadata read hostname 'smithi112' 2023-11-08T12:30:18.087 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xcdf190 0xcdf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 4 client.6012 mds_command: new command op to 5820 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:30:18.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 --> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc02e00 con 0xcdf190 2023-11-08T12:30:18.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xcdf190 0xcdf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xcdf190 0xcdf590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5772b9127bdf5725 server_cookie=e5931dc9a4c8765e in_seq=0 out_seq=0 2023-11-08T12:30:18.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f43a97fa700 10 client.6012 ms_handle_connect on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f266d80b700 1 Processor -- start 2023-11-08T12:30:18.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.074+0000 7f266d80b700 1 -- start start 2023-11-08T12:30:18.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43a97fa700 1 -- 172.21.15.112:0/2559230765 <== mds.0 v2:172.21.15.133:6832/4144675081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xc02e00 con 0xcdf190 2023-11-08T12:30:18.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43a97fa700 10 client.6012 handle_command_reply: tid=0 2023-11-08T12:30:18.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 client.6012 shutdown 2023-11-08T12:30:18.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 msgr2=0xcee400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcee400 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f43b804fbc0 tx=0x7f43b8019380 comp rx=0 tx=0).stop 2023-11-08T12:30:18.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 shutdown_connections 2023-11-08T12:30:18.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcee400 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xcdf190 0xcdf590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d80b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f266806c6a0 0x7f266806cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d80b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266806ac60 con 0x7f2668071600 2023-11-08T12:30:18.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 --2- 172.21.15.112:0/2559230765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xc9f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 >> 172.21.15.112:0/2559230765 conn(0xa32150 msgr2=0xcb35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43a97fa700 0 client.6012 ms_handle_reset on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d80b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26680b4ee0 con 0x7f26680b1730 2023-11-08T12:30:18.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d80b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26680b1eb0 con 0x7f266806c6a0 2023-11-08T12:30:18.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 shutdown_connections 2023-11-08T12:30:18.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 1 -- 172.21.15.112:0/2559230765 wait complete. 2023-11-08T12:30:18.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266c809700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2668071600 0x7f26680719d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:34410/0 (socket says 172.21.15.112:34410) 2023-11-08T12:30:18.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266c809700 1 -- 172.21.15.112:0/1604624545 learned_addr learned my addr 172.21.15.112:0/1604624545 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:18.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d00a700 1 --2- 172.21.15.112:0/1604624545 >> v2:172.21.15.133:3300/0 conn(0x7f266806c6a0 0x7f266806cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f43d39b1740 20 client.6012 trim_cache size 0 max 16384 2023-11-08T12:30:18.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f26677fe700 1 -- 172.21.15.112:0/1604624545 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781545628 0 0) 0x7f266806ac60 con 0x7f2668071600 2023-11-08T12:30:18.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f26677fe700 1 -- 172.21.15.112:0/1604624545 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26580035d0 con 0x7f2668071600 2023-11-08T12:30:18.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f26677fe700 1 -- 172.21.15.112:0/1604624545 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568383314 0 0) 0x7f26680b4ee0 con 0x7f26680b1730 2023-11-08T12:30:18.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f26677fe700 1 -- 172.21.15.112:0/1604624545 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f266806ac60 con 0x7f26680b1730 2023-11-08T12:30:18.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d00a700 1 -- 172.21.15.112:0/1604624545 >> v1:172.21.15.133:6789/0 conn(0x7f26680b1730 legacy=0x7f26680b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d00a700 1 -- 172.21.15.112:0/1604624545 >> v1:172.21.15.112:6789/0 conn(0x7f2668071600 legacy=0x7f26680719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d00a700 1 -- 172.21.15.112:0/1604624545 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26680b5370 con 0x7f266806c6a0 2023-11-08T12:30:18.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f266d00a700 1 --2- 172.21.15.112:0/1604624545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f266806c6a0 0x7f266806cb20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2660009d90 tx=0x7f266000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25beaffffd2f8a04 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f26677fe700 1 -- 172.21.15.112:0/1604624545 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000e070 con 0x7f266806c6a0 2023-11-08T12:30:18.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f26677fe700 1 -- 172.21.15.112:0/1604624545 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000bb20 con 0x7f266806c6a0 2023-11-08T12:30:18.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.078+0000 7f26677fe700 1 -- 172.21.15.112:0/1604624545 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660012430 con 0x7f266806c6a0 2023-11-08T12:30:18.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- 172.21.15.112:0/1604624545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f266806c6a0 msgr2=0x7f266806cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 --2- 172.21.15.112:0/1604624545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f266806c6a0 0x7f266806cb20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2660009d90 tx=0x7f266000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:18.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- 172.21.15.112:0/1604624545 shutdown_connections 2023-11-08T12:30:18.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 --2- 172.21.15.112:0/1604624545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f266806c6a0 0x7f266806cb20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- 172.21.15.112:0/1604624545 >> 172.21.15.112:0/1604624545 conn(0x7f26680b64e0 msgr2=0x7f26680d2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- 172.21.15.112:0/1604624545 shutdown_connections 2023-11-08T12:30:18.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- 172.21.15.112:0/1604624545 wait complete. 2023-11-08T12:30:18.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 Processor -- start 2023-11-08T12:30:18.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- start start 2023-11-08T12:30:18.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f266806c6a0 0x7f26680c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2668071600 0x7f266815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26680b1730 0x7f26680cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26681e6e60 con 0x7f26680b1730 2023-11-08T12:30:18.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680c9100 con 0x7f2668071600 2023-11-08T12:30:18.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.082+0000 7f266d80b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26681e64c0 con 0x7f266806c6a0 2023-11-08T12:30:18.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26680b1730 0x7f26680cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26680b1730 0x7f26680cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52792/0 (socket says 172.21.15.112:52792) 2023-11-08T12:30:18.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f2667fff700 1 --2- 172.21.15.112:0/1751429586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2668071600 0x7f266815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 -- 172.21.15.112:0/1751429586 learned_addr learned my addr 172.21.15.112:0/1751429586 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266c809700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f266806c6a0 0x7f26680c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 -- 172.21.15.112:0/1751429586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f266806c6a0 msgr2=0x7f26680c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 --2- 172.21.15.112:0/1751429586 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f266806c6a0 0x7f26680c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 -- 172.21.15.112:0/1751429586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2668071600 msgr2=0x7f266815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 --2- 172.21.15.112:0/1751429586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2668071600 0x7f266815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 -- 172.21.15.112:0/1751429586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660009a70 con 0x7f26680b1730 2023-11-08T12:30:18.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d00a700 1 --2- 172.21.15.112:0/1751429586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26680b1730 0x7f26680cf3d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2660014040 tx=0x7f2660004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660012430 con 0x7f26680b1730 2023-11-08T12:30:18.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2660020070 con 0x7f26680b1730 2023-11-08T12:30:18.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d80b700 1 -- 172.21.15.112:0/1751429586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2668072210 con 0x7f26680b1730 2023-11-08T12:30:18.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660027880 con 0x7f26680b1730 2023-11-08T12:30:18.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d80b700 1 -- 172.21.15.112:0/1751429586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26680b4b00 con 0x7f26680b1730 2023-11-08T12:30:18.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.086+0000 7f266d80b700 1 -- 172.21.15.112:0/1751429586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f266806a6a0 con 0x7f26680b1730 2023-11-08T12:30:18.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.090+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f266002e070 con 0x7f26680b1730 2023-11-08T12:30:18.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.090+0000 7f26657fa700 1 --2- 172.21.15.112:0/1751429586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f264c064ee0 0x7f264c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.090+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2660022070 con 0x7f26680b1730 2023-11-08T12:30:18.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.090+0000 7f266c809700 1 --2- 172.21.15.112:0/1751429586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f264c064ee0 0x7f264c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.094+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+502 (secure 0 0 0) 0x7f2660084630 con 0x7f26680b1730 2023-11-08T12:30:18.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.094+0000 7f266d80b700 1 -- 172.21.15.112:0/1751429586 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f266804ee90 con 0x7f26680b1730 2023-11-08T12:30:18.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.094+0000 7f266c809700 1 --2- 172.21.15.112:0/1751429586 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f264c064ee0 0x7f264c067390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f265c007fd0 tx=0x7f265c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 Processor -- start 2023-11-08T12:30:18.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 -- start start 2023-11-08T12:30:18.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xcdea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcc7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcc8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xc059d0 con 0xa31d80 2023-11-08T12:30:18.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xbbfbd0 con 0xa319b0 2023-11-08T12:30:18.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xbddf60 con 0xa7ca30 2023-11-08T12:30:18.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcc7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcc7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52808/0 (socket says 172.21.15.112:52808) 2023-11-08T12:30:18.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 -- 172.21.15.112:0/436396915 learned_addr learned my addr 172.21.15.112:0/436396915 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cecc3700 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcc8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xcdea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 -- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 msgr2=0xcc8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcc8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 -- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 msgr2=0xcdea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xcdea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 -- 172.21.15.112:0/436396915 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c806d3f0 con 0xa31d80 2023-11-08T12:30:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcc7cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f43b8050130 tx=0x7f43b8069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7862ea6bea8ecaf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43bcff9700 1 -- 172.21.15.112:0/436396915 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8052ed0 con 0xa31d80 2023-11-08T12:30:18.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43bcff9700 1 -- 172.21.15.112:0/436396915 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b804fa50 con 0xa31d80 2023-11-08T12:30:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.098+0000 7f43bcff9700 1 -- 172.21.15.112:0/436396915 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b805b550 con 0xa31d80 2023-11-08T12:30:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 -- 172.21.15.112:0/436396915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 msgr2=0xcc7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcc7cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f43b8050130 tx=0x7f43b8069000 comp rx=0 tx=0).stop 2023-11-08T12:30:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 -- 172.21.15.112:0/436396915 shutdown_connections 2023-11-08T12:30:18.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa7ca30 0xcc8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa31d80 0xcc7cd0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 --2- 172.21.15.112:0/436396915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa319b0 0xcdea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 -- 172.21.15.112:0/436396915 >> 172.21.15.112:0/436396915 conn(0xa32150 msgr2=0xcf81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 -- 172.21.15.112:0/436396915 shutdown_connections 2023-11-08T12:30:18.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 -- 172.21.15.112:0/436396915 wait complete. 2023-11-08T12:30:18.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 -- start start 2023-11-08T12:30:18.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.102+0000 7f43d39b1740 1 Processor -- start 2023-11-08T12:30:18.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa319b0 0xcfd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa31d80 0xcfebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa7ca30 0xcff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xcfcce0 con 0xa7ca30 2023-11-08T12:30:18.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xcfd650 con 0xa31d80 2023-11-08T12:30:18.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xcded40 con 0xa319b0 2023-11-08T12:30:18.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 10 client.0 _ll_register_callbacks cb 0xc30910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:30:18.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa7ca30 0xcff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa7ca30 0xcff0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52824/0 (socket says 172.21.15.112:52824) 2023-11-08T12:30:18.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 -- 172.21.15.112:0/1590478673 learned_addr learned my addr 172.21.15.112:0/1590478673 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa319b0 0xcfd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cdcc1700 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa31d80 0xcfebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 -- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa319b0 msgr2=0xcfd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa319b0 0xcfd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 -- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa31d80 msgr2=0xcfebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa31d80 0xcfebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 -- 172.21.15.112:0/1590478673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xa7dc80 con 0xa7ca30 2023-11-08T12:30:18.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43cecc3700 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa7ca30 0xcff0f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f43c0013000 tx=0x7f43c0004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf63234c4de204e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:30:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43a97fa700 1 -- 172.21.15.112:0/1590478673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00046a0 con 0xa7ca30 2023-11-08T12:30:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43a97fa700 1 -- 172.21.15.112:0/1590478673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f43c002d050 con 0xa7ca30 2023-11-08T12:30:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xcf1750 con 0xa7ca30 2023-11-08T12:30:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43a97fa700 1 -- 172.21.15.112:0/1590478673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43c0004800 con 0xa7ca30 2023-11-08T12:30:18.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 10 client.6024 fetch_fsmap learned FSMap version 24 2023-11-08T12:30:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0xbb6bb0 con 0xa7ca30 2023-11-08T12:30:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43a97fa700 1 -- 172.21.15.112:0/1590478673 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xcf1750 con 0xa7ca30 2023-11-08T12:30:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43a97fa700 1 -- 172.21.15.112:0/1590478673 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f43c0034470 con 0xa7ca30 2023-11-08T12:30:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 10 client.6024 fetch_fsmap finished waiting for FSMap version 24 2023-11-08T12:30:18.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 10 client.6024 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-08T12:30:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 20 client.6024 populate_metadata read hostname 'smithi112' 2023-11-08T12:30:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xd478f0 0xcc7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 4 client.6024 mds_command: new command op to 5820 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-08T12:30:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.106+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 --> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x7f43c4014440 con 0xd478f0 2023-11-08T12:30:18.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xd478f0 0xcc7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43ce4c2700 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xd478f0 0xcc7a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a0969429796338d server_cookie=ce2c1d24abad7e05 in_seq=0 out_seq=0 2023-11-08T12:30:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43a97fa700 10 client.6024 ms_handle_connect on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43a97fa700 1 -- 172.21.15.112:0/1590478673 <== mds.0 v2:172.21.15.133:6832/4144675081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f43c4014440 con 0xd478f0 2023-11-08T12:30:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43a97fa700 10 client.6024 handle_command_reply: tid=0 2023-11-08T12:30:18.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 client.6024 shutdown 2023-11-08T12:30:18.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa7ca30 msgr2=0xcff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa7ca30 0xcff0f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f43c0013000 tx=0x7f43c0004b60 comp rx=0 tx=0).stop 2023-11-08T12:30:18.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 shutdown_connections 2023-11-08T12:30:18.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xa7ca30 0xcff0f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0xd478f0 0xcc7a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xa31d80 0xcfebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 --2- 172.21.15.112:0/1590478673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xa319b0 0xcfd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 >> 172.21.15.112:0/1590478673 conn(0xa32150 msgr2=0xcc6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43a97fa700 0 client.6024 ms_handle_reset on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 shutdown_connections 2023-11-08T12:30:18.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 1 -- 172.21.15.112:0/1590478673 wait complete. 2023-11-08T12:30:18.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.110+0000 7f43d39b1740 20 client.6024 trim_cache size 0 max 16384 2023-11-08T12:30:18.135 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:30:18.136 INFO:teuthology.orchestra.run.smithi112.stdout: "return_code": 0, 2023-11-08T12:30:18.136 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_tag": "be752ffe-2127-4070-b7ee-07e9de5b459a", 2023-11-08T12:30:18.136 INFO:teuthology.orchestra.run.smithi112.stdout: "mode": "asynchronous" 2023-11-08T12:30:18.136 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:30:18.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f43ac064ee0 msgr2=0x7f43ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f43ac064ee0 0x7f43ac067390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43c806f060 tx=0x7f43c0011000 comp rx=0 tx=0).stop 2023-11-08T12:30:18.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8071fe0 msgr2=0x7f43c809b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8071fe0 0x7f43c809b450 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f43b80011e0 tx=0x7f43b800c800 comp rx=0 tx=0).stop 2023-11-08T12:30:18.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 shutdown_connections 2023-11-08T12:30:18.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f43ac064ee0 0x7f43ac067390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43c815c6e0 0x7f43c809b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43c8071fe0 0x7f43c809b450 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 --2- 172.21.15.112:0/2791913457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43c806a510 0x7f43c80c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 >> 172.21.15.112:0/2791913457 conn(0x7f43c80b65b0 msgr2=0x7f43c80b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 shutdown_connections 2023-11-08T12:30:18.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.114+0000 7f43cf4c4700 1 -- 172.21.15.112:0/2791913457 wait complete. 2023-11-08T12:30:18.140 INFO:tasks.ceph.mds.d.smithi133.stderr:2023-11-08T12:30:18.110+0000 7febfb1d1700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5800=0-4194304@1} caps={5800=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5800 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5618a8aadb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-08T12:30:18.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-08T12:30:18.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616e9a8700 1 Processor -- start 2023-11-08T12:30:18.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616e9a8700 1 -- start start 2023-11-08T12:30:18.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616e9a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616e9a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f61680cc860 0x7f6168070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616e9a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680ad6c0 con 0x7f61680705c0 2023-11-08T12:30:18.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616e9a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6168070a60 con 0x7f61680cc860 2023-11-08T12:30:18.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616e9a8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616806b1c0 con 0x7f6168160710 2023-11-08T12:30:18.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616d1a5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f61680cc860 0x7f6168070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616d9a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616d1a5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f61680cc860 0x7f6168070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38200/0 (socket says 172.21.15.112:38200) 2023-11-08T12:30:18.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.326+0000 7f616d1a5700 1 -- 172.21.15.112:0/241364312 learned_addr learned my addr 172.21.15.112:0/241364312 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616d1a5700 1 -- 172.21.15.112:0/241364312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 msgr2=0x7f61680cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616d1a5700 1 --2- 172.21.15.112:0/241364312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616d1a5700 1 -- 172.21.15.112:0/241364312 >> v1:172.21.15.133:6789/0 conn(0x7f61680705c0 legacy=0x7f6168069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616d1a5700 1 -- 172.21.15.112:0/241364312 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680adc60 con 0x7f61680cc860 2023-11-08T12:30:18.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616d1a5700 1 --2- 172.21.15.112:0/241364312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f6168070080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6158009910 tx=0x7f6158009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823d9d2aad3e7eec server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616c9a4700 1 -- 172.21.15.112:0/241364312 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158011830 con 0x7f61680cc860 2023-11-08T12:30:18.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616c9a4700 1 -- 172.21.15.112:0/241364312 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158011990 con 0x7f61680cc860 2023-11-08T12:30:18.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616c9a4700 1 -- 172.21.15.112:0/241364312 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158011d40 con 0x7f61680cc860 2023-11-08T12:30:18.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 -- 172.21.15.112:0/241364312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 msgr2=0x7f6168070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 --2- 172.21.15.112:0/241364312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f6168070080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6158009910 tx=0x7f6158009c20 comp rx=0 tx=0).stop 2023-11-08T12:30:18.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 -- 172.21.15.112:0/241364312 shutdown_connections 2023-11-08T12:30:18.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 --2- 172.21.15.112:0/241364312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f6168070080 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 --2- 172.21.15.112:0/241364312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 -- 172.21.15.112:0/241364312 >> 172.21.15.112:0/241364312 conn(0x7f61680b0f80 msgr2=0x7f61680ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 -- 172.21.15.112:0/241364312 shutdown_connections 2023-11-08T12:30:18.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.330+0000 7f616e9a8700 1 -- 172.21.15.112:0/241364312 wait complete. 2023-11-08T12:30:18.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.334+0000 7f616e9a8700 1 Processor -- start 2023-11-08T12:30:18.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.334+0000 7f616e9a8700 1 -- start start 2023-11-08T12:30:18.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61680705c0 0x7f616815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f61680c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616815de10 con 0x7f61680705c0 2023-11-08T12:30:18.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616815b050 con 0x7f61680cc860 2023-11-08T12:30:18.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616815db30 con 0x7f6168160710 2023-11-08T12:30:18.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61680705c0 0x7f616815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e1a7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61680705c0 0x7f616815ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52838/0 (socket says 172.21.15.112:52838) 2023-11-08T12:30:18.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 -- 172.21.15.112:0/2103540135 learned_addr learned my addr 172.21.15.112:0/2103540135 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d1a5700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f61680c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 -- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 msgr2=0x7f61680c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 -- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 msgr2=0x7f61680c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f61680c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 -- 172.21.15.112:0/2103540135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009570 con 0x7f61680705c0 2023-11-08T12:30:18.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d1a5700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f61680c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:18.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616d9a6700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61680705c0 0x7f616815ab10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f616400e840 tx=0x7f616400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f615e7fc700 1 -- 172.21.15.112:0/2103540135 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640095a0 con 0x7f61680705c0 2023-11-08T12:30:18.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f615e7fc700 1 -- 172.21.15.112:0/2103540135 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164013680 con 0x7f61680705c0 2023-11-08T12:30:18.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616806b6b0 con 0x7f61680705c0 2023-11-08T12:30:18.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f615e7fc700 1 -- 172.21.15.112:0/2103540135 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640139f0 con 0x7f61680705c0 2023-11-08T12:30:18.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.338+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616806b3d0 con 0x7f61680705c0 2023-11-08T12:30:18.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.342+0000 7f615e7fc700 1 -- 172.21.15.112:0/2103540135 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6164019030 con 0x7f61680705c0 2023-11-08T12:30:18.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 Processor -- start 2023-11-08T12:30:18.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 -- start start 2023-11-08T12:30:18.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f615e7fc700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f614c064f10 0x7f614c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f615e7fc700 1 -- 172.21.15.112:0/2103540135 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6164081cc0 con 0x7f61680705c0 2023-11-08T12:30:18.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616e1a7700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f614c064f10 0x7f614c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197dc10 0x1bfd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197d840 0x1bfdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1bfe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aecd20 con 0x19c88c0 2023-11-08T12:30:18.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b5cd60 con 0x197d840 2023-11-08T12:30:18.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b56060 con 0x197dc10 2023-11-08T12:30:18.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616e1a7700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f614c064f10 0x7f614c0673c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f616815f350 tx=0x7f6160009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616e1a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1bfe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616e1a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1bfe250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52846/0 (socket says 172.21.15.112:52846) 2023-11-08T12:30:18.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616e1a7700 1 -- 172.21.15.112:0/2181767650 learned_addr learned my addr 172.21.15.112:0/2181767650 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616d9a6700 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197dc10 0x1bfd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616d1a5700 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197d840 0x1bfdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.346+0000 7f616e1a7700 1 -- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197dc10 msgr2=0x1bfd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f616e1a7700 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197dc10 0x1bfd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f616e1a7700 1 -- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197d840 msgr2=0x1bfdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f616e1a7700 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197d840 0x1bfdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f616e1a7700 1 -- 172.21.15.112:0/2181767650 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b7c0a0 con 0x19c88c0 2023-11-08T12:30:18.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f616d9a6700 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197dc10 0x1bfd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:18.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f616e1a7700 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1bfe250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f616000fe90 tx=0x7f6160012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b412484ae84a0c94 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f614b7fe700 1 -- 172.21.15.112:0/2181767650 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160002000 con 0x19c88c0 2023-11-08T12:30:18.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f614b7fe700 1 -- 172.21.15.112:0/2181767650 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160014af0 con 0x19c88c0 2023-11-08T12:30:18.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f614b7fe700 1 -- 172.21.15.112:0/2181767650 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160014e60 con 0x19c88c0 2023-11-08T12:30:18.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 -- 172.21.15.112:0/2181767650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 msgr2=0x1bfe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1bfe250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f616000fe90 tx=0x7f6160012000 comp rx=0 tx=0).stop 2023-11-08T12:30:18.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 -- 172.21.15.112:0/2181767650 shutdown_connections 2023-11-08T12:30:18.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1bfe250 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197d840 0x1bfdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 --2- 172.21.15.112:0/2181767650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197dc10 0x1bfd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 -- 172.21.15.112:0/2181767650 >> 172.21.15.112:0/2181767650 conn(0x197dfe0 msgr2=0x1c16b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 -- 172.21.15.112:0/2181767650 shutdown_connections 2023-11-08T12:30:18.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 -- 172.21.15.112:0/2181767650 wait complete. 2023-11-08T12:30:18.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 -- start start 2023-11-08T12:30:18.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.350+0000 7f6172e98740 1 Processor -- start 2023-11-08T12:30:18.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197d840 0x1bffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197dc10 0x1bfce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x19c88c0 0x1c3c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a02c50 con 0x197d840 2023-11-08T12:30:18.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bfd360 con 0x197dc10 2023-11-08T12:30:18.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c3c8c0 con 0x19c88c0 2023-11-08T12:30:18.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 10 client.0 _ll_register_callbacks cb 0x1b4f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:30:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197d840 0x1bffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197d840 0x1bffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52856/0 (socket says 172.21.15.112:52856) 2023-11-08T12:30:18.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 -- 172.21.15.112:0/3434510449 learned_addr learned my addr 172.21.15.112:0/3434510449 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d1a5700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197dc10 0x1bfce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616e1a7700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x19c88c0 0x1c3c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 -- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x19c88c0 msgr2=0x1c3c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x19c88c0 0x1c3c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 -- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197dc10 msgr2=0x1bfce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197dc10 0x1bfce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 -- 172.21.15.112:0/3434510449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61680ad6c0 con 0x197d840 2023-11-08T12:30:18.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616e1a7700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x19c88c0 0x1c3c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:18.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d9a6700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197d840 0x1bffbf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f616404fee0 tx=0x7f6164053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66664dfe737d7859 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6148ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:30:18.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6148ff9700 1 -- 172.21.15.112:0/3434510449 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616404f9d0 con 0x197d840 2023-11-08T12:30:18.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6148ff9700 1 -- 172.21.15.112:0/3434510449 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f616404fb30 con 0x197d840 2023-11-08T12:30:18.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b4f0e0 con 0x197d840 2023-11-08T12:30:18.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6148ff9700 1 -- 172.21.15.112:0/3434510449 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6164013e20 con 0x197d840 2023-11-08T12:30:18.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 10 client.6033 fetch_fsmap learned FSMap version 24 2023-11-08T12:30:18.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x19c9b10 con 0x197d840 2023-11-08T12:30:18.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6148ff9700 1 -- 172.21.15.112:0/3434510449 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b4f0e0 con 0x197d840 2023-11-08T12:30:18.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6148ff9700 1 -- 172.21.15.112:0/3434510449 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f6164052940 con 0x197d840 2023-11-08T12:30:18.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 10 client.6033 fetch_fsmap finished waiting for FSMap version 24 2023-11-08T12:30:18.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 10 client.6033 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-08T12:30:18.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 20 client.6033 populate_metadata read hostname 'smithi112' 2023-11-08T12:30:18.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c3ae80 0x1bebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 4 client.6033 mds_command: new command op to 5820 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:30:18.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 --> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b4ee00 con 0x1c3ae80 2023-11-08T12:30:18.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.354+0000 7f616d1a5700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c3ae80 0x1bebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6148ff9700 10 client.6033 ms_handle_connect on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f616d1a5700 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c3ae80 0x1bebcc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b946bd1cc13ac96 server_cookie=eb700980e34385ed in_seq=0 out_seq=0 2023-11-08T12:30:18.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6148ff9700 1 -- 172.21.15.112:0/3434510449 <== mds.0 v2:172.21.15.133:6832/4144675081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1b4ee00 con 0x1c3ae80 2023-11-08T12:30:18.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6148ff9700 10 client.6033 handle_command_reply: tid=0 2023-11-08T12:30:18.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 client.6033 shutdown 2023-11-08T12:30:18.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197d840 msgr2=0x1bffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197d840 0x1bffbf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f616404fee0 tx=0x7f6164053000 comp rx=0 tx=0).stop 2023-11-08T12:30:18.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 shutdown_connections 2023-11-08T12:30:18.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x19c88c0 0x1c3c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c3ae80 0x1bebcc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x197dc10 0x1bfce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 --2- 172.21.15.112:0/3434510449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197d840 0x1bffbf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 >> 172.21.15.112:0/3434510449 conn(0x197dfe0 msgr2=0x1bfe970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6148ff9700 0 client.6033 ms_handle_reset on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 shutdown_connections 2023-11-08T12:30:18.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 1 -- 172.21.15.112:0/3434510449 wait complete. 2023-11-08T12:30:18.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.358+0000 7f6172e98740 20 client.6033 trim_cache size 0 max 16384 2023-11-08T12:30:18.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.378+0000 7f6172e98740 1 Processor -- start 2023-11-08T12:30:18.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f6172e98740 1 -- start start 2023-11-08T12:30:18.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f6172e98740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197dc10 0x1c15cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x19c88c0 0x1c16210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f6172e98740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b5dff0 con 0x197dc10 2023-11-08T12:30:18.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1af5510 con 0x19c88c0 2023-11-08T12:30:18.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b59730 con 0x197d840 2023-11-08T12:30:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197dc10 0x1c15cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197dc10 0x1c15cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52870/0 (socket says 172.21.15.112:52870) 2023-11-08T12:30:18.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d9a6700 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 -- 172.21.15.112:0/4115693864 learned_addr learned my addr 172.21.15.112:0/4115693864 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616e1a7700 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x19c88c0 0x1c16210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 -- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 msgr2=0x1c390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 -- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x19c88c0 msgr2=0x1c16210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x19c88c0 0x1c16210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d1a5700 1 -- 172.21.15.112:0/4115693864 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680b2f50 con 0x197dc10 2023-11-08T12:30:18.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.382+0000 7f616d9a6700 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:18.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f616d1a5700 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197dc10 0x1c15cd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6158009c60 tx=0x7f6158008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13a265e7c753c64 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f614bfff700 1 -- 172.21.15.112:0/4115693864 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158020040 con 0x197dc10 2023-11-08T12:30:18.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f614bfff700 1 -- 172.21.15.112:0/4115693864 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158011dc0 con 0x197dc10 2023-11-08T12:30:18.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f614bfff700 1 -- 172.21.15.112:0/4115693864 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158028270 con 0x197dc10 2023-11-08T12:30:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 -- 172.21.15.112:0/4115693864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197dc10 msgr2=0x1c15cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197dc10 0x1c15cd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6158009c60 tx=0x7f6158008030 comp rx=0 tx=0).stop 2023-11-08T12:30:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 -- 172.21.15.112:0/4115693864 shutdown_connections 2023-11-08T12:30:18.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x19c88c0 0x1c16210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x197dc10 0x1c15cd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 --2- 172.21.15.112:0/4115693864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 -- 172.21.15.112:0/4115693864 >> 172.21.15.112:0/4115693864 conn(0x197dfe0 msgr2=0x1c3b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 -- 172.21.15.112:0/4115693864 shutdown_connections 2023-11-08T12:30:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 -- 172.21.15.112:0/4115693864 wait complete. 2023-11-08T12:30:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 -- start start 2023-11-08T12:30:18.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.386+0000 7f6172e98740 1 Processor -- start 2023-11-08T12:30:18.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c4b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6172e98740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1c937d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6172e98740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1c93d10 0x1c940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6172e98740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bee840 con 0x19c88c0 2023-11-08T12:30:18.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c38fa0 con 0x1c93d10 2023-11-08T12:30:18.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6172e98740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c3bd30 con 0x197d840 2023-11-08T12:30:18.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6172e98740 10 client.0 _ll_register_callbacks cb 0x7f6160017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:30:18.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1c937d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1c937d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52872/0 (socket says 172.21.15.112:52872) 2023-11-08T12:30:18.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 -- 172.21.15.112:0/2306732682 learned_addr learned my addr 172.21.15.112:0/2306732682 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:18.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 -- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 msgr2=0x1c4b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c4b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 -- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1c93d10 msgr2=0x1c940e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:18.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1c93d10 0x1c940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 -- 172.21.15.112:0/2306732682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x19c9b10 con 0x19c88c0 2023-11-08T12:30:18.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f616d1a5700 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1c937d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f616806bc30 tx=0x7f61580047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64251da9f124765 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:18.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.390+0000 7f6148ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:30:18.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 1 -- 172.21.15.112:0/2306732682 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158004450 con 0x19c88c0 2023-11-08T12:30:18.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6160014af0 con 0x19c88c0 2023-11-08T12:30:18.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 1 -- 172.21.15.112:0/2306732682 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6158020040 con 0x19c88c0 2023-11-08T12:30:18.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 1 -- 172.21.15.112:0/2306732682 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61580045b0 con 0x19c88c0 2023-11-08T12:30:18.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 10 client.6039 fetch_fsmap learned FSMap version 24 2023-11-08T12:30:18.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x7f61680adc60 con 0x19c88c0 2023-11-08T12:30:18.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 1 -- 172.21.15.112:0/2306732682 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160014af0 con 0x19c88c0 2023-11-08T12:30:18.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 1 -- 172.21.15.112:0/2306732682 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f61580288b0 con 0x19c88c0 2023-11-08T12:30:18.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 10 client.6039 fetch_fsmap finished waiting for FSMap version 24 2023-11-08T12:30:18.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 10 client.6039 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-11-08T12:30:18.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 20 client.6039 populate_metadata read hostname 'smithi112' 2023-11-08T12:30:18.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c90e90 0x1c91290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:18.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 4 client.6039 mds_command: new command op to 5820 tid=0[{"prefix": "scrub status"}] 2023-11-08T12:30:18.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 --> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x19fa390 con 0x1c90e90 2023-11-08T12:30:18.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f616d9a6700 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c90e90 0x1c91290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:18.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f616d9a6700 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c90e90 0x1c91290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24cba7a959aa9ae4 server_cookie=969d0435e290952 in_seq=0 out_seq=0 2023-11-08T12:30:18.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 10 client.6039 ms_handle_connect on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 1 -- 172.21.15.112:0/2306732682 <== mds.0 v2:172.21.15.133:6832/4144675081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x19fa390 con 0x1c90e90 2023-11-08T12:30:18.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6148ff9700 10 client.6039 handle_command_reply: tid=0 2023-11-08T12:30:18.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.394+0000 7f6172e98740 1 client.6039 shutdown 2023-11-08T12:30:18.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 msgr2=0x1c937d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1c937d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f616806bc30 tx=0x7f61580047e0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 shutdown_connections 2023-11-08T12:30:18.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:6832/4144675081,v1:172.21.15.133:6833/4144675081] conn(0x1c90e90 0x1c91290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1c93d10 0x1c940e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x19c88c0 0x1c937d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6148ff9700 0 client.6039 ms_handle_reset on v2:172.21.15.133:6832/4144675081 2023-11-08T12:30:18.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 --2- 172.21.15.112:0/2306732682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x197d840 0x1c4b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 >> 172.21.15.112:0/2306732682 conn(0x197dfe0 msgr2=0x1bedcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 shutdown_connections 2023-11-08T12:30:18.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 1 -- 172.21.15.112:0/2306732682 wait complete. 2023-11-08T12:30:18.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f6172e98740 20 client.6039 trim_cache size 0 max 16384 2023-11-08T12:30:18.413 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:30:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "status": "no active scrubs running", 2023-11-08T12:30:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "scrubs": {} 2023-11-08T12:30:18.413 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:30:18.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f614c064f10 msgr2=0x7f614c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f614c064f10 0x7f614c0673c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f616815f350 tx=0x7f6160009040 comp rx=0 tx=0).stop 2023-11-08T12:30:18.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61680705c0 msgr2=0x7f616815ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:18.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61680705c0 0x7f616815ab10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f616400e840 tx=0x7f616400eb50 comp rx=0 tx=0).stop 2023-11-08T12:30:18.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 shutdown_connections 2023-11-08T12:30:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f614c064f10 0x7f614c0673c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6168160710 0x7f61680c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61680cc860 0x7f61680c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 --2- 172.21.15.112:0/2103540135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61680705c0 0x7f616815ab10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 >> 172.21.15.112:0/2103540135 conn(0x7f61680b0f80 msgr2=0x7f61680aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:18.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 shutdown_connections 2023-11-08T12:30:18.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.398+0000 7f616e9a8700 1 -- 172.21.15.112:0/2103540135 wait complete. 2023-11-08T12:30:18.426 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-08T12:30:18.527 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-11-08T12:30:18.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:18.890+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 7 ==== log(6 entries from seq 1 at 2023-11-08T12:30:18.113338+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f266005e120 con 0x7f26680b1730 2023-11-08T12:30:18.899 INFO:teuthology.orchestra.run.smithi112.stdout: cluster: 2023-11-08T12:30:18.899 INFO:teuthology.orchestra.run.smithi112.stdout: id: c14663df-4425-4498-9232-3ffa5f578bfa 2023-11-08T12:30:18.900 INFO:teuthology.orchestra.run.smithi112.stdout: health: HEALTH_OK 2023-11-08T12:30:18.900 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:18.900 INFO:teuthology.orchestra.run.smithi112.stdout: services: 2023-11-08T12:30:18.901 INFO:teuthology.orchestra.run.smithi112.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-08T12:30:18.901 INFO:teuthology.orchestra.run.smithi112.stdout: mgr: y(active, since 2m), standbys: x 2023-11-08T12:30:18.901 INFO:teuthology.orchestra.run.smithi112.stdout: mds: 1/1 daemons up, 3 standby 2023-11-08T12:30:18.901 INFO:teuthology.orchestra.run.smithi112.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2023-11-08T12:30:18.902 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:18.902 INFO:teuthology.orchestra.run.smithi112.stdout: data: 2023-11-08T12:30:18.902 INFO:teuthology.orchestra.run.smithi112.stdout: volumes: 1/1 healthy 2023-11-08T12:30:18.903 INFO:teuthology.orchestra.run.smithi112.stdout: pools: 4 pools, 105 pgs 2023-11-08T12:30:18.903 INFO:teuthology.orchestra.run.smithi112.stdout: objects: 24 objects, 579 KiB 2023-11-08T12:30:18.903 INFO:teuthology.orchestra.run.smithi112.stdout: usage: 75 MiB used, 720 GiB / 720 GiB avail 2023-11-08T12:30:18.903 INFO:teuthology.orchestra.run.smithi112.stdout: pgs: 105 active+clean 2023-11-08T12:30:18.903 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:18.904 INFO:teuthology.orchestra.run.smithi112.stdout: io: 2023-11-08T12:30:18.904 INFO:teuthology.orchestra.run.smithi112.stdout: client: 1.7 KiB/s wr, 0 op/s rd, 5 op/s wr 2023-11-08T12:30:18.904 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:18.904 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:18.904 INFO:teuthology.orchestra.run.smithi112.stdout:2023-11-08T12:30:18.113338+0000 mds.d [INF] scrub queued for path: / 2023-11-08T12:30:18.905 INFO:teuthology.orchestra.run.smithi112.stdout:2023-11-08T12:30:18.113345+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2023-11-08T12:30:18.905 INFO:teuthology.orchestra.run.smithi112.stdout:2023-11-08T12:30:18.113353+0000 mds.d [INF] scrub summary: active paths [/] 2023-11-08T12:30:18.905 INFO:teuthology.orchestra.run.smithi112.stdout:2023-11-08T12:30:18.115006+0000 mds.d [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-11-08T12:30:18.905 INFO:teuthology.orchestra.run.smithi112.stdout:2023-11-08T12:30:18.115032+0000 mds.d [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-11-08T12:30:18.905 INFO:teuthology.orchestra.run.smithi112.stdout:2023-11-08T12:30:18.115955+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2023-11-08T12:30:19.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:19.906+0000 7f26657fa700 1 -- 172.21.15.112:0/1751429586 <== mon.0 v2:172.21.15.112:3300/0 8 ==== log(1 entries from seq 7 at 2023-11-08T12:30:18.398854+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f26600541d0 con 0x7f26680b1730 2023-11-08T12:30:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:2023-11-08T12:30:18.398854+0000 mds.d [INF] scrub summary: idle 2023-11-08T12:30:33.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:33.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.777+0000 7fd54a0bc700 1 Processor -- start 2023-11-08T12:30:33.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.777+0000 7fd54a0bc700 1 -- start start 2023-11-08T12:30:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd54a0bc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd544070790 0x7fd544164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd54a0bc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54415a550 con 0x7fd5440b1640 2023-11-08T12:30:33.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd54a0bc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54406b0a0 con 0x7fd5440b43a0 2023-11-08T12:30:33.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd54a0bc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5440caac0 con 0x7fd544070790 2023-11-08T12:30:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd5498bb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd544070790 0x7fd544164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd5498bb700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd544070790 0x7fd544164fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41908/0 (socket says 172.21.15.112:41908) 2023-11-08T12:30:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd5498bb700 1 -- 172.21.15.112:0/1433718449 learned_addr learned my addr 172.21.15.112:0/1433718449 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd5498bb700 1 -- 172.21.15.112:0/1433718449 >> v1:172.21.15.133:6789/0 conn(0x7fd5440b43a0 legacy=0x7fd54415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:33.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd5498bb700 1 -- 172.21.15.112:0/1433718449 >> v1:172.21.15.112:6789/0 conn(0x7fd5440b1640 legacy=0x7fd544070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd53bfff700 1 -- 172.21.15.112:0/1433718449 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898478851 0 0) 0x7fd534001110 con 0x7fd5440b1640 2023-11-08T12:30:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd5498bb700 1 -- 172.21.15.112:0/1433718449 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440cada0 con 0x7fd544070790 2023-11-08T12:30:33.786 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd5498bb700 1 --2- 172.21.15.112:0/1433718449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd544164fa0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009e50 tx=0x7fd53c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21025ae0bf2fcb8d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd53bfff700 1 -- 172.21.15.112:0/1433718449 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00e070 con 0x7fd544070790 2023-11-08T12:30:33.787 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd53bfff700 1 -- 172.21.15.112:0/1433718449 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00b9c0 con 0x7fd544070790 2023-11-08T12:30:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.781+0000 7fd53bfff700 1 -- 172.21.15.112:0/1433718449 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00bd70 con 0x7fd544070790 2023-11-08T12:30:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 -- 172.21.15.112:0/1433718449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 msgr2=0x7fd544164fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/1433718449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd544164fa0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009e50 tx=0x7fd53c00b330 comp rx=0 tx=0).stop 2023-11-08T12:30:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 -- 172.21.15.112:0/1433718449 shutdown_connections 2023-11-08T12:30:33.788 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/1433718449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd544164fa0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 -- 172.21.15.112:0/1433718449 >> 172.21.15.112:0/1433718449 conn(0x7fd5440b0f80 msgr2=0x7fd5440ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 -- 172.21.15.112:0/1433718449 shutdown_connections 2023-11-08T12:30:33.789 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 -- 172.21.15.112:0/1433718449 wait complete. 2023-11-08T12:30:33.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 Processor -- start 2023-11-08T12:30:33.790 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.785+0000 7fd54a0bc700 1 -- start start 2023-11-08T12:30:33.791 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd5441f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5440b1640 0x7fd5440c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5440b43a0 0x7fd5440cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440cb7b0 con 0x7fd544070790 2023-11-08T12:30:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440cba00 con 0x7fd5440b1640 2023-11-08T12:30:33.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440cbce0 con 0x7fd5440b43a0 2023-11-08T12:30:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd5441f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd5441f11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41922/0 (socket says 172.21.15.112:41922) 2023-11-08T12:30:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 -- 172.21.15.112:0/557333182 learned_addr learned my addr 172.21.15.112:0/557333182 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:33.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5498bb700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5440b43a0 0x7fd5440cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5488b9700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5440b1640 0x7fd5440c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 -- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5440b43a0 msgr2=0x7fd5440cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5440b43a0 0x7fd5440cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 -- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5440b1640 msgr2=0x7fd5440c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:33.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5440b1640 0x7fd5440c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:33.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 -- 172.21.15.112:0/557333182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c009b30 con 0x7fd544070790 2023-11-08T12:30:33.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd5490ba700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd5441f11f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd54000c500 tx=0x7fd54000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:33.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd539ffb700 1 -- 172.21.15.112:0/557333182 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400052d0 con 0x7fd544070790 2023-11-08T12:30:33.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd539ffb700 1 -- 172.21.15.112:0/557333182 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540005430 con 0x7fd544070790 2023-11-08T12:30:33.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd539ffb700 1 -- 172.21.15.112:0/557333182 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400055a0 con 0x7fd544070790 2023-11-08T12:30:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54406b5d0 con 0x7fd544070790 2023-11-08T12:30:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.789+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54406b2f0 con 0x7fd544070790 2023-11-08T12:30:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.793+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5440ca7b0 con 0x7fd544070790 2023-11-08T12:30:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.793+0000 7fd539ffb700 1 -- 172.21.15.112:0/557333182 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd540019030 con 0x7fd544070790 2023-11-08T12:30:33.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.793+0000 7fd539ffb700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd528064ee0 0x7fd528067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.793+0000 7fd539ffb700 1 -- 172.21.15.112:0/557333182 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd540081340 con 0x7fd544070790 2023-11-08T12:30:33.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.793+0000 7fd5488b9700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd528064ee0 0x7fd528067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:33.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.797+0000 7fd5488b9700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd528064ee0 0x7fd528067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd5440ac460 tx=0x7fd534009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:33.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:33.801+0000 7fd539ffb700 1 -- 172.21.15.112:0/557333182 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd54004f3a0 con 0x7fd544070790 2023-11-08T12:30:34.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.009+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd544073cb0 con 0x7fd544070790 2023-11-08T12:30:34.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.009+0000 7fd539ffb700 1 -- 172.21.15.112:0/557333182 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fd5400529c0 con 0x7fd544070790 2023-11-08T12:30:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:34.012 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:34.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd528064ee0 msgr2=0x7fd528067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd528064ee0 0x7fd528067390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd5440ac460 tx=0x7fd534009040 comp rx=0 tx=0).stop 2023-11-08T12:30:34.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 msgr2=0x7fd5441f11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd5441f11f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd54000c500 tx=0x7fd54000c8c0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 shutdown_connections 2023-11-08T12:30:34.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd528064ee0 0x7fd528067390 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5440b43a0 0x7fd5440cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5440b1640 0x7fd5440c2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 --2- 172.21.15.112:0/557333182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd544070790 0x7fd5441f11f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 >> 172.21.15.112:0/557333182 conn(0x7fd5440b0f80 msgr2=0x7fd54415e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:34.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 shutdown_connections 2023-11-08T12:30:34.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.013+0000 7fd54a0bc700 1 -- 172.21.15.112:0/557333182 wait complete. 2023-11-08T12:30:34.018 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:34.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-08T12:30:34.249 INFO:teuthology.orchestra.run.smithi133.stdout:{"message":"","return_code":0} 2023-11-08T12:30:34.250 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-08T12:30:34.250 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-08T12:30:34.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 Processor -- start 2023-11-08T12:30:34.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 -- start start 2023-11-08T12:30:34.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf14d2700 0x55cdf15ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 0x55cdf14fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf1590f40 0x55cdf158fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf13fa240 con 0x55cdf14d2700 2023-11-08T12:30:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf14fbdf0 con 0x55cdf1590f40 2023-11-08T12:30:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdf14fc030 con 0x55cdf1505980 2023-11-08T12:30:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf14d2700 0x55cdf15ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf14d2700 0x55cdf15ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41932/0 (socket says 172.21.15.112:41932) 2023-11-08T12:30:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 -- 172.21.15.112:0/1830924588 learned_addr learned my addr 172.21.15.112:0/1830924588 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 -- 172.21.15.112:0/1830924588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 msgr2=0x55cdf14fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 --2- 172.21.15.112:0/1830924588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 0x55cdf14fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 -- 172.21.15.112:0/1830924588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf1590f40 msgr2=0x55cdf158fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 --2- 172.21.15.112:0/1830924588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf1590f40 0x55cdf158fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 -- 172.21.15.112:0/1830924588 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4005d20 con 0x55cdf14d2700 2023-11-08T12:30:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb24c1700 1 --2- 172.21.15.112:0/1830924588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf14d2700 0x55cdf15ad8b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40099a0 tx=0x7f2ba4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2736a4e84df3ee server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb0cbe700 1 -- 172.21.15.112:0/1830924588 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400f040 con 0x55cdf14d2700 2023-11-08T12:30:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb0cbe700 1 -- 172.21.15.112:0/1830924588 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba4008ca0 con 0x55cdf14d2700 2023-11-08T12:30:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb0cbe700 1 -- 172.21.15.112:0/1830924588 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4013620 con 0x55cdf14d2700 2023-11-08T12:30:34.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 -- 172.21.15.112:0/1830924588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf14d2700 msgr2=0x55cdf15ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1830924588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf14d2700 0x55cdf15ad8b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40099a0 tx=0x7f2ba4005a00 comp rx=0 tx=0).stop 2023-11-08T12:30:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.321+0000 7f2bb498c140 1 -- 172.21.15.112:0/1830924588 shutdown_connections 2023-11-08T12:30:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1830924588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf1590f40 0x55cdf158fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1830924588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 0x55cdf14fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1830924588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf14d2700 0x55cdf15ad8b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 -- 172.21.15.112:0/1830924588 >> 172.21.15.112:0/1830924588 conn(0x55cdf14d8c30 msgr2=0x55cdf15205c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:34.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 -- 172.21.15.112:0/1830924588 shutdown_connections 2023-11-08T12:30:34.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 -- 172.21.15.112:0/1830924588 wait complete. 2023-11-08T12:30:34.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 Processor -- start 2023-11-08T12:30:34.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 -- start start 2023-11-08T12:30:34.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf14d2700 0x55cdf14f9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 0x55cdf1597540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf1590f40 0x55cdf1597a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf1597180 con 0x55cdf1590f40 2023-11-08T12:30:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf16392f0 con 0x55cdf14d2700 2023-11-08T12:30:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb498c140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdf1639590 con 0x55cdf1505980 2023-11-08T12:30:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf1590f40 0x55cdf1597a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf1590f40 0x55cdf1597a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41934/0 (socket says 172.21.15.112:41934) 2023-11-08T12:30:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 -- 172.21.15.112:0/1925151735 learned_addr learned my addr 172.21.15.112:0/1925151735 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:34.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb24c1700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf14d2700 0x55cdf14f9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb1cc0700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 0x55cdf1597540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 -- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 msgr2=0x55cdf1597540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55cdf1505980 0x55cdf1597540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 -- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf14d2700 msgr2=0x55cdf14f9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf14d2700 0x55cdf14f9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 -- 172.21.15.112:0/1925151735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009600 con 0x55cdf1590f40 2023-11-08T12:30:34.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb24c1700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf14d2700 0x55cdf14f9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:34.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.325+0000 7f2bb2cc2700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf1590f40 0x55cdf1597a80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2bac013040 tx=0x7f2bac00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:34.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.329+0000 7f2bab7fe700 1 -- 172.21.15.112:0/1925151735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac010830 con 0x55cdf1590f40 2023-11-08T12:30:34.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.329+0000 7f2bab7fe700 1 -- 172.21.15.112:0/1925151735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac0109b0 con 0x55cdf1590f40 2023-11-08T12:30:34.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.329+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdf14058b0 con 0x55cdf1590f40 2023-11-08T12:30:34.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.329+0000 7f2bab7fe700 1 -- 172.21.15.112:0/1925151735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac010d60 con 0x55cdf1590f40 2023-11-08T12:30:34.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.329+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac00a100 con 0x55cdf1590f40 2023-11-08T12:30:34.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.329+0000 7f2bab7fe700 1 -- 172.21.15.112:0/1925151735 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2bac02c070 con 0x55cdf1590f40 2023-11-08T12:30:34.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bab7fe700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b94063840 0x7f2b94065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bab7fe700 1 -- 172.21.15.112:0/1925151735 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2bac081bf0 con 0x55cdf1590f40 2023-11-08T12:30:34.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb24c1700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b94063840 0x7f2b94065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x55cdf14fa410 0x55cdf1595db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58) v8 -- 0x55cdf163ace0 con 0x55cdf14fa410 2023-11-08T12:30:34.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb1cc0700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x55cdf14fa410 0x55cdf1595db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb24c1700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b94063840 0x7f2b94065cf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000c00 tx=0x7f2ba4012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:34.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb1cc0700 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x55cdf14fa410 0x55cdf1595db0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:34.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb1cc0700 1 -- 172.21.15.112:0/1925151735 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f2b9c00f450 con 0x55cdf14fa410 2023-11-08T12:30:34.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x55cdf14fa410 msgr2=0x55cdf1595db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x55cdf14fa410 0x55cdf1595db0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b94063840 msgr2=0x7f2b94065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2b94063840 0x7f2b94065cf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000c00 tx=0x7f2ba4012000 comp rx=0 tx=0).stop 2023-11-08T12:30:34.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf1590f40 msgr2=0x55cdf1597a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 --2- 172.21.15.112:0/1925151735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cdf1590f40 0x55cdf1597a80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2bac013040 tx=0x7f2bac00fd40 comp rx=0 tx=0).stop 2023-11-08T12:30:34.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb2cc2700 1 -- 172.21.15.112:0/1925151735 reap_dead start 2023-11-08T12:30:34.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 shutdown_connections 2023-11-08T12:30:34.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 >> 172.21.15.112:0/1925151735 conn(0x55cdf14d8c30 msgr2=0x55cdf14d9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:34.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 shutdown_connections 2023-11-08T12:30:34.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.333+0000 7f2bb498c140 1 -- 172.21.15.112:0/1925151735 wait complete. 2023-11-08T12:30:34.343 INFO:teuthology.orchestra.run.smithi112.stdout:Yalphaparent_a 2023-11-08T12:30:34.344 DEBUG:teuthology.orchestra.run.smithi112:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-08T12:30:34.427 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:30:34.428 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 1099511627777, 2023-11-08T12:30:34.428 INFO:teuthology.orchestra.run.smithi112.stdout: "ancestors": [ 2023-11-08T12:30:34.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:34.428 INFO:teuthology.orchestra.run.smithi112.stdout: "dirino": 1099511627776, 2023-11-08T12:30:34.429 INFO:teuthology.orchestra.run.smithi112.stdout: "dname": "alpha", 2023-11-08T12:30:34.429 INFO:teuthology.orchestra.run.smithi112.stdout: "version": 2 2023-11-08T12:30:34.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:34.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:34.429 INFO:teuthology.orchestra.run.smithi112.stdout: "dirino": 1, 2023-11-08T12:30:34.429 INFO:teuthology.orchestra.run.smithi112.stdout: "dname": "parent_a", 2023-11-08T12:30:34.430 INFO:teuthology.orchestra.run.smithi112.stdout: "version": 4 2023-11-08T12:30:34.430 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:34.430 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-11-08T12:30:34.430 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 9, 2023-11-08T12:30:34.430 INFO:teuthology.orchestra.run.smithi112.stdout: "old_pools": [] 2023-11-08T12:30:34.431 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:30:34.431 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:34.435 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T12:30:34.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:30:34.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:30:34.578 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T12:30:34.579 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:34.579 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:34.600 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:34.600 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:34.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:34.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.885+0000 7f6533ec8700 1 Processor -- start 2023-11-08T12:30:34.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.885+0000 7f6533ec8700 1 -- start start 2023-11-08T12:30:34.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6533ec8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f652c15d510 0x7f652c0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6533ec8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c0b6030 0x7f652c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6533ec8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c15d080 con 0x7f652c1534a0 2023-11-08T12:30:34.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6533ec8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c15d970 con 0x7f652c15d510 2023-11-08T12:30:34.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6533ec8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c153870 con 0x7f652c0b6030 2023-11-08T12:30:34.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531463700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f652c15d510 0x7f652c0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531c64700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f652c1534a0 0x7f652c160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45274/0 (socket says 172.21.15.112:45274) 2023-11-08T12:30:34.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531c64700 1 -- 172.21.15.112:0/1148512070 learned_addr learned my addr 172.21.15.112:0/1148512070 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:34.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6532465700 1 --2- 172.21.15.112:0/1148512070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c0b6030 0x7f652c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531463700 1 -- 172.21.15.112:0/1148512070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c0b6030 msgr2=0x7f652c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:34.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531463700 1 --2- 172.21.15.112:0/1148512070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c0b6030 0x7f652c070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531463700 1 -- 172.21.15.112:0/1148512070 >> v1:172.21.15.112:6789/0 conn(0x7f652c1534a0 legacy=0x7f652c160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531463700 1 -- 172.21.15.112:0/1148512070 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0b6430 con 0x7f652c15d510 2023-11-08T12:30:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6532465700 1 --2- 172.21.15.112:0/1148512070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c0b6030 0x7f652c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6531463700 1 --2- 172.21.15.112:0/1148512070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c15d510 0x7f652c0b5af0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f651c009850 tx=0x7f651c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2520f44099683f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6530c62700 1 -- 172.21.15.112:0/1148512070 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c011830 con 0x7f652c15d510 2023-11-08T12:30:34.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6530c62700 1 -- 172.21.15.112:0/1148512070 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c011990 con 0x7f652c15d510 2023-11-08T12:30:34.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6530c62700 1 -- 172.21.15.112:0/1148512070 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c011d20 con 0x7f652c15d510 2023-11-08T12:30:34.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6533ec8700 1 -- 172.21.15.112:0/1148512070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c15d510 msgr2=0x7f652c0b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.889+0000 7f6533ec8700 1 --2- 172.21.15.112:0/1148512070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c15d510 0x7f652c0b5af0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f651c009850 tx=0x7f651c009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:34.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- 172.21.15.112:0/1148512070 shutdown_connections 2023-11-08T12:30:34.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 --2- 172.21.15.112:0/1148512070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c0b6030 0x7f652c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 --2- 172.21.15.112:0/1148512070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c15d510 0x7f652c0b5af0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- 172.21.15.112:0/1148512070 >> 172.21.15.112:0/1148512070 conn(0x7f652c06bfc0 msgr2=0x7f652c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:34.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- 172.21.15.112:0/1148512070 shutdown_connections 2023-11-08T12:30:34.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- 172.21.15.112:0/1148512070 wait complete. 2023-11-08T12:30:34.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 Processor -- start 2023-11-08T12:30:34.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- start start 2023-11-08T12:30:34.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c0b6030 0x7f652c1f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c1534a0 0x7f652c0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f652c15d510 0x7f652c1f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c1558f0 con 0x7f652c0b6030 2023-11-08T12:30:34.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c155bd0 con 0x7f652c15d510 2023-11-08T12:30:34.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.893+0000 7f6533ec8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c155eb0 con 0x7f652c1534a0 2023-11-08T12:30:34.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c0b6030 0x7f652c1f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c0b6030 0x7f652c1f1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41948/0 (socket says 172.21.15.112:41948) 2023-11-08T12:30:34.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 -- 172.21.15.112:0/879869538 learned_addr learned my addr 172.21.15.112:0/879869538 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:34.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531463700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c1534a0 0x7f652c0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6532465700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f652c15d510 0x7f652c1f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 -- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c1534a0 msgr2=0x7f652c0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c1534a0 0x7f652c0c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 -- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f652c15d510 msgr2=0x7f652c1f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:34.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f652c15d510 0x7f652c1f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:34.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 -- 172.21.15.112:0/879869538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c0094b0 con 0x7f652c0b6030 2023-11-08T12:30:34.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6531c64700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c0b6030 0x7f652c1f1d50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f652800c700 tx=0x7f652800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:34.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f65227fc700 1 -- 172.21.15.112:0/879869538 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528005d90 con 0x7f652c0b6030 2023-11-08T12:30:34.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f65227fc700 1 -- 172.21.15.112:0/879869538 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280070d0 con 0x7f652c0b6030 2023-11-08T12:30:34.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c0b56a0 con 0x7f652c0b6030 2023-11-08T12:30:34.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f65227fc700 1 -- 172.21.15.112:0/879869538 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528007440 con 0x7f652c0b6030 2023-11-08T12:30:34.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c0b53c0 con 0x7f652c0b6030 2023-11-08T12:30:34.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.897+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c15ca30 con 0x7f652c0b6030 2023-11-08T12:30:34.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.901+0000 7f65227fc700 1 -- 172.21.15.112:0/879869538 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6528019030 con 0x7f652c0b6030 2023-11-08T12:30:34.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.901+0000 7f65227fc700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6510064ee0 0x7f6510067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:34.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.901+0000 7f65227fc700 1 -- 172.21.15.112:0/879869538 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f65280811b0 con 0x7f652c0b6030 2023-11-08T12:30:34.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.901+0000 7f6531463700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6510064ee0 0x7f6510067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:34.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.901+0000 7f6531463700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6510064ee0 0x7f6510067390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f651c000c00 tx=0x7f651c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:34.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:34.905+0000 7f65227fc700 1 -- 172.21.15.112:0/879869538 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f652804a400 con 0x7f652c0b6030 2023-11-08T12:30:35.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.085+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f652c0726c0 con 0x7f652c0b6030 2023-11-08T12:30:35.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.085+0000 7f65227fc700 1 -- 172.21.15.112:0/879869538 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18132 (secure 0 0 0) 0x7f652804f1d0 con 0x7f652c0b6030 2023-11-08T12:30:35.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:35.090 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":58,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:09.553416+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:07.036289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:07.538745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:35.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6510064ee0 msgr2=0x7f6510067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6510064ee0 0x7f6510067390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f651c000c00 tx=0x7f651c008030 comp rx=0 tx=0).stop 2023-11-08T12:30:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c0b6030 msgr2=0x7f652c1f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c0b6030 0x7f652c1f1d50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f652800c700 tx=0x7f652800ca10 comp rx=0 tx=0).stop 2023-11-08T12:30:35.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 shutdown_connections 2023-11-08T12:30:35.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6510064ee0 0x7f6510067390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f652c15d510 0x7f652c1f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f652c1534a0 0x7f652c0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 --2- 172.21.15.112:0/879869538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f652c0b6030 0x7f652c1f1d50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 >> 172.21.15.112:0/879869538 conn(0x7f652c06bfc0 msgr2=0x7f652c06c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:35.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 shutdown_connections 2023-11-08T12:30:35.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.089+0000 7f6533ec8700 1 -- 172.21.15.112:0/879869538 wait complete. 2023-11-08T12:30:35.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:30:07.036289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:30:07.538745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:30:35.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:30:35.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.293+0000 7f0e3dfd5700 1 Processor -- start 2023-11-08T12:30:35.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3dfd5700 1 -- start start 2023-11-08T12:30:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3dfd5700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e3806c3f0 0x7f0e3806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3dfd5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e380c9560 0x7f0e380c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3dfd5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3806cd80 con 0x7f0e3815f7d0 2023-11-08T12:30:35.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3dfd5700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380ccc60 con 0x7f0e3806c3f0 2023-11-08T12:30:35.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3dfd5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3806b3a0 con 0x7f0e380c9560 2023-11-08T12:30:35.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e37fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e3806c3f0 0x7f0e3806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3cfd3700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0e3815f7d0 0x7f0e38160720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55064/0 (socket says 172.21.15.112:55064) 2023-11-08T12:30:35.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.297+0000 7f0e3cfd3700 1 -- 172.21.15.112:0/807519828 learned_addr learned my addr 172.21.15.112:0/807519828 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:35.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3d7d4700 1 --2- 172.21.15.112:0/807519828 >> v2:172.21.15.133:3300/0 conn(0x7f0e380c9560 0x7f0e380c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e37fff700 1 -- 172.21.15.112:0/807519828 >> v2:172.21.15.133:3300/0 conn(0x7f0e380c9560 msgr2=0x7f0e380c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e37fff700 1 --2- 172.21.15.112:0/807519828 >> v2:172.21.15.133:3300/0 conn(0x7f0e380c9560 0x7f0e380c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e37fff700 1 -- 172.21.15.112:0/807519828 >> v1:172.21.15.112:6789/0 conn(0x7f0e3815f7d0 legacy=0x7f0e38160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e37fff700 1 -- 172.21.15.112:0/807519828 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380ccf20 con 0x7f0e3806c3f0 2023-11-08T12:30:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e37fff700 1 --2- 172.21.15.112:0/807519828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e3806c3f0 0x7f0e3806c840 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0e380b4e40 tx=0x7f0e24009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcf3c1b95ab18de server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e377fe700 1 -- 172.21.15.112:0/807519828 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24011830 con 0x7f0e3806c3f0 2023-11-08T12:30:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e377fe700 1 -- 172.21.15.112:0/807519828 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e24011990 con 0x7f0e3806c3f0 2023-11-08T12:30:35.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e377fe700 1 -- 172.21.15.112:0/807519828 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24011d40 con 0x7f0e3806c3f0 2023-11-08T12:30:35.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/807519828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e3806c3f0 msgr2=0x7f0e3806c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/807519828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e3806c3f0 0x7f0e3806c840 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0e380b4e40 tx=0x7f0e24009b30 comp rx=0 tx=0).stop 2023-11-08T12:30:35.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/807519828 shutdown_connections 2023-11-08T12:30:35.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/807519828 >> v2:172.21.15.133:3300/0 conn(0x7f0e380c9560 0x7f0e380c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/807519828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e3806c3f0 0x7f0e3806c840 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/807519828 >> 172.21.15.112:0/807519828 conn(0x7f0e380b0a20 msgr2=0x7f0e380b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:35.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/807519828 shutdown_connections 2023-11-08T12:30:35.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.301+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/807519828 wait complete. 2023-11-08T12:30:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.305+0000 7f0e3dfd5700 1 Processor -- start 2023-11-08T12:30:35.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.305+0000 7f0e3dfd5700 1 -- start start 2023-11-08T12:30:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e3806c3f0 0x7f0e3815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e380c9560 0x7f0e3814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e3815f7d0 0x7f0e3815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380c8180 con 0x7f0e380c9560 2023-11-08T12:30:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380c7570 con 0x7f0e3815f7d0 2023-11-08T12:30:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380c7850 con 0x7f0e3806c3f0 2023-11-08T12:30:35.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e380c9560 0x7f0e3814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e380c9560 0x7f0e3814f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59508/0 (socket says 172.21.15.112:59508) 2023-11-08T12:30:35.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 -- 172.21.15.112:0/2695680105 learned_addr learned my addr 172.21.15.112:0/2695680105 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:35.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3d7d4700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e3815f7d0 0x7f0e3815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3cfd3700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e3806c3f0 0x7f0e3815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 -- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e3806c3f0 msgr2=0x7f0e3815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e3806c3f0 0x7f0e3815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 -- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e3815f7d0 msgr2=0x7f0e3815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e3815f7d0 0x7f0e3815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 -- 172.21.15.112:0/2695680105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e240094b0 con 0x7f0e380c9560 2023-11-08T12:30:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e37fff700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e380c9560 0x7f0e3814f540 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0e24014040 tx=0x7f0e24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:35.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e357fa700 1 -- 172.21.15.112:0/2695680105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e240036c0 con 0x7f0e380c9560 2023-11-08T12:30:35.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e357fa700 1 -- 172.21.15.112:0/2695680105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2401e070 con 0x7f0e380c9560 2023-11-08T12:30:35.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e357fa700 1 -- 172.21.15.112:0/2695680105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24003a80 con 0x7f0e380c9560 2023-11-08T12:30:35.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e38071880 con 0x7f0e380c9560 2023-11-08T12:30:35.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.309+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e380ce600 con 0x7f0e380c9560 2023-11-08T12:30:35.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.313+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e38071a10 con 0x7f0e380c9560 2023-11-08T12:30:35.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.313+0000 7f0e357fa700 1 -- 172.21.15.112:0/2695680105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0e2400f050 con 0x7f0e380c9560 2023-11-08T12:30:35.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.317+0000 7f0e357fa700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e1c064ee0 0x7f0e1c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.317+0000 7f0e357fa700 1 -- 172.21.15.112:0/2695680105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0e24020070 con 0x7f0e380c9560 2023-11-08T12:30:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.317+0000 7f0e3cfd3700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e1c064ee0 0x7f0e1c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.317+0000 7f0e3cfd3700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e1c064ee0 0x7f0e1c067390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c005930 tx=0x7f0e2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:35.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.321+0000 7f0e357fa700 1 -- 172.21.15.112:0/2695680105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0e24051570 con 0x7f0e380c9560 2023-11-08T12:30:35.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.497+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e380b4390 con 0x7f0e380c9560 2023-11-08T12:30:35.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.497+0000 7f0e357fa700 1 -- 172.21.15.112:0/2695680105 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e240150a0 con 0x7f0e380c9560 2023-11-08T12:30:35.500 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:30:35.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e1c064ee0 msgr2=0x7f0e1c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e1c064ee0 0x7f0e1c067390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c005930 tx=0x7f0e2c009040 comp rx=0 tx=0).stop 2023-11-08T12:30:35.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e380c9560 msgr2=0x7f0e3814f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e380c9560 0x7f0e3814f540 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0e24014040 tx=0x7f0e24004770 comp rx=0 tx=0).stop 2023-11-08T12:30:35.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 shutdown_connections 2023-11-08T12:30:35.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0e1c064ee0 0x7f0e1c067390 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e3815f7d0 0x7f0e3815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e380c9560 0x7f0e3814f540 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 --2- 172.21.15.112:0/2695680105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e3806c3f0 0x7f0e3815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 >> 172.21.15.112:0/2695680105 conn(0x7f0e380b0a20 msgr2=0x7f0e380cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:35.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 shutdown_connections 2023-11-08T12:30:35.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.501+0000 7f0e3dfd5700 1 -- 172.21.15.112:0/2695680105 wait complete. 2023-11-08T12:30:35.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:30:35.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.705+0000 7fb69d46d700 1 Processor -- start 2023-11-08T12:30:35.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.705+0000 7fb69d46d700 1 -- start start 2023-11-08T12:30:35.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb6980d0dc0 0x7fb6980c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cd360 0x7fb6980702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69806d160 con 0x7fb6980d1190 2023-11-08T12:30:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69806c8c0 con 0x7fb6980d0dc0 2023-11-08T12:30:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69806cba0 con 0x7fb6980cd360 2023-11-08T12:30:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb6967fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb6980d1190 0x7fb69806c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55066/0 (socket says 172.21.15.112:55066) 2023-11-08T12:30:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb6967fc700 1 -- 172.21.15.112:0/2061885066 learned_addr learned my addr 172.21.15.112:0/2061885066 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:35.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb696ffd700 1 --2- 172.21.15.112:0/2061885066 >> v2:172.21.15.112:3300/0 conn(0x7fb6980d0dc0 0x7fb6980c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb6977fe700 1 --2- 172.21.15.112:0/2061885066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cd360 0x7fb6980702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb695ffb700 1 -- 172.21.15.112:0/2061885066 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933522325 0 0) 0x7fb69806d160 con 0x7fb6980d1190 2023-11-08T12:30:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb695ffb700 1 -- 172.21.15.112:0/2061885066 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6800035d0 con 0x7fb6980d1190 2023-11-08T12:30:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb696ffd700 1 -- 172.21.15.112:0/2061885066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cd360 msgr2=0x7fb6980702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb696ffd700 1 --2- 172.21.15.112:0/2061885066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cd360 0x7fb6980702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb696ffd700 1 -- 172.21.15.112:0/2061885066 >> v1:172.21.15.112:6789/0 conn(0x7fb6980d1190 legacy=0x7fb69806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb696ffd700 1 -- 172.21.15.112:0/2061885066 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69806ce80 con 0x7fb6980d0dc0 2023-11-08T12:30:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb696ffd700 1 --2- 172.21.15.112:0/2061885066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980c6110 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb688009850 tx=0x7fb688009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520ef44c5f571e62 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb695ffb700 1 -- 172.21.15.112:0/2061885066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011830 con 0x7fb6980d0dc0 2023-11-08T12:30:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb695ffb700 1 -- 172.21.15.112:0/2061885066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688011990 con 0x7fb6980d0dc0 2023-11-08T12:30:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb695ffb700 1 -- 172.21.15.112:0/2061885066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011d40 con 0x7fb6980d0dc0 2023-11-08T12:30:35.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 -- 172.21.15.112:0/2061885066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 msgr2=0x7fb6980c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 --2- 172.21.15.112:0/2061885066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980c6110 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb688009850 tx=0x7fb688009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 -- 172.21.15.112:0/2061885066 shutdown_connections 2023-11-08T12:30:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 --2- 172.21.15.112:0/2061885066 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cd360 0x7fb6980702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 --2- 172.21.15.112:0/2061885066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980c6110 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.709+0000 7fb69d46d700 1 -- 172.21.15.112:0/2061885066 >> 172.21.15.112:0/2061885066 conn(0x7fb6980d2d10 msgr2=0x7fb6980d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.713+0000 7fb69d46d700 1 -- 172.21.15.112:0/2061885066 shutdown_connections 2023-11-08T12:30:35.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.713+0000 7fb69d46d700 1 -- 172.21.15.112:0/2061885066 wait complete. 2023-11-08T12:30:35.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.713+0000 7fb69d46d700 1 Processor -- start 2023-11-08T12:30:35.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.713+0000 7fb69d46d700 1 -- start start 2023-11-08T12:30:35.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.713+0000 7fb69d46d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6980cd360 0x7fb69815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.713+0000 7fb69d46d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb69d46d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cc9c0 0x7fb6980cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb69d46d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69815c2f0 con 0x7fb6980d0dc0 2023-11-08T12:30:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb69d46d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69815c060 con 0x7fb6980cd360 2023-11-08T12:30:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb69d46d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69815ddf0 con 0x7fb6980cc9c0 2023-11-08T12:30:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59528/0 (socket says 172.21.15.112:59528) 2023-11-08T12:30:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 -- 172.21.15.112:0/719020680 learned_addr learned my addr 172.21.15.112:0/719020680 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb696ffd700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6980cd360 0x7fb69815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6977fe700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cc9c0 0x7fb6980cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 -- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cc9c0 msgr2=0x7fb6980cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cc9c0 0x7fb6980cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 -- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6980cd360 msgr2=0x7fb69815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6980cd360 0x7fb69815c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 -- 172.21.15.112:0/719020680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880094b0 con 0x7fb6980d0dc0 2023-11-08T12:30:35.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb696ffd700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6980cd360 0x7fb69815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:35.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb6967fc700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980cb8d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c700 tx=0x7fb68c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:35.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb67f7fe700 1 -- 172.21.15.112:0/719020680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c005d90 con 0x7fb6980d0dc0 2023-11-08T12:30:35.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb67f7fe700 1 -- 172.21.15.112:0/719020680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0070d0 con 0x7fb6980d0dc0 2023-11-08T12:30:35.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6980cd7e0 con 0x7fb6980d0dc0 2023-11-08T12:30:35.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb67f7fe700 1 -- 172.21.15.112:0/719020680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c007480 con 0x7fb6980d0dc0 2023-11-08T12:30:35.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb698069d20 con 0x7fb6980d0dc0 2023-11-08T12:30:35.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.717+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6980cd970 con 0x7fb6980d0dc0 2023-11-08T12:30:35.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.721+0000 7fb67f7fe700 1 -- 172.21.15.112:0/719020680 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb68c019030 con 0x7fb6980d0dc0 2023-11-08T12:30:35.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.721+0000 7fb67f7fe700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb684064ee0 0x7fb684067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:35.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.721+0000 7fb67f7fe700 1 -- 172.21.15.112:0/719020680 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb68c0813f0 con 0x7fb6980d0dc0 2023-11-08T12:30:35.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.721+0000 7fb696ffd700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb684064ee0 0x7fb684067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:35.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.725+0000 7fb696ffd700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb684064ee0 0x7fb684067390 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb6880090b0 tx=0x7fb68801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:35.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.729+0000 7fb67f7fe700 1 -- 172.21.15.112:0/719020680 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb68c04f300 con 0x7fb6980d0dc0 2023-11-08T12:30:35.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.909+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6980c9e70 con 0x7fb6980d0dc0 2023-11-08T12:30:35.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.909+0000 7fb67f7fe700 1 -- 172.21.15.112:0/719020680 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb68c052920 con 0x7fb6980d0dc0 2023-11-08T12:30:35.912 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:30:35.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb684064ee0 msgr2=0x7fb684067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb684064ee0 0x7fb684067390 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb6880090b0 tx=0x7fb68801c040 comp rx=0 tx=0).stop 2023-11-08T12:30:35.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 msgr2=0x7fb6980cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:35.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980cb8d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c700 tx=0x7fb68c00ca10 comp rx=0 tx=0).stop 2023-11-08T12:30:35.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 shutdown_connections 2023-11-08T12:30:35.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb684064ee0 0x7fb684067390 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb6980cc9c0 0x7fb6980cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6980d0dc0 0x7fb6980cb8d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 --2- 172.21.15.112:0/719020680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6980cd360 0x7fb69815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:35.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 >> 172.21.15.112:0/719020680 conn(0x7fb6980d2d10 msgr2=0x7fb69806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:35.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 shutdown_connections 2023-11-08T12:30:35.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:35.913+0000 7fb69d46d700 1 -- 172.21.15.112:0/719020680 wait complete. 2023-11-08T12:30:35.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:30:36.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680108c700 1 Processor -- start 2023-11-08T12:30:36.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680108c700 1 -- start start 2023-11-08T12:30:36.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680108c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67fc070a90 0x7f67fc0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680108c700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc070600 con 0x7f67fc15a9f0 2023-11-08T12:30:36.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680108c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc15adf0 con 0x7f67fc159f10 2023-11-08T12:30:36.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680108c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0afcc0 con 0x7f67fc070a90 2023-11-08T12:30:36.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680088b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f67fc15a9f0 0x7f67fc06be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55076/0 (socket says 172.21.15.112:55076) 2023-11-08T12:30:36.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f680088b700 1 -- 172.21.15.112:0/284674419 learned_addr learned my addr 172.21.15.112:0/284674419 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:36.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67f37fe700 1 --2- 172.21.15.112:0/284674419 >> v2:172.21.15.133:3300/0 conn(0x7f67fc070a90 0x7f67fc0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67fb7fe700 1 -- 172.21.15.112:0/284674419 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765741728 0 0) 0x7f67fc070600 con 0x7f67fc15a9f0 2023-11-08T12:30:36.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67fb7fe700 1 -- 172.21.15.112:0/284674419 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e80035d0 con 0x7f67fc15a9f0 2023-11-08T12:30:36.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67f37fe700 1 -- 172.21.15.112:0/284674419 >> v1:172.21.15.133:6789/0 conn(0x7f67fc159f10 legacy=0x7f67fc15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67f37fe700 1 -- 172.21.15.112:0/284674419 >> v1:172.21.15.112:6789/0 conn(0x7f67fc15a9f0 legacy=0x7f67fc06be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67f37fe700 1 -- 172.21.15.112:0/284674419 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc06ffb0 con 0x7f67fc070a90 2023-11-08T12:30:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67f37fe700 1 --2- 172.21.15.112:0/284674419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 0x7f67fc0c8c90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009850 tx=0x7f67e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7046e6913c7c9453 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67fb7fe700 1 -- 172.21.15.112:0/284674419 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4011830 con 0x7f67fc070a90 2023-11-08T12:30:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67fb7fe700 1 -- 172.21.15.112:0/284674419 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4011990 con 0x7f67fc070a90 2023-11-08T12:30:36.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.113+0000 7f67fb7fe700 1 -- 172.21.15.112:0/284674419 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4011d40 con 0x7f67fc070a90 2023-11-08T12:30:36.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 -- 172.21.15.112:0/284674419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 msgr2=0x7f67fc0c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 --2- 172.21.15.112:0/284674419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 0x7f67fc0c8c90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009850 tx=0x7f67e4009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:36.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 -- 172.21.15.112:0/284674419 shutdown_connections 2023-11-08T12:30:36.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 --2- 172.21.15.112:0/284674419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 0x7f67fc0c8c90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 -- 172.21.15.112:0/284674419 >> 172.21.15.112:0/284674419 conn(0x7f67fc0cf280 msgr2=0x7f67fc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 -- 172.21.15.112:0/284674419 shutdown_connections 2023-11-08T12:30:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 -- 172.21.15.112:0/284674419 wait complete. 2023-11-08T12:30:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 Processor -- start 2023-11-08T12:30:36.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.117+0000 7f680108c700 1 -- start start 2023-11-08T12:30:36.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 0x7f67fc0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67fc159f10 0x7f67fc0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67fc15a9f0 0x7f67fc1ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc142a80 con 0x7f67fc159f10 2023-11-08T12:30:36.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc141e70 con 0x7f67fc070a90 2023-11-08T12:30:36.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc142150 con 0x7f67fc15a9f0 2023-11-08T12:30:36.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67fc159f10 0x7f67fc0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67fc159f10 0x7f67fc0b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59540/0 (socket says 172.21.15.112:59540) 2023-11-08T12:30:36.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 -- 172.21.15.112:0/2930317188 learned_addr learned my addr 172.21.15.112:0/2930317188 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:36.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67fbfff700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 0x7f67fc0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680088b700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67fc15a9f0 0x7f67fc1ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 -- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67fc15a9f0 msgr2=0x7f67fc1ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67fc15a9f0 0x7f67fc1ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 -- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 msgr2=0x7f67fc0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 0x7f67fc0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 -- 172.21.15.112:0/2930317188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40094b0 con 0x7f67fc159f10 2023-11-08T12:30:36.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f37fe700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67fc159f10 0x7f67fc0b4180 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f67e4000c00 tx=0x7f67e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f97fa700 1 -- 172.21.15.112:0/2930317188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e401aac0 con 0x7f67fc159f10 2023-11-08T12:30:36.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f97fa700 1 -- 172.21.15.112:0/2930317188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e401f070 con 0x7f67fc159f10 2023-11-08T12:30:36.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc0affa0 con 0x7f67fc159f10 2023-11-08T12:30:36.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f67f97fa700 1 -- 172.21.15.112:0/2930317188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e401ae60 con 0x7f67fc159f10 2023-11-08T12:30:36.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.121+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc070290 con 0x7f67fc159f10 2023-11-08T12:30:36.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.125+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc06b300 con 0x7f67fc159f10 2023-11-08T12:30:36.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.125+0000 7f67f97fa700 1 -- 172.21.15.112:0/2930317188 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f67e400f050 con 0x7f67fc159f10 2023-11-08T12:30:36.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.125+0000 7f67f97fa700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f67dc064ee0 0x7f67dc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.129+0000 7f67f97fa700 1 -- 172.21.15.112:0/2930317188 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67e4083110 con 0x7f67fc159f10 2023-11-08T12:30:36.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.129+0000 7f67fbfff700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f67dc064ee0 0x7f67dc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.129+0000 7f67fbfff700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f67dc064ee0 0x7f67dc067390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f67ec000f60 tx=0x7f67ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.133+0000 7f67f97fa700 1 -- 172.21.15.112:0/2930317188 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f67e4051170 con 0x7f67fc159f10 2023-11-08T12:30:36.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.305+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67fc06cf30 con 0x7f67fc159f10 2023-11-08T12:30:36.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.305+0000 7f67f97fa700 1 -- 172.21.15.112:0/2930317188 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67e4021020 con 0x7f67fc159f10 2023-11-08T12:30:36.308 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:30:36.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.305+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f67dc064ee0 msgr2=0x7f67dc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.305+0000 7f680108c700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f67dc064ee0 0x7f67dc067390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f67ec000f60 tx=0x7f67ec009040 comp rx=0 tx=0).stop 2023-11-08T12:30:36.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.305+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67fc159f10 msgr2=0x7f67fc0b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.305+0000 7f680108c700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67fc159f10 0x7f67fc0b4180 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f67e4000c00 tx=0x7f67e4004770 comp rx=0 tx=0).stop 2023-11-08T12:30:36.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 shutdown_connections 2023-11-08T12:30:36.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f67dc064ee0 0x7f67dc067390 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67fc15a9f0 0x7f67fc1ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67fc159f10 0x7f67fc0b4180 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 --2- 172.21.15.112:0/2930317188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc070a90 0x7f67fc0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 >> 172.21.15.112:0/2930317188 conn(0x7f67fc0cf280 msgr2=0x7f67fc0ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:36.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 shutdown_connections 2023-11-08T12:30:36.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.309+0000 7f680108c700 1 -- 172.21.15.112:0/2930317188 wait complete. 2023-11-08T12:30:36.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:30:36.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.509+0000 7f537f59e700 1 Processor -- start 2023-11-08T12:30:36.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.509+0000 7f537f59e700 1 -- start start 2023-11-08T12:30:36.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380070620 0x7f53800b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537f59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5380069bf0 0x7f538006a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538015c520 con 0x7f538015c150 2023-11-08T12:30:36.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537f59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53800b4240 con 0x7f5380069bf0 2023-11-08T12:30:36.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538006cc50 con 0x7f5380070620 2023-11-08T12:30:36.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5380069bf0 0x7f538006a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537dd9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380070620 0x7f53800b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5380069bf0 0x7f538006a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59550/0 (socket says 172.21.15.112:59550) 2023-11-08T12:30:36.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537dd9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380070620 0x7f53800b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:38452/0 (socket says 172.21.15.112:38452) 2023-11-08T12:30:36.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 -- 172.21.15.112:0/3369702575 learned_addr learned my addr 172.21.15.112:0/3369702575 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:36.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537d59a700 1 -- 172.21.15.112:0/3369702575 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553005568 0 0) 0x7f538015c520 con 0x7f538015c150 2023-11-08T12:30:36.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 -- 172.21.15.112:0/3369702575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380070620 msgr2=0x7f53800b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:36.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 --2- 172.21.15.112:0/3369702575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380070620 0x7f53800b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 -- 172.21.15.112:0/3369702575 >> v1:172.21.15.133:6789/0 conn(0x7f538015c150 legacy=0x7f538006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 -- 172.21.15.112:0/3369702575 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800d2450 con 0x7f5380069bf0 2023-11-08T12:30:36.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.513+0000 7f537ed9d700 1 --2- 172.21.15.112:0/3369702575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380069bf0 0x7f538006a050 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f537800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b11ccd54f08336 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537d59a700 1 -- 172.21.15.112:0/3369702575 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800e070 con 0x7f5380069bf0 2023-11-08T12:30:36.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537d59a700 1 -- 172.21.15.112:0/3369702575 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800b910 con 0x7f5380069bf0 2023-11-08T12:30:36.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537d59a700 1 -- 172.21.15.112:0/3369702575 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800bcc0 con 0x7f5380069bf0 2023-11-08T12:30:36.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 -- 172.21.15.112:0/3369702575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380069bf0 msgr2=0x7f538006a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 --2- 172.21.15.112:0/3369702575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380069bf0 0x7f538006a050 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f537800b330 comp rx=0 tx=0).stop 2023-11-08T12:30:36.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 -- 172.21.15.112:0/3369702575 shutdown_connections 2023-11-08T12:30:36.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 --2- 172.21.15.112:0/3369702575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380069bf0 0x7f538006a050 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 --2- 172.21.15.112:0/3369702575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380070620 0x7f53800b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 -- 172.21.15.112:0/3369702575 >> 172.21.15.112:0/3369702575 conn(0x7f53800d3680 msgr2=0x7f53800cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:36.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 -- 172.21.15.112:0/3369702575 shutdown_connections 2023-11-08T12:30:36.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 -- 172.21.15.112:0/3369702575 wait complete. 2023-11-08T12:30:36.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.517+0000 7f537f59e700 1 Processor -- start 2023-11-08T12:30:36.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 -- start start 2023-11-08T12:30:36.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380069bf0 0x7f53801f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380070620 0x7f538014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f538015c150 0x7f5380150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800b5950 con 0x7f5380070620 2023-11-08T12:30:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53801f2990 con 0x7f538015c150 2023-11-08T12:30:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53800b5bf0 con 0x7f5380069bf0 2023-11-08T12:30:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380070620 0x7f538014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380070620 0x7f538014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59554/0 (socket says 172.21.15.112:59554) 2023-11-08T12:30:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 -- 172.21.15.112:0/46135949 learned_addr learned my addr 172.21.15.112:0/46135949 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537ed9d700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f538015c150 0x7f5380150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537e59c700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380069bf0 0x7f53801f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 -- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380069bf0 msgr2=0x7f53801f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380069bf0 0x7f53801f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 -- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f538015c150 msgr2=0x7f5380150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f538015c150 0x7f5380150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 -- 172.21.15.112:0/46135949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378009b30 con 0x7f5380070620 2023-11-08T12:30:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537e59c700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380069bf0 0x7f53801f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:36.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537dd9b700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380070620 0x7f538014ff50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f537400e980 tx=0x7f537400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f536effd700 1 -- 172.21.15.112:0/46135949 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374009710 con 0x7f5380070620 2023-11-08T12:30:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f536effd700 1 -- 172.21.15.112:0/46135949 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400eed0 con 0x7f5380070620 2023-11-08T12:30:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f536effd700 1 -- 172.21.15.112:0/46135949 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400ca90 con 0x7f5380070620 2023-11-08T12:30:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53800d05e0 con 0x7f5380070620 2023-11-08T12:30:36.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.521+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53800d2730 con 0x7f5380070620 2023-11-08T12:30:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.525+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53800d2140 con 0x7f5380070620 2023-11-08T12:30:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.525+0000 7f536effd700 1 -- 172.21.15.112:0/46135949 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5374023070 con 0x7f5380070620 2023-11-08T12:30:36.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.529+0000 7f536effd700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5360064f60 0x7f5360067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.529+0000 7f536effd700 1 -- 172.21.15.112:0/46135949 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f53740821f0 con 0x7f5380070620 2023-11-08T12:30:36.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.529+0000 7f537e59c700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5360064f60 0x7f5360067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.529+0000 7f537e59c700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5360064f60 0x7f5360067410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5370000f60 tx=0x7f5370009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.533+0000 7f536effd700 1 -- 172.21.15.112:0/46135949 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f53740502f0 con 0x7f5380070620 2023-11-08T12:30:36.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.705+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5380073d20 con 0x7f5380070620 2023-11-08T12:30:36.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.705+0000 7f536effd700 1 -- 172.21.15.112:0/46135949 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5374053910 con 0x7f5380070620 2023-11-08T12:30:36.707 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:30:36.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5360064f60 msgr2=0x7f5360067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5360064f60 0x7f5360067410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5370000f60 tx=0x7f5370009040 comp rx=0 tx=0).stop 2023-11-08T12:30:36.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380070620 msgr2=0x7f538014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380070620 0x7f538014ff50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f537400e980 tx=0x7f537400ec90 comp rx=0 tx=0).stop 2023-11-08T12:30:36.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 shutdown_connections 2023-11-08T12:30:36.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5360064f60 0x7f5360067410 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f538015c150 0x7f5380150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5380070620 0x7f538014ff50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 --2- 172.21.15.112:0/46135949 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5380069bf0 0x7f53801f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 >> 172.21.15.112:0/46135949 conn(0x7f53800d3680 msgr2=0x7f5380155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:36.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 shutdown_connections 2023-11-08T12:30:36.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.709+0000 7f537f59e700 1 -- 172.21.15.112:0/46135949 wait complete. 2023-11-08T12:30:36.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:30:36.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.909+0000 7f242ea0a700 1 Processor -- start 2023-11-08T12:30:36.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.909+0000 7f242ea0a700 1 -- start start 2023-11-08T12:30:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f242ea0a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24280c8d10 0x7f24280cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f242ea0a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2428069d60 0x7f242806a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f242ea0a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242815a850 con 0x7f242815a480 2023-11-08T12:30:36.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f242ea0a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24280ce060 con 0x7f24280c8d10 2023-11-08T12:30:36.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f242ea0a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24280ce300 con 0x7f2428069d60 2023-11-08T12:30:36.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24280c8d10 0x7f24280cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24280c8d10 0x7f24280cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59560/0 (socket says 172.21.15.112:59560) 2023-11-08T12:30:36.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 -- 172.21.15.112:0/1734440881 learned_addr learned my addr 172.21.15.112:0/1734440881 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f242cfa7700 1 --2- 172.21.15.112:0/1734440881 >> v2:172.21.15.133:3300/0 conn(0x7f2428069d60 0x7f242806a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 -- 172.21.15.112:0/1734440881 >> v2:172.21.15.133:3300/0 conn(0x7f2428069d60 msgr2=0x7f242806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 --2- 172.21.15.112:0/1734440881 >> v2:172.21.15.133:3300/0 conn(0x7f2428069d60 0x7f242806a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 -- 172.21.15.112:0/1734440881 >> v1:172.21.15.133:6789/0 conn(0x7f242815a480 legacy=0x7f24280cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 -- 172.21.15.112:0/1734440881 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280cada0 con 0x7f24280c8d10 2023-11-08T12:30:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f241ffff700 1 --2- 172.21.15.112:0/1734440881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24280c8d10 0x7f24280cc9a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f24280c9340 tx=0x7f2410009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31b533ea181c010 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f24277fe700 1 -- 172.21.15.112:0/1734440881 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410011830 con 0x7f24280c8d10 2023-11-08T12:30:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f24277fe700 1 -- 172.21.15.112:0/1734440881 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410011990 con 0x7f24280c8d10 2023-11-08T12:30:36.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.913+0000 7f24277fe700 1 -- 172.21.15.112:0/1734440881 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410011d20 con 0x7f24280c8d10 2023-11-08T12:30:36.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 -- 172.21.15.112:0/1734440881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24280c8d10 msgr2=0x7f24280cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 --2- 172.21.15.112:0/1734440881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24280c8d10 0x7f24280cc9a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f24280c9340 tx=0x7f2410009bf0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 -- 172.21.15.112:0/1734440881 shutdown_connections 2023-11-08T12:30:36.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 --2- 172.21.15.112:0/1734440881 >> v2:172.21.15.133:3300/0 conn(0x7f2428069d60 0x7f242806a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 --2- 172.21.15.112:0/1734440881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24280c8d10 0x7f24280cc9a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 -- 172.21.15.112:0/1734440881 >> 172.21.15.112:0/1734440881 conn(0x7f24280cf350 msgr2=0x7f24280b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:36.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 -- 172.21.15.112:0/1734440881 shutdown_connections 2023-11-08T12:30:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 -- 172.21.15.112:0/1734440881 wait complete. 2023-11-08T12:30:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 Processor -- start 2023-11-08T12:30:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.917+0000 7f242ea0a700 1 -- start start 2023-11-08T12:30:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2428069d60 0x7f242814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24280c8d10 0x7f24281f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f242815a480 0x7f2428146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24281f1a20 con 0x7f242815a480 2023-11-08T12:30:36.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24280b2d40 con 0x7f24280c8d10 2023-11-08T12:30:36.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242815d2f0 con 0x7f2428069d60 2023-11-08T12:30:36.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f242815a480 0x7f2428146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f242815a480 0x7f2428146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59576/0 (socket says 172.21.15.112:59576) 2023-11-08T12:30:36.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 -- 172.21.15.112:0/2443337703 learned_addr learned my addr 172.21.15.112:0/2443337703 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:36.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f2427fff700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2428069d60 0x7f242814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f241ffff700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24280c8d10 0x7f24281f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 -- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2428069d60 msgr2=0x7f242814c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2428069d60 0x7f242814c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 -- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24280c8d10 msgr2=0x7f24281f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24280c8d10 0x7f24281f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:36.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 -- 172.21.15.112:0/2443337703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410009570 con 0x7f242815a480 2023-11-08T12:30:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f241ffff700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24280c8d10 0x7f24281f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242cfa7700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f242815a480 0x7f2428146640 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f242000efc0 tx=0x7f242000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f24257fa700 1 -- 172.21.15.112:0/2443337703 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000cb80 con 0x7f242815a480 2023-11-08T12:30:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f24257fa700 1 -- 172.21.15.112:0/2443337703 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000f040 con 0x7f242815a480 2023-11-08T12:30:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24280add50 con 0x7f242815a480 2023-11-08T12:30:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f24257fa700 1 -- 172.21.15.112:0/2443337703 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420014480 con 0x7f242815a480 2023-11-08T12:30:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24280caa30 con 0x7f242815a480 2023-11-08T12:30:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.921+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24280ca6e0 con 0x7f242815a480 2023-11-08T12:30:36.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.925+0000 7f24257fa700 1 -- 172.21.15.112:0/2443337703 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f24200145e0 con 0x7f242815a480 2023-11-08T12:30:36.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.925+0000 7f24257fa700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2408064ee0 0x7f2408067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:36.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.925+0000 7f24257fa700 1 -- 172.21.15.112:0/2443337703 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24200828e0 con 0x7f242815a480 2023-11-08T12:30:36.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.925+0000 7f2427fff700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2408064ee0 0x7f2408067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:36.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.929+0000 7f2427fff700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2408064ee0 0x7f2408067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f242806e550 tx=0x7f2418009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:36.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:36.933+0000 7f24257fa700 1 -- 172.21.15.112:0/2443337703 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2420050940 con 0x7f242815a480 2023-11-08T12:30:37.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24280726c0 con 0x7f242815a480 2023-11-08T12:30:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f24257fa700 1 -- 172.21.15.112:0/2443337703 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2420053f60 con 0x7f242815a480 2023-11-08T12:30:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2408064ee0 msgr2=0x7f2408067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2408064ee0 0x7f2408067390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f242806e550 tx=0x7f2418009040 comp rx=0 tx=0).stop 2023-11-08T12:30:37.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f242815a480 msgr2=0x7f2428146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f242815a480 0x7f2428146640 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f242000efc0 tx=0x7f242000c0c0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 shutdown_connections 2023-11-08T12:30:37.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2408064ee0 0x7f2408067390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f242815a480 0x7f2428146640 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24280c8d10 0x7f24281f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 --2- 172.21.15.112:0/2443337703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2428069d60 0x7f242814c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 >> 172.21.15.112:0/2443337703 conn(0x7f24280cf350 msgr2=0x7f242806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:37.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 shutdown_connections 2023-11-08T12:30:37.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.117+0000 7f242ea0a700 1 -- 172.21.15.112:0/2443337703 wait complete. 2023-11-08T12:30:37.124 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:30:37.140 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T12:30:37.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:37.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T12:30:37.212 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:30:37.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:30:37.213 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T12:30:37.231 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:30:37.232 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:37.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:30:37.247 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:37.247 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:37.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:30:37.289 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:30:37.289 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:37.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:30:37.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:37.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.497+0000 7f1e28ab1700 1 Processor -- start 2023-11-08T12:30:37.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.497+0000 7f1e28ab1700 1 -- start start 2023-11-08T12:30:37.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e28ab1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e240b1640 0x7f1e24070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:37.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e28ab1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e240c9040 0x7f1e240705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:37.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e28ab1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2415a550 con 0x7f1e240b43a0 2023-11-08T12:30:37.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e28ab1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2406b0a0 con 0x7f1e240b1640 2023-11-08T12:30:37.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e28ab1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240caac0 con 0x7f1e240c9040 2023-11-08T12:30:37.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e240b1640 0x7f1e24070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:37.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e240b1640 0x7f1e24070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59586/0 (socket says 172.21.15.112:59586) 2023-11-08T12:30:37.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 -- 172.21.15.112:0/3862914279 learned_addr learned my addr 172.21.15.112:0/3862914279 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:37.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e23fff700 1 --2- 172.21.15.112:0/3862914279 >> v2:172.21.15.133:3300/0 conn(0x7f1e240c9040 0x7f1e240705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:37.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 -- 172.21.15.112:0/3862914279 >> v2:172.21.15.133:3300/0 conn(0x7f1e240c9040 msgr2=0x7f1e240705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 --2- 172.21.15.112:0/3862914279 >> v2:172.21.15.133:3300/0 conn(0x7f1e240c9040 0x7f1e240705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 -- 172.21.15.112:0/3862914279 >> v1:172.21.15.133:6789/0 conn(0x7f1e240b43a0 legacy=0x7f1e2415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 -- 172.21.15.112:0/3862914279 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240cada0 con 0x7f1e240b1640 2023-11-08T12:30:37.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e22ffd700 1 --2- 172.21.15.112:0/3862914279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b1640 0x7f1e24070080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1e2406fe30 tx=0x7f1e18009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35078ac63059a6d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:37.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e227fc700 1 -- 172.21.15.112:0/3862914279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800b8a0 con 0x7f1e240b1640 2023-11-08T12:30:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e227fc700 1 -- 172.21.15.112:0/3862914279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1800ba00 con 0x7f1e240b1640 2023-11-08T12:30:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.501+0000 7f1e227fc700 1 -- 172.21.15.112:0/3862914279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800bd90 con 0x7f1e240b1640 2023-11-08T12:30:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 -- 172.21.15.112:0/3862914279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b1640 msgr2=0x7f1e24070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/3862914279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b1640 0x7f1e24070080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1e2406fe30 tx=0x7f1e18009bf0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 -- 172.21.15.112:0/3862914279 shutdown_connections 2023-11-08T12:30:37.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/3862914279 >> v2:172.21.15.133:3300/0 conn(0x7f1e240c9040 0x7f1e240705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/3862914279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b1640 0x7f1e24070080 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 -- 172.21.15.112:0/3862914279 >> 172.21.15.112:0/3862914279 conn(0x7f1e240b0f80 msgr2=0x7f1e240ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:37.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 -- 172.21.15.112:0/3862914279 shutdown_connections 2023-11-08T12:30:37.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.505+0000 7f1e28ab1700 1 -- 172.21.15.112:0/3862914279 wait complete. 2023-11-08T12:30:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 Processor -- start 2023-11-08T12:30:37.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 -- start start 2023-11-08T12:30:37.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e240b1640 0x7f1e240c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:37.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b43a0 0x7f1e2415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:37.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e240c9040 0x7f1e240cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:37.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2415ac30 con 0x7f1e240b43a0 2023-11-08T12:30:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240c4bc0 con 0x7f1e240c9040 2023-11-08T12:30:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e28ab1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2415a870 con 0x7f1e240b1640 2023-11-08T12:30:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e22ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b43a0 0x7f1e2415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e22ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b43a0 0x7f1e2415b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59596/0 (socket says 172.21.15.112:59596) 2023-11-08T12:30:37.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.509+0000 7f1e22ffd700 1 -- 172.21.15.112:0/801372585 learned_addr learned my addr 172.21.15.112:0/801372585 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:37.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e237fe700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e240b1640 0x7f1e240c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:37.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e23fff700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e240c9040 0x7f1e240cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:37.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e22ffd700 1 -- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e240b1640 msgr2=0x7f1e240c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e22ffd700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e240b1640 0x7f1e240c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e22ffd700 1 -- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e240c9040 msgr2=0x7f1e240cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e22ffd700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e240c9040 0x7f1e240cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e22ffd700 1 -- 172.21.15.112:0/801372585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18009570 con 0x7f1e240b43a0 2023-11-08T12:30:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e22ffd700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b43a0 0x7f1e2415b050 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1e18000c00 tx=0x7f1e18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e0bfff700 1 -- 172.21.15.112:0/801372585 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180038c0 con 0x7f1e240b43a0 2023-11-08T12:30:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e0bfff700 1 -- 172.21.15.112:0/801372585 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1801e070 con 0x7f1e240b43a0 2023-11-08T12:30:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e0bfff700 1 -- 172.21.15.112:0/801372585 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18003c40 con 0x7f1e240b43a0 2023-11-08T12:30:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2406b5d0 con 0x7f1e240b43a0 2023-11-08T12:30:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2406b2f0 con 0x7f1e240b43a0 2023-11-08T12:30:37.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.513+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e240ca7b0 con 0x7f1e240b43a0 2023-11-08T12:30:37.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.517+0000 7f1e0bfff700 1 -- 172.21.15.112:0/801372585 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1e1800f050 con 0x7f1e240b43a0 2023-11-08T12:30:37.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.517+0000 7f1e0bfff700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1e10064ee0 0x7f1e10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:37.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.517+0000 7f1e0bfff700 1 -- 172.21.15.112:0/801372585 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1e18020070 con 0x7f1e240b43a0 2023-11-08T12:30:37.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.517+0000 7f1e237fe700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1e10064ee0 0x7f1e10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:37.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.521+0000 7f1e237fe700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1e10064ee0 0x7f1e10067390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1e2415b8d0 tx=0x7f1e14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.525+0000 7f1e0bfff700 1 -- 172.21.15.112:0/801372585 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1e18051720 con 0x7f1e240b43a0 2023-11-08T12:30:37.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.729+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e2415ad70 con 0x7f1e240b43a0 2023-11-08T12:30:37.770 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:30:37.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e0bfff700 1 -- 172.21.15.112:0/801372585 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f1e2415ad70 con 0x7f1e240b43a0 2023-11-08T12:30:37.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:37.772 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:37.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1e10064ee0 msgr2=0x7f1e10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1e10064ee0 0x7f1e10067390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1e2415b8d0 tx=0x7f1e14009040 comp rx=0 tx=0).stop 2023-11-08T12:30:37.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b43a0 msgr2=0x7f1e2415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:37.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b43a0 0x7f1e2415b050 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1e18000c00 tx=0x7f1e18004770 comp rx=0 tx=0).stop 2023-11-08T12:30:37.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 shutdown_connections 2023-11-08T12:30:37.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1e10064ee0 0x7f1e10067390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e240c9040 0x7f1e240cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e240b43a0 0x7f1e2415b050 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 --2- 172.21.15.112:0/801372585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e240b1640 0x7f1e240c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:37.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.733+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 >> 172.21.15.112:0/801372585 conn(0x7f1e240b0f80 msgr2=0x7f1e240ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:37.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.737+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 shutdown_connections 2023-11-08T12:30:37.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:37.737+0000 7f1e28ab1700 1 -- 172.21.15.112:0/801372585 wait complete. 2023-11-08T12:30:37.776 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:37.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:37.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:30:38.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.001+0000 7ff02d691700 1 Processor -- start 2023-11-08T12:30:38.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.001+0000 7ff02d691700 1 -- start start 2023-11-08T12:30:38.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.001+0000 7ff02d691700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280cf9d0 0x7ff0280b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.001+0000 7ff02d691700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280cec90 con 0x7ff0280b5be0 2023-11-08T12:30:38.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.001+0000 7ff02d691700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280cdc80 con 0x7ff02806f320 2023-11-08T12:30:38.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.001+0000 7ff02d691700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280cded0 con 0x7ff0280cf9d0 2023-11-08T12:30:38.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff027fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff0280b5be0 0x7ff0280b44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55090/0 (socket says 172.21.15.112:55090) 2023-11-08T12:30:38.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff027fff700 1 -- 172.21.15.112:0/2644857843 learned_addr learned my addr 172.21.15.112:0/2644857843 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:38.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff0267fc700 1 --2- 172.21.15.112:0/2644857843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280cf9d0 0x7ff0280b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff025ffb700 1 -- 172.21.15.112:0/2644857843 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156335823 0 0) 0x7ff0280cec90 con 0x7ff0280b5be0 2023-11-08T12:30:38.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff025ffb700 1 -- 172.21.15.112:0/2644857843 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0100035d0 con 0x7ff0280b5be0 2023-11-08T12:30:38.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff025ffb700 1 -- 172.21.15.112:0/2644857843 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382909037 0 0) 0x7ff0280cdc80 con 0x7ff02806f320 2023-11-08T12:30:38.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff025ffb700 1 -- 172.21.15.112:0/2644857843 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0280cec90 con 0x7ff02806f320 2023-11-08T12:30:38.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff0267fc700 1 -- 172.21.15.112:0/2644857843 >> v1:172.21.15.133:6789/0 conn(0x7ff02806f320 legacy=0x7ff02806f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff0267fc700 1 -- 172.21.15.112:0/2644857843 >> v1:172.21.15.112:6789/0 conn(0x7ff0280b5be0 legacy=0x7ff0280b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff0267fc700 1 -- 172.21.15.112:0/2644857843 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280ce1b0 con 0x7ff0280cf9d0 2023-11-08T12:30:38.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff0267fc700 1 --2- 172.21.15.112:0/2644857843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280cf9d0 0x7ff0280b3fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009880 tx=0x7ff01c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6af60d7ed433e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff025ffb700 1 -- 172.21.15.112:0/2644857843 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c011830 con 0x7ff0280cf9d0 2023-11-08T12:30:38.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff025ffb700 1 -- 172.21.15.112:0/2644857843 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c011990 con 0x7ff0280cf9d0 2023-11-08T12:30:38.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff025ffb700 1 -- 172.21.15.112:0/2644857843 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c011d20 con 0x7ff0280cf9d0 2023-11-08T12:30:38.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff02d691700 1 -- 172.21.15.112:0/2644857843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280cf9d0 msgr2=0x7ff0280b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff02d691700 1 --2- 172.21.15.112:0/2644857843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280cf9d0 0x7ff0280b3fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009880 tx=0x7ff01c009b90 comp rx=0 tx=0).stop 2023-11-08T12:30:38.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff02d691700 1 -- 172.21.15.112:0/2644857843 shutdown_connections 2023-11-08T12:30:38.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff02d691700 1 --2- 172.21.15.112:0/2644857843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280cf9d0 0x7ff0280b3fa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff02d691700 1 -- 172.21.15.112:0/2644857843 >> 172.21.15.112:0/2644857843 conn(0x7ff0280ccb30 msgr2=0x7ff0280ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:38.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff02d691700 1 -- 172.21.15.112:0/2644857843 shutdown_connections 2023-11-08T12:30:38.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.005+0000 7ff02d691700 1 -- 172.21.15.112:0/2644857843 wait complete. 2023-11-08T12:30:38.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.009+0000 7ff02d691700 1 Processor -- start 2023-11-08T12:30:38.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.009+0000 7ff02d691700 1 -- start start 2023-11-08T12:30:38.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff02d691700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff02806f320 0x7ff0281de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff02d691700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280b5be0 0x7ff0281486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff02d691700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0280cf9d0 0x7ff0281564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff02d691700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff028149b30 con 0x7ff0280cf9d0 2023-11-08T12:30:38.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff02d691700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff028148f20 con 0x7ff02806f320 2023-11-08T12:30:38.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff02d691700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff028149200 con 0x7ff0280b5be0 2023-11-08T12:30:38.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0280cf9d0 0x7ff0281564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff026ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff02806f320 0x7ff0281de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff026ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff02806f320 0x7ff0281de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:33600/0 (socket says 172.21.15.112:33600) 2023-11-08T12:30:38.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0280cf9d0 0x7ff0281564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59598/0 (socket says 172.21.15.112:59598) 2023-11-08T12:30:38.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff026ffd700 1 -- 172.21.15.112:0/2236821326 learned_addr learned my addr 172.21.15.112:0/2236821326 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:38.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff0267fc700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280b5be0 0x7ff0281486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 -- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280b5be0 msgr2=0x7ff0281486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280b5be0 0x7ff0281486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 -- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff02806f320 msgr2=0x7ff0281de0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff02806f320 0x7ff0281de0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 -- 172.21.15.112:0/2236821326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0094b0 con 0x7ff0280cf9d0 2023-11-08T12:30:38.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff0267fc700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280b5be0 0x7ff0281486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:38.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff026ffd700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff02806f320 0x7ff0281de0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:38.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff027fff700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0280cf9d0 0x7ff0281564b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff02000ca70 tx=0x7ff02000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff00f7fe700 1 -- 172.21.15.112:0/2236821326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020007480 con 0x7ff0280cf9d0 2023-11-08T12:30:38.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff00f7fe700 1 -- 172.21.15.112:0/2236821326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0200075e0 con 0x7ff0280cf9d0 2023-11-08T12:30:38.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff00f7fe700 1 -- 172.21.15.112:0/2236821326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020007950 con 0x7ff0280cf9d0 2023-11-08T12:30:38.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.013+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0280ce770 con 0x7ff0280cf9d0 2023-11-08T12:30:38.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.017+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0280ce490 con 0x7ff0280cf9d0 2023-11-08T12:30:38.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.017+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff028158bb0 con 0x7ff0280cf9d0 2023-11-08T12:30:38.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.017+0000 7ff00f7fe700 1 -- 172.21.15.112:0/2236821326 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff020019030 con 0x7ff0280cf9d0 2023-11-08T12:30:38.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.021+0000 7ff00f7fe700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff014064ee0 0x7ff014067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.021+0000 7ff00f7fe700 1 -- 172.21.15.112:0/2236821326 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff020081720 con 0x7ff0280cf9d0 2023-11-08T12:30:38.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.021+0000 7ff026ffd700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff014064ee0 0x7ff014067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.021+0000 7ff026ffd700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff014064ee0 0x7ff014067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff0180011e0 tx=0x7ff018009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.029+0000 7ff00f7fe700 1 -- 172.21.15.112:0/2236821326 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff02004a400 con 0x7ff0280cf9d0 2023-11-08T12:30:38.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.201+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0280726c0 con 0x7ff0280cf9d0 2023-11-08T12:30:38.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.205+0000 7ff00f7fe700 1 -- 172.21.15.112:0/2236821326 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18132 (secure 0 0 0) 0x7ff020017090 con 0x7ff0280cf9d0 2023-11-08T12:30:38.208 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:38.208 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":58,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:09.553416+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:07.036289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:07.538745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:38.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff014064ee0 msgr2=0x7ff014067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff014064ee0 0x7ff014067390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff0180011e0 tx=0x7ff018009040 comp rx=0 tx=0).stop 2023-11-08T12:30:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0280cf9d0 msgr2=0x7ff0281564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0280cf9d0 0x7ff0281564b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff02000ca70 tx=0x7ff02000caa0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 shutdown_connections 2023-11-08T12:30:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff014064ee0 0x7ff014067390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0280cf9d0 0x7ff0281564b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0280b5be0 0x7ff0281486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 --2- 172.21.15.112:0/2236821326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff02806f320 0x7ff0281de0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 >> 172.21.15.112:0/2236821326 conn(0x7ff0280ccb30 msgr2=0x7ff0281573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:38.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 shutdown_connections 2023-11-08T12:30:38.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.209+0000 7ff02d691700 1 -- 172.21.15.112:0/2236821326 wait complete. 2023-11-08T12:30:38.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:30:07.036289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:30:07.538745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:30:38.238 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:30:38.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.429+0000 7fe8cf59e700 1 Processor -- start 2023-11-08T12:30:38.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.429+0000 7fe8cf59e700 1 -- start start 2023-11-08T12:30:38.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cf59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cf59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8d006ff10 0x7fe8d0070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cf59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d015c520 con 0x7fe8d015fc30 2023-11-08T12:30:38.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cf59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00b4240 con 0x7fe8d006ff10 2023-11-08T12:30:38.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cf59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00708a0 con 0x7fe8d015c150 2023-11-08T12:30:38.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8ced9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe8d015fc30 0x7fe8d01600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55104/0 (socket says 172.21.15.112:55104) 2023-11-08T12:30:38.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8ced9d700 1 -- 172.21.15.112:0/3353971663 learned_addr learned my addr 172.21.15.112:0/3353971663 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:38.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8ce59c700 1 --2- 172.21.15.112:0/3353971663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cdd9b700 1 --2- 172.21.15.112:0/3353971663 >> v2:172.21.15.133:3300/0 conn(0x7fe8d006ff10 0x7fe8d0070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cd59a700 1 -- 172.21.15.112:0/3353971663 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950370683 0 0) 0x7fe8d015c520 con 0x7fe8d015fc30 2023-11-08T12:30:38.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cd59a700 1 -- 172.21.15.112:0/3353971663 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b80035d0 con 0x7fe8d015fc30 2023-11-08T12:30:38.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8ce59c700 1 -- 172.21.15.112:0/3353971663 >> v2:172.21.15.133:3300/0 conn(0x7fe8d006ff10 msgr2=0x7fe8d0070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:38.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8ce59c700 1 --2- 172.21.15.112:0/3353971663 >> v2:172.21.15.133:3300/0 conn(0x7fe8d006ff10 0x7fe8d0070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8ce59c700 1 -- 172.21.15.112:0/3353971663 >> v1:172.21.15.112:6789/0 conn(0x7fe8d015fc30 legacy=0x7fe8d01600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8ce59c700 1 -- 172.21.15.112:0/3353971663 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d006ac00 con 0x7fe8d015c150 2023-11-08T12:30:38.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.433+0000 7fe8cdd9b700 1 --2- 172.21.15.112:0/3353971663 >> v2:172.21.15.133:3300/0 conn(0x7fe8d006ff10 0x7fe8d0070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:38.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8ce59c700 1 --2- 172.21.15.112:0/3353971663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00b3d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009850 tx=0x7fe8c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b3a934dd877186 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cd59a700 1 -- 172.21.15.112:0/3353971663 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0011830 con 0x7fe8d015c150 2023-11-08T12:30:38.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cd59a700 1 -- 172.21.15.112:0/3353971663 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0011990 con 0x7fe8d015c150 2023-11-08T12:30:38.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cd59a700 1 -- 172.21.15.112:0/3353971663 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0011d40 con 0x7fe8d015c150 2023-11-08T12:30:38.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 -- 172.21.15.112:0/3353971663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 msgr2=0x7fe8d00b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/3353971663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00b3d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009850 tx=0x7fe8c0009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:38.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 -- 172.21.15.112:0/3353971663 shutdown_connections 2023-11-08T12:30:38.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/3353971663 >> v2:172.21.15.133:3300/0 conn(0x7fe8d006ff10 0x7fe8d0070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/3353971663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00b3d00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 -- 172.21.15.112:0/3353971663 >> 172.21.15.112:0/3353971663 conn(0x7fe8d00d3680 msgr2=0x7fe8d00cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:38.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 -- 172.21.15.112:0/3353971663 shutdown_connections 2023-11-08T12:30:38.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.437+0000 7fe8cf59e700 1 -- 172.21.15.112:0/3353971663 wait complete. 2023-11-08T12:30:38.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 Processor -- start 2023-11-08T12:30:38.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 -- start start 2023-11-08T12:30:38.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d006ff10 0x7fe8d01567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d015fc30 0x7fe8d00b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cd980 con 0x7fe8d006ff10 2023-11-08T12:30:38.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cdc60 con 0x7fe8d015fc30 2023-11-08T12:30:38.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cdf40 con 0x7fe8d015c150 2023-11-08T12:30:38.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d006ff10 0x7fe8d01567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d006ff10 0x7fe8d01567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59604/0 (socket says 172.21.15.112:59604) 2023-11-08T12:30:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 -- 172.21.15.112:0/2071121820 learned_addr learned my addr 172.21.15.112:0/2071121820 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cdd9b700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ced9d700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d015fc30 0x7fe8d00b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 -- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 msgr2=0x7fe8d00ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 -- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d015fc30 msgr2=0x7fe8d00b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d015fc30 0x7fe8d00b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 -- 172.21.15.112:0/2071121820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4009450 con 0x7fe8d006ff10 2023-11-08T12:30:38.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cdd9b700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:38.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8ce59c700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d006ff10 0x7fe8d01567f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00090b0 tx=0x7fe8c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8beffd700 1 -- 172.21.15.112:0/2071121820 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004480 con 0x7fe8d006ff10 2023-11-08T12:30:38.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8beffd700 1 -- 172.21.15.112:0/2071121820 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c001f070 con 0x7fe8d006ff10 2023-11-08T12:30:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8beffd700 1 -- 172.21.15.112:0/2071121820 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0003900 con 0x7fe8d006ff10 2023-11-08T12:30:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c00094b0 con 0x7fe8d006ff10 2023-11-08T12:30:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.441+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d00d2450 con 0x7fe8d006ff10 2023-11-08T12:30:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.445+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d006cc50 con 0x7fe8d006ff10 2023-11-08T12:30:38.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.445+0000 7fe8beffd700 1 -- 172.21.15.112:0/2071121820 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe8c002a020 con 0x7fe8d006ff10 2023-11-08T12:30:38.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.449+0000 7fe8beffd700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8b0064ee0 0x7fe8b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.449+0000 7fe8beffd700 1 -- 172.21.15.112:0/2071121820 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe8c0083600 con 0x7fe8d006ff10 2023-11-08T12:30:38.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.449+0000 7fe8cdd9b700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8b0064ee0 0x7fe8b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.449+0000 7fe8cdd9b700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8b0064ee0 0x7fe8b0067390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00b8730 tx=0x7fe8c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.453+0000 7fe8beffd700 1 -- 172.21.15.112:0/2071121820 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe8c0051570 con 0x7fe8d006ff10 2023-11-08T12:30:38.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.633+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8d00d2730 con 0x7fe8d006ff10 2023-11-08T12:30:38.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8beffd700 1 -- 172.21.15.112:0/2071121820 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8c0015020 con 0x7fe8d006ff10 2023-11-08T12:30:38.638 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:30:38.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8b0064ee0 msgr2=0x7fe8b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8b0064ee0 0x7fe8b0067390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00b8730 tx=0x7fe8c4008040 comp rx=0 tx=0).stop 2023-11-08T12:30:38.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d006ff10 msgr2=0x7fe8d01567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d006ff10 0x7fe8d01567f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00090b0 tx=0x7fe8c0004770 comp rx=0 tx=0).stop 2023-11-08T12:30:38.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 shutdown_connections 2023-11-08T12:30:38.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe8b0064ee0 0x7fe8b0067390 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.642 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d015fc30 0x7fe8d00b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d015c150 0x7fe8d00ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 --2- 172.21.15.112:0/2071121820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d006ff10 0x7fe8d01567f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 >> 172.21.15.112:0/2071121820 conn(0x7fe8d00d3680 msgr2=0x7fe8d00c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:38.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 shutdown_connections 2023-11-08T12:30:38.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.637+0000 7fe8cf59e700 1 -- 172.21.15.112:0/2071121820 wait complete. 2023-11-08T12:30:38.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:30:38.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.841+0000 7f5eced08700 1 Processor -- start 2023-11-08T12:30:38.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.841+0000 7f5eced08700 1 -- start start 2023-11-08T12:30:38.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eced08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ec815e190 0x7f5ec80cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eced08700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ec8161560 0x7f5ec8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eced08700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec806ff10 0x7f5ec8070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eced08700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec80708d0 con 0x7f5ec8161560 2023-11-08T12:30:38.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eced08700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec815e560 con 0x7f5ec815e190 2023-11-08T12:30:38.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eced08700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec806be80 con 0x7f5ec806ff10 2023-11-08T12:30:38.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ec8161560 0x7f5ec8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5ec8161560 0x7f5ec8069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59618/0 (socket says 172.21.15.112:59618) 2023-11-08T12:30:38.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 -- 172.21.15.112:0/2894656319 learned_addr learned my addr 172.21.15.112:0/2894656319 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:38.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ece507700 1 --2- 172.21.15.112:0/2894656319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec806ff10 0x7f5ec8070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecdd06700 1 --2- 172.21.15.112:0/2894656319 >> v2:172.21.15.133:3300/0 conn(0x7f5ec815e190 0x7f5ec80cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 -- 172.21.15.112:0/2894656319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec806ff10 msgr2=0x7f5ec8070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:38.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 --2- 172.21.15.112:0/2894656319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec806ff10 0x7f5ec8070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 -- 172.21.15.112:0/2894656319 >> v2:172.21.15.133:3300/0 conn(0x7f5ec815e190 msgr2=0x7f5ec80cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:38.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 --2- 172.21.15.112:0/2894656319 >> v2:172.21.15.133:3300/0 conn(0x7f5ec815e190 0x7f5ec80cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 -- 172.21.15.112:0/2894656319 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec80ce330 con 0x7f5ec8161560 2023-11-08T12:30:38.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecdd06700 1 --2- 172.21.15.112:0/2894656319 >> v2:172.21.15.133:3300/0 conn(0x7f5ec815e190 0x7f5ec80cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:38.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5ecd505700 1 --2- 172.21.15.112:0/2894656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec8161560 0x7f5ec8069bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80cb9b0 tx=0x7f5eb8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ef586d7d736481 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eccd04700 1 -- 172.21.15.112:0/2894656319 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8011830 con 0x7f5ec8161560 2023-11-08T12:30:38.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eccd04700 1 -- 172.21.15.112:0/2894656319 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8011990 con 0x7f5ec8161560 2023-11-08T12:30:38.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.845+0000 7f5eccd04700 1 -- 172.21.15.112:0/2894656319 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8011d20 con 0x7f5ec8161560 2023-11-08T12:30:38.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 -- 172.21.15.112:0/2894656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec8161560 msgr2=0x7f5ec8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 --2- 172.21.15.112:0/2894656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec8161560 0x7f5ec8069bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80cb9b0 tx=0x7f5eb8009bf0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 -- 172.21.15.112:0/2894656319 shutdown_connections 2023-11-08T12:30:38.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 --2- 172.21.15.112:0/2894656319 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec806ff10 0x7f5ec8070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 --2- 172.21.15.112:0/2894656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec8161560 0x7f5ec8069bf0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 --2- 172.21.15.112:0/2894656319 >> v2:172.21.15.133:3300/0 conn(0x7f5ec815e190 0x7f5ec80cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 -- 172.21.15.112:0/2894656319 >> 172.21.15.112:0/2894656319 conn(0x7f5ec80cf280 msgr2=0x7f5ec80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:38.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 -- 172.21.15.112:0/2894656319 shutdown_connections 2023-11-08T12:30:38.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.849+0000 7f5eced08700 1 -- 172.21.15.112:0/2894656319 wait complete. 2023-11-08T12:30:38.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 Processor -- start 2023-11-08T12:30:38.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 -- start start 2023-11-08T12:30:38.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec806ff10 0x7f5ec80b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec815e190 0x7f5ec8151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec8161560 0x7f5ec80ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80c9bf0 con 0x7f5ec806ff10 2023-11-08T12:30:38.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80b4530 con 0x7f5ec8161560 2023-11-08T12:30:38.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5eced08700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec81522d0 con 0x7f5ec815e190 2023-11-08T12:30:38.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec806ff10 0x7f5ec80b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec806ff10 0x7f5ec80b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59620/0 (socket says 172.21.15.112:59620) 2023-11-08T12:30:38.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 -- 172.21.15.112:0/537354826 learned_addr learned my addr 172.21.15.112:0/537354826 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ece507700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec8161560 0x7f5ec80ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecd505700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec815e190 0x7f5ec8151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 -- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec815e190 msgr2=0x7f5ec8151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec815e190 0x7f5ec8151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 -- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec8161560 msgr2=0x7f5ec80ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:38.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec8161560 0x7f5ec80ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:38.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 -- 172.21.15.112:0/537354826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8009570 con 0x7f5ec806ff10 2023-11-08T12:30:38.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ece507700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec8161560 0x7f5ec80ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:38.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecd505700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec815e190 0x7f5ec8151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:38.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.853+0000 7f5ecdd06700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec806ff10 0x7f5ec80b3ff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400e880 tx=0x7f5ec400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.857+0000 7f5ebe7fc700 1 -- 172.21.15.112:0/537354826 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400c780 con 0x7f5ec806ff10 2023-11-08T12:30:38.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.857+0000 7f5ebe7fc700 1 -- 172.21.15.112:0/537354826 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec400c8e0 con 0x7f5ec806ff10 2023-11-08T12:30:38.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.857+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec80afc70 con 0x7f5ec806ff10 2023-11-08T12:30:38.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.857+0000 7f5ebe7fc700 1 -- 172.21.15.112:0/537354826 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400cc70 con 0x7f5ec806ff10 2023-11-08T12:30:38.861 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.857+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec80af990 con 0x7f5ec806ff10 2023-11-08T12:30:38.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.857+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec80aff50 con 0x7f5ec806ff10 2023-11-08T12:30:38.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.857+0000 7f5ebe7fc700 1 -- 172.21.15.112:0/537354826 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5ec4023070 con 0x7f5ec806ff10 2023-11-08T12:30:38.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.861+0000 7f5ebe7fc700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5eac064ee0 0x7f5eac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:38.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.861+0000 7f5ebe7fc700 1 -- 172.21.15.112:0/537354826 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5ec4081de0 con 0x7f5ec806ff10 2023-11-08T12:30:38.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.861+0000 7f5ecd505700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5eac064ee0 0x7f5eac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:38.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.861+0000 7f5ecd505700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5eac064ee0 0x7f5eac067390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000c00 tx=0x7f5eb8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:38.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:38.865+0000 7f5ebe7fc700 1 -- 172.21.15.112:0/537354826 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5ec404fcf0 con 0x7f5ec806ff10 2023-11-08T12:30:39.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.041+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ec8163be0 con 0x7f5ec806ff10 2023-11-08T12:30:39.045 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.041+0000 7f5ebe7fc700 1 -- 172.21.15.112:0/537354826 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ec4053310 con 0x7f5ec806ff10 2023-11-08T12:30:39.045 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:30:39.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5eac064ee0 msgr2=0x7f5eac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5eac064ee0 0x7f5eac067390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000c00 tx=0x7f5eb8008030 comp rx=0 tx=0).stop 2023-11-08T12:30:39.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec806ff10 msgr2=0x7f5ec80b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec806ff10 0x7f5ec80b3ff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400e880 tx=0x7f5ec400ec40 comp rx=0 tx=0).stop 2023-11-08T12:30:39.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 shutdown_connections 2023-11-08T12:30:39.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5eac064ee0 0x7f5eac067390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec8161560 0x7f5ec80ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ec815e190 0x7f5ec8151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 --2- 172.21.15.112:0/537354826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ec806ff10 0x7f5ec80b3ff0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 >> 172.21.15.112:0/537354826 conn(0x7f5ec80cf280 msgr2=0x7f5ec8060660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:39.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 shutdown_connections 2023-11-08T12:30:39.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.049+0000 7f5eced08700 1 -- 172.21.15.112:0/537354826 wait complete. 2023-11-08T12:30:39.071 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:30:39.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f00256aa700 1 Processor -- start 2023-11-08T12:30:39.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f00256aa700 1 -- start start 2023-11-08T12:30:39.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f00256aa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f002015c150 0x7f00200b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f00256aa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0020070360 0x7f0020160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f00256aa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002015c520 con 0x7f002006ff10 2023-11-08T12:30:39.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f00256aa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00200b4240 con 0x7f002015c150 2023-11-08T12:30:39.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f00256aa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002006ac00 con 0x7f0020070360 2023-11-08T12:30:39.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f0017fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f002006ff10 0x7f002015fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55114/0 (socket says 172.21.15.112:55114) 2023-11-08T12:30:39.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f0017fff700 1 -- 172.21.15.112:0/3811983087 learned_addr learned my addr 172.21.15.112:0/3811983087 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:39.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f001effd700 1 --2- 172.21.15.112:0/3811983087 >> v2:172.21.15.112:3300/0 conn(0x7f002015c150 0x7f00200b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.253+0000 7f001f7fe700 1 --2- 172.21.15.112:0/3811983087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0020070360 0x7f0020160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001e7fc700 1 -- 172.21.15.112:0/3811983087 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644052123 0 0) 0x7f002015c520 con 0x7f002006ff10 2023-11-08T12:30:39.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001e7fc700 1 -- 172.21.15.112:0/3811983087 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c0035d0 con 0x7f002006ff10 2023-11-08T12:30:39.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001effd700 1 -- 172.21.15.112:0/3811983087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0020070360 msgr2=0x7f0020160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:39.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001effd700 1 --2- 172.21.15.112:0/3811983087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0020070360 0x7f0020160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001effd700 1 -- 172.21.15.112:0/3811983087 >> v1:172.21.15.112:6789/0 conn(0x7f002006ff10 legacy=0x7f002015fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001effd700 1 -- 172.21.15.112:0/3811983087 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002006cc50 con 0x7f002015c150 2023-11-08T12:30:39.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001effd700 1 --2- 172.21.15.112:0/3811983087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002015c150 0x7f00200b3d00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0010009850 tx=0x7f0010009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca2ea8e65228df8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:39.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001e7fc700 1 -- 172.21.15.112:0/3811983087 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010011830 con 0x7f002015c150 2023-11-08T12:30:39.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001e7fc700 1 -- 172.21.15.112:0/3811983087 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0010011990 con 0x7f002015c150 2023-11-08T12:30:39.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f001e7fc700 1 -- 172.21.15.112:0/3811983087 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010011d00 con 0x7f002015c150 2023-11-08T12:30:39.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 -- 172.21.15.112:0/3811983087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002015c150 msgr2=0x7f00200b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 --2- 172.21.15.112:0/3811983087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002015c150 0x7f00200b3d00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0010009850 tx=0x7f0010009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:39.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 -- 172.21.15.112:0/3811983087 shutdown_connections 2023-11-08T12:30:39.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 --2- 172.21.15.112:0/3811983087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0020070360 0x7f0020160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 --2- 172.21.15.112:0/3811983087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f002015c150 0x7f00200b3d00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 -- 172.21.15.112:0/3811983087 >> 172.21.15.112:0/3811983087 conn(0x7f00200d3680 msgr2=0x7f00200cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:39.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 -- 172.21.15.112:0/3811983087 shutdown_connections 2023-11-08T12:30:39.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.257+0000 7f00256aa700 1 -- 172.21.15.112:0/3811983087 wait complete. 2023-11-08T12:30:39.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 Processor -- start 2023-11-08T12:30:39.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 -- start start 2023-11-08T12:30:39.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f002006ff10 0x7f00200cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0020070360 0x7f00200b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f002015c150 0x7f0020152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00201f5be0 con 0x7f0020070360 2023-11-08T12:30:39.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200cfdf0 con 0x7f002015c150 2023-11-08T12:30:39.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00256aa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00201f4c80 con 0x7f002006ff10 2023-11-08T12:30:39.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0020070360 0x7f00200b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0020070360 0x7f00200b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59640/0 (socket says 172.21.15.112:59640) 2023-11-08T12:30:39.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 -- 172.21.15.112:0/2311074384 learned_addr learned my addr 172.21.15.112:0/2311074384 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:39.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f001effd700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f002006ff10 0x7f00200cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f001f7fe700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f002015c150 0x7f0020152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 -- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f002006ff10 msgr2=0x7f00200cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f002006ff10 0x7f00200cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 -- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f002015c150 msgr2=0x7f0020152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f002015c150 0x7f0020152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 -- 172.21.15.112:0/2311074384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00100094b0 con 0x7f0020070360 2023-11-08T12:30:39.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f0017fff700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0020070360 0x7f00200b6520 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f000800c680 tx=0x7f000800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:39.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.261+0000 7f00177fe700 1 -- 172.21.15.112:0/2311074384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080074e0 con 0x7f0020070360 2023-11-08T12:30:39.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.265+0000 7f00177fe700 1 -- 172.21.15.112:0/2311074384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0008007660 con 0x7f0020070360 2023-11-08T12:30:39.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.265+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00200d2730 con 0x7f0020070360 2023-11-08T12:30:39.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.265+0000 7f00177fe700 1 -- 172.21.15.112:0/2311074384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008005a90 con 0x7f0020070360 2023-11-08T12:30:39.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.265+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00200d2450 con 0x7f0020070360 2023-11-08T12:30:39.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.265+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00200d05e0 con 0x7f0020070360 2023-11-08T12:30:39.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.265+0000 7f00177fe700 1 -- 172.21.15.112:0/2311074384 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0008019030 con 0x7f0020070360 2023-11-08T12:30:39.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.269+0000 7f00177fe700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0000064ee0 0x7f0000067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.269+0000 7f00177fe700 1 -- 172.21.15.112:0/2311074384 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f00080812f0 con 0x7f0020070360 2023-11-08T12:30:39.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.269+0000 7f001effd700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0000064ee0 0x7f0000067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.269+0000 7f001effd700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0000064ee0 0x7f0000067390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00100090b0 tx=0x7f0010008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:39.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.273+0000 7f00177fe700 1 -- 172.21.15.112:0/2311074384 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f000804f350 con 0x7f0020070360 2023-11-08T12:30:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.445+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00200cdfd0 con 0x7f0020070360 2023-11-08T12:30:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.445+0000 7f00177fe700 1 -- 172.21.15.112:0/2311074384 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00200cdfd0 con 0x7f0020070360 2023-11-08T12:30:39.449 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:30:39.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0000064ee0 msgr2=0x7f0000067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0000064ee0 0x7f0000067390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00100090b0 tx=0x7f0010008030 comp rx=0 tx=0).stop 2023-11-08T12:30:39.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0020070360 msgr2=0x7f00200b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0020070360 0x7f00200b6520 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f000800c680 tx=0x7f000800c990 comp rx=0 tx=0).stop 2023-11-08T12:30:39.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 shutdown_connections 2023-11-08T12:30:39.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0000064ee0 0x7f0000067390 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f002015c150 0x7f0020152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0020070360 0x7f00200b6520 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 --2- 172.21.15.112:0/2311074384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f002006ff10 0x7f00200cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 >> 172.21.15.112:0/2311074384 conn(0x7f00200d3680 msgr2=0x7f00200b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:39.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 shutdown_connections 2023-11-08T12:30:39.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.449+0000 7f00256aa700 1 -- 172.21.15.112:0/2311074384 wait complete. 2023-11-08T12:30:39.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:30:39.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.653+0000 7f9c527bc700 1 Processor -- start 2023-11-08T12:30:39.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.653+0000 7f9c527bc700 1 -- start start 2023-11-08T12:30:39.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c527bc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c4c15c150 0x7f9c4c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c527bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c527bc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c15c520 con 0x7f9c4c15fc30 2023-11-08T12:30:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c527bc700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0b4240 con 0x7f9c4c15c150 2023-11-08T12:30:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c527bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0708a0 con 0x7f9c4c06ff10 2023-11-08T12:30:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c517ba700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c4c15c150 0x7f9c4c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.660 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c51fbb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9c4c15fc30 0x7f9c4c1600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55128/0 (socket says 172.21.15.112:55128) 2023-11-08T12:30:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c51fbb700 1 -- 172.21.15.112:0/3487728456 learned_addr learned my addr 172.21.15.112:0/3487728456 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c50fb9700 1 --2- 172.21.15.112:0/3487728456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c517ba700 1 -- 172.21.15.112:0/3487728456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 msgr2=0x7f9c4c070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c517ba700 1 --2- 172.21.15.112:0/3487728456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c517ba700 1 -- 172.21.15.112:0/3487728456 >> v1:172.21.15.112:6789/0 conn(0x7f9c4c15fc30 legacy=0x7f9c4c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c517ba700 1 -- 172.21.15.112:0/3487728456 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c06ac00 con 0x7f9c4c15c150 2023-11-08T12:30:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c517ba700 1 --2- 172.21.15.112:0/3487728456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c0b3d00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009850 tx=0x7f9c48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb4b19c5921ce2e server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c43fff700 1 -- 172.21.15.112:0/3487728456 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48011830 con 0x7f9c4c15c150 2023-11-08T12:30:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c43fff700 1 -- 172.21.15.112:0/3487728456 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48011990 con 0x7f9c4c15c150 2023-11-08T12:30:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.657+0000 7f9c43fff700 1 -- 172.21.15.112:0/3487728456 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48011d40 con 0x7f9c4c15c150 2023-11-08T12:30:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- 172.21.15.112:0/3487728456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 msgr2=0x7f9c4c0b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3487728456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c0b3d00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009850 tx=0x7f9c48009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- 172.21.15.112:0/3487728456 shutdown_connections 2023-11-08T12:30:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3487728456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3487728456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c0b3d00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- 172.21.15.112:0/3487728456 >> 172.21.15.112:0/3487728456 conn(0x7f9c4c0d3680 msgr2=0x7f9c4c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- 172.21.15.112:0/3487728456 shutdown_connections 2023-11-08T12:30:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- 172.21.15.112:0/3487728456 wait complete. 2023-11-08T12:30:39.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 Processor -- start 2023-11-08T12:30:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- start start 2023-11-08T12:30:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c14c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c4c15fc30 0x7f9c4c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0cb180 con 0x7f9c4c15c150 2023-11-08T12:30:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0caea0 con 0x7f9c4c15fc30 2023-11-08T12:30:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.661+0000 7f9c527bc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0ce1c0 con 0x7f9c4c06ff10 2023-11-08T12:30:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c14c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c14c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59660/0 (socket says 172.21.15.112:59660) 2023-11-08T12:30:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 -- 172.21.15.112:0/3034409918 learned_addr learned my addr 172.21.15.112:0/3034409918 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c51fbb700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c4c15fc30 0x7f9c4c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c517ba700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 -- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 msgr2=0x7f9c4c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 -- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c4c15fc30 msgr2=0x7f9c4c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c4c15fc30 0x7f9c4c0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 -- 172.21.15.112:0/3034409918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c480094b0 con 0x7f9c4c15c150 2023-11-08T12:30:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c50fb9700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c14c390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00e9b0 tx=0x7f9c3c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c41ffb700 1 -- 172.21.15.112:0/3034409918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c009710 con 0x7f9c4c15c150 2023-11-08T12:30:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c41ffb700 1 -- 172.21.15.112:0/3034409918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c00ee50 con 0x7f9c4c15c150 2023-11-08T12:30:39.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c0d2450 con 0x7f9c4c15c150 2023-11-08T12:30:39.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c41ffb700 1 -- 172.21.15.112:0/3034409918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00ca50 con 0x7f9c4c15c150 2023-11-08T12:30:39.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.665+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c06cc50 con 0x7f9c4c15c150 2023-11-08T12:30:39.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.669+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c0d2730 con 0x7f9c4c15c150 2023-11-08T12:30:39.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.669+0000 7f9c41ffb700 1 -- 172.21.15.112:0/3034409918 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c3c023070 con 0x7f9c4c15c150 2023-11-08T12:30:39.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.669+0000 7f9c41ffb700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:39.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.669+0000 7f9c41ffb700 1 -- 172.21.15.112:0/3034409918 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9c3c0821d0 con 0x7f9c4c15c150 2023-11-08T12:30:39.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.669+0000 7f9c517ba700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:39.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.669+0000 7f9c517ba700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9c480090b0 tx=0x7f9c48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:39.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.673+0000 7f9c41ffb700 1 -- 172.21.15.112:0/3034409918 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c3c050230 con 0x7f9c4c15c150 2023-11-08T12:30:39.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.841+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c4c073d20 con 0x7f9c4c15c150 2023-11-08T12:30:39.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c41ffb700 1 -- 172.21.15.112:0/3034409918 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c3c053850 con 0x7f9c4c15c150 2023-11-08T12:30:39.846 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:30:39.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 msgr2=0x7f9c30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9c480090b0 tx=0x7f9c48008030 comp rx=0 tx=0).stop 2023-11-08T12:30:39.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 msgr2=0x7f9c4c14c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:39.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c14c390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00e9b0 tx=0x7f9c3c00ecc0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 shutdown_connections 2023-11-08T12:30:39.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c4c15fc30 0x7f9c4c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c15c150 0x7f9c4c14c390 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 --2- 172.21.15.112:0/3034409918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c4c06ff10 0x7f9c4c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:39.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 >> 172.21.15.112:0/3034409918 conn(0x7f9c4c0d3680 msgr2=0x7f9c4c0c8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:39.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 shutdown_connections 2023-11-08T12:30:39.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:39.845+0000 7f9c527bc700 1 -- 172.21.15.112:0/3034409918 wait complete. 2023-11-08T12:30:39.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.045+0000 7f3b61937700 1 Processor -- start 2023-11-08T12:30:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.045+0000 7f3b61937700 1 -- start start 2023-11-08T12:30:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.045+0000 7f3b61937700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b5c15a1a0 0x7f3b5c0b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b61937700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c15dd10 con 0x7f3b5c0b4120 2023-11-08T12:30:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b61937700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c15dff0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b61937700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c15e990 con 0x7f3b5c15a1a0 2023-11-08T12:30:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5bfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3b5c0b4120 0x7f3b5c0cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55140/0 (socket says 172.21.15.112:55140) 2023-11-08T12:30:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5bfff700 1 -- 172.21.15.112:0/908260934 learned_addr learned my addr 172.21.15.112:0/908260934 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5affd700 1 --2- 172.21.15.112:0/908260934 >> v2:172.21.15.133:3300/0 conn(0x7f3b5c15a1a0 0x7f3b5c0b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5a7fc700 1 -- 172.21.15.112:0/908260934 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229626623 0 0) 0x7f3b5c15dd10 con 0x7f3b5c0b4120 2023-11-08T12:30:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5a7fc700 1 -- 172.21.15.112:0/908260934 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b480035d0 con 0x7f3b5c0b4120 2023-11-08T12:30:40.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5affd700 1 -- 172.21.15.112:0/908260934 >> v1:172.21.15.133:6789/0 conn(0x7f3b5c0b5dc0 legacy=0x7f3b5c0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5a7fc700 1 -- 172.21.15.112:0/908260934 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591409488 0 0) 0x7f3b480035d0 con 0x7f3b5c0b4120 2023-11-08T12:30:40.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5affd700 1 -- 172.21.15.112:0/908260934 >> v1:172.21.15.112:6789/0 conn(0x7f3b5c0b4120 legacy=0x7f3b5c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5affd700 1 -- 172.21.15.112:0/908260934 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c15e2d0 con 0x7f3b5c15a1a0 2023-11-08T12:30:40.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5affd700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 0x7f3b5c0b5880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009850 tx=0x7f3b4c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639f24babbcdbbd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5a7fc700 1 -- 172.21.15.112:0/908260934 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540019f0 con 0x7f3b5c15a1a0 2023-11-08T12:30:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5a7fc700 1 -- 172.21.15.112:0/908260934 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c010590 con 0x7f3b5c15a1a0 2023-11-08T12:30:40.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.049+0000 7f3b5a7fc700 1 -- 172.21.15.112:0/908260934 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c010900 con 0x7f3b5c15a1a0 2023-11-08T12:30:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.053+0000 7f3b61937700 1 -- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 msgr2=0x7f3b5c0b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.053+0000 7f3b61937700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 0x7f3b5c0b5880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009850 tx=0x7f3b4c009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.053+0000 7f3b61937700 1 -- 172.21.15.112:0/908260934 shutdown_connections 2023-11-08T12:30:40.055 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.053+0000 7f3b61937700 1 --2- 172.21.15.112:0/908260934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 0x7f3b5c0b5880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.053+0000 7f3b61937700 1 -- 172.21.15.112:0/908260934 >> 172.21.15.112:0/908260934 conn(0x7f3b5c0ccb30 msgr2=0x7f3b5c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.053+0000 7f3b61937700 1 -- 172.21.15.112:0/908260934 shutdown_connections 2023-11-08T12:30:40.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.053+0000 7f3b61937700 1 -- 172.21.15.112:0/908260934 wait complete. 2023-11-08T12:30:40.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 Processor -- start 2023-11-08T12:30:40.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 -- start start 2023-11-08T12:30:40.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0b4120 0x7f3b5c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b5c0b5dc0 0x7f3b5c15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 0x7f3b5c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c8be0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c8e30 con 0x7f3b5c15a1a0 2023-11-08T12:30:40.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b61937700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c9110 con 0x7f3b5c0b4120 2023-11-08T12:30:40.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b5c0b5dc0 0x7f3b5c15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b5c0b5dc0 0x7f3b5c15c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59666/0 (socket says 172.21.15.112:59666) 2023-11-08T12:30:40.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 -- 172.21.15.112:0/870623903 learned_addr learned my addr 172.21.15.112:0/870623903 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:40.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b5bfff700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 0x7f3b5c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b5affd700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0b4120 0x7f3b5c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0b4120 msgr2=0x7f3b5c15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0b4120 0x7f3b5c15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 msgr2=0x7f3b5c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 0x7f3b5c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.057+0000 7f3b53fff700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0094b0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.061+0000 7f3b53fff700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b5c0b5dc0 0x7f3b5c15c250 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c750 tx=0x7f3b4400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.061+0000 7f3b58ff9700 1 -- 172.21.15.112:0/870623903 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440054e0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.061+0000 7f3b58ff9700 1 -- 172.21.15.112:0/870623903 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b440036a0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.061+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c069bf0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.061+0000 7f3b58ff9700 1 -- 172.21.15.112:0/870623903 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44003a30 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.061+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c15e5b0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.061+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c0b33d0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.065+0000 7f3b58ff9700 1 -- 172.21.15.112:0/870623903 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b44019030 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.065+0000 7f3b58ff9700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b3c064ee0 0x7f3b3c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.065+0000 7f3b58ff9700 1 -- 172.21.15.112:0/870623903 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3b440813e0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.065+0000 7f3b5affd700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b3c064ee0 0x7f3b3c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.069+0000 7f3b5affd700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b3c064ee0 0x7f3b3c067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c013040 tx=0x7f3b4c008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.073+0000 7f3b58ff9700 1 -- 172.21.15.112:0/870623903 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b4404f350 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.285+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b5c0726c0 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.285+0000 7f3b58ff9700 1 -- 172.21.15.112:0/870623903 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f3b44052970 con 0x7f3b5c0b5dc0 2023-11-08T12:30:40.289 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:40.289 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:40.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b3c064ee0 msgr2=0x7f3b3c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b3c064ee0 0x7f3b3c067390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c013040 tx=0x7f3b4c008000 comp rx=0 tx=0).stop 2023-11-08T12:30:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b5c0b5dc0 msgr2=0x7f3b5c15c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b5c0b5dc0 0x7f3b5c15c250 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c750 tx=0x7f3b4400ca60 comp rx=0 tx=0).stop 2023-11-08T12:30:40.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 shutdown_connections 2023-11-08T12:30:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b3c064ee0 0x7f3b3c067390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c15a1a0 0x7f3b5c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b5c0b5dc0 0x7f3b5c15c250 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 --2- 172.21.15.112:0/870623903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0b4120 0x7f3b5c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 >> 172.21.15.112:0/870623903 conn(0x7f3b5c0ccb30 msgr2=0x7f3b5c0cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:40.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 shutdown_connections 2023-11-08T12:30:40.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.289+0000 7f3b61937700 1 -- 172.21.15.112:0/870623903 wait complete. 2023-11-08T12:30:40.294 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:40.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:40.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.481+0000 7f08fa6d1700 1 Processor -- start 2023-11-08T12:30:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.481+0000 7f08fa6d1700 1 -- start start 2023-11-08T12:30:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.481+0000 7f08fa6d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08f4160710 0x7f08f40cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.481+0000 7f08fa6d1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08f4070790 0x7f08f4164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.481+0000 7f08fa6d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f40ad6c0 con 0x7f08f40cc860 2023-11-08T12:30:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.481+0000 7f08fa6d1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f406b1c0 con 0x7f08f4070790 2023-11-08T12:30:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.481+0000 7f08fa6d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f40adc60 con 0x7f08f4160710 2023-11-08T12:30:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08f4070790 0x7f08f4164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f08f4070790 0x7f08f4164250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59676/0 (socket says 172.21.15.112:59676) 2023-11-08T12:30:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 -- 172.21.15.112:0/3719953248 learned_addr learned my addr 172.21.15.112:0/3719953248 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f96cf700 1 --2- 172.21.15.112:0/3719953248 >> v2:172.21.15.133:3300/0 conn(0x7f08f4160710 0x7f08f40cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 -- 172.21.15.112:0/3719953248 >> v2:172.21.15.133:3300/0 conn(0x7f08f4160710 msgr2=0x7f08f40cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:40.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 --2- 172.21.15.112:0/3719953248 >> v2:172.21.15.133:3300/0 conn(0x7f08f4160710 0x7f08f40cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 -- 172.21.15.112:0/3719953248 >> v1:172.21.15.133:6789/0 conn(0x7f08f40cc860 legacy=0x7f08f4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 -- 172.21.15.112:0/3719953248 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f406b3d0 con 0x7f08f4070790 2023-11-08T12:30:40.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08f9ed0700 1 --2- 172.21.15.112:0/3719953248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f4070790 0x7f08f4164250 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f08f4072ed0 tx=0x7f08ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226627f9b7fce134 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08ebfff700 1 -- 172.21.15.112:0/3719953248 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00e070 con 0x7f08f4070790 2023-11-08T12:30:40.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08ebfff700 1 -- 172.21.15.112:0/3719953248 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00b910 con 0x7f08f4070790 2023-11-08T12:30:40.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08ebfff700 1 -- 172.21.15.112:0/3719953248 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00bcc0 con 0x7f08f4070790 2023-11-08T12:30:40.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08fa6d1700 1 -- 172.21.15.112:0/3719953248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f4070790 msgr2=0x7f08f4164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/3719953248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f4070790 0x7f08f4164250 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f08f4072ed0 tx=0x7f08ec00b330 comp rx=0 tx=0).stop 2023-11-08T12:30:40.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08fa6d1700 1 -- 172.21.15.112:0/3719953248 shutdown_connections 2023-11-08T12:30:40.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/3719953248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f4070790 0x7f08f4164250 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/3719953248 >> v2:172.21.15.133:3300/0 conn(0x7f08f4160710 0x7f08f40cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.485+0000 7f08fa6d1700 1 -- 172.21.15.112:0/3719953248 >> 172.21.15.112:0/3719953248 conn(0x7f08f40b0f80 msgr2=0x7f08f40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:40.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.489+0000 7f08fa6d1700 1 -- 172.21.15.112:0/3719953248 shutdown_connections 2023-11-08T12:30:40.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.489+0000 7f08fa6d1700 1 -- 172.21.15.112:0/3719953248 wait complete. 2023-11-08T12:30:40.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.489+0000 7f08fa6d1700 1 Processor -- start 2023-11-08T12:30:40.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08fa6d1700 1 -- start start 2023-11-08T12:30:40.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08fa6d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f4070790 0x7f08f415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08fa6d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f40cc860 0x7f08f415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08fa6d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f4160710 0x7f08f415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08fa6d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f415f6e0 con 0x7f08f40cc860 2023-11-08T12:30:40.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08fa6d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f415dd90 con 0x7f08f4070790 2023-11-08T12:30:40.496 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08fa6d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f415d4f0 con 0x7f08f4160710 2023-11-08T12:30:40.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f40cc860 0x7f08f415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f40cc860 0x7f08f415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59688/0 (socket says 172.21.15.112:59688) 2023-11-08T12:30:40.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 -- 172.21.15.112:0/2563755743 learned_addr learned my addr 172.21.15.112:0/2563755743 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:40.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f96cf700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f4070790 0x7f08f415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f9ed0700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f4160710 0x7f08f415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 -- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f4160710 msgr2=0x7f08f415bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f4160710 0x7f08f415bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 -- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f4070790 msgr2=0x7f08f415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f4070790 0x7f08f415ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 -- 172.21.15.112:0/2563755743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec009b30 con 0x7f08f40cc860 2023-11-08T12:30:40.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08f8ece700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f40cc860 0x7f08f415f1a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f08e400c500 tx=0x7f08e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08e9ffb700 1 -- 172.21.15.112:0/2563755743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40052d0 con 0x7f08f40cc860 2023-11-08T12:30:40.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.493+0000 7f08e9ffb700 1 -- 172.21.15.112:0/2563755743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4005430 con 0x7f08f40cc860 2023-11-08T12:30:40.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.497+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f40ad8f0 con 0x7f08f40cc860 2023-11-08T12:30:40.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.497+0000 7f08e9ffb700 1 -- 172.21.15.112:0/2563755743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e40055a0 con 0x7f08f40cc860 2023-11-08T12:30:40.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.497+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f406b6b0 con 0x7f08f40cc860 2023-11-08T12:30:40.501 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.497+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f4160ae0 con 0x7f08f40cc860 2023-11-08T12:30:40.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.497+0000 7f08e9ffb700 1 -- 172.21.15.112:0/2563755743 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f08e4019030 con 0x7f08f40cc860 2023-11-08T12:30:40.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.501+0000 7f08e9ffb700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.501+0000 7f08e9ffb700 1 -- 172.21.15.112:0/2563755743 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f08e40814a0 con 0x7f08f40cc860 2023-11-08T12:30:40.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.501+0000 7f08f96cf700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.501+0000 7f08f96cf700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009ae0 tx=0x7f08f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.505+0000 7f08e9ffb700 1 -- 172.21.15.112:0/2563755743 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f08e404f410 con 0x7f08f40cc860 2023-11-08T12:30:40.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.681+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08f4073cb0 con 0x7f08f40cc860 2023-11-08T12:30:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.685+0000 7f08e9ffb700 1 -- 172.21.15.112:0/2563755743 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18132 (secure 0 0 0) 0x7f08e4052a30 con 0x7f08f40cc860 2023-11-08T12:30:40.688 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:40.688 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":58,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:09.553416+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:07.036289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:07.538745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 msgr2=0x7f08d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009ae0 tx=0x7f08f0008040 comp rx=0 tx=0).stop 2023-11-08T12:30:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f40cc860 msgr2=0x7f08f415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f40cc860 0x7f08f415f1a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f08e400c500 tx=0x7f08e400c8c0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 shutdown_connections 2023-11-08T12:30:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f08d8064ee0 0x7f08d8067390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08f4160710 0x7f08f415bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08f40cc860 0x7f08f415f1a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 --2- 172.21.15.112:0/2563755743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f4070790 0x7f08f415ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 >> 172.21.15.112:0/2563755743 conn(0x7f08f40b0f80 msgr2=0x7f08f4069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 shutdown_connections 2023-11-08T12:30:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.689+0000 7f08fa6d1700 1 -- 172.21.15.112:0/2563755743 wait complete. 2023-11-08T12:30:40.712 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T12:30:40.712 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:40.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdfafa700 1 Processor -- start 2023-11-08T12:30:40.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdfafa700 1 -- start start 2023-11-08T12:30:40.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdfafa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0bd806d4c0 0x7f0bd816b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdfafa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd8164080 con 0x7f0bd80cdfb0 2023-11-08T12:30:40.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdfafa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd8069bf0 con 0x7f0bd8163cb0 2023-11-08T12:30:40.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdfafa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd80cc290 con 0x7f0bd806d4c0 2023-11-08T12:30:40.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdd095700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0bd80cdfb0 0x7f0bd806cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55156/0 (socket says 172.21.15.112:55156) 2023-11-08T12:30:40.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdd095700 1 -- 172.21.15.112:0/3264069127 learned_addr learned my addr 172.21.15.112:0/3264069127 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:40.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bde097700 1 --2- 172.21.15.112:0/3264069127 >> v2:172.21.15.112:3300/0 conn(0x7f0bd806d4c0 0x7f0bd816b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686784336 0 0) 0x7f0bd8164080 con 0x7f0bd80cdfb0 2023-11-08T12:30:40.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.889+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc40035d0 con 0x7f0bd80cdfb0 2023-11-08T12:30:40.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287717862 0 0) 0x7f0bd8069bf0 con 0x7f0bd8163cb0 2023-11-08T12:30:40.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd8164080 con 0x7f0bd8163cb0 2023-11-08T12:30:40.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bde097700 1 -- 172.21.15.112:0/3264069127 >> v1:172.21.15.133:6789/0 conn(0x7f0bd8163cb0 legacy=0x7f0bd8164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3103469372 0 0) 0x7f0bc40035d0 con 0x7f0bd80cdfb0 2023-11-08T12:30:40.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bde097700 1 -- 172.21.15.112:0/3264069127 >> v1:172.21.15.112:6789/0 conn(0x7f0bd80cdfb0 legacy=0x7f0bd806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bde097700 1 -- 172.21.15.112:0/3264069127 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd80cc4a0 con 0x7f0bd806d4c0 2023-11-08T12:30:40.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bde097700 1 --2- 172.21.15.112:0/3264069127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd816b630 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009d90 tx=0x7f0bd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302d15faff488045 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd000e070 con 0x7f0bd806d4c0 2023-11-08T12:30:40.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd0003a40 con 0x7f0bd806d4c0 2023-11-08T12:30:40.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdc894700 1 -- 172.21.15.112:0/3264069127 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8001670 con 0x7f0bd806d4c0 2023-11-08T12:30:40.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdfafa700 1 -- 172.21.15.112:0/3264069127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 msgr2=0x7f0bd816b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/3264069127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd816b630 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009d90 tx=0x7f0bd000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:40.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdfafa700 1 -- 172.21.15.112:0/3264069127 shutdown_connections 2023-11-08T12:30:40.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/3264069127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd816b630 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdfafa700 1 -- 172.21.15.112:0/3264069127 >> 172.21.15.112:0/3264069127 conn(0x7f0bd80cf350 msgr2=0x7f0bd80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:40.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdfafa700 1 -- 172.21.15.112:0/3264069127 shutdown_connections 2023-11-08T12:30:40.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.893+0000 7f0bdfafa700 1 -- 172.21.15.112:0/3264069127 wait complete. 2023-11-08T12:30:40.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 Processor -- start 2023-11-08T12:30:40.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 -- start start 2023-11-08T12:30:40.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd806ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd80cdfb0 0x7f0bd80b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bd8163cb0 0x7f0bd815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd80b1ed0 con 0x7f0bd806d4c0 2023-11-08T12:30:40.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd80b21b0 con 0x7f0bd80cdfb0 2023-11-08T12:30:40.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdfafa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd80b2490 con 0x7f0bd8163cb0 2023-11-08T12:30:40.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.897+0000 7f0bdd896700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd806ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd806ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59712/0 (socket says 172.21.15.112:59712) 2023-11-08T12:30:40.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 -- 172.21.15.112:0/609908288 learned_addr learned my addr 172.21.15.112:0/609908288 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:40.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd095700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd80cdfb0 0x7f0bd80b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bde097700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bd8163cb0 0x7f0bd815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 -- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bd8163cb0 msgr2=0x7f0bd815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bd8163cb0 0x7f0bd815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 -- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd80cdfb0 msgr2=0x7f0bd80b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:40.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd80cdfb0 0x7f0bd80b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:40.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 -- 172.21.15.112:0/609908288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0009a70 con 0x7f0bd806d4c0 2023-11-08T12:30:40.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdd896700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd806ca60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c520 tx=0x7f0bd400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bce7fc700 1 -- 172.21.15.112:0/609908288 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40052d0 con 0x7f0bd806d4c0 2023-11-08T12:30:40.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bce7fc700 1 -- 172.21.15.112:0/609908288 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4005450 con 0x7f0bd806d4c0 2023-11-08T12:30:40.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd8069e40 con 0x7f0bd806d4c0 2023-11-08T12:30:40.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bce7fc700 1 -- 172.21.15.112:0/609908288 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40038e0 con 0x7f0bd806d4c0 2023-11-08T12:30:40.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd80cc780 con 0x7f0bd806d4c0 2023-11-08T12:30:40.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.901+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd806a120 con 0x7f0bd806d4c0 2023-11-08T12:30:40.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.905+0000 7f0bce7fc700 1 -- 172.21.15.112:0/609908288 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f0bd4019030 con 0x7f0bd806d4c0 2023-11-08T12:30:40.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.905+0000 7f0bce7fc700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0bbc064ee0 0x7f0bbc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:40.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.905+0000 7f0bce7fc700 1 -- 172.21.15.112:0/609908288 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0bd40813a0 con 0x7f0bd806d4c0 2023-11-08T12:30:40.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.905+0000 7f0bdd095700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0bbc064ee0 0x7f0bbc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:40.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.909+0000 7f0bdd095700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0bbc064ee0 0x7f0bbc067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80b4680 tx=0x7f0bc8001770 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:40.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:40.909+0000 7f0bce7fc700 1 -- 172.21.15.112:0/609908288 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f0bd404f2b0 con 0x7f0bd806d4c0 2023-11-08T12:30:41.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.117+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bd80726c0 con 0x7f0bd806d4c0 2023-11-08T12:30:41.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.117+0000 7f0bce7fc700 1 -- 172.21.15.112:0/609908288 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f0bd40528d0 con 0x7f0bd806d4c0 2023-11-08T12:30:41.120 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:41.121 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:41.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0bbc064ee0 msgr2=0x7f0bbc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0bbc064ee0 0x7f0bbc067390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80b4680 tx=0x7f0bc8001770 comp rx=0 tx=0).stop 2023-11-08T12:30:41.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 msgr2=0x7f0bd806ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd806ca60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c520 tx=0x7f0bd400c830 comp rx=0 tx=0).stop 2023-11-08T12:30:41.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 shutdown_connections 2023-11-08T12:30:41.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0bbc064ee0 0x7f0bbc067390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bd8163cb0 0x7f0bd815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd80cdfb0 0x7f0bd80b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 --2- 172.21.15.112:0/609908288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bd806d4c0 0x7f0bd806ca60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 >> 172.21.15.112:0/609908288 conn(0x7f0bd80cf350 msgr2=0x7f0bd806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:41.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 shutdown_connections 2023-11-08T12:30:41.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.121+0000 7f0bdfafa700 1 -- 172.21.15.112:0/609908288 wait complete. 2023-11-08T12:30:41.128 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:41.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:41.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29b59e700 1 Processor -- start 2023-11-08T12:30:41.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29b59e700 1 -- start start 2023-11-08T12:30:41.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb29c15c640 0x7fb29c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29b59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb29c069e00 0x7fb29c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c06c600 con 0x7fb29c071aa0 2023-11-08T12:30:41.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29b59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c06cef0 con 0x7fb29c069e00 2023-11-08T12:30:41.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c06a7c0 con 0x7fb29c15c640 2023-11-08T12:30:41.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.325+0000 7fb29ad9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb29c069e00 0x7fb29c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb29c15c640 0x7fb29c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb29c15c640 0x7fb29c0d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:33692/0 (socket says 172.21.15.112:33692) 2023-11-08T12:30:41.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 -- 172.21.15.112:0/152209651 learned_addr learned my addr 172.21.15.112:0/152209651 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:41.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 -- 172.21.15.112:0/152209651 >> v2:172.21.15.112:3300/0 conn(0x7fb29c069e00 msgr2=0x7fb29c06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:41.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 --2- 172.21.15.112:0/152209651 >> v2:172.21.15.112:3300/0 conn(0x7fb29c069e00 0x7fb29c06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 -- 172.21.15.112:0/152209651 >> v1:172.21.15.133:6789/0 conn(0x7fb29c071aa0 legacy=0x7fb29c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 -- 172.21.15.112:0/152209651 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0722f0 con 0x7fb29c15c640 2023-11-08T12:30:41.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29a59c700 1 --2- 172.21.15.112:0/152209651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c15c640 0x7fb29c0d31e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb29c06e290 tx=0x7fb28c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea81301de4fe5ad server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:41.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb299d9b700 1 -- 172.21.15.112:0/152209651 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c011830 con 0x7fb29c15c640 2023-11-08T12:30:41.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb299d9b700 1 -- 172.21.15.112:0/152209651 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c011990 con 0x7fb29c15c640 2023-11-08T12:30:41.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb299d9b700 1 -- 172.21.15.112:0/152209651 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c011d20 con 0x7fb29c15c640 2023-11-08T12:30:41.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 -- 172.21.15.112:0/152209651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c15c640 msgr2=0x7fb29c0d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 --2- 172.21.15.112:0/152209651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c15c640 0x7fb29c0d31e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb29c06e290 tx=0x7fb28c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 -- 172.21.15.112:0/152209651 shutdown_connections 2023-11-08T12:30:41.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 --2- 172.21.15.112:0/152209651 >> v2:172.21.15.112:3300/0 conn(0x7fb29c069e00 0x7fb29c06a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 --2- 172.21.15.112:0/152209651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c15c640 0x7fb29c0d31e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 -- 172.21.15.112:0/152209651 >> 172.21.15.112:0/152209651 conn(0x7fb29c0b6520 msgr2=0x7fb29c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:41.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 -- 172.21.15.112:0/152209651 shutdown_connections 2023-11-08T12:30:41.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.329+0000 7fb29b59e700 1 -- 172.21.15.112:0/152209651 wait complete. 2023-11-08T12:30:41.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.333+0000 7fb29b59e700 1 Processor -- start 2023-11-08T12:30:41.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.333+0000 7fb29b59e700 1 -- start start 2023-11-08T12:30:41.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c069e00 0x7fb29c09bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb29c071aa0 0x7fb29c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c15c640 0x7fb29c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.338 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c09c2f0 con 0x7fb29c15c640 2023-11-08T12:30:41.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c0c6df0 con 0x7fb29c069e00 2023-11-08T12:30:41.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c0cf220 con 0x7fb29c071aa0 2023-11-08T12:30:41.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c15c640 0x7fb29c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c15c640 0x7fb29c0b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59728/0 (socket says 172.21.15.112:59728) 2023-11-08T12:30:41.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 -- 172.21.15.112:0/3354754660 learned_addr learned my addr 172.21.15.112:0/3354754660 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:41.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb291d9b700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb29c071aa0 0x7fb29c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29a59c700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c069e00 0x7fb29c09bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 -- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb29c071aa0 msgr2=0x7fb29c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb29c071aa0 0x7fb29c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 -- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c069e00 msgr2=0x7fb29c09bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c069e00 0x7fb29c09bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 -- 172.21.15.112:0/3354754660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009570 con 0x7fb29c15c640 2023-11-08T12:30:41.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29a59c700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c069e00 0x7fb29c09bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:41.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29ad9d700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c15c640 0x7fb29c0b4480 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb29400efc0 tx=0x7fb29400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:41.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb2937fe700 1 -- 172.21.15.112:0/3354754660 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400cad0 con 0x7fb29c15c640 2023-11-08T12:30:41.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb2937fe700 1 -- 172.21.15.112:0/3354754660 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400f040 con 0x7fb29c15c640 2023-11-08T12:30:41.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c15ca10 con 0x7fb29c15c640 2023-11-08T12:30:41.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb2937fe700 1 -- 172.21.15.112:0/3354754660 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400ce70 con 0x7fb29c15c640 2023-11-08T12:30:41.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.337+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c06da20 con 0x7fb29c15c640 2023-11-08T12:30:41.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.341+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c072010 con 0x7fb29c15c640 2023-11-08T12:30:41.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.341+0000 7fb2937fe700 1 -- 172.21.15.112:0/3354754660 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb294014480 con 0x7fb29c15c640 2023-11-08T12:30:41.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.345+0000 7fb2937fe700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb27c064ee0 0x7fb27c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.345+0000 7fb2937fe700 1 -- 172.21.15.112:0/3354754660 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb294082c70 con 0x7fb29c15c640 2023-11-08T12:30:41.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.345+0000 7fb29a59c700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb27c064ee0 0x7fb27c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.345+0000 7fb29a59c700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb27c064ee0 0x7fb27c067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb28c000c00 tx=0x7fb28c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:41.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.349+0000 7fb2937fe700 1 -- 172.21.15.112:0/3354754660 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb294050b80 con 0x7fb29c15c640 2023-11-08T12:30:41.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.553+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb29c0c6f60 con 0x7fb29c15c640 2023-11-08T12:30:41.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.553+0000 7fb2937fe700 1 -- 172.21.15.112:0/3354754660 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fb2940541a0 con 0x7fb29c15c640 2023-11-08T12:30:41.557 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:41.557 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:08.547994+0000","modified":"2023-11-08T12:30:11.575341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5820},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5820":{"gid":5820,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6833/4144675081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4144675081},{"type":"v1","addr":"172.21.15.133:6833","nonce":4144675081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-08T12:30:41.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb27c064ee0 msgr2=0x7fb27c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb27c064ee0 0x7fb27c067390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb28c000c00 tx=0x7fb28c008030 comp rx=0 tx=0).stop 2023-11-08T12:30:41.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c15c640 msgr2=0x7fb29c0b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c15c640 0x7fb29c0b4480 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb29400efc0 tx=0x7fb29400c0c0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 shutdown_connections 2023-11-08T12:30:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb27c064ee0 0x7fb27c067390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb29c15c640 0x7fb29c0b4480 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb29c071aa0 0x7fb29c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 --2- 172.21.15.112:0/3354754660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb29c069e00 0x7fb29c09bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 >> 172.21.15.112:0/3354754660 conn(0x7fb29c0b6520 msgr2=0x7fb29c0d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 shutdown_connections 2023-11-08T12:30:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.557+0000 7fb29b59e700 1 -- 172.21.15.112:0/3354754660 wait complete. 2023-11-08T12:30:41.563 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2023-11-08T12:30:41.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32aa700700 1 Processor -- start 2023-11-08T12:30:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32aa700700 1 -- start start 2023-11-08T12:30:41.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32aa700700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32a4160710 0x7f32a40cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32aa700700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a40ad6c0 con 0x7f32a4070790 2023-11-08T12:30:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32aa700700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a40adc60 con 0x7f32a40cc860 2023-11-08T12:30:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32aa700700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a406b1c0 con 0x7f32a4160710 2023-11-08T12:30:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32a96fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f32a4160710 0x7f32a40cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32a9eff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f32a4070790 0x7f32a4164250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55168/0 (socket says 172.21.15.112:55168) 2023-11-08T12:30:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.757+0000 7f32a9eff700 1 -- 172.21.15.112:0/16437810 learned_addr learned my addr 172.21.15.112:0/16437810 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f329bfff700 1 -- 172.21.15.112:0/16437810 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943129936 0 0) 0x7f32a40ad6c0 con 0x7f32a4070790 2023-11-08T12:30:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f329bfff700 1 -- 172.21.15.112:0/16437810 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32900035d0 con 0x7f32a4070790 2023-11-08T12:30:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32a96fe700 1 -- 172.21.15.112:0/16437810 >> v1:172.21.15.133:6789/0 conn(0x7f32a40cc860 legacy=0x7f32a4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32a96fe700 1 -- 172.21.15.112:0/16437810 >> v1:172.21.15.112:6789/0 conn(0x7f32a4070790 legacy=0x7f32a4164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32a96fe700 1 -- 172.21.15.112:0/16437810 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a406b3d0 con 0x7f32a4160710 2023-11-08T12:30:41.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32a96fe700 1 --2- 172.21.15.112:0/16437810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a4160710 0x7f32a40cc320 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d90 tx=0x7f32a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c339c284fd3fa230 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:41.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f329bfff700 1 -- 172.21.15.112:0/16437810 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000e070 con 0x7f32a4160710 2023-11-08T12:30:41.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f329bfff700 1 -- 172.21.15.112:0/16437810 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000bb20 con 0x7f32a4160710 2023-11-08T12:30:41.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f329bfff700 1 -- 172.21.15.112:0/16437810 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0012430 con 0x7f32a4160710 2023-11-08T12:30:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32aa700700 1 -- 172.21.15.112:0/16437810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a4160710 msgr2=0x7f32a40cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32aa700700 1 --2- 172.21.15.112:0/16437810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a4160710 0x7f32a40cc320 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d90 tx=0x7f32a000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32aa700700 1 -- 172.21.15.112:0/16437810 shutdown_connections 2023-11-08T12:30:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32aa700700 1 --2- 172.21.15.112:0/16437810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a4160710 0x7f32a40cc320 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32aa700700 1 -- 172.21.15.112:0/16437810 >> 172.21.15.112:0/16437810 conn(0x7f32a40b0f80 msgr2=0x7f32a40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32aa700700 1 -- 172.21.15.112:0/16437810 shutdown_connections 2023-11-08T12:30:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.761+0000 7f32aa700700 1 -- 172.21.15.112:0/16437810 wait complete. 2023-11-08T12:30:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 Processor -- start 2023-11-08T12:30:41.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 -- start start 2023-11-08T12:30:41.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32a4070790 0x7f32a414d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a40cc860 0x7f32a415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32a4160710 0x7f32a414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a415eaf0 con 0x7f32a40cc860 2023-11-08T12:30:41.769 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a415edd0 con 0x7f32a4160710 2023-11-08T12:30:41.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32aa700700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a415f0b0 con 0x7f32a4070790 2023-11-08T12:30:41.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.765+0000 7f32a8efd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a40cc860 0x7f32a415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a40cc860 0x7f32a415e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59750/0 (socket says 172.21.15.112:59750) 2023-11-08T12:30:41.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 -- 172.21.15.112:0/193357062 learned_addr learned my addr 172.21.15.112:0/193357062 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:41.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a9eff700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32a4160710 0x7f32a414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a96fe700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32a4070790 0x7f32a414d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 -- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32a4070790 msgr2=0x7f32a414d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32a4070790 0x7f32a414d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 -- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32a4160710 msgr2=0x7f32a414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.772 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32a4160710 0x7f32a414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 -- 172.21.15.112:0/193357062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0009a70 con 0x7f32a40cc860 2023-11-08T12:30:41.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32a8efd700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a40cc860 0x7f32a415e2c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f329400c500 tx=0x7f329400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:41.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f3299ffb700 1 -- 172.21.15.112:0/193357062 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940052d0 con 0x7f32a40cc860 2023-11-08T12:30:41.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f3299ffb700 1 -- 172.21.15.112:0/193357062 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3294005430 con 0x7f32a40cc860 2023-11-08T12:30:41.773 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a40ad8f0 con 0x7f32a40cc860 2023-11-08T12:30:41.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f3299ffb700 1 -- 172.21.15.112:0/193357062 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940055a0 con 0x7f32a40cc860 2023-11-08T12:30:41.774 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a406b6b0 con 0x7f32a40cc860 2023-11-08T12:30:41.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.769+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a4160ae0 con 0x7f32a40cc860 2023-11-08T12:30:41.775 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.773+0000 7f3299ffb700 1 -- 172.21.15.112:0/193357062 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3294019030 con 0x7f32a40cc860 2023-11-08T12:30:41.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.773+0000 7f3299ffb700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3288064f10 0x7f32880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:41.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.773+0000 7f3299ffb700 1 -- 172.21.15.112:0/193357062 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f32940813d0 con 0x7f32a40cc860 2023-11-08T12:30:41.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.773+0000 7f32a96fe700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3288064f10 0x7f32880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:41.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.773+0000 7f32a96fe700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3288064f10 0x7f32880673c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32a0014040 tx=0x7f32a0011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:41.780 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.777+0000 7f3299ffb700 1 -- 172.21.15.112:0/193357062 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f329404f430 con 0x7f32a40cc860 2023-11-08T12:30:41.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.949+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32a40c32d0 con 0x7f32a40cc860 2023-11-08T12:30:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.949+0000 7f3299ffb700 1 -- 172.21.15.112:0/193357062 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+18132 (secure 0 0 0) 0x7f3294052a50 con 0x7f32a40cc860 2023-11-08T12:30:41.953 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:41.953 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":58,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:09.553416+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:07.036289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:07.538745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:41.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3288064f10 msgr2=0x7f32880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3288064f10 0x7f32880673c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32a0014040 tx=0x7f32a0011000 comp rx=0 tx=0).stop 2023-11-08T12:30:41.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a40cc860 msgr2=0x7f32a415e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:41.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a40cc860 0x7f32a415e2c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f329400c500 tx=0x7f329400c8c0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 shutdown_connections 2023-11-08T12:30:41.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3288064f10 0x7f32880673c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32a4160710 0x7f32a414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32a40cc860 0x7f32a415e2c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 --2- 172.21.15.112:0/193357062 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32a4070790 0x7f32a414d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:41.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 >> 172.21.15.112:0/193357062 conn(0x7f32a40b0f80 msgr2=0x7f32a4069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:41.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 shutdown_connections 2023-11-08T12:30:41.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:41.953+0000 7f32aa700700 1 -- 172.21.15.112:0/193357062 wait complete. 2023-11-08T12:30:41.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T12:30:42.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.153+0000 7efcc15f9700 1 Processor -- start 2023-11-08T12:30:42.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.153+0000 7efcc15f9700 1 -- start start 2023-11-08T12:30:42.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.153+0000 7efcc15f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:42.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.153+0000 7efcc15f9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcbc0cd1e0 0x7efcbc15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:42.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.153+0000 7efcc15f9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc06c8c0 con 0x7efcbc0cdc60 2023-11-08T12:30:42.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc15d830 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0b1f10 con 0x7efcbc159e00 2023-11-08T12:30:42.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcbc0cd1e0 0x7efcbc15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:42.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efcbc0cd1e0 0x7efcbc15d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59764/0 (socket says 172.21.15.112:59764) 2023-11-08T12:30:42.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 -- 172.21.15.112:0/205612051 learned_addr learned my addr 172.21.15.112:0/205612051 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:42.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcbaffd700 1 --2- 172.21.15.112:0/205612051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:42.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 -- 172.21.15.112:0/205612051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 msgr2=0x7efcbc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:42.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 --2- 172.21.15.112:0/205612051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:42.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 -- 172.21.15.112:0/205612051 >> v1:172.21.15.133:6789/0 conn(0x7efcbc0cdc60 legacy=0x7efcbc0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:42.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 -- 172.21.15.112:0/205612051 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0b21f0 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcba7fc700 1 --2- 172.21.15.112:0/205612051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc15d2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009910 tx=0x7efcb0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93354275ce69faa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:42.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcb9ffb700 1 -- 172.21.15.112:0/205612051 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011830 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcb9ffb700 1 -- 172.21.15.112:0/205612051 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0011990 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcb9ffb700 1 -- 172.21.15.112:0/205612051 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011d40 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 -- 172.21.15.112:0/205612051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 msgr2=0x7efcbc15d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:42.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 --2- 172.21.15.112:0/205612051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc15d2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009910 tx=0x7efcb0009c20 comp rx=0 tx=0).stop 2023-11-08T12:30:42.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 -- 172.21.15.112:0/205612051 shutdown_connections 2023-11-08T12:30:42.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 --2- 172.21.15.112:0/205612051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc15d2f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:42.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 --2- 172.21.15.112:0/205612051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:42.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.157+0000 7efcc15f9700 1 -- 172.21.15.112:0/205612051 >> 172.21.15.112:0/205612051 conn(0x7efcbc0cf6a0 msgr2=0x7efcbc0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:42.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.161+0000 7efcc15f9700 1 -- 172.21.15.112:0/205612051 shutdown_connections 2023-11-08T12:30:42.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.161+0000 7efcc15f9700 1 -- 172.21.15.112:0/205612051 wait complete. 2023-11-08T12:30:42.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 Processor -- start 2023-11-08T12:30:42.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 -- start start 2023-11-08T12:30:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc0c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcbc0cdc60 0x7efcbc1f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc0b8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0c8680 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0c8960 con 0x7efcbc0cdc60 2023-11-08T12:30:42.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1f5710 con 0x7efcbc159e00 2023-11-08T12:30:42.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc0c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:42.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc0c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59774/0 (socket says 172.21.15.112:59774) 2023-11-08T12:30:42.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 -- 172.21.15.112:0/2620289582 learned_addr learned my addr 172.21.15.112:0/2620289582 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:42.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbb7fe700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc0b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:42.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcba7fc700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcbc0cdc60 0x7efcbc1f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:42.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 -- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 msgr2=0x7efcbc0b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:42.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc0b8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:42.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 -- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcbc0cdc60 msgr2=0x7efcbc1f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:42.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcbc0cdc60 0x7efcbc1f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:42.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 -- 172.21.15.112:0/2620289582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009570 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcbaffd700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc0c7b60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efcac00e840 tx=0x7efcac00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:42.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efca37fe700 1 -- 172.21.15.112:0/2620289582 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0095a0 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efca37fe700 1 -- 172.21.15.112:0/2620289582 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac00c690 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc15a1d0 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efca37fe700 1 -- 172.21.15.112:0/2620289582 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac00ca00 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.165+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc06cb30 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.169+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc0b24d0 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.169+0000 7efca37fe700 1 -- 172.21.15.112:0/2620289582 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7efcac019030 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.173+0000 7efca37fe700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efca8064ee0 0x7efca8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:42.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.173+0000 7efca37fe700 1 -- 172.21.15.112:0/2620289582 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efcac081f60 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.173+0000 7efcba7fc700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efca8064ee0 0x7efca8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:42.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.173+0000 7efcba7fc700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efca8064ee0 0x7efca8067390 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efcb0014040 tx=0x7efcb0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:42.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.177+0000 7efca37fe700 1 -- 172.21.15.112:0/2620289582 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7efcac04fed0 con 0x7efcbc0cd1e0 2023-11-08T12:30:42.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:42.377+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efcbc1f58d0 con 0x7efcbc0cd1e0 2023-11-08T12:30:43.026 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-11-08T12:30:43.025+0000 7f2dc63f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T12:30:43.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.041+0000 7efca37fe700 1 -- 172.21.15.112:0/2620289582 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7efcac0534f0 con 0x7efcbc0cd1e0 2023-11-08T12:30:43.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efca8064ee0 msgr2=0x7efca8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:43.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efca8064ee0 0x7efca8067390 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efcb0014040 tx=0x7efcb0008030 comp rx=0 tx=0).stop 2023-11-08T12:30:43.046 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 msgr2=0x7efcbc0c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:43.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc0c7b60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efcac00e840 tx=0x7efcac00ec00 comp rx=0 tx=0).stop 2023-11-08T12:30:43.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 shutdown_connections 2023-11-08T12:30:43.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7efca8064ee0 0x7efca8067390 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:43.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcbc159e00 0x7efcbc0b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:43.047 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcbc0cdc60 0x7efcbc1f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:43.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 --2- 172.21.15.112:0/2620289582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcbc0cd1e0 0x7efcbc0c7b60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:43.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 >> 172.21.15.112:0/2620289582 conn(0x7efcbc0cf6a0 msgr2=0x7efcbc0b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:43.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 shutdown_connections 2023-11-08T12:30:43.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.045+0000 7efcc15f9700 1 -- 172.21.15.112:0/2620289582 wait complete. 2023-11-08T12:30:43.049 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T12:30:43.055 INFO:tasks.ceph.mds.d.smithi133.stderr: -4789> 2023-11-08T12:30:14.062+0000 7febfe9d8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:30:43.061 INFO:tasks.ceph.mds.d.smithi133.stderr: -2400> 2023-11-08T12:30:18.110+0000 7febfb1d1700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5800=0-4194304@1} caps={5800=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5800 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5618a8aadb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-08T12:30:43.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T12:30:43.124 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-11-08T12:30:43.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.253+0000 7f6cb1451700 1 Processor -- start 2023-11-08T12:30:43.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.253+0000 7f6cb1451700 1 -- start start 2023-11-08T12:30:43.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cb1451700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6cac070790 0x7f6cac167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:43.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cb1451700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac0adf90 con 0x7f6cac15c1a0 2023-11-08T12:30:43.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cb1451700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac0ce370 con 0x7f6cac0cdeb0 2023-11-08T12:30:43.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cb1451700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac069bf0 con 0x7f6cac070790 2023-11-08T12:30:43.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6caaffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6cac15c1a0 0x7f6cac06c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55182/0 (socket says 172.21.15.112:55182) 2023-11-08T12:30:43.259 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6caaffd700 1 -- 172.21.15.112:0/2781443295 learned_addr learned my addr 172.21.15.112:0/2781443295 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:43.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cab7fe700 1 --2- 172.21.15.112:0/2781443295 >> v2:172.21.15.133:3300/0 conn(0x7f6cac070790 0x7f6cac167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6ca9ffb700 1 -- 172.21.15.112:0/2781443295 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17731042 0 0) 0x7f6cac0adf90 con 0x7f6cac15c1a0 2023-11-08T12:30:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6ca9ffb700 1 -- 172.21.15.112:0/2781443295 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c940035d0 con 0x7f6cac15c1a0 2023-11-08T12:30:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cab7fe700 1 -- 172.21.15.112:0/2781443295 >> v1:172.21.15.133:6789/0 conn(0x7f6cac0cdeb0 legacy=0x7f6cac070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cab7fe700 1 -- 172.21.15.112:0/2781443295 >> v1:172.21.15.112:6789/0 conn(0x7f6cac15c1a0 legacy=0x7f6cac06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:43.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cab7fe700 1 -- 172.21.15.112:0/2781443295 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0cc4a0 con 0x7f6cac070790 2023-11-08T12:30:43.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cab7fe700 1 --2- 172.21.15.112:0/2781443295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac167110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0ae180 tx=0x7f6ca400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2523d5ff92de43c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:43.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6ca9ffb700 1 -- 172.21.15.112:0/2781443295 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4016070 con 0x7f6cac070790 2023-11-08T12:30:43.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6ca9ffb700 1 -- 172.21.15.112:0/2781443295 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca400bb20 con 0x7f6cac070790 2023-11-08T12:30:43.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6ca9ffb700 1 -- 172.21.15.112:0/2781443295 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca400e070 con 0x7f6cac070790 2023-11-08T12:30:43.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cb1451700 1 -- 172.21.15.112:0/2781443295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 msgr2=0x7f6cac167110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:43.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.257+0000 7f6cb1451700 1 --2- 172.21.15.112:0/2781443295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac167110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0ae180 tx=0x7f6ca400b330 comp rx=0 tx=0).stop 2023-11-08T12:30:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.261+0000 7f6cb1451700 1 -- 172.21.15.112:0/2781443295 shutdown_connections 2023-11-08T12:30:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.261+0000 7f6cb1451700 1 --2- 172.21.15.112:0/2781443295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac167110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.261+0000 7f6cb1451700 1 -- 172.21.15.112:0/2781443295 >> 172.21.15.112:0/2781443295 conn(0x7f6cac0b0f80 msgr2=0x7f6cac0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.261+0000 7f6cb1451700 1 -- 172.21.15.112:0/2781443295 shutdown_connections 2023-11-08T12:30:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.261+0000 7f6cb1451700 1 -- 172.21.15.112:0/2781443295 wait complete. 2023-11-08T12:30:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.261+0000 7f6cb1451700 1 Processor -- start 2023-11-08T12:30:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.261+0000 7f6cb1451700 1 -- start start 2023-11-08T12:30:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cac0cdeb0 0x7f6cac0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cac15c1a0 0x7f6cac148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac149900 con 0x7f6cac0cdeb0 2023-11-08T12:30:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac149be0 con 0x7f6cac070790 2023-11-08T12:30:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0b3840 con 0x7f6cac15c1a0 2023-11-08T12:30:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caa7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cac0cdeb0 0x7f6cac0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caa7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cac0cdeb0 0x7f6cac0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59786/0 (socket says 172.21.15.112:59786) 2023-11-08T12:30:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caa7fc700 1 -- 172.21.15.112:0/3381168367 learned_addr learned my addr 172.21.15.112:0/3381168367 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cab7fe700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cac15c1a0 0x7f6cac148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caaffd700 1 -- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cac15c1a0 msgr2=0x7f6cac148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caaffd700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cac15c1a0 0x7f6cac148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caaffd700 1 -- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cac0cdeb0 msgr2=0x7f6cac0b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caaffd700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cac0cdeb0 0x7f6cac0b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caaffd700 1 -- 172.21.15.112:0/3381168367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4009a70 con 0x7f6cac070790 2023-11-08T12:30:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caa7fc700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cac0cdeb0 0x7f6cac0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6caaffd700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac146720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c410 tx=0x7f6c9c00c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6c937fe700 1 -- 172.21.15.112:0/3381168367 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c005d90 con 0x7f6cac070790 2023-11-08T12:30:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6c937fe700 1 -- 172.21.15.112:0/3381168367 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c00ce20 con 0x7f6cac070790 2023-11-08T12:30:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6c937fe700 1 -- 172.21.15.112:0/3381168367 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c0072d0 con 0x7f6cac070790 2023-11-08T12:30:43.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac15c570 con 0x7f6cac070790 2023-11-08T12:30:43.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.265+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac0cc780 con 0x7f6cac070790 2023-11-08T12:30:43.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.269+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac06b020 con 0x7f6cac070790 2023-11-08T12:30:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.269+0000 7f6c937fe700 1 -- 172.21.15.112:0/3381168367 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6c9c010070 con 0x7f6cac070790 2023-11-08T12:30:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.273+0000 7f6c937fe700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6c98064ee0 0x7f6c98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.273+0000 7f6c937fe700 1 -- 172.21.15.112:0/3381168367 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f6c9c080e50 con 0x7f6cac070790 2023-11-08T12:30:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.273+0000 7f6caa7fc700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6c98064ee0 0x7f6c98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.273+0000 7f6caa7fc700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6c98064ee0 0x7f6c98067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0af260 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:43.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.281+0000 7f6c937fe700 1 -- 172.21.15.112:0/3381168367 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6c9c04ee90 con 0x7f6cac070790 2023-11-08T12:30:43.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:43.489+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6cac0b3d60 con 0x7f6cac070790 2023-11-08T12:30:44.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.045+0000 7f6c937fe700 1 -- 172.21.15.112:0/3381168367 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c9c0524b0 con 0x7f6cac070790 2023-11-08T12:30:44.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6c98064ee0 msgr2=0x7f6c98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:44.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6c98064ee0 0x7f6c98067390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0af260 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2023-11-08T12:30:44.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 msgr2=0x7f6cac146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:44.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac146720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c410 tx=0x7f6c9c00c720 comp rx=0 tx=0).stop 2023-11-08T12:30:44.052 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 shutdown_connections 2023-11-08T12:30:44.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6c98064ee0 0x7f6c98067390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6cac15c1a0 0x7f6cac148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cac0cdeb0 0x7f6cac0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 --2- 172.21.15.112:0/3381168367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac070790 0x7f6cac146720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 >> 172.21.15.112:0/3381168367 conn(0x7f6cac0b0f80 msgr2=0x7f6cac0afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:44.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 shutdown_connections 2023-11-08T12:30:44.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.049+0000 7f6cb1451700 1 -- 172.21.15.112:0/3381168367 wait complete. 2023-11-08T12:30:44.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T12:30:44.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.257+0000 7fef1852d700 1 Processor -- start 2023-11-08T12:30:44.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.257+0000 7fef1852d700 1 -- start start 2023-11-08T12:30:44.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef1852d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fef100b6110 0x7fef10142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:44.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef1852d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef1006aab0 0x7fef1006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:44.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef1852d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1006b8d0 con 0x7fef10142650 2023-11-08T12:30:44.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef1852d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1006bb70 con 0x7fef100b6110 2023-11-08T12:30:44.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef1852d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1006be50 con 0x7fef1006aab0 2023-11-08T12:30:44.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef162c9700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fef10142650 0x7fef100b5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55194/0 (socket says 172.21.15.112:55194) 2023-11-08T12:30:44.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef162c9700 1 -- 172.21.15.112:0/1654112617 learned_addr learned my addr 172.21.15.112:0/1654112617 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:44.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef15ac8700 1 --2- 172.21.15.112:0/1654112617 >> v2:172.21.15.112:3300/0 conn(0x7fef100b6110 0x7fef10142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:44.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef16aca700 1 --2- 172.21.15.112:0/1654112617 >> v2:172.21.15.133:3300/0 conn(0x7fef1006aab0 0x7fef1006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:44.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef15ac8700 1 -- 172.21.15.112:0/1654112617 >> v2:172.21.15.133:3300/0 conn(0x7fef1006aab0 msgr2=0x7fef1006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:44.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef15ac8700 1 --2- 172.21.15.112:0/1654112617 >> v2:172.21.15.133:3300/0 conn(0x7fef1006aab0 0x7fef1006af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef15ac8700 1 -- 172.21.15.112:0/1654112617 >> v1:172.21.15.112:6789/0 conn(0x7fef10142650 legacy=0x7fef100b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:44.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef15ac8700 1 -- 172.21.15.112:0/1654112617 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1006c130 con 0x7fef100b6110 2023-11-08T12:30:44.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef152c7700 1 -- 172.21.15.112:0/1654112617 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110884895 0 0) 0x7fef1006b8d0 con 0x7fef10142650 2023-11-08T12:30:44.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef15ac8700 1 --2- 172.21.15.112:0/1654112617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef10142fa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fef1006ffa0 tx=0x7fef00009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812fb45f41191084 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:44.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef152c7700 1 -- 172.21.15.112:0/1654112617 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00011830 con 0x7fef100b6110 2023-11-08T12:30:44.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef152c7700 1 -- 172.21.15.112:0/1654112617 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef00011990 con 0x7fef100b6110 2023-11-08T12:30:44.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.261+0000 7fef152c7700 1 -- 172.21.15.112:0/1654112617 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00011d20 con 0x7fef100b6110 2023-11-08T12:30:44.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 -- 172.21.15.112:0/1654112617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 msgr2=0x7fef10142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:44.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 --2- 172.21.15.112:0/1654112617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef10142fa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fef1006ffa0 tx=0x7fef00009b30 comp rx=0 tx=0).stop 2023-11-08T12:30:44.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 -- 172.21.15.112:0/1654112617 shutdown_connections 2023-11-08T12:30:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 --2- 172.21.15.112:0/1654112617 >> v2:172.21.15.133:3300/0 conn(0x7fef1006aab0 0x7fef1006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 --2- 172.21.15.112:0/1654112617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef10142fa0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 -- 172.21.15.112:0/1654112617 >> 172.21.15.112:0/1654112617 conn(0x7fef100b5390 msgr2=0x7fef100d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 -- 172.21.15.112:0/1654112617 shutdown_connections 2023-11-08T12:30:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.265+0000 7fef1852d700 1 -- 172.21.15.112:0/1654112617 wait complete. 2023-11-08T12:30:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 Processor -- start 2023-11-08T12:30:44.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 -- start start 2023-11-08T12:30:44.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef1006aab0 0x7fef101f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:44.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef101f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:44.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef10142650 0x7fef101f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:44.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1013a450 con 0x7fef100b6110 2023-11-08T12:30:44.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1013b740 con 0x7fef10142650 2023-11-08T12:30:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef1852d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1015c8b0 con 0x7fef1006aab0 2023-11-08T12:30:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef15ac8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef101f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef15ac8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef101f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59800/0 (socket says 172.21.15.112:59800) 2023-11-08T12:30:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef15ac8700 1 -- 172.21.15.112:0/771164333 learned_addr learned my addr 172.21.15.112:0/771164333 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef162c9700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef1006aab0 0x7fef101f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.269+0000 7fef16aca700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef10142650 0x7fef101f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef15ac8700 1 -- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef1006aab0 msgr2=0x7fef101f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef15ac8700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef1006aab0 0x7fef101f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef15ac8700 1 -- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef10142650 msgr2=0x7fef101f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:44.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef15ac8700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef10142650 0x7fef101f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:44.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef15ac8700 1 -- 172.21.15.112:0/771164333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000094b0 con 0x7fef100b6110 2023-11-08T12:30:44.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef15ac8700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef101f55c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fef000090b0 tx=0x7fef00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:44.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef06ffd700 1 -- 172.21.15.112:0/771164333 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000036c0 con 0x7fef100b6110 2023-11-08T12:30:44.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef06ffd700 1 -- 172.21.15.112:0/771164333 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0001f070 con 0x7fef100b6110 2023-11-08T12:30:44.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef06ffd700 1 -- 172.21.15.112:0/771164333 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00003a20 con 0x7fef100b6110 2023-11-08T12:30:44.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef10142a20 con 0x7fef100b6110 2023-11-08T12:30:44.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1006c410 con 0x7fef100b6110 2023-11-08T12:30:44.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.273+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1006b450 con 0x7fef100b6110 2023-11-08T12:30:44.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.277+0000 7fef06ffd700 1 -- 172.21.15.112:0/771164333 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fef0000f050 con 0x7fef100b6110 2023-11-08T12:30:44.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.277+0000 7fef06ffd700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feef4064ee0 0x7feef4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:44.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.277+0000 7fef06ffd700 1 -- 172.21.15.112:0/771164333 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fef00021070 con 0x7fef100b6110 2023-11-08T12:30:44.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.277+0000 7fef162c9700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feef4064ee0 0x7feef4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:44.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.281+0000 7fef162c9700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feef4064ee0 0x7feef4067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0012e0 tx=0x7fef0c0018c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:44.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.281+0000 7fef06ffd700 1 -- 172.21.15.112:0/771164333 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fef00051d80 con 0x7fef100b6110 2023-11-08T12:30:44.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:44.461+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef100726c0 con 0x7fef100b6110 2023-11-08T12:30:45.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.049+0000 7fef06ffd700 1 -- 172.21.15.112:0/771164333 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef000553a0 con 0x7fef100b6110 2023-11-08T12:30:45.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feef4064ee0 msgr2=0x7feef4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:45.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feef4064ee0 0x7feef4067390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0012e0 tx=0x7fef0c0018c0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 msgr2=0x7fef101f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:45.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef101f55c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fef000090b0 tx=0x7fef00004770 comp rx=0 tx=0).stop 2023-11-08T12:30:45.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 shutdown_connections 2023-11-08T12:30:45.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feef4064ee0 0x7feef4067390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef10142650 0x7fef101f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef100b6110 0x7fef101f55c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 --2- 172.21.15.112:0/771164333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef1006aab0 0x7fef101f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 >> 172.21.15.112:0/771164333 conn(0x7fef100b5390 msgr2=0x7fef1015c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:45.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 shutdown_connections 2023-11-08T12:30:45.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.057+0000 7fef1852d700 1 -- 172.21.15.112:0/771164333 wait complete. 2023-11-08T12:30:45.061 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2023-11-08T12:30:45.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T12:30:45.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.277+0000 7f69c0f45700 1 Processor -- start 2023-11-08T12:30:45.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.277+0000 7f69c0f45700 1 -- start start 2023-11-08T12:30:45.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69c0f45700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69bc0b4dd0 0x7f69bc06be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:45.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69c0f45700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc06eb10 con 0x7f69bc06a510 2023-11-08T12:30:45.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69c0f45700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc06f690 con 0x7f69bc0aed00 2023-11-08T12:30:45.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69c0f45700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc15a4f0 con 0x7f69bc0b4dd0 2023-11-08T12:30:45.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69bbfff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f69bc06a510 0x7f69bc0ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35170/0 (socket says 172.21.15.112:35170) 2023-11-08T12:30:45.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69bbfff700 1 -- 172.21.15.112:0/3964752926 learned_addr learned my addr 172.21.15.112:0/3964752926 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:45.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69bb7fe700 1 --2- 172.21.15.112:0/3964752926 >> v2:172.21.15.112:3300/0 conn(0x7f69bc0b4dd0 0x7f69bc06be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:45.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69ba7fc700 1 -- 172.21.15.112:0/3964752926 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793173100 0 0) 0x7f69bc06f690 con 0x7f69bc0aed00 2023-11-08T12:30:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69ba7fc700 1 -- 172.21.15.112:0/3964752926 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a40035d0 con 0x7f69bc0aed00 2023-11-08T12:30:45.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69ba7fc700 1 -- 172.21.15.112:0/3964752926 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780014535 0 0) 0x7f69bc06eb10 con 0x7f69bc06a510 2023-11-08T12:30:45.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69ba7fc700 1 -- 172.21.15.112:0/3964752926 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69bc06f690 con 0x7f69bc06a510 2023-11-08T12:30:45.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69bb7fe700 1 -- 172.21.15.112:0/3964752926 >> v1:172.21.15.133:6789/0 conn(0x7f69bc0aed00 legacy=0x7f69bc069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:45.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69bb7fe700 1 -- 172.21.15.112:0/3964752926 >> v1:172.21.15.112:6789/0 conn(0x7f69bc06a510 legacy=0x7f69bc0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:45.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.281+0000 7f69bb7fe700 1 -- 172.21.15.112:0/3964752926 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc06ed60 con 0x7f69bc0b4dd0 2023-11-08T12:30:45.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69bb7fe700 1 --2- 172.21.15.112:0/3964752926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc0b4dd0 0x7f69bc06be80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009850 tx=0x7f69ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863670312727d660 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69ba7fc700 1 -- 172.21.15.112:0/3964752926 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac011830 con 0x7f69bc0b4dd0 2023-11-08T12:30:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69ba7fc700 1 -- 172.21.15.112:0/3964752926 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac011990 con 0x7f69bc0b4dd0 2023-11-08T12:30:45.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69ba7fc700 1 -- 172.21.15.112:0/3964752926 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac011d40 con 0x7f69bc0b4dd0 2023-11-08T12:30:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69c0f45700 1 -- 172.21.15.112:0/3964752926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc0b4dd0 msgr2=0x7f69bc06be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69c0f45700 1 --2- 172.21.15.112:0/3964752926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc0b4dd0 0x7f69bc06be80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009850 tx=0x7f69ac009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:45.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69c0f45700 1 -- 172.21.15.112:0/3964752926 shutdown_connections 2023-11-08T12:30:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69c0f45700 1 --2- 172.21.15.112:0/3964752926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc0b4dd0 0x7f69bc06be80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69c0f45700 1 -- 172.21.15.112:0/3964752926 >> 172.21.15.112:0/3964752926 conn(0x7f69bc0d0340 msgr2=0x7f69bc0cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69c0f45700 1 -- 172.21.15.112:0/3964752926 shutdown_connections 2023-11-08T12:30:45.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.285+0000 7f69c0f45700 1 -- 172.21.15.112:0/3964752926 wait complete. 2023-11-08T12:30:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 Processor -- start 2023-11-08T12:30:45.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 -- start start 2023-11-08T12:30:45.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69bc06a510 0x7f69bc0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:45.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69bc0aed00 0x7f69bc151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc152730 0x7f69bc0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc152e80 con 0x7f69bc152730 2023-11-08T12:30:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc153160 con 0x7f69bc0aed00 2023-11-08T12:30:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69c0f45700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc153440 con 0x7f69bc06a510 2023-11-08T12:30:45.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.289+0000 7f69bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc152730 0x7f69bc0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:45.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc152730 0x7f69bc0c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50352/0 (socket says 172.21.15.112:50352) 2023-11-08T12:30:45.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 -- 172.21.15.112:0/14316983 learned_addr learned my addr 172.21.15.112:0/14316983 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:45.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69baffd700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69bc0aed00 0x7f69bc151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:45.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bb7fe700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69bc06a510 0x7f69bc0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:45.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 -- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69bc06a510 msgr2=0x7f69bc0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:45.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69bc06a510 0x7f69bc0c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 -- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69bc0aed00 msgr2=0x7f69bc151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:45.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69bc0aed00 0x7f69bc151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:45.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 -- 172.21.15.112:0/14316983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0094b0 con 0x7f69bc152730 2023-11-08T12:30:45.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69baffd700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69bc0aed00 0x7f69bc151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:45.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69bbfff700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc152730 0x7f69bc0c8bf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f69b400cae0 tx=0x7f69b400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:45.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69a3fff700 1 -- 172.21.15.112:0/14316983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b400a820 con 0x7f69bc152730 2023-11-08T12:30:45.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69a3fff700 1 -- 172.21.15.112:0/14316983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b400a980 con 0x7f69bc152730 2023-11-08T12:30:45.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69a3fff700 1 -- 172.21.15.112:0/14316983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b400ad30 con 0x7f69bc152730 2023-11-08T12:30:45.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69bc06f320 con 0x7f69bc152730 2023-11-08T12:30:45.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc06f040 con 0x7f69bc152730 2023-11-08T12:30:45.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.293+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc06c3c0 con 0x7f69bc152730 2023-11-08T12:30:45.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.297+0000 7f69a3fff700 1 -- 172.21.15.112:0/14316983 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f69b4019030 con 0x7f69bc152730 2023-11-08T12:30:45.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.297+0000 7f69a3fff700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69a8064ee0 0x7f69a8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:45.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.297+0000 7f69a3fff700 1 -- 172.21.15.112:0/14316983 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6030+0+0 (secure 0 0 0) 0x7f69b4081800 con 0x7f69bc152730 2023-11-08T12:30:45.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.297+0000 7f69bb7fe700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69a8064ee0 0x7f69a8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:45.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.297+0000 7f69bb7fe700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69a8064ee0 0x7f69a8067390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0cf550 tx=0x7f69ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:45.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.305+0000 7f69a3fff700 1 -- 172.21.15.112:0/14316983 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f69b404f8e0 con 0x7f69bc152730 2023-11-08T12:30:45.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:45.473+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f69bc073cb0 con 0x7f69bc152730 2023-11-08T12:30:46.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.065+0000 7f69a3fff700 1 -- 172.21.15.112:0/14316983 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f69b4052f00 con 0x7f69bc152730 2023-11-08T12:30:46.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69a8064ee0 msgr2=0x7f69a8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69a8064ee0 0x7f69a8067390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0cf550 tx=0x7f69ac008030 comp rx=0 tx=0).stop 2023-11-08T12:30:46.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc152730 msgr2=0x7f69bc0c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc152730 0x7f69bc0c8bf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f69b400cae0 tx=0x7f69b400cbc0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 shutdown_connections 2023-11-08T12:30:46.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69a8064ee0 0x7f69a8067390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69bc152730 0x7f69bc0c8bf0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69bc0aed00 0x7f69bc151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 --2- 172.21.15.112:0/14316983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69bc06a510 0x7f69bc0c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.073+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 >> 172.21.15.112:0/14316983 conn(0x7f69bc0d0340 msgr2=0x7f69bc0b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:46.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.077+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 shutdown_connections 2023-11-08T12:30:46.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.077+0000 7f69c0f45700 1 -- 172.21.15.112:0/14316983 wait complete. 2023-11-08T12:30:46.082 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2023-11-08T12:30:46.103 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T12:30:46.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c17fff700 1 Processor -- start 2023-11-08T12:30:46.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c17fff700 1 -- start start 2023-11-08T12:30:46.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c17fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c18070080 0x7f4c180704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18164250 0x7f4c181646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c17fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c180ad6c0 con 0x7f4c18160710 2023-11-08T12:30:46.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c17fff700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1806b1c0 con 0x7f4c18070080 2023-11-08T12:30:46.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c17fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180adc60 con 0x7f4c18164250 2023-11-08T12:30:46.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c0ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c18070080 0x7f4c180704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c0ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c18070080 0x7f4c180704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50366/0 (socket says 172.21.15.112:50366) 2023-11-08T12:30:46.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c0ffff700 1 -- 172.21.15.112:0/1998967691 learned_addr learned my addr 172.21.15.112:0/1998967691 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:46.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c177fe700 1 --2- 172.21.15.112:0/1998967691 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18164250 0x7f4c181646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c0ffff700 1 -- 172.21.15.112:0/1998967691 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18164250 msgr2=0x7f4c181646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:46.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c0ffff700 1 --2- 172.21.15.112:0/1998967691 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18164250 0x7f4c181646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c0ffff700 1 -- 172.21.15.112:0/1998967691 >> v1:172.21.15.133:6789/0 conn(0x7f4c18160710 legacy=0x7f4c180cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.285+0000 7f4c0ffff700 1 -- 172.21.15.112:0/1998967691 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180709f0 con 0x7f4c18070080 2023-11-08T12:30:46.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c0ffff700 1 --2- 172.21.15.112:0/1998967691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c180704b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009910 tx=0x7f4c00009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcd18eb510c8674 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:46.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c167fc700 1 -- 172.21.15.112:0/1998967691 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000ba60 con 0x7f4c18070080 2023-11-08T12:30:46.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c167fc700 1 -- 172.21.15.112:0/1998967691 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0000bbc0 con 0x7f4c18070080 2023-11-08T12:30:46.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c167fc700 1 -- 172.21.15.112:0/1998967691 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00009e60 con 0x7f4c18070080 2023-11-08T12:30:46.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 -- 172.21.15.112:0/1998967691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 msgr2=0x7f4c180704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1998967691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c180704b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009910 tx=0x7f4c00009c20 comp rx=0 tx=0).stop 2023-11-08T12:30:46.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 -- 172.21.15.112:0/1998967691 shutdown_connections 2023-11-08T12:30:46.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1998967691 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18164250 0x7f4c181646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1998967691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c180704b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 -- 172.21.15.112:0/1998967691 >> 172.21.15.112:0/1998967691 conn(0x7f4c180b0f80 msgr2=0x7f4c180ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:46.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 -- 172.21.15.112:0/1998967691 shutdown_connections 2023-11-08T12:30:46.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.289+0000 7f4c17fff700 1 -- 172.21.15.112:0/1998967691 wait complete. 2023-11-08T12:30:46.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 Processor -- start 2023-11-08T12:30:46.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 -- start start 2023-11-08T12:30:46.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c1815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18160710 0x7f4c1815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c18164250 0x7f4c180c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c181f7410 con 0x7f4c18070080 2023-11-08T12:30:46.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c181f6790 con 0x7f4c18164250 2023-11-08T12:30:46.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c17fff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c181f6a70 con 0x7f4c18160710 2023-11-08T12:30:46.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c1815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c1815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50368/0 (socket says 172.21.15.112:50368) 2023-11-08T12:30:46.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 -- 172.21.15.112:0/1464336232 learned_addr learned my addr 172.21.15.112:0/1464336232 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:46.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c0ffff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18160710 0x7f4c1815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c177fe700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c18164250 0x7f4c180c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 -- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18160710 msgr2=0x7f4c1815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18160710 0x7f4c1815f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 -- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c18164250 msgr2=0x7f4c180c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c18164250 0x7f4c180c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 -- 172.21.15.112:0/1464336232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009570 con 0x7f4c18070080 2023-11-08T12:30:46.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.293+0000 7f4c16ffd700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c1815eea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c500 tx=0x7f4c0800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:46.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.297+0000 7f4c0f7fe700 1 -- 172.21.15.112:0/1464336232 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c080052d0 con 0x7f4c18070080 2023-11-08T12:30:46.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.297+0000 7f4c0f7fe700 1 -- 172.21.15.112:0/1464336232 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08005430 con 0x7f4c18070080 2023-11-08T12:30:46.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.297+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1806b3d0 con 0x7f4c18070080 2023-11-08T12:30:46.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.297+0000 7f4c0f7fe700 1 -- 172.21.15.112:0/1464336232 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c080055a0 con 0x7f4c18070080 2023-11-08T12:30:46.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.297+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c180cca30 con 0x7f4c18070080 2023-11-08T12:30:46.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.297+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1806b6b0 con 0x7f4c18070080 2023-11-08T12:30:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.301+0000 7f4c0f7fe700 1 -- 172.21.15.112:0/1464336232 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4c08019030 con 0x7f4c18070080 2023-11-08T12:30:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.301+0000 7f4c0f7fe700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bf8064ee0 0x7f4bf8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.301+0000 7f4c0f7fe700 1 -- 172.21.15.112:0/1464336232 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4c08080f30 con 0x7f4c18070080 2023-11-08T12:30:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.301+0000 7f4c0ffff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bf8064ee0 0x7f4bf8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.301+0000 7f4c0ffff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bf8064ee0 0x7f4bf8067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4c00000c00 tx=0x7f4c00008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:46.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.305+0000 7f4c0f7fe700 1 -- 172.21.15.112:0/1464336232 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4c0804f250 con 0x7f4c18070080 2023-11-08T12:30:46.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.481+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4c181f7550 con 0x7f4c18070080 2023-11-08T12:30:46.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.489+0000 7f4c0f7fe700 1 -- 172.21.15.112:0/1464336232 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c08052870 con 0x7f4c18070080 2023-11-08T12:30:46.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bf8064ee0 msgr2=0x7f4bf8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bf8064ee0 0x7f4bf8067390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4c00000c00 tx=0x7f4c00008030 comp rx=0 tx=0).stop 2023-11-08T12:30:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 msgr2=0x7f4c1815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c1815eea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c500 tx=0x7f4c0800c810 comp rx=0 tx=0).stop 2023-11-08T12:30:46.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 shutdown_connections 2023-11-08T12:30:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4bf8064ee0 0x7f4bf8067390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c18164250 0x7f4c180c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c18160710 0x7f4c1815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 --2- 172.21.15.112:0/1464336232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c18070080 0x7f4c1815eea0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.493+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 >> 172.21.15.112:0/1464336232 conn(0x7f4c180b0f80 msgr2=0x7f4c1806bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:46.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.497+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 shutdown_connections 2023-11-08T12:30:46.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.497+0000 7f4c17fff700 1 -- 172.21.15.112:0/1464336232 wait complete. 2023-11-08T12:30:46.519 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-08T12:30:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.689+0000 7f44af59e700 1 Processor -- start 2023-11-08T12:30:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.689+0000 7f44af59e700 1 -- start start 2023-11-08T12:30:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.689+0000 7f44af59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f44b00b43a0 0x7f44b015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.689+0000 7f44af59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b0070790 0x7f44b006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.689+0000 7f44af59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b015a550 con 0x7f44b00b1640 2023-11-08T12:30:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.689+0000 7f44af59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b006b0a0 con 0x7f44b00b43a0 2023-11-08T12:30:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.689+0000 7f44af59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00caac0 con 0x7f44b0070790 2023-11-08T12:30:46.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ae59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f44b00b43a0 0x7f44b015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44add9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f44b00b1640 0x7f44b0070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35182/0 (socket says 172.21.15.112:35182) 2023-11-08T12:30:46.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44add9b700 1 -- 172.21.15.112:0/60715433 learned_addr learned my addr 172.21.15.112:0/60715433 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:46.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44aed9d700 1 --2- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b0070790 0x7f44b006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ae59c700 1 -- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b0070790 msgr2=0x7f44b006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:46.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ae59c700 1 --2- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b0070790 0x7f44b006bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ad59a700 1 -- 172.21.15.112:0/60715433 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875003314 0 0) 0x7f44a4001110 con 0x7f44b00b1640 2023-11-08T12:30:46.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ae59c700 1 -- 172.21.15.112:0/60715433 >> v1:172.21.15.112:6789/0 conn(0x7f44b00b1640 legacy=0x7f44b0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ae59c700 1 -- 172.21.15.112:0/60715433 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00cada0 con 0x7f44b00b43a0 2023-11-08T12:30:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ae59c700 1 --2- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b015e5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009850 tx=0x7f44a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=430d333ba3098d13 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ad59a700 1 -- 172.21.15.112:0/60715433 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011830 con 0x7f44b00b43a0 2023-11-08T12:30:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ad59a700 1 -- 172.21.15.112:0/60715433 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0011990 con 0x7f44b00b43a0 2023-11-08T12:30:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44ad59a700 1 -- 172.21.15.112:0/60715433 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011d40 con 0x7f44b00b43a0 2023-11-08T12:30:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 -- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 msgr2=0x7f44b015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 --2- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b015e5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009850 tx=0x7f44a0009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 -- 172.21.15.112:0/60715433 shutdown_connections 2023-11-08T12:30:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 --2- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b0070790 0x7f44b006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 --2- 172.21.15.112:0/60715433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b015e5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 -- 172.21.15.112:0/60715433 >> 172.21.15.112:0/60715433 conn(0x7f44b00b0f80 msgr2=0x7f44b00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:46.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 -- 172.21.15.112:0/60715433 shutdown_connections 2023-11-08T12:30:46.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.693+0000 7f44af59e700 1 -- 172.21.15.112:0/60715433 wait complete. 2023-11-08T12:30:46.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.697+0000 7f44af59e700 1 Processor -- start 2023-11-08T12:30:46.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.697+0000 7f44af59e700 1 -- start start 2023-11-08T12:30:46.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44b0070790 0x7f44b01530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b00b1640 0x7f44b00cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00cd870 con 0x7f44b0070790 2023-11-08T12:30:46.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b0153610 con 0x7f44b00b43a0 2023-11-08T12:30:46.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00ccc60 con 0x7f44b00b1640 2023-11-08T12:30:46.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44b0070790 0x7f44b01530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44b0070790 0x7f44b01530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50384/0 (socket says 172.21.15.112:50384) 2023-11-08T12:30:46.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 -- 172.21.15.112:0/1151371951 learned_addr learned my addr 172.21.15.112:0/1151371951 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:46.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44add9b700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b00b1640 0x7f44b00cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 -- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b00b1640 msgr2=0x7f44b00cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b00b1640 0x7f44b00cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44aed9d700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 -- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 msgr2=0x7f44b00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:46.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b00ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:46.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 -- 172.21.15.112:0/1151371951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00094b0 con 0x7f44b0070790 2023-11-08T12:30:46.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44add9b700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b00b1640 0x7f44b00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:46.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44aed9d700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:46.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44ae59c700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44b0070790 0x7f44b01530d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f44a00097a0 tx=0x7f44a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:46.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f449effd700 1 -- 172.21.15.112:0/1151371951 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0004590 con 0x7f44b0070790 2023-11-08T12:30:46.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f449effd700 1 -- 172.21.15.112:0/1151371951 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a001e070 con 0x7f44b0070790 2023-11-08T12:30:46.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f449effd700 1 -- 172.21.15.112:0/1151371951 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0003900 con 0x7f44b0070790 2023-11-08T12:30:46.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b006b5d0 con 0x7f44b0070790 2023-11-08T12:30:46.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.701+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b006b2f0 con 0x7f44b0070790 2023-11-08T12:30:46.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.705+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b015eb10 con 0x7f44b0070790 2023-11-08T12:30:46.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.705+0000 7f449effd700 1 -- 172.21.15.112:0/1151371951 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f44a002a020 con 0x7f44b0070790 2023-11-08T12:30:46.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.709+0000 7f449effd700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4490064f10 0x7f44900673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:46.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.709+0000 7f449effd700 1 -- 172.21.15.112:0/1151371951 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f44a0082c20 con 0x7f44b0070790 2023-11-08T12:30:46.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.709+0000 7f44add9b700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4490064f10 0x7f44900673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:46.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.709+0000 7f44add9b700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4490064f10 0x7f44900673c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f44b01f51d0 tx=0x7f44a4007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:46.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.713+0000 7f449effd700 1 -- 172.21.15.112:0/1151371951 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f44a0050eb0 con 0x7f44b0070790 2023-11-08T12:30:46.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:46.945+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f44b0073cb0 con 0x7f44b0070790 2023-11-08T12:30:47.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.069+0000 7f449effd700 1 -- 172.21.15.112:0/1151371951 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v174) v1 ==== 149+0+0 (secure 0 0 0) 0x7f44a00544d0 con 0x7f44b0070790 2023-11-08T12:30:47.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4490064f10 msgr2=0x7f44900673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4490064f10 0x7f44900673c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f44b01f51d0 tx=0x7f44a4007b00 comp rx=0 tx=0).stop 2023-11-08T12:30:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44b0070790 msgr2=0x7f44b01530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44b0070790 0x7f44b01530d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f44a00097a0 tx=0x7f44a0004770 comp rx=0 tx=0).stop 2023-11-08T12:30:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 shutdown_connections 2023-11-08T12:30:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4490064f10 0x7f44900673c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44b00b43a0 0x7f44b00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44b00b1640 0x7f44b00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 --2- 172.21.15.112:0/1151371951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44b0070790 0x7f44b01530d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 >> 172.21.15.112:0/1151371951 conn(0x7f44b00b0f80 msgr2=0x7f44b00c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.073+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 shutdown_connections 2023-11-08T12:30:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.077+0000 7f44af59e700 1 -- 172.21.15.112:0/1151371951 wait complete. 2023-11-08T12:30:47.101 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-11-08T12:30:47.101 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-08T12:30:47.102 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T12:30:47.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-08T12:30:47.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.277+0000 7f69deeb8700 1 Processor -- start 2023-11-08T12:30:47.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.277+0000 7f69deeb8700 1 -- start start 2023-11-08T12:30:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69deeb8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d80cdeb0 0x7f69d8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:47.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69deeb8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69deeb8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d8070a20 con 0x7f69d815c1a0 2023-11-08T12:30:47.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69deeb8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d8069bf0 con 0x7f69d80cdeb0 2023-11-08T12:30:47.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69deeb8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80adf90 con 0x7f69d80705c0 2023-11-08T12:30:47.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d80cdeb0 0x7f69d8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:47.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69de6b7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:47.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d80cdeb0 0x7f69d8070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:53736/0 (socket says 172.21.15.112:53736) 2023-11-08T12:30:47.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 -- 172.21.15.112:0/193464366 learned_addr learned my addr 172.21.15.112:0/193464366 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 -- 172.21.15.112:0/193464366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 msgr2=0x7f69d806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 --2- 172.21.15.112:0/193464366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d806a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 -- 172.21.15.112:0/193464366 >> v1:172.21.15.133:6789/0 conn(0x7f69d815c1a0 legacy=0x7f69d806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dceb4700 1 -- 172.21.15.112:0/193464366 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176826309 0 0) 0x7f69d8070a20 con 0x7f69d815c1a0 2023-11-08T12:30:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 -- 172.21.15.112:0/193464366 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80ce370 con 0x7f69d80cdeb0 2023-11-08T12:30:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dd6b5700 1 --2- 172.21.15.112:0/193464366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80cdeb0 0x7f69d8070080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009910 tx=0x7f69c8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da06a4c86c41ab96 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:47.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dceb4700 1 -- 172.21.15.112:0/193464366 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8011830 con 0x7f69d80cdeb0 2023-11-08T12:30:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dceb4700 1 -- 172.21.15.112:0/193464366 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c8011990 con 0x7f69d80cdeb0 2023-11-08T12:30:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.281+0000 7f69dceb4700 1 -- 172.21.15.112:0/193464366 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8011d40 con 0x7f69d80cdeb0 2023-11-08T12:30:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 -- 172.21.15.112:0/193464366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80cdeb0 msgr2=0x7f69d8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 --2- 172.21.15.112:0/193464366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80cdeb0 0x7f69d8070080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009910 tx=0x7f69c8009c20 comp rx=0 tx=0).stop 2023-11-08T12:30:47.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 -- 172.21.15.112:0/193464366 shutdown_connections 2023-11-08T12:30:47.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 --2- 172.21.15.112:0/193464366 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 --2- 172.21.15.112:0/193464366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80cdeb0 0x7f69d8070080 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 -- 172.21.15.112:0/193464366 >> 172.21.15.112:0/193464366 conn(0x7f69d80b0f80 msgr2=0x7f69d80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:47.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 -- 172.21.15.112:0/193464366 shutdown_connections 2023-11-08T12:30:47.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 -- 172.21.15.112:0/193464366 wait complete. 2023-11-08T12:30:47.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 Processor -- start 2023-11-08T12:30:47.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.285+0000 7f69deeb8700 1 -- start start 2023-11-08T12:30:47.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d815f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:47.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69d80cdeb0 0x7f69d814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:47.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d815c1a0 0x7f69d80b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:47.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80b2bd0 con 0x7f69d80cdeb0 2023-11-08T12:30:47.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80b2610 con 0x7f69d815c1a0 2023-11-08T12:30:47.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80b28f0 con 0x7f69d80705c0 2023-11-08T12:30:47.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69d80cdeb0 0x7f69d814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:47.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69d80cdeb0 0x7f69d814caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50400/0 (socket says 172.21.15.112:50400) 2023-11-08T12:30:47.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 -- 172.21.15.112:0/2251925682 learned_addr learned my addr 172.21.15.112:0/2251925682 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:47.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69ddeb6700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d815f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:47.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69de6b7700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d815c1a0 0x7f69d80b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:47.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 -- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 msgr2=0x7f69d815f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:47.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d815f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 -- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d815c1a0 msgr2=0x7f69d80b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:47.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d815c1a0 0x7f69d80b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:47.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 -- 172.21.15.112:0/2251925682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c8009570 con 0x7f69d80cdeb0 2023-11-08T12:30:47.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69dd6b5700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69d80cdeb0 0x7f69d814caa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f69d806bc30 tx=0x7f69c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:47.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69ce7fc700 1 -- 172.21.15.112:0/2251925682 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800b970 con 0x7f69d80cdeb0 2023-11-08T12:30:47.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69ce7fc700 1 -- 172.21.15.112:0/2251925682 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c801f070 con 0x7f69d80cdeb0 2023-11-08T12:30:47.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69ce7fc700 1 -- 172.21.15.112:0/2251925682 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800bd30 con 0x7f69d80cdeb0 2023-11-08T12:30:47.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d80cc780 con 0x7f69d80cdeb0 2023-11-08T12:30:47.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.289+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d80cc4a0 con 0x7f69d80cdeb0 2023-11-08T12:30:47.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.293+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d815c570 con 0x7f69d80cdeb0 2023-11-08T12:30:47.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.293+0000 7f69ce7fc700 1 -- 172.21.15.112:0/2251925682 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f69c800f050 con 0x7f69d80cdeb0 2023-11-08T12:30:47.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.293+0000 7f69ce7fc700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69bc064ee0 0x7f69bc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:47.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.293+0000 7f69ce7fc700 1 -- 172.21.15.112:0/2251925682 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f69c8021070 con 0x7f69d80cdeb0 2023-11-08T12:30:47.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.293+0000 7f69ddeb6700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69bc064ee0 0x7f69bc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:47.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.297+0000 7f69ddeb6700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69bc064ee0 0x7f69bc067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000f60 tx=0x7f69d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:47.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.301+0000 7f69ce7fc700 1 -- 172.21.15.112:0/2251925682 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f69c8051970 con 0x7f69d80cdeb0 2023-11-08T12:30:47.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:47.533+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f69d8073cb0 con 0x7f69d80cdeb0 2023-11-08T12:30:48.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.073+0000 7f69ce7fc700 1 -- 172.21.15.112:0/2251925682 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v175) v1 ==== 172+0+0 (secure 0 0 0) 0x7f69c8006da0 con 0x7f69d80cdeb0 2023-11-08T12:30:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69bc064ee0 msgr2=0x7f69bc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69bc064ee0 0x7f69bc067390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000f60 tx=0x7f69d4009040 comp rx=0 tx=0).stop 2023-11-08T12:30:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69d80cdeb0 msgr2=0x7f69d814caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69d80cdeb0 0x7f69d814caa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f69d806bc30 tx=0x7f69c8004770 comp rx=0 tx=0).stop 2023-11-08T12:30:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 shutdown_connections 2023-11-08T12:30:48.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f69bc064ee0 0x7f69bc067390 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d815c1a0 0x7f69d80b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69d80cdeb0 0x7f69d814caa0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 --2- 172.21.15.112:0/2251925682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69d80705c0 0x7f69d815f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 >> 172.21.15.112:0/2251925682 conn(0x7f69d80b0f80 msgr2=0x7f69d80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:48.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.077+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 shutdown_connections 2023-11-08T12:30:48.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.081+0000 7f69deeb8700 1 -- 172.21.15.112:0/2251925682 wait complete. 2023-11-08T12:30:48.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-08T12:30:48.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.301+0000 7fe812f4f700 1 Processor -- start 2023-11-08T12:30:48.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.301+0000 7fe812f4f700 1 -- start start 2023-11-08T12:30:48.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe812f4f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe812f4f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe80c069bf0 0x7fe80c06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe812f4f700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c15c520 con 0x7fe80c15c150 2023-11-08T12:30:48.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe812f4f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0b4240 con 0x7fe80c069bf0 2023-11-08T12:30:48.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe812f4f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c06cc50 con 0x7fe80c070620 2023-11-08T12:30:48.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe811f4d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe80c15c150 0x7fe80c06ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35198/0 (socket says 172.21.15.112:35198) 2023-11-08T12:30:48.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe811f4d700 1 -- 172.21.15.112:0/4094326962 learned_addr learned my addr 172.21.15.112:0/4094326962 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:48.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe81274e700 1 --2- 172.21.15.112:0/4094326962 >> v2:172.21.15.112:3300/0 conn(0x7fe80c069bf0 0x7fe80c06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.305+0000 7fe81174c700 1 --2- 172.21.15.112:0/4094326962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe810f4b700 1 -- 172.21.15.112:0/4094326962 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565235153 0 0) 0x7fe80c15c520 con 0x7fe80c15c150 2023-11-08T12:30:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe810f4b700 1 -- 172.21.15.112:0/4094326962 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f80035d0 con 0x7fe80c15c150 2023-11-08T12:30:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe81274e700 1 -- 172.21.15.112:0/4094326962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 msgr2=0x7fe80c0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe81274e700 1 --2- 172.21.15.112:0/4094326962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe81274e700 1 -- 172.21.15.112:0/4094326962 >> v1:172.21.15.112:6789/0 conn(0x7fe80c15c150 legacy=0x7fe80c06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe81274e700 1 -- 172.21.15.112:0/4094326962 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0d2450 con 0x7fe80c069bf0 2023-11-08T12:30:48.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe81274e700 1 --2- 172.21.15.112:0/4094326962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c069bf0 0x7fe80c06a050 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe804009d90 tx=0x7fe80400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71066898736201c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:48.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe810f4b700 1 -- 172.21.15.112:0/4094326962 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400e070 con 0x7fe80c069bf0 2023-11-08T12:30:48.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe810f4b700 1 -- 172.21.15.112:0/4094326962 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400bb20 con 0x7fe80c069bf0 2023-11-08T12:30:48.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe810f4b700 1 -- 172.21.15.112:0/4094326962 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804012430 con 0x7fe80c069bf0 2023-11-08T12:30:48.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 -- 172.21.15.112:0/4094326962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c069bf0 msgr2=0x7fe80c06a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 --2- 172.21.15.112:0/4094326962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c069bf0 0x7fe80c06a050 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe804009d90 tx=0x7fe80400b330 comp rx=0 tx=0).stop 2023-11-08T12:30:48.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 -- 172.21.15.112:0/4094326962 shutdown_connections 2023-11-08T12:30:48.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 --2- 172.21.15.112:0/4094326962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c069bf0 0x7fe80c06a050 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 --2- 172.21.15.112:0/4094326962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 -- 172.21.15.112:0/4094326962 >> 172.21.15.112:0/4094326962 conn(0x7fe80c0d3680 msgr2=0x7fe80c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:48.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 -- 172.21.15.112:0/4094326962 shutdown_connections 2023-11-08T12:30:48.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.309+0000 7fe812f4f700 1 -- 172.21.15.112:0/4094326962 wait complete. 2023-11-08T12:30:48.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.313+0000 7fe812f4f700 1 Processor -- start 2023-11-08T12:30:48.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.313+0000 7fe812f4f700 1 -- start start 2023-11-08T12:30:48.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.313+0000 7fe812f4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c069bf0 0x7fe80c0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.313+0000 7fe812f4f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.313+0000 7fe812f4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c15c150 0x7fe80c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe812f4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0b8360 con 0x7fe80c15c150 2023-11-08T12:30:48.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe812f4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c157350 con 0x7fe80c069bf0 2023-11-08T12:30:48.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe812f4f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c157630 con 0x7fe80c070620 2023-11-08T12:30:48.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c15c150 0x7fe80c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c15c150 0x7fe80c1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50420/0 (socket says 172.21.15.112:50420) 2023-11-08T12:30:48.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 -- 172.21.15.112:0/2682161966 learned_addr learned my addr 172.21.15.112:0/2682161966 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:48.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81174c700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe811f4d700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c069bf0 0x7fe80c0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 -- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 msgr2=0x7fe80c0b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 -- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c069bf0 msgr2=0x7fe80c0b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c069bf0 0x7fe80c0b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 -- 172.21.15.112:0/2682161966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009a70 con 0x7fe80c15c150 2023-11-08T12:30:48.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe81274e700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c15c150 0x7fe80c1561c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe804014040 tx=0x7fe804004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:48.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe8027fc700 1 -- 172.21.15.112:0/2682161966 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804012430 con 0x7fe80c15c150 2023-11-08T12:30:48.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe8027fc700 1 -- 172.21.15.112:0/2682161966 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804020070 con 0x7fe80c15c150 2023-11-08T12:30:48.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c0d05e0 con 0x7fe80c15c150 2023-11-08T12:30:48.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe8027fc700 1 -- 172.21.15.112:0/2682161966 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040098f0 con 0x7fe80c15c150 2023-11-08T12:30:48.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c0d2730 con 0x7fe80c15c150 2023-11-08T12:30:48.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.317+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0d2140 con 0x7fe80c15c150 2023-11-08T12:30:48.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.321+0000 7fe8027fc700 1 -- 172.21.15.112:0/2682161966 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe804004040 con 0x7fe80c15c150 2023-11-08T12:30:48.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.321+0000 7fe8027fc700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7f0064f10 0x7fe7f00673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.321+0000 7fe8027fc700 1 -- 172.21.15.112:0/2682161966 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe804022070 con 0x7fe80c15c150 2023-11-08T12:30:48.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.321+0000 7fe811f4d700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7f0064f10 0x7fe7f00673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.325+0000 7fe811f4d700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7f0064f10 0x7fe7f00673c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe808007fd0 tx=0x7fe808007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:48.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.329+0000 7fe8027fc700 1 -- 172.21.15.112:0/2682161966 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe8040524b0 con 0x7fe80c15c150 2023-11-08T12:30:48.518 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.517+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe80c073d20 con 0x7fe80c15c150 2023-11-08T12:30:48.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.525+0000 7fe8027fc700 1 -- 172.21.15.112:0/2682161966 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe804055ad0 con 0x7fe80c15c150 2023-11-08T12:30:48.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7f0064f10 msgr2=0x7fe7f00673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7f0064f10 0x7fe7f00673c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe808007fd0 tx=0x7fe808007de0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c15c150 msgr2=0x7fe80c1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c15c150 0x7fe80c1561c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe804014040 tx=0x7fe804004af0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 shutdown_connections 2023-11-08T12:30:48.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe7f0064f10 0x7fe7f00673c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe80c15c150 0x7fe80c1561c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c070620 0x7fe80c0b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 --2- 172.21.15.112:0/2682161966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c069bf0 0x7fe80c0b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 >> 172.21.15.112:0/2682161966 conn(0x7fe80c0d3680 msgr2=0x7fe80c0b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:48.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 shutdown_connections 2023-11-08T12:30:48.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.529+0000 7fe812f4f700 1 -- 172.21.15.112:0/2682161966 wait complete. 2023-11-08T12:30:48.554 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T12:30:48.555 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:30:48.598 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:30:48.642 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T12:30:48.643 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:48.643 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:48.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:30:48.664 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:30:48.664 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:48.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:30:48.704 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:30:48.705 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:48.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:30:48.729 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:30:48.730 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:30:48.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:30:48.766 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-08T12:30:48.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:48.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54f59e700 1 Processor -- start 2023-11-08T12:30:48.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54f59e700 1 -- start start 2023-11-08T12:30:48.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54f59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb550069e00 0x7fb55006a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54f59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55006c600 con 0x7fb550071aa0 2023-11-08T12:30:48.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5500722f0 con 0x7fb55015c640 2023-11-08T12:30:48.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54f59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55006cef0 con 0x7fb550069e00 2023-11-08T12:30:48.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54dd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb550071aa0 0x7fb55006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35202/0 (socket says 172.21.15.112:35202) 2023-11-08T12:30:48.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54dd9b700 1 -- 172.21.15.112:0/3447303434 learned_addr learned my addr 172.21.15.112:0/3447303434 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:48.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54ed9d700 1 --2- 172.21.15.112:0/3447303434 >> v2:172.21.15.112:3300/0 conn(0x7fb550069e00 0x7fb55006a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54d59a700 1 -- 172.21.15.112:0/3447303434 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378039478 0 0) 0x7fb55006c600 con 0x7fb550071aa0 2023-11-08T12:30:48.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54d59a700 1 -- 172.21.15.112:0/3447303434 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5380035d0 con 0x7fb550071aa0 2023-11-08T12:30:48.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.949+0000 7fb54d59a700 1 -- 172.21.15.112:0/3447303434 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393989503 0 0) 0x7fb5380035d0 con 0x7fb550071aa0 2023-11-08T12:30:48.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54ed9d700 1 -- 172.21.15.112:0/3447303434 >> v1:172.21.15.133:6789/0 conn(0x7fb55015c640 legacy=0x7fb5500d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54ed9d700 1 -- 172.21.15.112:0/3447303434 >> v1:172.21.15.112:6789/0 conn(0x7fb550071aa0 legacy=0x7fb55006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54ed9d700 1 -- 172.21.15.112:0/3447303434 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55006da20 con 0x7fb550069e00 2023-11-08T12:30:48.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54ed9d700 1 --2- 172.21.15.112:0/3447303434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb55006a280 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb548009d90 tx=0x7fb54800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95fe43407814df5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:48.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54d59a700 1 -- 172.21.15.112:0/3447303434 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800e070 con 0x7fb550069e00 2023-11-08T12:30:48.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54d59a700 1 -- 172.21.15.112:0/3447303434 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548003a40 con 0x7fb550069e00 2023-11-08T12:30:48.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54d59a700 1 -- 172.21.15.112:0/3447303434 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544001670 con 0x7fb550069e00 2023-11-08T12:30:48.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54f59e700 1 -- 172.21.15.112:0/3447303434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 msgr2=0x7fb55006a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3447303434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb55006a280 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb548009d90 tx=0x7fb54800b330 comp rx=0 tx=0).stop 2023-11-08T12:30:48.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54f59e700 1 -- 172.21.15.112:0/3447303434 shutdown_connections 2023-11-08T12:30:48.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3447303434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb55006a280 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54f59e700 1 -- 172.21.15.112:0/3447303434 >> 172.21.15.112:0/3447303434 conn(0x7fb5500b6520 msgr2=0x7fb550071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:48.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54f59e700 1 -- 172.21.15.112:0/3447303434 shutdown_connections 2023-11-08T12:30:48.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.953+0000 7fb54f59e700 1 -- 172.21.15.112:0/3447303434 wait complete. 2023-11-08T12:30:48.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 Processor -- start 2023-11-08T12:30:48.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 -- start start 2023-11-08T12:30:48.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb5500c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb550071aa0 0x7fb55009c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55015c640 0x7fb5500cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500d38f0 con 0x7fb550069e00 2023-11-08T12:30:48.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500cb380 con 0x7fb550071aa0 2023-11-08T12:30:48.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500cf7f0 con 0x7fb55015c640 2023-11-08T12:30:48.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb5500c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb5500c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50444/0 (socket says 172.21.15.112:50444) 2023-11-08T12:30:48.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 -- 172.21.15.112:0/3565805070 learned_addr learned my addr 172.21.15.112:0/3565805070 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:48.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54dd9b700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb550071aa0 0x7fb55009c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54ed9d700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55015c640 0x7fb5500cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 -- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55015c640 msgr2=0x7fb5500cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55015c640 0x7fb5500cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 -- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb550071aa0 msgr2=0x7fb55009c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:48.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb550071aa0 0x7fb55009c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:48.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 -- 172.21.15.112:0/3565805070 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548009a70 con 0x7fb550069e00 2023-11-08T12:30:48.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54ed9d700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55015c640 0x7fb5500cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:48.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.957+0000 7fb54e59c700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb5500c6750 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c500 tx=0x7fb54000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:48.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.961+0000 7fb53effd700 1 -- 172.21.15.112:0/3565805070 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5400052d0 con 0x7fb550069e00 2023-11-08T12:30:48.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.961+0000 7fb53effd700 1 -- 172.21.15.112:0/3565805070 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb540005430 con 0x7fb550069e00 2023-11-08T12:30:48.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.961+0000 7fb53effd700 1 -- 172.21.15.112:0/3565805070 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5400055a0 con 0x7fb550069e00 2023-11-08T12:30:48.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.961+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb550072010 con 0x7fb550069e00 2023-11-08T12:30:48.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.961+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55015ca10 con 0x7fb550069e00 2023-11-08T12:30:48.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.961+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55006c830 con 0x7fb550069e00 2023-11-08T12:30:48.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.961+0000 7fb53effd700 1 -- 172.21.15.112:0/3565805070 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb540019030 con 0x7fb550069e00 2023-11-08T12:30:48.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.965+0000 7fb53effd700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb530064ee0 0x7fb530067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:48.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.965+0000 7fb53effd700 1 -- 172.21.15.112:0/3565805070 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb540081060 con 0x7fb550069e00 2023-11-08T12:30:48.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.965+0000 7fb54dd9b700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb530064ee0 0x7fb530067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:48.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.965+0000 7fb54dd9b700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb530064ee0 0x7fb530067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb5500c71e0 tx=0x7fb544001bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:48.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:48.969+0000 7fb53effd700 1 -- 172.21.15.112:0/3565805070 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb54004f3c0 con 0x7fb550069e00 2023-11-08T12:30:49.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.181+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5500b2160 con 0x7fb550069e00 2023-11-08T12:30:49.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.181+0000 7fb53effd700 1 -- 172.21.15.112:0/3565805070 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fb540017de0 con 0x7fb550069e00 2023-11-08T12:30:49.185 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:49.185 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/794879000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":794879000},{"type":"v1","addr":"172.21.15.133:6835","nonce":794879000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/907181815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":907181815},{"type":"v1","addr":"172.21.15.112:6835","nonce":907181815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5814,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3093315266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3093315266},{"type":"v1","addr":"172.21.15.112:6837","nonce":3093315266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5989,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3440097574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3440097574},{"type":"v1","addr":"172.21.15.133:6833","nonce":3440097574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-11-08T12:30:49.187 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb530064ee0 msgr2=0x7fb530067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb530064ee0 0x7fb530067390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb5500c71e0 tx=0x7fb544001bc0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 msgr2=0x7fb5500c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb5500c6750 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c500 tx=0x7fb54000c8c0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 shutdown_connections 2023-11-08T12:30:49.188 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb530064ee0 0x7fb530067390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb55015c640 0x7fb5500cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb550071aa0 0x7fb55009c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 --2- 172.21.15.112:0/3565805070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb550069e00 0x7fb5500c6750 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 >> 172.21.15.112:0/3565805070 conn(0x7fb5500b6520 msgr2=0x7fb5500606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:49.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 shutdown_connections 2023-11-08T12:30:49.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.185+0000 7fb54f59e700 1 -- 172.21.15.112:0/3565805070 wait complete. 2023-11-08T12:30:49.190 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 26 2023-11-08T12:30:49.210 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-08T12:30:49.210 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-08T12:30:49.211 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T12:30:49.211 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:49.211 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-08T12:30:49.211 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-08T12:30:49.212 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T12:30:49.212 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:49.212 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-08T12:30:49.213 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-08T12:30:49.213 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T12:30:49.213 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:49.213 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-08T12:30:49.214 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-08T12:30:49.214 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T12:30:49.214 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:30:49.234 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T12:30:49.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-08T12:30:49.236 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T12:30:49.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-08T12:30:49.238 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T12:30:49.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-08T12:30:49.239 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T12:30:49.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-08T12:30:49.283 INFO:tasks.ceph.mds.d:Started 2023-11-08T12:30:49.283 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:49.287 INFO:tasks.ceph.mds.b:Started 2023-11-08T12:30:49.287 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:49.292 INFO:tasks.ceph.mds.c:Started 2023-11-08T12:30:49.292 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:49.297 INFO:tasks.ceph.mds.a:Started 2023-11-08T12:30:49.298 DEBUG:teuthology.parallel:result is None 2023-11-08T12:30:49.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-08T12:30:49.402 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-11-08T12:30:49.407 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2023-11-08T12:30:49.410 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-11-08T12:30:49.428 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-11-08T12:30:49.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.481+0000 7fd59759e700 1 Processor -- start 2023-11-08T12:30:49.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.481+0000 7fd59759e700 1 -- start start 2023-11-08T12:30:49.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.485+0000 7fd59759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5980cd0d0 0x7fd5980b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.485+0000 7fd59759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980c9d40 con 0x7fd59815c650 2023-11-08T12:30:49.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.485+0000 7fd59759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980cd5d0 con 0x7fd5980b1b80 2023-11-08T12:30:49.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.485+0000 7fd59759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59806b140 con 0x7fd5980cd0d0 2023-11-08T12:30:49.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.485+0000 7fd59659c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd59815c650 0x7fd59806b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35230/0 (socket says 172.21.15.112:35230) 2023-11-08T12:30:49.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.485+0000 7fd59659c700 1 -- 172.21.15.112:0/286299799 learned_addr learned my addr 172.21.15.112:0/286299799 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:49.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd595d9b700 1 --2- 172.21.15.112:0/286299799 >> v2:172.21.15.133:3300/0 conn(0x7fd5980cd0d0 0x7fd5980b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817003197 0 0) 0x7fd5980c9d40 con 0x7fd59815c650 2023-11-08T12:30:49.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5800035d0 con 0x7fd59815c650 2023-11-08T12:30:49.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829492083 0 0) 0x7fd5800035d0 con 0x7fd59815c650 2023-11-08T12:30:49.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 >> v2:172.21.15.133:3300/0 conn(0x7fd5980cd0d0 msgr2=0x7fd5980b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:49.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 --2- 172.21.15.112:0/286299799 >> v2:172.21.15.133:3300/0 conn(0x7fd5980cd0d0 0x7fd5980b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 >> v1:172.21.15.133:6789/0 conn(0x7fd5980b1b80 legacy=0x7fd59806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:49.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980cd8b0 con 0x7fd59815c650 2023-11-08T12:30:49.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7fd588001670 con 0x7fd59815c650 2023-11-08T12:30:49.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 >> v1:172.21.15.112:6789/0 conn(0x7fd59815c650 legacy=0x7fd59806b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:49.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd580003a20 0x7fd580003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd580004410 0x7fd5800048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5800050d0 0x7fd58000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58000e230 con 0x7fd5800050d0 2023-11-08T12:30:49.494 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58000e370 con 0x7fd580004410 2023-11-08T12:30:49.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58000e530 con 0x7fd580003a20 2023-11-08T12:30:49.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5800050d0 0x7fd58000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59659c700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd580003a20 0x7fd580003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.495 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd595d9b700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd580004410 0x7fd5800048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 -- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd580003a20 msgr2=0x7fd580003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:49.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd580003a20 0x7fd580003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 -- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd580004410 msgr2=0x7fd5800048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:49.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd580004410 0x7fd5800048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 -- 172.21.15.112:0/286299799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800035d0 con 0x7fd5800050d0 2023-11-08T12:30:49.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 -- 172.21.15.112:0/286299799 reap_dead start 2023-11-08T12:30:49.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd596d9d700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5800050d0 0x7fd58000dc40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd590001ed0 tx=0x7fd5800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d28c5d8ab21f4b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:49.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000cca0 con 0x7fd5800050d0 2023-11-08T12:30:49.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000ce20 con 0x7fd5800050d0 2023-11-08T12:30:49.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.489+0000 7fd59559a700 1 -- 172.21.15.112:0/286299799 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590003c60 con 0x7fd5800050d0 2023-11-08T12:30:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.493+0000 7fd59759e700 1 -- 172.21.15.112:0/286299799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5800050d0 msgr2=0x7fd58000dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.493+0000 7fd59759e700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5800050d0 0x7fd58000dc40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd590001ed0 tx=0x7fd5800058a0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.493+0000 7fd59759e700 1 -- 172.21.15.112:0/286299799 shutdown_connections 2023-11-08T12:30:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.493+0000 7fd59759e700 1 --2- 172.21.15.112:0/286299799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5800050d0 0x7fd58000dc40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.493+0000 7fd59759e700 1 -- 172.21.15.112:0/286299799 >> 172.21.15.112:0/286299799 conn(0x7fd5980b0f80 msgr2=0x7fd5980ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:49.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.493+0000 7fd59759e700 1 -- 172.21.15.112:0/286299799 shutdown_connections 2023-11-08T12:30:49.500 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.493+0000 7fd59759e700 1 -- 172.21.15.112:0/286299799 wait complete. 2023-11-08T12:30:49.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 Processor -- start 2023-11-08T12:30:49.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 -- start start 2023-11-08T12:30:49.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5800050d0 0x7fd598150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd598151d20 0x7fd598155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.502 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd598152190 0x7fd5981561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981511e0 con 0x7fd598151d20 2023-11-08T12:30:49.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981567f0 con 0x7fd598152190 2023-11-08T12:30:49.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598156ad0 con 0x7fd5800050d0 2023-11-08T12:30:49.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd598151d20 0x7fd598155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd598151d20 0x7fd598155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50482/0 (socket says 172.21.15.112:50482) 2023-11-08T12:30:49.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 -- 172.21.15.112:0/192718709 learned_addr learned my addr 172.21.15.112:0/192718709 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:49.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd596d9d700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd598152190 0x7fd5981561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd59659c700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5800050d0 0x7fd598150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 -- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5800050d0 msgr2=0x7fd598150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:49.504 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5800050d0 0x7fd598150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 -- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd598152190 msgr2=0x7fd5981561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:49.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd598152190 0x7fd5981561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:49.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.497+0000 7fd595d9b700 1 -- 172.21.15.112:0/192718709 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980c9680 con 0x7fd598151d20 2023-11-08T12:30:49.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.501+0000 7fd595d9b700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd598151d20 0x7fd598155c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0119b0 tx=0x7fd58c011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:49.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.501+0000 7fd586ffd700 1 -- 172.21.15.112:0/192718709 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c011e40 con 0x7fd598151d20 2023-11-08T12:30:49.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.501+0000 7fd586ffd700 1 -- 172.21.15.112:0/192718709 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c00f940 con 0x7fd598151d20 2023-11-08T12:30:49.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.501+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5980c99d0 con 0x7fd598151d20 2023-11-08T12:30:49.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.501+0000 7fd586ffd700 1 -- 172.21.15.112:0/192718709 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00fcd0 con 0x7fd598151d20 2023-11-08T12:30:49.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.501+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5980b1640 con 0x7fd598151d20 2023-11-08T12:30:49.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.501+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd598151380 con 0x7fd598151d20 2023-11-08T12:30:49.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.505+0000 7fd586ffd700 1 -- 172.21.15.112:0/192718709 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fd58c014440 con 0x7fd598151d20 2023-11-08T12:30:49.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.505+0000 7fd586ffd700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd578064f10 0x7fd5780673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:49.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.505+0000 7fd586ffd700 1 -- 172.21.15.112:0/192718709 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd58c082370 con 0x7fd598151d20 2023-11-08T12:30:49.508 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.505+0000 7fd59659c700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd578064f10 0x7fd5780673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:49.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.505+0000 7fd59659c700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd578064f10 0x7fd5780673c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd588001aa0 tx=0x7fd588001a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:49.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.509+0000 7fd586ffd700 1 -- 172.21.15.112:0/192718709 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fd598151380 con 0x7fd598151d20 2023-11-08T12:30:49.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:49.701+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd598151380 con 0x7fd598151d20 2023-11-08T12:30:50.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.533+0000 7fd586ffd700 1 -- 172.21.15.112:0/192718709 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd598151380 con 0x7fd598151d20 2023-11-08T12:30:50.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd578064f10 msgr2=0x7fd5780673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:50.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd578064f10 0x7fd5780673c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd588001aa0 tx=0x7fd588001a10 comp rx=0 tx=0).stop 2023-11-08T12:30:50.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd598151d20 msgr2=0x7fd598155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:50.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd598151d20 0x7fd598155c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0119b0 tx=0x7fd58c011cc0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 shutdown_connections 2023-11-08T12:30:50.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fd578064f10 0x7fd5780673c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd598152190 0x7fd5981561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd598151d20 0x7fd598155c80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 --2- 172.21.15.112:0/192718709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5800050d0 0x7fd598150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 >> 172.21.15.112:0/192718709 conn(0x7fd5980b0f80 msgr2=0x7fd598159750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:50.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 shutdown_connections 2023-11-08T12:30:50.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.537+0000 7fd59759e700 1 -- 172.21.15.112:0/192718709 wait complete. 2023-11-08T12:30:50.542 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2023-11-08T12:30:50.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-08T12:30:50.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.725+0000 7f75422d5700 1 Processor -- start 2023-11-08T12:30:50.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.725+0000 7f75422d5700 1 -- start start 2023-11-08T12:30:50.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75422d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:50.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75422d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f753c0b1640 0x7f753c070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:50.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75422d5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c15a550 con 0x7f753c0c9040 2023-11-08T12:30:50.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75422d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753c06b0a0 con 0x7f753c0b1640 2023-11-08T12:30:50.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75422d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0caac0 con 0x7f753c0b43a0 2023-11-08T12:30:50.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7541ad4700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f753c0c9040 0x7f753c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35240/0 (socket says 172.21.15.112:35240) 2023-11-08T12:30:50.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7541ad4700 1 -- 172.21.15.112:0/626007752 learned_addr learned my addr 172.21.15.112:0/626007752 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:50.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7540ad2700 1 --2- 172.21.15.112:0/626007752 >> v2:172.21.15.133:3300/0 conn(0x7f753c0b1640 0x7f753c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:50.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75412d3700 1 --2- 172.21.15.112:0/626007752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:50.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7533fff700 1 -- 172.21.15.112:0/626007752 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433394518 0 0) 0x7f7534001490 con 0x7f753c0c9040 2023-11-08T12:30:50.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7533fff700 1 -- 172.21.15.112:0/626007752 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75280035d0 con 0x7f753c0c9040 2023-11-08T12:30:50.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75412d3700 1 -- 172.21.15.112:0/626007752 >> v2:172.21.15.133:3300/0 conn(0x7f753c0b1640 msgr2=0x7f753c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:50.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75412d3700 1 --2- 172.21.15.112:0/626007752 >> v2:172.21.15.133:3300/0 conn(0x7f753c0b1640 0x7f753c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75412d3700 1 -- 172.21.15.112:0/626007752 >> v1:172.21.15.112:6789/0 conn(0x7f753c0c9040 legacy=0x7f753c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:50.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75412d3700 1 -- 172.21.15.112:0/626007752 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0cada0 con 0x7f753c0b43a0 2023-11-08T12:30:50.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7540ad2700 1 --2- 172.21.15.112:0/626007752 >> v2:172.21.15.133:3300/0 conn(0x7f753c0b1640 0x7f753c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:50.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75412d3700 1 --2- 172.21.15.112:0/626007752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c15e5d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7538009850 tx=0x7f7538009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eb3d5ea267398e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:50.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7533fff700 1 -- 172.21.15.112:0/626007752 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538011830 con 0x7f753c0b43a0 2023-11-08T12:30:50.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7533fff700 1 -- 172.21.15.112:0/626007752 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538011990 con 0x7f753c0b43a0 2023-11-08T12:30:50.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f7533fff700 1 -- 172.21.15.112:0/626007752 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538011d40 con 0x7f753c0b43a0 2023-11-08T12:30:50.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75422d5700 1 -- 172.21.15.112:0/626007752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 msgr2=0x7f753c15e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:50.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.729+0000 7f75422d5700 1 --2- 172.21.15.112:0/626007752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c15e5d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7538009850 tx=0x7f7538009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:50.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.733+0000 7f75422d5700 1 -- 172.21.15.112:0/626007752 shutdown_connections 2023-11-08T12:30:50.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.733+0000 7f75422d5700 1 --2- 172.21.15.112:0/626007752 >> v2:172.21.15.133:3300/0 conn(0x7f753c0b1640 0x7f753c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.733+0000 7f75422d5700 1 --2- 172.21.15.112:0/626007752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c15e5d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.733+0000 7f75422d5700 1 -- 172.21.15.112:0/626007752 >> 172.21.15.112:0/626007752 conn(0x7f753c0b0f80 msgr2=0x7f753c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:50.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.733+0000 7f75422d5700 1 -- 172.21.15.112:0/626007752 shutdown_connections 2023-11-08T12:30:50.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.733+0000 7f75422d5700 1 -- 172.21.15.112:0/626007752 wait complete. 2023-11-08T12:30:50.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.733+0000 7f75422d5700 1 Processor -- start 2023-11-08T12:30:50.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75422d5700 1 -- start start 2023-11-08T12:30:50.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75422d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f753c0b1640 0x7f753c1f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:50.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75422d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:50.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75422d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c0c9040 0x7f753c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:50.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75422d5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c1f2610 con 0x7f753c0c9040 2023-11-08T12:30:50.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75422d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c1f2410 con 0x7f753c0b1640 2023-11-08T12:30:50.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75422d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0cc8e0 con 0x7f753c0b43a0 2023-11-08T12:30:50.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c0c9040 0x7f753c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:50.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c0c9040 0x7f753c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50492/0 (socket says 172.21.15.112:50492) 2023-11-08T12:30:50.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 -- 172.21.15.112:0/1215707421 learned_addr learned my addr 172.21.15.112:0/1215707421 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:50.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f75412d3700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f753c0b1640 0x7f753c1f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:50.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7540ad2700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:50.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 -- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 msgr2=0x7f753c151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:50.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 -- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f753c0b1640 msgr2=0x7f753c1f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:50.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f753c0b1640 0x7f753c1f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:50.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 -- 172.21.15.112:0/1215707421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0094b0 con 0x7f753c0c9040 2023-11-08T12:30:50.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7541ad4700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c0c9040 0x7f753c0af2e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f753400cae0 tx=0x7f753400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:50.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7531ffb700 1 -- 172.21.15.112:0/1215707421 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534007480 con 0x7f753c0c9040 2023-11-08T12:30:50.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.737+0000 7f7531ffb700 1 -- 172.21.15.112:0/1215707421 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75340075e0 con 0x7f753c0c9040 2023-11-08T12:30:50.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.741+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75380094b0 con 0x7f753c0c9040 2023-11-08T12:30:50.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.741+0000 7f7531ffb700 1 -- 172.21.15.112:0/1215707421 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534007970 con 0x7f753c0c9040 2023-11-08T12:30:50.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.741+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c06b5d0 con 0x7f753c0c9040 2023-11-08T12:30:50.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.741+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c06b2f0 con 0x7f753c0c9040 2023-11-08T12:30:50.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.741+0000 7f7531ffb700 1 -- 172.21.15.112:0/1215707421 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7534019030 con 0x7f753c0c9040 2023-11-08T12:30:50.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.741+0000 7f7531ffb700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7520064ee0 0x7f7520067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:50.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.741+0000 7f7531ffb700 1 -- 172.21.15.112:0/1215707421 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7534081390 con 0x7f753c0c9040 2023-11-08T12:30:50.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.745+0000 7f75412d3700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7520064ee0 0x7f7520067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:50.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.745+0000 7f75412d3700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7520064ee0 0x7f7520067390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f75380090b0 tx=0x7f7538008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:50.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.745+0000 7f7531ffb700 1 -- 172.21.15.112:0/1215707421 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f753404f650 con 0x7f753c0c9040 2023-11-08T12:30:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.973+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f753c15eb10 con 0x7f753c0c9040 2023-11-08T12:30:50.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.973+0000 7f7531ffb700 1 -- 172.21.15.112:0/1215707421 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f7534017090 con 0x7f753c0c9040 2023-11-08T12:30:50.975 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:50.975 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:30:50.975 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2023-11-08T12:30:50.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.976 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2023-11-08T12:30:50.976 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlRHRoFxAAyw1Nx0lpcoK2O0Mffhxa+Q==", 2023-11-08T12:30:50.976 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.976 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:50.976 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:50.977 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:50.977 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.978 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2023-11-08T12:30:50.978 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlJ/6NKhAA4JtSpMqfz11efoyViRsE9w==", 2023-11-08T12:30:50.978 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.978 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:50.979 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:50.979 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:50.979 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.980 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2023-11-08T12:30:50.980 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlxtc7IhAAMY7VdOn5spixCeT9mzaa7w==", 2023-11-08T12:30:50.981 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.981 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:50.981 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:50.981 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:50.981 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.982 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2023-11-08T12:30:50.983 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlk30kNhAAeSX6T/4QZc9cWY79qyTDvg==", 2023-11-08T12:30:50.983 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.983 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:50.984 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:50.984 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:50.984 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.985 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2023-11-08T12:30:50.985 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCEfktlLsnsJRAAFve4QGR18ZZEoiNJHRc/bg==", 2023-11-08T12:30:50.985 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.985 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.986 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:50.986 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.986 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.987 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2023-11-08T12:30:50.987 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCHfktlyiDmNhAAAmDd3WWs+eLtraPczzmkTA==", 2023-11-08T12:30:50.987 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.987 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.987 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:50.988 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.988 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.988 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2023-11-08T12:30:50.989 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCLfktl3wtACRAAjC1v7SBT82SZhX7/gihG2g==", 2023-11-08T12:30:50.989 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.989 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.989 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:50.989 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.990 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2023-11-08T12:30:50.990 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCOfktlD3FjFxAAIjzJfy66ntwKBw7jYTmQEQ==", 2023-11-08T12:30:50.991 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.991 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.991 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:50.991 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.992 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.992 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2023-11-08T12:30:50.992 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCUfktlPUqvKhAApaw64K+eVu+b7K5vRpIrzg==", 2023-11-08T12:30:50.993 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.993 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.993 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:50.993 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.995 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2023-11-08T12:30:50.995 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCYfktlWkjeCxAAwJdasGWtOKqaCqIooSo5+Q==", 2023-11-08T12:30:50.995 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.995 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.996 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:50.996 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.997 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2023-11-08T12:30:50.997 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCbfktlvK3vGRAADNtY8DuzQeaQ+lamxqnpxA==", 2023-11-08T12:30:50.997 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.997 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.997 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:50.997 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:50.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:50.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:50.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:50.998 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2023-11-08T12:30:50.999 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCefktl6KNCKRAAp5984rD5GU3VsLxxZPH9Sg==", 2023-11-08T12:30:50.999 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:50.999 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2023-11-08T12:30:50.999 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2023-11-08T12:30:51.000 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:51.000 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:51.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:51.001 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2023-11-08T12:30:51.001 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlKVzUARAA264fUIQ90p7D7mpBaFS5Iw==", 2023-11-08T12:30:51.001 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:51.002 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:51.002 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2023-11-08T12:30:51.003 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-08T12:30:51.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:51.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:51.004 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2023-11-08T12:30:51.004 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlvItzDhAAOIl7M/iJ+xzhTEWNIef+/A==", 2023-11-08T12:30:51.004 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:51.005 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:51.005 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:30:51.005 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:30:51.005 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:30:51.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:51.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:51.007 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2023-11-08T12:30:51.007 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlg7APCBAA4UD3EeuTRrU2hjW+ozVSnw==", 2023-11-08T12:30:51.007 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:51.008 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:51.008 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:30:51.008 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:30:51.008 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:30:51.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:51.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:51.009 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2023-11-08T12:30:51.010 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCBfktlskN+FBAA7JKk8gz0qAYvbt/9+mvqwg==", 2023-11-08T12:30:51.010 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:51.010 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2023-11-08T12:30:51.010 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2023-11-08T12:30:51.011 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2023-11-08T12:30:51.011 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2023-11-08T12:30:51.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:51.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:51.011 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2023-11-08T12:30:51.012 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB/fktljcX3JxAAlDmA6nydT/tOMoWhfxG67w==", 2023-11-08T12:30:51.012 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:51.012 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:30:51.013 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2023-11-08T12:30:51.013 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2023-11-08T12:30:51.013 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:51.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:51.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:51.014 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2023-11-08T12:30:51.014 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlRLDaDxAAlkslT/w/88ZbnIMNtISKSg==", 2023-11-08T12:30:51.014 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:51.014 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:30:51.015 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-11-08T12:30:51.015 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:51.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:51.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:51.016 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2023-11-08T12:30:51.016 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQCAfktlutF6CRAAjM6KkWuj4y/Fl97qiak9Xw==", 2023-11-08T12:30:51.016 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2023-11-08T12:30:51.016 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2023-11-08T12:30:51.017 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2023-11-08T12:30:51.017 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2023-11-08T12:30:51.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:51.017 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2023-11-08T12:30:51.017 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:30:51.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.973+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7520064ee0 msgr2=0x7f7520067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.973+0000 7f75422d5700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7520064ee0 0x7f7520067390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f75380090b0 tx=0x7f7538008030 comp rx=0 tx=0).stop 2023-11-08T12:30:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.973+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c0c9040 msgr2=0x7f753c0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.973+0000 7f75422d5700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c0c9040 0x7f753c0af2e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f753400cae0 tx=0x7f753400cb10 comp rx=0 tx=0).stop 2023-11-08T12:30:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 shutdown_connections 2023-11-08T12:30:51.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7520064ee0 0x7f7520067390 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f753c0c9040 0x7f753c0af2e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f753c0b43a0 0x7f753c151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 --2- 172.21.15.112:0/1215707421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f753c0b1640 0x7f753c1f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 >> 172.21.15.112:0/1215707421 conn(0x7f753c0b0f80 msgr2=0x7f753c070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:51.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 shutdown_connections 2023-11-08T12:30:51.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:50.977+0000 7f75422d5700 1 -- 172.21.15.112:0/1215707421 wait complete. 2023-11-08T12:30:51.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:51.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.189+0000 7f4f1f9ba700 1 Processor -- start 2023-11-08T12:30:51.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.193+0000 7f4f1f9ba700 1 -- start start 2023-11-08T12:30:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.193+0000 7f4f1f9ba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f181534a0 0x7f4f1815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.193+0000 7f4f1f9ba700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f18160920 0x7f4f180b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1815d080 con 0x7f4f180b6030 2023-11-08T12:30:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f18153870 con 0x7f4f18160920 2023-11-08T12:30:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180b6430 con 0x7f4f181534a0 2023-11-08T12:30:51.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f18160920 0x7f4f180b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f18160920 0x7f4f180b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50504/0 (socket says 172.21.15.112:50504) 2023-11-08T12:30:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 -- 172.21.15.112:0/1985174168 learned_addr learned my addr 172.21.15.112:0/1985174168 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1d756700 1 --2- 172.21.15.112:0/1985174168 >> v2:172.21.15.133:3300/0 conn(0x7f4f181534a0 0x7f4f1815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 -- 172.21.15.112:0/1985174168 >> v2:172.21.15.133:3300/0 conn(0x7f4f181534a0 msgr2=0x7f4f1815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 --2- 172.21.15.112:0/1985174168 >> v2:172.21.15.133:3300/0 conn(0x7f4f181534a0 0x7f4f1815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 -- 172.21.15.112:0/1985174168 >> v1:172.21.15.133:6789/0 conn(0x7f4f180b6030 legacy=0x7f4f18070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 -- 172.21.15.112:0/1985174168 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180b53c0 con 0x7f4f18160920 2023-11-08T12:30:51.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1cf55700 1 --2- 172.21.15.112:0/1985174168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f18160920 0x7f4f180b5af0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806ff60 tx=0x7f4f08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba39dcbcf0b151d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:51.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f0ffff700 1 -- 172.21.15.112:0/1985174168 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011830 con 0x7f4f18160920 2023-11-08T12:30:51.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f0ffff700 1 -- 172.21.15.112:0/1985174168 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08011990 con 0x7f4f18160920 2023-11-08T12:30:51.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f0ffff700 1 -- 172.21.15.112:0/1985174168 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011d20 con 0x7f4f18160920 2023-11-08T12:30:51.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/1985174168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f18160920 msgr2=0x7f4f180b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/1985174168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f18160920 0x7f4f180b5af0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806ff60 tx=0x7f4f08009bf0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/1985174168 shutdown_connections 2023-11-08T12:30:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/1985174168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f18160920 0x7f4f180b5af0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/1985174168 >> v2:172.21.15.133:3300/0 conn(0x7f4f181534a0 0x7f4f1815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.197+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/1985174168 >> 172.21.15.112:0/1985174168 conn(0x7f4f1806bfc0 msgr2=0x7f4f1806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:51.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/1985174168 shutdown_connections 2023-11-08T12:30:51.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/1985174168 wait complete. 2023-11-08T12:30:51.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 Processor -- start 2023-11-08T12:30:51.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 -- start start 2023-11-08T12:30:51.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180b6030 0x7f4f1815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181534a0 0x7f4f1813f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f18160920 0x7f4f1813f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1813fb70 con 0x7f4f180b6030 2023-11-08T12:30:51.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181f65b0 con 0x7f4f181534a0 2023-11-08T12:30:51.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.201+0000 7f4f1f9ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18153c70 con 0x7f4f18160920 2023-11-08T12:30:51.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180b6030 0x7f4f1815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180b6030 0x7f4f1815dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50514/0 (socket says 172.21.15.112:50514) 2023-11-08T12:30:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 -- 172.21.15.112:0/673636374 learned_addr learned my addr 172.21.15.112:0/673636374 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 -- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f18160920 msgr2=0x7f4f1813f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1cf55700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181534a0 0x7f4f1813f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1df57700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f18160920 0x7f4f1813f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f18160920 0x7f4f1813f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 -- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181534a0 msgr2=0x7f4f1813f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181534a0 0x7f4f1813f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 -- 172.21.15.112:0/673636374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08009570 con 0x7f4f180b6030 2023-11-08T12:30:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1df57700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f18160920 0x7f4f1813f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:51.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1cf55700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181534a0 0x7f4f1813f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1d756700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180b6030 0x7f4f1815dff0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400ea00 tx=0x7f4f1400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f0dffb700 1 -- 172.21.15.112:0/673636374 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14009720 con 0x7f4f180b6030 2023-11-08T12:30:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f0dffb700 1 -- 172.21.15.112:0/673636374 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400c850 con 0x7f4f180b6030 2023-11-08T12:30:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f0dffb700 1 -- 172.21.15.112:0/673636374 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400cbc0 con 0x7f4f180b6030 2023-11-08T12:30:51.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1815ca30 con 0x7f4f180b6030 2023-11-08T12:30:51.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180b56a0 con 0x7f4f180b6030 2023-11-08T12:30:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.205+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1815cd10 con 0x7f4f180b6030 2023-11-08T12:30:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.209+0000 7f4f0dffb700 1 -- 172.21.15.112:0/673636374 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4f14019030 con 0x7f4f180b6030 2023-11-08T12:30:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.209+0000 7f4f0dffb700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4efc064ee0 0x7f4efc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.209+0000 7f4f0dffb700 1 -- 172.21.15.112:0/673636374 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4f14081e00 con 0x7f4f180b6030 2023-11-08T12:30:51.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.209+0000 7f4f1cf55700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4efc064ee0 0x7f4efc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.209+0000 7f4f1cf55700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4efc064ee0 0x7f4efc067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4f180b4f90 tx=0x7f4f08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:51.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.213+0000 7f4f0dffb700 1 -- 172.21.15.112:0/673636374 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4f14050040 con 0x7f4f180b6030 2023-11-08T12:30:51.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.389+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f180726c0 con 0x7f4f180b6030 2023-11-08T12:30:51.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f0dffb700 1 -- 172.21.15.112:0/673636374 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+14424 (secure 0 0 0) 0x7f4f14053660 con 0x7f4f180b6030 2023-11-08T12:30:51.394 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:51.395 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":66,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:50.526510+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:51.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4efc064ee0 msgr2=0x7f4efc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4efc064ee0 0x7f4efc067390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4f180b4f90 tx=0x7f4f08008030 comp rx=0 tx=0).stop 2023-11-08T12:30:51.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180b6030 msgr2=0x7f4f1815dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180b6030 0x7f4f1815dff0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400ea00 tx=0x7f4f1400edc0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 shutdown_connections 2023-11-08T12:30:51.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4efc064ee0 0x7f4efc067390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f18160920 0x7f4f1813f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.393+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181534a0 0x7f4f1813f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.397+0000 7f4f1f9ba700 1 --2- 172.21.15.112:0/673636374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f180b6030 0x7f4f1815dff0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.397+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 >> 172.21.15.112:0/673636374 conn(0x7f4f1806bfc0 msgr2=0x7f4f181601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:51.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.397+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 shutdown_connections 2023-11-08T12:30:51.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.397+0000 7f4f1f9ba700 1 -- 172.21.15.112:0/673636374 wait complete. 2023-11-08T12:30:51.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:30:51.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:30:51.609 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.605+0000 7fe02315d700 1 Processor -- start 2023-11-08T12:30:51.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02315d700 1 -- start start 2023-11-08T12:30:51.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02315d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c070620 0x7fe01c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02315d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe01c069bf0 0x7fe01c06a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02315d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c15c520 con 0x7fe01c15c150 2023-11-08T12:30:51.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02315d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c0b4240 con 0x7fe01c069bf0 2023-11-08T12:30:51.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02315d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c06cc50 con 0x7fe01c070620 2023-11-08T12:30:51.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02295c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe01c069bf0 0x7fe01c06a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02215b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe01c15c150 0x7fe01c06ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35244/0 (socket says 172.21.15.112:35244) 2023-11-08T12:30:51.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02215b700 1 -- 172.21.15.112:0/1868364957 learned_addr learned my addr 172.21.15.112:0/1868364957 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:51.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.609+0000 7fe02195a700 1 --2- 172.21.15.112:0/1868364957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c070620 0x7fe01c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02295c700 1 -- 172.21.15.112:0/1868364957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c070620 msgr2=0x7fe01c0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:51.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02295c700 1 --2- 172.21.15.112:0/1868364957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c070620 0x7fe01c0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02295c700 1 -- 172.21.15.112:0/1868364957 >> v1:172.21.15.112:6789/0 conn(0x7fe01c15c150 legacy=0x7fe01c06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02295c700 1 -- 172.21.15.112:0/1868364957 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0d2450 con 0x7fe01c069bf0 2023-11-08T12:30:51.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02295c700 1 --2- 172.21.15.112:0/1868364957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c06a050 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe014009d90 tx=0x7fe01400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e669a31b2903b549 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:51.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe021159700 1 -- 172.21.15.112:0/1868364957 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01400e070 con 0x7fe01c069bf0 2023-11-08T12:30:51.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe021159700 1 -- 172.21.15.112:0/1868364957 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014003a40 con 0x7fe01c069bf0 2023-11-08T12:30:51.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe021159700 1 -- 172.21.15.112:0/1868364957 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014003df0 con 0x7fe01c069bf0 2023-11-08T12:30:51.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 -- 172.21.15.112:0/1868364957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 msgr2=0x7fe01c06a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 --2- 172.21.15.112:0/1868364957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c06a050 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe014009d90 tx=0x7fe01400b330 comp rx=0 tx=0).stop 2023-11-08T12:30:51.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 -- 172.21.15.112:0/1868364957 shutdown_connections 2023-11-08T12:30:51.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 --2- 172.21.15.112:0/1868364957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c06a050 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 --2- 172.21.15.112:0/1868364957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c070620 0x7fe01c0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 -- 172.21.15.112:0/1868364957 >> 172.21.15.112:0/1868364957 conn(0x7fe01c0d3680 msgr2=0x7fe01c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:51.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 -- 172.21.15.112:0/1868364957 shutdown_connections 2023-11-08T12:30:51.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.613+0000 7fe02315d700 1 -- 172.21.15.112:0/1868364957 wait complete. 2023-11-08T12:30:51.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 Processor -- start 2023-11-08T12:30:51.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 -- start start 2023-11-08T12:30:51.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c14b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe01c070620 0x7fe01c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c15c150 0x7fe01c0b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0b6a80 con 0x7fe01c069bf0 2023-11-08T12:30:51.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0cdb30 con 0x7fe01c070620 2023-11-08T12:30:51.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02315d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0b64c0 con 0x7fe01c15c150 2023-11-08T12:30:51.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02215b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c14b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02215b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c14b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50522/0 (socket says 172.21.15.112:50522) 2023-11-08T12:30:51.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02215b700 1 -- 172.21.15.112:0/2196139511 learned_addr learned my addr 172.21.15.112:0/2196139511 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:51.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02195a700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe01c070620 0x7fe01c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.617+0000 7fe02295c700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c15c150 0x7fe01c0b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02215b700 1 -- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c15c150 msgr2=0x7fe01c0b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02215b700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c15c150 0x7fe01c0b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02215b700 1 -- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe01c070620 msgr2=0x7fe01c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02215b700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe01c070620 0x7fe01c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02215b700 1 -- 172.21.15.112:0/2196139511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014009a70 con 0x7fe01c069bf0 2023-11-08T12:30:51.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02215b700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c14b5b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe01800c780 tx=0x7fe01800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:51.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe012ffd700 1 -- 172.21.15.112:0/2196139511 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018004ca0 con 0x7fe01c069bf0 2023-11-08T12:30:51.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe012ffd700 1 -- 172.21.15.112:0/2196139511 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe018004e00 con 0x7fe01c069bf0 2023-11-08T12:30:51.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe012ffd700 1 -- 172.21.15.112:0/2196139511 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180072f0 con 0x7fe01c069bf0 2023-11-08T12:30:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c0d05e0 con 0x7fe01c069bf0 2023-11-08T12:30:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c0d2730 con 0x7fe01c069bf0 2023-11-08T12:30:51.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.621+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c0d2140 con 0x7fe01c069bf0 2023-11-08T12:30:51.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.625+0000 7fe012ffd700 1 -- 172.21.15.112:0/2196139511 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe01801a020 con 0x7fe01c069bf0 2023-11-08T12:30:51.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.625+0000 7fe012ffd700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe000064f10 0x7fe0000673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:51.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.625+0000 7fe012ffd700 1 -- 172.21.15.112:0/2196139511 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe018081890 con 0x7fe01c069bf0 2023-11-08T12:30:51.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.625+0000 7fe02195a700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe000064f10 0x7fe0000673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:51.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.629+0000 7fe02195a700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe000064f10 0x7fe0000673c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0b6d30 tx=0x7fe00c0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:51.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.633+0000 7fe012ffd700 1 -- 172.21.15.112:0/2196139511 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe01804faf0 con 0x7fe01c069bf0 2023-11-08T12:30:51.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.805+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe01c073d20 con 0x7fe01c069bf0 2023-11-08T12:30:51.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.805+0000 7fe012ffd700 1 -- 172.21.15.112:0/2196139511 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe018053110 con 0x7fe01c069bf0 2023-11-08T12:30:51.809 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:30:51.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe000064f10 msgr2=0x7fe0000673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe000064f10 0x7fe0000673c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0b6d30 tx=0x7fe00c0091c0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 msgr2=0x7fe01c14b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:51.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c14b5b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe01800c780 tx=0x7fe01800ca90 comp rx=0 tx=0).stop 2023-11-08T12:30:51.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 shutdown_connections 2023-11-08T12:30:51.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe000064f10 0x7fe0000673c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe01c15c150 0x7fe01c0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe01c070620 0x7fe01c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 --2- 172.21.15.112:0/2196139511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe01c069bf0 0x7fe01c14b5b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:51.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 >> 172.21.15.112:0/2196139511 conn(0x7fe01c0d3680 msgr2=0x7fe01c1559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:51.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 shutdown_connections 2023-11-08T12:30:51.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:51.809+0000 7fe02315d700 1 -- 172.21.15.112:0/2196139511 wait complete. 2023-11-08T12:30:51.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:30:52.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.057+0000 7fce29eee700 1 Processor -- start 2023-11-08T12:30:52.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.057+0000 7fce29eee700 1 -- start start 2023-11-08T12:30:52.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce29eee700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce24070a00 0x7fce24069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce29eee700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce240b2130 0x7fce2406a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce29eee700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce240cd360 con 0x7fce2415c700 2023-11-08T12:30:52.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce29eee700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce24160190 con 0x7fce240b2130 2023-11-08T12:30:52.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce29eee700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce24160470 con 0x7fce24070a00 2023-11-08T12:30:52.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce240b2130 0x7fce2406a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce22ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce24070a00 0x7fce24069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce240b2130 0x7fce2406a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50536/0 (socket says 172.21.15.112:50536) 2023-11-08T12:30:52.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 -- 172.21.15.112:0/1680249306 learned_addr learned my addr 172.21.15.112:0/1680249306 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:52.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 -- 172.21.15.112:0/1680249306 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce24070a00 msgr2=0x7fce24069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:52.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 --2- 172.21.15.112:0/1680249306 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce24070a00 0x7fce24069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 -- 172.21.15.112:0/1680249306 >> v1:172.21.15.133:6789/0 conn(0x7fce2415c700 legacy=0x7fce240702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 -- 172.21.15.112:0/1680249306 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24160750 con 0x7fce240b2130 2023-11-08T12:30:52.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.061+0000 7fce23fff700 1 --2- 172.21.15.112:0/1680249306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce240b2130 0x7fce2406a130 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009e50 tx=0x7fce1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb874b7c70c05ba1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce227fc700 1 -- 172.21.15.112:0/1680249306 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00e070 con 0x7fce240b2130 2023-11-08T12:30:52.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce227fc700 1 -- 172.21.15.112:0/1680249306 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c00b910 con 0x7fce240b2130 2023-11-08T12:30:52.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce227fc700 1 -- 172.21.15.112:0/1680249306 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00bcc0 con 0x7fce240b2130 2023-11-08T12:30:52.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 -- 172.21.15.112:0/1680249306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce240b2130 msgr2=0x7fce2406a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 --2- 172.21.15.112:0/1680249306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce240b2130 0x7fce2406a130 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009e50 tx=0x7fce1c00b330 comp rx=0 tx=0).stop 2023-11-08T12:30:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 -- 172.21.15.112:0/1680249306 shutdown_connections 2023-11-08T12:30:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 --2- 172.21.15.112:0/1680249306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce240b2130 0x7fce2406a130 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 --2- 172.21.15.112:0/1680249306 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce24070a00 0x7fce24069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 -- 172.21.15.112:0/1680249306 >> 172.21.15.112:0/1680249306 conn(0x7fce240d2d10 msgr2=0x7fce240d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 -- 172.21.15.112:0/1680249306 shutdown_connections 2023-11-08T12:30:52.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.065+0000 7fce29eee700 1 -- 172.21.15.112:0/1680249306 wait complete. 2023-11-08T12:30:52.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.069+0000 7fce29eee700 1 Processor -- start 2023-11-08T12:30:52.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.069+0000 7fce29eee700 1 -- start start 2023-11-08T12:30:52.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce24070a00 0x7fce2415ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce240b2130 0x7fce240b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2415c700 0x7fce240b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce240b7a90 con 0x7fce2415c700 2023-11-08T12:30:52.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2415cad0 con 0x7fce24070a00 2023-11-08T12:30:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2415d090 con 0x7fce240b2130 2023-11-08T12:30:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2415c700 0x7fce240b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2415c700 0x7fce240b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50548/0 (socket says 172.21.15.112:50548) 2023-11-08T12:30:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 -- 172.21.15.112:0/3687015390 learned_addr learned my addr 172.21.15.112:0/3687015390 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:52.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce22ffd700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce240b2130 0x7fce240b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce237fe700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce24070a00 0x7fce2415ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 -- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce240b2130 msgr2=0x7fce240b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce240b2130 0x7fce240b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 -- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce24070a00 msgr2=0x7fce2415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce24070a00 0x7fce2415ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 -- 172.21.15.112:0/3687015390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c009b30 con 0x7fce2415c700 2023-11-08T12:30:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce23fff700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2415c700 0x7fce240b6080 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00b680 tx=0x7fce1c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce0bfff700 1 -- 172.21.15.112:0/3687015390 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c004830 con 0x7fce2415c700 2023-11-08T12:30:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce0bfff700 1 -- 172.21.15.112:0/3687015390 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c0099b0 con 0x7fce2415c700 2023-11-08T12:30:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce0bfff700 1 -- 172.21.15.112:0/3687015390 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c004990 con 0x7fce2415c700 2023-11-08T12:30:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2406b530 con 0x7fce2415c700 2023-11-08T12:30:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.073+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce24160a30 con 0x7fce2415c700 2023-11-08T12:30:52.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.077+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce240b1be0 con 0x7fce2415c700 2023-11-08T12:30:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.077+0000 7fce0bfff700 1 -- 172.21.15.112:0/3687015390 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fce1c02c070 con 0x7fce2415c700 2023-11-08T12:30:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.081+0000 7fce0bfff700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce10064ee0 0x7fce10067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.081+0000 7fce0bfff700 1 -- 172.21.15.112:0/3687015390 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fce1c0837a0 con 0x7fce2415c700 2023-11-08T12:30:52.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.081+0000 7fce237fe700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce10064ee0 0x7fce10067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.081+0000 7fce237fe700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce10064ee0 0x7fce10067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fce14000f60 tx=0x7fce14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.085+0000 7fce0bfff700 1 -- 172.21.15.112:0/3687015390 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fce1c051a60 con 0x7fce2415c700 2023-11-08T12:30:52.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.261+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce2415d200 con 0x7fce2415c700 2023-11-08T12:30:52.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.261+0000 7fce0bfff700 1 -- 172.21.15.112:0/3687015390 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce1c055080 con 0x7fce2415c700 2023-11-08T12:30:52.264 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:30:52.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce10064ee0 msgr2=0x7fce10067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce10064ee0 0x7fce10067390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fce14000f60 tx=0x7fce14009040 comp rx=0 tx=0).stop 2023-11-08T12:30:52.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2415c700 msgr2=0x7fce240b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2415c700 0x7fce240b6080 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00b680 tx=0x7fce1c004af0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 shutdown_connections 2023-11-08T12:30:52.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fce10064ee0 0x7fce10067390 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce2415c700 0x7fce240b6080 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce240b2130 0x7fce240b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 --2- 172.21.15.112:0/3687015390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce24070a00 0x7fce2415ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 >> 172.21.15.112:0/3687015390 conn(0x7fce240d2d10 msgr2=0x7fce240cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:52.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 shutdown_connections 2023-11-08T12:30:52.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.265+0000 7fce29eee700 1 -- 172.21.15.112:0/3687015390 wait complete. 2023-11-08T12:30:52.293 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-08T12:30:52.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.461+0000 7f37a8d97700 1 Processor -- start 2023-11-08T12:30:52.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.461+0000 7f37a8d97700 1 -- start start 2023-11-08T12:30:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a8d97700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a4070790 0x7f37a4164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a8d97700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a415a550 con 0x7f37a40b43a0 2023-11-08T12:30:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a8d97700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a406b0a0 con 0x7f37a40b1640 2023-11-08T12:30:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a8d97700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40caac0 con 0x7f37a4070790 2023-11-08T12:30:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a37fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f37a40b43a0 0x7f37a415e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35250/0 (socket says 172.21.15.112:35250) 2023-11-08T12:30:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a37fe700 1 -- 172.21.15.112:0/3888206638 learned_addr learned my addr 172.21.15.112:0/3888206638 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:52.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a3fff700 1 --2- 172.21.15.112:0/3888206638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a4070790 0x7f37a4164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955743497 0 0) 0x7f3794001490 con 0x7f37a40b43a0 2023-11-08T12:30:52.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37900035d0 con 0x7f37a40b43a0 2023-11-08T12:30:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765458319 0 0) 0x7f37a406b0a0 con 0x7f37a40b1640 2023-11-08T12:30:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3794001490 con 0x7f37a40b1640 2023-11-08T12:30:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a3fff700 1 -- 172.21.15.112:0/3888206638 >> v1:172.21.15.133:6789/0 conn(0x7f37a40b1640 legacy=0x7f37a4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a3fff700 1 -- 172.21.15.112:0/3888206638 >> v1:172.21.15.112:6789/0 conn(0x7f37a40b43a0 legacy=0x7f37a415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790913424 0 0) 0x7f37900035d0 con 0x7f37a40b43a0 2023-11-08T12:30:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a3fff700 1 -- 172.21.15.112:0/3888206638 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40cada0 con 0x7f37a4070790 2023-11-08T12:30:52.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.465+0000 7f37a3fff700 1 --2- 172.21.15.112:0/3888206638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a4070790 0x7f37a4164fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f379c009880 tx=0x7f379c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dfc7347f9f8e3e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794001b80 con 0x7f37a4070790 2023-11-08T12:30:52.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c004030 con 0x7f37a4070790 2023-11-08T12:30:52.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a2ffd700 1 -- 172.21.15.112:0/3888206638 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c0043c0 con 0x7f37a4070790 2023-11-08T12:30:52.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 -- 172.21.15.112:0/3888206638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a4070790 msgr2=0x7f37a4164fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 --2- 172.21.15.112:0/3888206638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a4070790 0x7f37a4164fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f379c009880 tx=0x7f379c009b90 comp rx=0 tx=0).stop 2023-11-08T12:30:52.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 -- 172.21.15.112:0/3888206638 shutdown_connections 2023-11-08T12:30:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 --2- 172.21.15.112:0/3888206638 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a4070790 0x7f37a4164fa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 -- 172.21.15.112:0/3888206638 >> 172.21.15.112:0/3888206638 conn(0x7f37a40b0f80 msgr2=0x7f37a40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 -- 172.21.15.112:0/3888206638 shutdown_connections 2023-11-08T12:30:52.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 -- 172.21.15.112:0/3888206638 wait complete. 2023-11-08T12:30:52.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.469+0000 7f37a8d97700 1 Processor -- start 2023-11-08T12:30:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 -- start start 2023-11-08T12:30:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a4070790 0x7f37a40c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37a40b1640 0x7f37a41f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a40b43a0 0x7f37a40c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a415c580 con 0x7f37a4070790 2023-11-08T12:30:52.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a41f3970 con 0x7f37a40b1640 2023-11-08T12:30:52.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40c50d0 con 0x7f37a40b43a0 2023-11-08T12:30:52.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a4070790 0x7f37a40c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a4070790 0x7f37a40c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50552/0 (socket says 172.21.15.112:50552) 2023-11-08T12:30:52.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 -- 172.21.15.112:0/2881188934 learned_addr learned my addr 172.21.15.112:0/2881188934 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a3fff700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a40b43a0 0x7f37a40c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f379affd700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37a40b1640 0x7f37a41f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 -- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a40b43a0 msgr2=0x7f37a40c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a40b43a0 0x7f37a40c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 -- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37a40b1640 msgr2=0x7f37a41f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37a40b1640 0x7f37a41f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 -- 172.21.15.112:0/2881188934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0094b0 con 0x7f37a4070790 2023-11-08T12:30:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f379affd700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37a40b1640 0x7f37a41f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:30:52.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a37fe700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a4070790 0x7f37a40c2340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3794001c20 tx=0x7f379400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a0ff9700 1 -- 172.21.15.112:0/2881188934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940070d0 con 0x7f37a4070790 2023-11-08T12:30:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a0ff9700 1 -- 172.21.15.112:0/2881188934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794007230 con 0x7f37a4070790 2023-11-08T12:30:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a406b5d0 con 0x7f37a4070790 2023-11-08T12:30:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a0ff9700 1 -- 172.21.15.112:0/2881188934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940075e0 con 0x7f37a4070790 2023-11-08T12:30:52.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.473+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a406b2f0 con 0x7f37a4070790 2023-11-08T12:30:52.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.477+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a415c2f0 con 0x7f37a4070790 2023-11-08T12:30:52.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.477+0000 7f37a0ff9700 1 -- 172.21.15.112:0/2881188934 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3794010070 con 0x7f37a4070790 2023-11-08T12:30:52.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.477+0000 7f37a0ff9700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3784064ee0 0x7f3784067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.481+0000 7f37a0ff9700 1 -- 172.21.15.112:0/2881188934 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3794081a90 con 0x7f37a4070790 2023-11-08T12:30:52.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.481+0000 7f379affd700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3784064ee0 0x7f3784067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.481+0000 7f379affd700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3784064ee0 0x7f3784067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f37a4159b00 tx=0x7f378c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.481+0000 7f37a0ff9700 1 -- 172.21.15.112:0/2881188934 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f379404fc70 con 0x7f37a4070790 2023-11-08T12:30:52.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.657+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f37a40ca7b0 con 0x7f37a4070790 2023-11-08T12:30:52.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.657+0000 7f37a0ff9700 1 -- 172.21.15.112:0/2881188934 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3794018020 con 0x7f37a4070790 2023-11-08T12:30:52.659 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:52.659 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-11-08T12:30:52.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:52.660 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2023-11-08T12:30:52.660 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2023-11-08T12:30:52.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:30:52.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:30:52.661 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 2, 2023-11-08T12:30:52.661 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": "rbd" 2023-11-08T12:30:52.661 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:30:52.661 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-11-08T12:30:52.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3784064ee0 msgr2=0x7f3784067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3784064ee0 0x7f3784067390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f37a4159b00 tx=0x7f378c009040 comp rx=0 tx=0).stop 2023-11-08T12:30:52.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a4070790 msgr2=0x7f37a40c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a4070790 0x7f37a40c2340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3794001c20 tx=0x7f379400a3f0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 shutdown_connections 2023-11-08T12:30:52.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3784064ee0 0x7f3784067390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37a40b43a0 0x7f37a40c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37a40b1640 0x7f37a41f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 --2- 172.21.15.112:0/2881188934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a4070790 0x7f37a40c2340 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 >> 172.21.15.112:0/2881188934 conn(0x7f37a40b0f80 msgr2=0x7f37a4070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:52.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 shutdown_connections 2023-11-08T12:30:52.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.661+0000 7f37a8d97700 1 -- 172.21.15.112:0/2881188934 wait complete. 2023-11-08T12:30:52.681 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-08T12:30:52.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-08T12:30:52.864 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.861+0000 7ff67de98700 1 Processor -- start 2023-11-08T12:30:52.865 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.861+0000 7ff67de98700 1 -- start start 2023-11-08T12:30:52.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67de98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678069e00 0x7ff67806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67de98700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff67806c630 0x7ff67806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67de98700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67806a790 con 0x7ff67815c6e0 2023-11-08T12:30:52.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67de98700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6780d2800 con 0x7ff67806c630 2023-11-08T12:30:52.867 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67de98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67815cab0 con 0x7ff678069e00 2023-11-08T12:30:52.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67ce96700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff67815c6e0 0x7ff678071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35264/0 (socket says 172.21.15.112:35264) 2023-11-08T12:30:52.868 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67ce96700 1 -- 172.21.15.112:0/2722761042 learned_addr learned my addr 172.21.15.112:0/2722761042 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:52.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67d697700 1 --2- 172.21.15.112:0/2722761042 >> v2:172.21.15.133:3300/0 conn(0x7ff67806c630 0x7ff67806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff677fff700 1 --2- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678069e00 0x7ff67806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff6777fe700 1 -- 172.21.15.112:0/2722761042 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955615360 0 0) 0x7ff66c001110 con 0x7ff67815c6e0 2023-11-08T12:30:52.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff6777fe700 1 -- 172.21.15.112:0/2722761042 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6680035d0 con 0x7ff67815c6e0 2023-11-08T12:30:52.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67d697700 1 -- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678069e00 msgr2=0x7ff67806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:52.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67d697700 1 --2- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678069e00 0x7ff67806a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67d697700 1 -- 172.21.15.112:0/2722761042 >> v1:172.21.15.112:6789/0 conn(0x7ff67815c6e0 legacy=0x7ff678071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67d697700 1 -- 172.21.15.112:0/2722761042 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780702d0 con 0x7ff67806c630 2023-11-08T12:30:52.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff67d697700 1 --2- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 0x7ff67806ca80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff670009d90 tx=0x7ff67000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a862f64d52d1c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff6777fe700 1 -- 172.21.15.112:0/2722761042 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000e070 con 0x7ff67806c630 2023-11-08T12:30:52.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff6777fe700 1 -- 172.21.15.112:0/2722761042 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67000bb20 con 0x7ff67806c630 2023-11-08T12:30:52.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.865+0000 7ff6777fe700 1 -- 172.21.15.112:0/2722761042 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670012430 con 0x7ff67806c630 2023-11-08T12:30:52.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 -- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 msgr2=0x7ff67806ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 --2- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 0x7ff67806ca80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff670009d90 tx=0x7ff67000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:52.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 -- 172.21.15.112:0/2722761042 shutdown_connections 2023-11-08T12:30:52.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 --2- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 0x7ff67806ca80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 --2- 172.21.15.112:0/2722761042 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678069e00 0x7ff67806a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 -- 172.21.15.112:0/2722761042 >> 172.21.15.112:0/2722761042 conn(0x7ff6780b65b0 msgr2=0x7ff678071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:52.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 -- 172.21.15.112:0/2722761042 shutdown_connections 2023-11-08T12:30:52.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.869+0000 7ff67de98700 1 -- 172.21.15.112:0/2722761042 wait complete. 2023-11-08T12:30:52.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 Processor -- start 2023-11-08T12:30:52.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 -- start start 2023-11-08T12:30:52.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678069e00 0x7ff67809bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 0x7ff6780b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815c6e0 0x7ff6780b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780b2960 con 0x7ff678069e00 2023-11-08T12:30:52.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780b2390 con 0x7ff67806c630 2023-11-08T12:30:52.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67de98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67806a250 con 0x7ff67815c6e0 2023-11-08T12:30:52.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678069e00 0x7ff67809bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678069e00 0x7ff67809bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50562/0 (socket says 172.21.15.112:50562) 2023-11-08T12:30:52.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 -- 172.21.15.112:0/3751983714 learned_addr learned my addr 172.21.15.112:0/3751983714 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:52.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67d697700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815c6e0 0x7ff6780b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff677fff700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 0x7ff6780b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 -- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815c6e0 msgr2=0x7ff6780b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815c6e0 0x7ff6780b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 -- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 msgr2=0x7ff6780b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:52.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 0x7ff6780b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:52.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.873+0000 7ff67ce96700 1 -- 172.21.15.112:0/3751983714 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670009a70 con 0x7ff678069e00 2023-11-08T12:30:52.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.877+0000 7ff67ce96700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678069e00 0x7ff67809bc10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff66c001270 tx=0x7ff66c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.877+0000 7ff6757fa700 1 -- 172.21.15.112:0/3751983714 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c005d90 con 0x7ff678069e00 2023-11-08T12:30:52.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.877+0000 7ff6757fa700 1 -- 172.21.15.112:0/3751983714 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c0070d0 con 0x7ff678069e00 2023-11-08T12:30:52.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.877+0000 7ff6757fa700 1 -- 172.21.15.112:0/3751983714 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c007480 con 0x7ff678069e00 2023-11-08T12:30:52.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.877+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6780d2cf0 con 0x7ff678069e00 2023-11-08T12:30:52.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.877+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6780d2a10 con 0x7ff678069e00 2023-11-08T12:30:52.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.877+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6780d2fd0 con 0x7ff678069e00 2023-11-08T12:30:52.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.881+0000 7ff6757fa700 1 -- 172.21.15.112:0/3751983714 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff66c019030 con 0x7ff678069e00 2023-11-08T12:30:52.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.881+0000 7ff6757fa700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff65c064f30 0x7ff65c0673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:52.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.881+0000 7ff6757fa700 1 -- 172.21.15.112:0/3751983714 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff66c080e70 con 0x7ff678069e00 2023-11-08T12:30:52.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.881+0000 7ff677fff700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff65c064f30 0x7ff65c0673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:52.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.881+0000 7ff677fff700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff65c064f30 0x7ff65c0673e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff678071e00 tx=0x7ff664009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:52.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:52.889+0000 7ff6757fa700 1 -- 172.21.15.112:0/3751983714 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff66c04f1b0 con 0x7ff678069e00 2023-11-08T12:30:53.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.061+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff678073cb0 con 0x7ff678069e00 2023-11-08T12:30:53.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.805+0000 7ff6757fa700 1 -- 172.21.15.112:0/3751983714 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff66c0527d0 con 0x7ff678069e00 2023-11-08T12:30:53.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff65c064f30 msgr2=0x7ff65c0673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff65c064f30 0x7ff65c0673e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff678071e00 tx=0x7ff664009240 comp rx=0 tx=0).stop 2023-11-08T12:30:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678069e00 msgr2=0x7ff67809bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678069e00 0x7ff67809bc10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff66c001270 tx=0x7ff66c00c7d0 comp rx=0 tx=0).stop 2023-11-08T12:30:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 shutdown_connections 2023-11-08T12:30:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff65c064f30 0x7ff65c0673e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815c6e0 0x7ff6780b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff67806c630 0x7ff6780b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 --2- 172.21.15.112:0/3751983714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff678069e00 0x7ff67809bc10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 >> 172.21.15.112:0/3751983714 conn(0x7ff6780b65b0 msgr2=0x7ff6780c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 shutdown_connections 2023-11-08T12:30:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:53.809+0000 7ff67de98700 1 -- 172.21.15.112:0/3751983714 wait complete. 2023-11-08T12:30:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2023-11-08T12:30:53.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-08T12:30:54.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599f59e700 1 Processor -- start 2023-11-08T12:30:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599f59e700 1 -- start start 2023-11-08T12:30:54.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59a015c650 0x7f59a00cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599f59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a00d0b80 con 0x7f59a015c280 2023-11-08T12:30:54.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a00d2680 con 0x7f59a0071630 2023-11-08T12:30:54.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a00d2960 con 0x7f59a015c650 2023-11-08T12:30:54.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599e59c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f59a015c280 0x7f59a006a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35280/0 (socket says 172.21.15.112:35280) 2023-11-08T12:30:54.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599e59c700 1 -- 172.21.15.112:0/2137480780 learned_addr learned my addr 172.21.15.112:0/2137480780 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:54.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.013+0000 7f599dd9b700 1 --2- 172.21.15.112:0/2137480780 >> v2:172.21.15.133:3300/0 conn(0x7f59a015c650 0x7f59a00cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346139275 0 0) 0x7f59a00d0b80 con 0x7f59a015c280 2023-11-08T12:30:54.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59880035d0 con 0x7f59a015c280 2023-11-08T12:30:54.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1097972988 0 0) 0x7f59880035d0 con 0x7f59a015c280 2023-11-08T12:30:54.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 >> v2:172.21.15.133:3300/0 conn(0x7f59a015c650 msgr2=0x7f59a00cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:54.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 --2- 172.21.15.112:0/2137480780 >> v2:172.21.15.133:3300/0 conn(0x7f59a015c650 0x7f59a00cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 >> v1:172.21.15.133:6789/0 conn(0x7f59a0071630 legacy=0x7f59a015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:54.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00d0810 con 0x7f59a015c280 2023-11-08T12:30:54.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f5990001670 con 0x7f59a015c280 2023-11-08T12:30:54.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 >> v1:172.21.15.112:6789/0 conn(0x7f59a015c280 legacy=0x7f59a006a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:54.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a20 0x7f5988003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5988004870 0x7f5988004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988005220 0x7f598800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00d2960 con 0x7f5988004870 2023-11-08T12:30:54.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598800c1b0 con 0x7f5988005220 2023-11-08T12:30:54.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598800c370 con 0x7f5988003a20 2023-11-08T12:30:54.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599dd9b700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5988004870 0x7f5988004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599e59c700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a20 0x7f5988003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599ed9d700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988005220 0x7f598800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599dd9b700 1 -- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a20 msgr2=0x7f5988003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:54.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599dd9b700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988003a20 0x7f5988003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599dd9b700 1 -- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988005220 msgr2=0x7f598800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:54.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599dd9b700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988005220 0x7f598800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599dd9b700 1 -- 172.21.15.112:0/2137480780 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59880035d0 con 0x7f5988004870 2023-11-08T12:30:54.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599ed9d700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5988005220 0x7f598800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:54.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599ed9d700 1 -- 172.21.15.112:0/2137480780 reap_dead start 2023-11-08T12:30:54.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599dd9b700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5988004870 0x7f5988004ce0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f59a015ca20 tx=0x7f59880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8e7156052e2094 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:54.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400e6c0 con 0x7f5988004870 2023-11-08T12:30:54.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400e820 con 0x7f5988004870 2023-11-08T12:30:54.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.017+0000 7f599d59a700 1 -- 172.21.15.112:0/2137480780 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400ebb0 con 0x7f5988004870 2023-11-08T12:30:54.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.021+0000 7f599f59e700 1 -- 172.21.15.112:0/2137480780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5988004870 msgr2=0x7f5988004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:54.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.021+0000 7f599f59e700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5988004870 0x7f5988004ce0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f59a015ca20 tx=0x7f59880058a0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.021+0000 7f599f59e700 1 -- 172.21.15.112:0/2137480780 shutdown_connections 2023-11-08T12:30:54.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.021+0000 7f599f59e700 1 --2- 172.21.15.112:0/2137480780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5988004870 0x7f5988004ce0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.021+0000 7f599f59e700 1 -- 172.21.15.112:0/2137480780 >> 172.21.15.112:0/2137480780 conn(0x7f59a00b53e0 msgr2=0x7f59a006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:54.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.021+0000 7f599f59e700 1 -- 172.21.15.112:0/2137480780 shutdown_connections 2023-11-08T12:30:54.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.021+0000 7f599f59e700 1 -- 172.21.15.112:0/2137480780 wait complete. 2023-11-08T12:30:54.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 Processor -- start 2023-11-08T12:30:54.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 -- start start 2023-11-08T12:30:54.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988004870 0x7f59a0152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a01f12b0 0x7f59a01f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59a01f1700 0x7f59a01f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01564b0 con 0x7f59a01f1700 2023-11-08T12:30:54.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a01525d0 con 0x7f59a01f12b0 2023-11-08T12:30:54.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0156180 con 0x7f5988004870 2023-11-08T12:30:54.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59a01f1700 0x7f59a01f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59a01f1700 0x7f59a01f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50588/0 (socket says 172.21.15.112:50588) 2023-11-08T12:30:54.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 -- 172.21.15.112:0/4131670496 learned_addr learned my addr 172.21.15.112:0/4131670496 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:54.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599e59c700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988004870 0x7f59a0152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599dd9b700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a01f12b0 0x7f59a01f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 -- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988004870 msgr2=0x7f59a0152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:54.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988004870 0x7f59a0152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 -- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a01f12b0 msgr2=0x7f59a01f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:54.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a01f12b0 0x7f59a01f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 -- 172.21.15.112:0/4131670496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00d2450 con 0x7f59a01f1700 2023-11-08T12:30:54.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f599ed9d700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59a01f1700 0x7f59a01f5580 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f59a006ca90 tx=0x7f599800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:54.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f598effd700 1 -- 172.21.15.112:0/4131670496 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998003c30 con 0x7f59a01f1700 2023-11-08T12:30:54.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.025+0000 7f598effd700 1 -- 172.21.15.112:0/4131670496 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5998003d90 con 0x7f59a01f1700 2023-11-08T12:30:54.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.029+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a00d22c0 con 0x7f59a01f1700 2023-11-08T12:30:54.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.029+0000 7f598effd700 1 -- 172.21.15.112:0/4131670496 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59980052f0 con 0x7f59a01f1700 2023-11-08T12:30:54.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.029+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a00b20a0 con 0x7f59a01f1700 2023-11-08T12:30:54.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.029+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a0073cb0 con 0x7f59a01f1700 2023-11-08T12:30:54.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.029+0000 7f598effd700 1 -- 172.21.15.112:0/4131670496 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5998005450 con 0x7f59a01f1700 2023-11-08T12:30:54.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.033+0000 7f598effd700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5980064ee0 0x7f5980067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:54.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.033+0000 7f598effd700 1 -- 172.21.15.112:0/4131670496 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f5998082090 con 0x7f59a01f1700 2023-11-08T12:30:54.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.033+0000 7f599e59c700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5980064ee0 0x7f5980067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:54.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.033+0000 7f599e59c700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5980064ee0 0x7f5980067390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5990000c00 tx=0x7f5990001000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:54.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.041+0000 7f598effd700 1 -- 172.21.15.112:0/4131670496 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f59980502d0 con 0x7f59a01f1700 2023-11-08T12:30:54.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.217+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f59a006cac0 con 0x7f59a01f1700 2023-11-08T12:30:54.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.817+0000 7f598effd700 1 -- 172.21.15.112:0/4131670496 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) v1 ==== 170+0+0 (secure 0 0 0) 0x7f59980538f0 con 0x7f59a01f1700 2023-11-08T12:30:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.825+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5980064ee0 msgr2=0x7f5980067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.825+0000 7f599f59e700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5980064ee0 0x7f5980067390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5990000c00 tx=0x7f5990001000 comp rx=0 tx=0).stop 2023-11-08T12:30:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.825+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59a01f1700 msgr2=0x7f59a01f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:54.827 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.825+0000 7f599f59e700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59a01f1700 0x7f59a01f5580 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f59a006ca90 tx=0x7f599800ef00 comp rx=0 tx=0).stop 2023-11-08T12:30:54.831 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.829+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 shutdown_connections 2023-11-08T12:30:54.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.829+0000 7f599f59e700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5980064ee0 0x7f5980067390 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.829+0000 7f599f59e700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59a01f1700 0x7f59a01f5580 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.829+0000 7f599f59e700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59a01f12b0 0x7f59a01f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.829+0000 7f599f59e700 1 --2- 172.21.15.112:0/4131670496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5988004870 0x7f59a0152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:54.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.829+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 >> 172.21.15.112:0/4131670496 conn(0x7f59a00b53e0 msgr2=0x7f59a015ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:54.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.833+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 shutdown_connections 2023-11-08T12:30:54.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:54.837+0000 7f599f59e700 1 -- 172.21.15.112:0/4131670496 wait complete. 2023-11-08T12:30:54.844 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2023-11-08T12:30:54.866 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-08T12:30:55.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.045+0000 7fb9a359e700 1 Processor -- start 2023-11-08T12:30:55.049 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.045+0000 7fb9a359e700 1 -- start start 2023-11-08T12:30:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.049+0000 7fb9a359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9a415c150 0x7fb9a40b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.049+0000 7fb9a359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a406ff10 0x7fb9a4070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.049+0000 7fb9a359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a415c520 con 0x7fb9a415fc30 2023-11-08T12:30:55.053 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.049+0000 7fb9a359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a40b4240 con 0x7fb9a415c150 2023-11-08T12:30:55.054 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.049+0000 7fb9a359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40708a0 con 0x7fb9a406ff10 2023-11-08T12:30:55.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.049+0000 7fb9a2d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb9a415fc30 0x7fb9a41600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:35282/0 (socket says 172.21.15.112:35282) 2023-11-08T12:30:55.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.049+0000 7fb9a2d9d700 1 -- 172.21.15.112:0/3226205877 learned_addr learned my addr 172.21.15.112:0/3226205877 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:55.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a259c700 1 --2- 172.21.15.112:0/3226205877 >> v2:172.21.15.133:3300/0 conn(0x7fb9a415c150 0x7fb9a40b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a1d9b700 1 --2- 172.21.15.112:0/3226205877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a406ff10 0x7fb9a4070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a159a700 1 -- 172.21.15.112:0/3226205877 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060708692 0 0) 0x7fb9a415c520 con 0x7fb9a415fc30 2023-11-08T12:30:55.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a159a700 1 -- 172.21.15.112:0/3226205877 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb98c0035d0 con 0x7fb9a415fc30 2023-11-08T12:30:55.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a1d9b700 1 -- 172.21.15.112:0/3226205877 >> v2:172.21.15.133:3300/0 conn(0x7fb9a415c150 msgr2=0x7fb9a40b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:55.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a1d9b700 1 --2- 172.21.15.112:0/3226205877 >> v2:172.21.15.133:3300/0 conn(0x7fb9a415c150 0x7fb9a40b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a1d9b700 1 -- 172.21.15.112:0/3226205877 >> v1:172.21.15.112:6789/0 conn(0x7fb9a415fc30 legacy=0x7fb9a41600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a1d9b700 1 -- 172.21.15.112:0/3226205877 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a406ac00 con 0x7fb9a406ff10 2023-11-08T12:30:55.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a1d9b700 1 --2- 172.21.15.112:0/3226205877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a406ff10 0x7fb9a4070360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb998009840 tx=0x7fb998009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=983ff59e3d2f8308 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a159a700 1 -- 172.21.15.112:0/3226205877 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998005e50 con 0x7fb9a406ff10 2023-11-08T12:30:55.058 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a159a700 1 -- 172.21.15.112:0/3226205877 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998006030 con 0x7fb9a406ff10 2023-11-08T12:30:55.059 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a159a700 1 -- 172.21.15.112:0/3226205877 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980063c0 con 0x7fb9a406ff10 2023-11-08T12:30:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 -- 172.21.15.112:0/3226205877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a406ff10 msgr2=0x7fb9a4070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3226205877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a406ff10 0x7fb9a4070360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb998009840 tx=0x7fb998009b50 comp rx=0 tx=0).stop 2023-11-08T12:30:55.060 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 -- 172.21.15.112:0/3226205877 shutdown_connections 2023-11-08T12:30:55.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3226205877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a406ff10 0x7fb9a4070360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3226205877 >> v2:172.21.15.133:3300/0 conn(0x7fb9a415c150 0x7fb9a40b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 -- 172.21.15.112:0/3226205877 >> 172.21.15.112:0/3226205877 conn(0x7fb9a40d3680 msgr2=0x7fb9a40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:55.061 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 -- 172.21.15.112:0/3226205877 shutdown_connections 2023-11-08T12:30:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.053+0000 7fb9a359e700 1 -- 172.21.15.112:0/3226205877 wait complete. 2023-11-08T12:30:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 Processor -- start 2023-11-08T12:30:55.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 -- start start 2023-11-08T12:30:55.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9a406ff10 0x7fb9a414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9a415c150 0x7fb9a4157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a415fc30 0x7fb9a40c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4158870 con 0x7fb9a415c150 2023-11-08T12:30:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a414cd40 con 0x7fb9a406ff10 2023-11-08T12:30:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4157c60 con 0x7fb9a415fc30 2023-11-08T12:30:55.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9a415c150 0x7fb9a4157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a1d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9a415c150 0x7fb9a4157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50596/0 (socket says 172.21.15.112:50596) 2023-11-08T12:30:55.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.057+0000 7fb9a1d9b700 1 -- 172.21.15.112:0/3440357961 learned_addr learned my addr 172.21.15.112:0/3440357961 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:55.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a259c700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9a406ff10 0x7fb9a414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a2d9d700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a415fc30 0x7fb9a40c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a1d9b700 1 -- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a415fc30 msgr2=0x7fb9a40c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a1d9b700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a415fc30 0x7fb9a40c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a1d9b700 1 -- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9a406ff10 msgr2=0x7fb9a414c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a1d9b700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9a406ff10 0x7fb9a414c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a1d9b700 1 -- 172.21.15.112:0/3440357961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998009450 con 0x7fb9a415c150 2023-11-08T12:30:55.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a259c700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9a406ff10 0x7fb9a414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:55.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a1d9b700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9a415c150 0x7fb9a4157210 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb998000c00 tx=0x7fb998004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb992ffd700 1 -- 172.21.15.112:0/3440357961 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998004610 con 0x7fb9a415c150 2023-11-08T12:30:55.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb992ffd700 1 -- 172.21.15.112:0/3440357961 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998003af0 con 0x7fb9a415c150 2023-11-08T12:30:55.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a40d2450 con 0x7fb9a415c150 2023-11-08T12:30:55.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb992ffd700 1 -- 172.21.15.112:0/3440357961 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998003ea0 con 0x7fb9a415c150 2023-11-08T12:30:55.070 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a406cc50 con 0x7fb9a415c150 2023-11-08T12:30:55.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.061+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a40d2730 con 0x7fb9a415c150 2023-11-08T12:30:55.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.065+0000 7fb992ffd700 1 -- 172.21.15.112:0/3440357961 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb99800f050 con 0x7fb9a415c150 2023-11-08T12:30:55.071 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.065+0000 7fb992ffd700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb984064f10 0x7fb9840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.065+0000 7fb992ffd700 1 -- 172.21.15.112:0/3440357961 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fb998083980 con 0x7fb9a415c150 2023-11-08T12:30:55.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.065+0000 7fb9a259c700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb984064f10 0x7fb9840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.072 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.065+0000 7fb9a259c700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb984064f10 0x7fb9840673c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb994009c40 tx=0x7fb994008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.073+0000 7fb992ffd700 1 -- 172.21.15.112:0/3440357961 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb998051a40 con 0x7fb9a415c150 2023-11-08T12:30:55.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.277+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb9a4073d20 con 0x7fb9a415c150 2023-11-08T12:30:55.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.293+0000 7fb992ffd700 1 -- 172.21.15.112:0/3440357961 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v28) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb998055060 con 0x7fb9a415c150 2023-11-08T12:30:55.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb984064f10 msgr2=0x7fb9840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb984064f10 0x7fb9840673c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb994009c40 tx=0x7fb994008040 comp rx=0 tx=0).stop 2023-11-08T12:30:55.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9a415c150 msgr2=0x7fb9a4157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9a415c150 0x7fb9a4157210 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb998000c00 tx=0x7fb998004770 comp rx=0 tx=0).stop 2023-11-08T12:30:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 shutdown_connections 2023-11-08T12:30:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb984064f10 0x7fb9840673c0 secure :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb994009c40 tx=0x7fb994008040 comp rx=0 tx=0).stop 2023-11-08T12:30:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9a415fc30 0x7fb9a40c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9a415c150 0x7fb9a4157210 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 --2- 172.21.15.112:0/3440357961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9a406ff10 0x7fb9a414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 >> 172.21.15.112:0/3440357961 conn(0x7fb9a40d3680 msgr2=0x7fb9a4155990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:55.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.301+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 shutdown_connections 2023-11-08T12:30:55.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.305+0000 7fb9a359e700 1 -- 172.21.15.112:0/3440357961 wait complete. 2023-11-08T12:30:55.314 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 10 and data pool 11 2023-11-08T12:30:55.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:55.506 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.505+0000 7f159759e700 1 Processor -- start 2023-11-08T12:30:55.507 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.505+0000 7f159759e700 1 -- start start 2023-11-08T12:30:55.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15980cbe70 0x7f1598070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f159806a020 0x7f15981602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159759e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15980ce7a0 con 0x7f1598069bf0 2023-11-08T12:30:55.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1598165160 con 0x7f159806a020 2023-11-08T12:30:55.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1598161d20 con 0x7f15980cbe70 2023-11-08T12:30:55.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1595d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1598069bf0 0x7f159815fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51190/0 (socket says 172.21.15.112:51190) 2023-11-08T12:30:55.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1595d9b700 1 -- 172.21.15.112:0/2587895788 learned_addr learned my addr 172.21.15.112:0/2587895788 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:55.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159659c700 1 --2- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15980cbe70 0x7f1598070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1596d9d700 1 --2- 172.21.15.112:0/2587895788 >> v2:172.21.15.133:3300/0 conn(0x7f159806a020 0x7f15981602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159559a700 1 -- 172.21.15.112:0/2587895788 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942662432 0 0) 0x7f15980ce7a0 con 0x7f1598069bf0 2023-11-08T12:30:55.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159559a700 1 -- 172.21.15.112:0/2587895788 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15800035d0 con 0x7f1598069bf0 2023-11-08T12:30:55.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1596d9d700 1 -- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15980cbe70 msgr2=0x7f1598070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:55.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1596d9d700 1 --2- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15980cbe70 0x7f1598070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.513 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1596d9d700 1 -- 172.21.15.112:0/2587895788 >> v1:172.21.15.112:6789/0 conn(0x7f1598069bf0 legacy=0x7f159815fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1596d9d700 1 -- 172.21.15.112:0/2587895788 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15980ccae0 con 0x7f159806a020 2023-11-08T12:30:55.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f1596d9d700 1 --2- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 0x7f15981602e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1590009d90 tx=0x7f159000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fde603b6188a2d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159559a700 1 -- 172.21.15.112:0/2587895788 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000e070 con 0x7f159806a020 2023-11-08T12:30:55.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159559a700 1 -- 172.21.15.112:0/2587895788 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000bb20 con 0x7f159806a020 2023-11-08T12:30:55.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.509+0000 7f159559a700 1 -- 172.21.15.112:0/2587895788 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590012430 con 0x7f159806a020 2023-11-08T12:30:55.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 -- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 msgr2=0x7f15981602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 --2- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 0x7f15981602e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1590009d90 tx=0x7f159000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:55.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 -- 172.21.15.112:0/2587895788 shutdown_connections 2023-11-08T12:30:55.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 --2- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 0x7f15981602e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 --2- 172.21.15.112:0/2587895788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f15980cbe70 0x7f1598070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 -- 172.21.15.112:0/2587895788 >> 172.21.15.112:0/2587895788 conn(0x7f15980b0a20 msgr2=0x7f15980b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:55.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 -- 172.21.15.112:0/2587895788 shutdown_connections 2023-11-08T12:30:55.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 -- 172.21.15.112:0/2587895788 wait complete. 2023-11-08T12:30:55.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 Processor -- start 2023-11-08T12:30:55.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.513+0000 7f159759e700 1 -- start start 2023-11-08T12:30:55.519 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1598069bf0 0x7f159815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 0x7f15980b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15980cbe70 0x7f15980c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15980c6d90 con 0x7f15980cbe70 2023-11-08T12:30:55.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15980c6110 con 0x7f159806a020 2023-11-08T12:30:55.520 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15980c63f0 con 0x7f1598069bf0 2023-11-08T12:30:55.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15980cbe70 0x7f15980c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15980cbe70 0x7f15980c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44176/0 (socket says 172.21.15.112:44176) 2023-11-08T12:30:55.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 -- 172.21.15.112:0/831614897 learned_addr learned my addr 172.21.15.112:0/831614897 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:55.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159659c700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1598069bf0 0x7f159815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1595d9b700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 0x7f15980b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.521 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 -- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1598069bf0 msgr2=0x7f159815e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1598069bf0 0x7f159815e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 -- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 msgr2=0x7f15980b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 0x7f15980b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.522 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 -- 172.21.15.112:0/831614897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590009a70 con 0x7f15980cbe70 2023-11-08T12:30:55.523 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1596d9d700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15980cbe70 0x7f15980c3500 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f159000b370 tx=0x7f1590004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1586ffd700 1 -- 172.21.15.112:0/831614897 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590012430 con 0x7f15980cbe70 2023-11-08T12:30:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1586ffd700 1 -- 172.21.15.112:0/831614897 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1590020070 con 0x7f15980cbe70 2023-11-08T12:30:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f1586ffd700 1 -- 172.21.15.112:0/831614897 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590003e80 con 0x7f15980cbe70 2023-11-08T12:30:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1598161a00 con 0x7f15980cbe70 2023-11-08T12:30:55.524 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.517+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15980cec80 con 0x7f15980cbe70 2023-11-08T12:30:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.521+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15980ccda0 con 0x7f15980cbe70 2023-11-08T12:30:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.521+0000 7f1586ffd700 1 -- 172.21.15.112:0/831614897 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f159002e070 con 0x7f15980cbe70 2023-11-08T12:30:55.525 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.521+0000 7f1586ffd700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1578064ee0 0x7f1578067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.521+0000 7f1586ffd700 1 -- 172.21.15.112:0/831614897 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1590022070 con 0x7f15980cbe70 2023-11-08T12:30:55.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.521+0000 7f159659c700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1578064ee0 0x7f1578067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.525+0000 7f159659c700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1578064ee0 0x7f1578067390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1588009bf0 tx=0x7f1588009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.529+0000 7f1586ffd700 1 -- 172.21.15.112:0/831614897 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1590051c60 con 0x7f15980cbe70 2023-11-08T12:30:55.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.697+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15980c6ed0 con 0x7f15980cbe70 2023-11-08T12:30:55.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.701+0000 7f1586ffd700 1 -- 172.21.15.112:0/831614897 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18148 (secure 0 0 0) 0x7f159002c020 con 0x7f15980cbe70 2023-11-08T12:30:55.704 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:55.704 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":69,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:55.282179+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:53.129272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:54.279849+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:55.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1578064ee0 msgr2=0x7f1578067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1578064ee0 0x7f1578067390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1588009bf0 tx=0x7f1588009240 comp rx=0 tx=0).stop 2023-11-08T12:30:55.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15980cbe70 msgr2=0x7f15980c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15980cbe70 0x7f15980c3500 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f159000b370 tx=0x7f1590004b40 comp rx=0 tx=0).stop 2023-11-08T12:30:55.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 shutdown_connections 2023-11-08T12:30:55.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1578064ee0 0x7f1578067390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15980cbe70 0x7f15980c3500 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f159806a020 0x7f15980b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 --2- 172.21.15.112:0/831614897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1598069bf0 0x7f159815e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 >> 172.21.15.112:0/831614897 conn(0x7f15980b0a20 msgr2=0x7f15980ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:55.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 shutdown_connections 2023-11-08T12:30:55.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.705+0000 7f159759e700 1 -- 172.21.15.112:0/831614897 wait complete. 2023-11-08T12:30:55.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:55.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.909+0000 7f2f071a1700 1 Processor -- start 2023-11-08T12:30:55.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.909+0000 7f2f071a1700 1 -- start start 2023-11-08T12:30:55.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f071a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f0006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f071a1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f00160770 0x7f2f00070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f071a1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f000705c0 0x7f2f0006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f071a1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f00070a00 con 0x7f2f000705c0 2023-11-08T12:30:55.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f071a1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f000d24d0 con 0x7f2f00160770 2023-11-08T12:30:55.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f071a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000d27b0 con 0x7f2f000ced50 2023-11-08T12:30:55.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f000705c0 0x7f2f0006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2f000705c0 0x7f2f0006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44180/0 (socket says 172.21.15.112:44180) 2023-11-08T12:30:55.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 -- 172.21.15.112:0/1746628279 learned_addr learned my addr 172.21.15.112:0/1746628279 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:55.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f0599e700 1 --2- 172.21.15.112:0/1746628279 >> v2:172.21.15.133:3300/0 conn(0x7f2f00160770 0x7f2f00070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f0619f700 1 --2- 172.21.15.112:0/1746628279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f0006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 -- 172.21.15.112:0/1746628279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 msgr2=0x7f2f0006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:55.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 --2- 172.21.15.112:0/1746628279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f0006afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 -- 172.21.15.112:0/1746628279 >> v2:172.21.15.133:3300/0 conn(0x7f2f00160770 msgr2=0x7f2f00070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:55.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 --2- 172.21.15.112:0/1746628279 >> v2:172.21.15.133:3300/0 conn(0x7f2f00160770 0x7f2f00070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f069a0700 1 -- 172.21.15.112:0/1746628279 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000d08d0 con 0x7f2f000705c0 2023-11-08T12:30:55.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.913+0000 7f2f0599e700 1 --2- 172.21.15.112:0/1746628279 >> v2:172.21.15.133:3300/0 conn(0x7f2f00160770 0x7f2f00070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:30:55.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f069a0700 1 --2- 172.21.15.112:0/1746628279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f0006bed0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2f0006fc10 tx=0x7f2ef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f9ad1f71c5f382 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f0519d700 1 -- 172.21.15.112:0/1746628279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800e070 con 0x7f2f000705c0 2023-11-08T12:30:55.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f0519d700 1 -- 172.21.15.112:0/1746628279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800b910 con 0x7f2f000705c0 2023-11-08T12:30:55.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f0519d700 1 -- 172.21.15.112:0/1746628279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800bcc0 con 0x7f2f000705c0 2023-11-08T12:30:55.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 -- 172.21.15.112:0/1746628279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 msgr2=0x7f2f0006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 --2- 172.21.15.112:0/1746628279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f0006bed0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2f0006fc10 tx=0x7f2ef800b330 comp rx=0 tx=0).stop 2023-11-08T12:30:55.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 -- 172.21.15.112:0/1746628279 shutdown_connections 2023-11-08T12:30:55.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 --2- 172.21.15.112:0/1746628279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f0006bed0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 --2- 172.21.15.112:0/1746628279 >> v2:172.21.15.133:3300/0 conn(0x7f2f00160770 0x7f2f00070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 --2- 172.21.15.112:0/1746628279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f0006afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 -- 172.21.15.112:0/1746628279 >> 172.21.15.112:0/1746628279 conn(0x7f2f000b53a0 msgr2=0x7f2f000d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:55.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 -- 172.21.15.112:0/1746628279 shutdown_connections 2023-11-08T12:30:55.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.917+0000 7f2f071a1700 1 -- 172.21.15.112:0/1746628279 wait complete. 2023-11-08T12:30:55.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 Processor -- start 2023-11-08T12:30:55.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 -- start start 2023-11-08T12:30:55.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f00157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f000b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f00160770 0x7f2f000b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000b6280 con 0x7f2f000705c0 2023-11-08T12:30:55.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000cbfc0 con 0x7f2f00160770 2023-11-08T12:30:55.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f071a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f001577a0 con 0x7f2f000ced50 2023-11-08T12:30:55.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f00157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f00157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44192/0 (socket says 172.21.15.112:44192) 2023-11-08T12:30:55.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 -- 172.21.15.112:0/2423138794 learned_addr learned my addr 172.21.15.112:0/2423138794 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:55.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f069a0700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f00160770 0x7f2f000b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0599e700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f000b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 -- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 msgr2=0x7f2f000b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f000b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 -- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f00160770 msgr2=0x7f2f000b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:55.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f00160770 0x7f2f000b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:55.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f0619f700 1 -- 172.21.15.112:0/2423138794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00094b0 con 0x7f2f000705c0 2023-11-08T12:30:55.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.921+0000 7f2f069a0700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f00160770 0x7f2f000b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:55.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.925+0000 7f2f0619f700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f00157260 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00e960 tx=0x7f2efc00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.925+0000 7f2ef6ffd700 1 -- 172.21.15.112:0/2423138794 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0096c0 con 0x7f2f000705c0 2023-11-08T12:30:55.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.925+0000 7f2ef6ffd700 1 -- 172.21.15.112:0/2423138794 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00c850 con 0x7f2f000705c0 2023-11-08T12:30:55.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.925+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef8009b30 con 0x7f2f000705c0 2023-11-08T12:30:55.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.925+0000 7f2ef6ffd700 1 -- 172.21.15.112:0/2423138794 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00cbe0 con 0x7f2f000705c0 2023-11-08T12:30:55.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.925+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f000cf120 con 0x7f2f000705c0 2023-11-08T12:30:55.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.925+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f000d0bb0 con 0x7f2f000705c0 2023-11-08T12:30:55.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.929+0000 7f2ef6ffd700 1 -- 172.21.15.112:0/2423138794 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2efc019030 con 0x7f2f000705c0 2023-11-08T12:30:55.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.929+0000 7f2ef6ffd700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2ee4064ee0 0x7f2ee4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:55.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.929+0000 7f2ef6ffd700 1 -- 172.21.15.112:0/2423138794 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2efc082010 con 0x7f2f000705c0 2023-11-08T12:30:55.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.929+0000 7f2f0599e700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2ee4064ee0 0x7f2ee4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:55.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.929+0000 7f2f0599e700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2ee4064ee0 0x7f2ee4067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f0006b200 tx=0x7f2ef0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:55.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:55.933+0000 7f2ef6ffd700 1 -- 172.21.15.112:0/2423138794 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f2efc050010 con 0x7f2f000705c0 2023-11-08T12:30:56.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.105+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f00160bc0 con 0x7f2f000705c0 2023-11-08T12:30:56.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.109+0000 7f2ef6ffd700 1 -- 172.21.15.112:0/2423138794 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18148 (secure 0 0 0) 0x7f2efc053630 con 0x7f2f000705c0 2023-11-08T12:30:56.113 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:56.113 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":69,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:55.282179+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:53.129272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:54.279849+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:56.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2ee4064ee0 msgr2=0x7f2ee4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2ee4064ee0 0x7f2ee4067390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2f0006b200 tx=0x7f2ef0008040 comp rx=0 tx=0).stop 2023-11-08T12:30:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 msgr2=0x7f2f00157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:56.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f00157260 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00e960 tx=0x7f2efc00ed20 comp rx=0 tx=0).stop 2023-11-08T12:30:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 shutdown_connections 2023-11-08T12:30:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2ee4064ee0 0x7f2ee4067390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f00160770 0x7f2f000b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f000ced50 0x7f2f000b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:56.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 --2- 172.21.15.112:0/2423138794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f000705c0 0x7f2f00157260 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 >> 172.21.15.112:0/2423138794 conn(0x7f2f000b53a0 msgr2=0x7f2f0006a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:56.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 shutdown_connections 2023-11-08T12:30:56.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.113+0000 7f2f071a1700 1 -- 172.21.15.112:0/2423138794 wait complete. 2023-11-08T12:30:56.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-08T12:30:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.313+0000 7f4bb93f9700 1 Processor -- start 2023-11-08T12:30:56.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.313+0000 7f4bb93f9700 1 -- start start 2023-11-08T12:30:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb93f9700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4bb4070620 0x7f4bb40b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:56.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb93f9700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb415c520 con 0x7f4bb415c150 2023-11-08T12:30:56.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb93f9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb406cc50 con 0x7f4bb4069bf0 2023-11-08T12:30:56.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb93f9700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb40b4240 con 0x7f4bb4070620 2023-11-08T12:30:56.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb37fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4bb4070620 0x7f4bb40b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:56.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb37fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4bb4070620 0x7f4bb40b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44198/0 (socket says 172.21.15.112:44198) 2023-11-08T12:30:56.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb37fe700 1 -- 172.21.15.112:0/2582571336 learned_addr learned my addr 172.21.15.112:0/2582571336 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:56.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb37fe700 1 -- 172.21.15.112:0/2582571336 >> v1:172.21.15.133:6789/0 conn(0x7f4bb4069bf0 legacy=0x7f4bb4069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:56.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb37fe700 1 -- 172.21.15.112:0/2582571336 >> v1:172.21.15.112:6789/0 conn(0x7f4bb415c150 legacy=0x7f4bb406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:56.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb37fe700 1 -- 172.21.15.112:0/2582571336 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb40d2450 con 0x7f4bb4070620 2023-11-08T12:30:56.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb37fe700 1 --2- 172.21.15.112:0/2582571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4070620 0x7f4bb40b3d00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009900 tx=0x7f4ba8009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2682e1181bfaaf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:56.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb2ffd700 1 -- 172.21.15.112:0/2582571336 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8004230 con 0x7f4bb4070620 2023-11-08T12:30:56.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb2ffd700 1 -- 172.21.15.112:0/2582571336 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba8004390 con 0x7f4bb4070620 2023-11-08T12:30:56.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb2ffd700 1 -- 172.21.15.112:0/2582571336 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8009e50 con 0x7f4bb4070620 2023-11-08T12:30:56.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb93f9700 1 -- 172.21.15.112:0/2582571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4070620 msgr2=0x7f4bb40b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:56.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.317+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/2582571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4070620 0x7f4bb40b3d00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009900 tx=0x7f4ba8009c10 comp rx=0 tx=0).stop 2023-11-08T12:30:56.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.321+0000 7f4bb93f9700 1 -- 172.21.15.112:0/2582571336 shutdown_connections 2023-11-08T12:30:56.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.321+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/2582571336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4070620 0x7f4bb40b3d00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:56.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.321+0000 7f4bb93f9700 1 -- 172.21.15.112:0/2582571336 >> 172.21.15.112:0/2582571336 conn(0x7f4bb40d3680 msgr2=0x7f4bb40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:56.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.321+0000 7f4bb93f9700 1 -- 172.21.15.112:0/2582571336 shutdown_connections 2023-11-08T12:30:56.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.321+0000 7f4bb93f9700 1 -- 172.21.15.112:0/2582571336 wait complete. 2023-11-08T12:30:56.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.321+0000 7f4bb93f9700 1 Processor -- start 2023-11-08T12:30:56.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.321+0000 7f4bb93f9700 1 -- start start 2023-11-08T12:30:56.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4069bf0 0x7f4bb40b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:56.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb4070620 0x7f4bb40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:56.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb415c150 0x7f4bb4158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:56.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40b6db0 con 0x7f4bb4069bf0 2023-11-08T12:30:56.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40b7780 con 0x7f4bb415c150 2023-11-08T12:30:56.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40b61a0 con 0x7f4bb4070620 2023-11-08T12:30:56.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4069bf0 0x7f4bb40b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:56.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4069bf0 0x7f4bb40b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44214/0 (socket says 172.21.15.112:44214) 2023-11-08T12:30:56.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 -- 172.21.15.112:0/1828502671 learned_addr learned my addr 172.21.15.112:0/1828502671 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:56.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb37fe700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb4070620 0x7f4bb40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:56.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb8bf8700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb415c150 0x7f4bb4158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:56.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 -- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb4070620 msgr2=0x7f4bb40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:56.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb4070620 0x7f4bb40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:56.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 -- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb415c150 msgr2=0x7f4bb4158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb415c150 0x7f4bb4158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 -- 172.21.15.112:0/1828502671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8009510 con 0x7f4bb4069bf0 2023-11-08T12:30:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb37fe700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb4070620 0x7f4bb40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb3fff700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4069bf0 0x7f4bb40b7240 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c500 tx=0x7f4ba400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb0ff9700 1 -- 172.21.15.112:0/1828502671 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40052d0 con 0x7f4bb4069bf0 2023-11-08T12:30:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb0ff9700 1 -- 172.21.15.112:0/1828502671 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba4005430 con 0x7f4bb4069bf0 2023-11-08T12:30:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb40d05e0 con 0x7f4bb4069bf0 2023-11-08T12:30:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb0ff9700 1 -- 172.21.15.112:0/1828502671 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40055a0 con 0x7f4bb4069bf0 2023-11-08T12:30:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.325+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb40d2730 con 0x7f4bb4069bf0 2023-11-08T12:30:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.329+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb40d2140 con 0x7f4bb4069bf0 2023-11-08T12:30:56.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.329+0000 7f4bb0ff9700 1 -- 172.21.15.112:0/1828502671 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ba4019030 con 0x7f4bb4069bf0 2023-11-08T12:30:56.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.329+0000 7f4bb0ff9700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ba0064ee0 0x7f4ba0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:56.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.329+0000 7f4bb0ff9700 1 -- 172.21.15.112:0/1828502671 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4ba4081490 con 0x7f4bb4069bf0 2023-11-08T12:30:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.333+0000 7f4bb37fe700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ba0064ee0 0x7f4ba0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.333+0000 7f4bb37fe700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ba0064ee0 0x7f4ba0067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80094e0 tx=0x7f4ba8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:56.339 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.337+0000 7f4bb0ff9700 1 -- 172.21.15.112:0/1828502671 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ba404f370 con 0x7f4bb4069bf0 2023-11-08T12:30:56.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:56.545+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4bb4073d20 con 0x7f4bb4069bf0 2023-11-08T12:30:57.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.309+0000 7f4bb0ff9700 1 -- 172.21.15.112:0/1828502671 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4ba40170b0 con 0x7f4bb4069bf0 2023-11-08T12:30:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ba0064ee0 msgr2=0x7f4ba0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:57.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ba0064ee0 0x7f4ba0067390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80094e0 tx=0x7f4ba8008030 comp rx=0 tx=0).stop 2023-11-08T12:30:57.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4069bf0 msgr2=0x7f4bb40b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:57.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4069bf0 0x7f4bb40b7240 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c500 tx=0x7f4ba400c8c0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 shutdown_connections 2023-11-08T12:30:57.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4ba0064ee0 0x7f4ba0067390 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb415c150 0x7f4bb4158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4bb4070620 0x7f4bb40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 --2- 172.21.15.112:0/1828502671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4bb4069bf0 0x7f4bb40b7240 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 >> 172.21.15.112:0/1828502671 conn(0x7f4bb40d3680 msgr2=0x7f4bb406ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:57.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 shutdown_connections 2023-11-08T12:30:57.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.313+0000 7f4bb93f9700 1 -- 172.21.15.112:0/1828502671 wait complete. 2023-11-08T12:30:57.338 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-08T12:30:57.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-08T12:30:57.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.525+0000 7fefbc9a1700 1 Processor -- start 2023-11-08T12:30:57.528 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.525+0000 7fefbc9a1700 1 -- start start 2023-11-08T12:30:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.525+0000 7fefbc9a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb8070a90 0x7fefb80c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.525+0000 7fefbc9a1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fefb815a9f0 0x7fefb806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.525+0000 7fefbc9a1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb8070600 con 0x7fefb8159f10 2023-11-08T12:30:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.525+0000 7fefbc9a1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb8070f00 con 0x7fefb815a9f0 2023-11-08T12:30:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.525+0000 7fefbc9a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb806b840 con 0x7fefb8070a90 2023-11-08T12:30:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fefb815a9f0 0x7fefb806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fefb815a9f0 0x7fefb806b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44226/0 (socket says 172.21.15.112:44226) 2023-11-08T12:30:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 -- 172.21.15.112:0/1456151411 learned_addr learned my addr 172.21.15.112:0/1456151411 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:57.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefaffff700 1 --2- 172.21.15.112:0/1456151411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb8070a90 0x7fefb80c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:57.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 -- 172.21.15.112:0/1456151411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb8070a90 msgr2=0x7fefb80c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:57.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 --2- 172.21.15.112:0/1456151411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb8070a90 0x7fefb80c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 -- 172.21.15.112:0/1456151411 >> v1:172.21.15.133:6789/0 conn(0x7fefb8159f10 legacy=0x7fefb815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:57.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 -- 172.21.15.112:0/1456151411 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb815ae30 con 0x7fefb815a9f0 2023-11-08T12:30:57.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb7fff700 1 --2- 172.21.15.112:0/1456151411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb815a9f0 0x7fefb806b300 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009e50 tx=0x7fefb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603cd9a9f4fa5274 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:57.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb6ffd700 1 -- 172.21.15.112:0/1456151411 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000e070 con 0x7fefb815a9f0 2023-11-08T12:30:57.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb6ffd700 1 -- 172.21.15.112:0/1456151411 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000b9c0 con 0x7fefb815a9f0 2023-11-08T12:30:57.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefb6ffd700 1 -- 172.21.15.112:0/1456151411 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000bd70 con 0x7fefb815a9f0 2023-11-08T12:30:57.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1456151411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb815a9f0 msgr2=0x7fefb806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:57.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1456151411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb815a9f0 0x7fefb806b300 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009e50 tx=0x7fefb000b330 comp rx=0 tx=0).stop 2023-11-08T12:30:57.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1456151411 shutdown_connections 2023-11-08T12:30:57.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1456151411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb815a9f0 0x7fefb806b300 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1456151411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb8070a90 0x7fefb80c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1456151411 >> 172.21.15.112:0/1456151411 conn(0x7fefb80cf280 msgr2=0x7fefb80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1456151411 shutdown_connections 2023-11-08T12:30:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.529+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1456151411 wait complete. 2023-11-08T12:30:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 Processor -- start 2023-11-08T12:30:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 -- start start 2023-11-08T12:30:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb8070a90 0x7fefb81501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb8159f10 0x7fefb80b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb815a9f0 0x7fefb8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80b27a0 con 0x7fefb8159f10 2023-11-08T12:30:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80b1f00 con 0x7fefb8070a90 2023-11-08T12:30:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefbc9a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80b21e0 con 0x7fefb815a9f0 2023-11-08T12:30:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb8159f10 0x7fefb80b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb8159f10 0x7fefb80b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44234/0 (socket says 172.21.15.112:44234) 2023-11-08T12:30:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 -- 172.21.15.112:0/1587693553 learned_addr learned my addr 172.21.15.112:0/1587693553 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefb77fe700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb8070a90 0x7fefb81501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefb7fff700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb815a9f0 0x7fefb8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 -- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb815a9f0 msgr2=0x7fefb8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb815a9f0 0x7fefb8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 -- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb8070a90 msgr2=0x7fefb81501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb8070a90 0x7fefb81501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.533+0000 7fefaffff700 1 -- 172.21.15.112:0/1587693553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009b30 con 0x7fefb8159f10 2023-11-08T12:30:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.537+0000 7fefaffff700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb8159f10 0x7fefb80b1540 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e810 tx=0x7fefa000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.537+0000 7fefb4ff9700 1 -- 172.21.15.112:0/1587693553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0013610 con 0x7fefb8159f10 2023-11-08T12:30:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.537+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb806ffb0 con 0x7fefb8159f10 2023-11-08T12:30:57.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.537+0000 7fefb4ff9700 1 -- 172.21.15.112:0/1587693553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0013770 con 0x7fefb8159f10 2023-11-08T12:30:57.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.537+0000 7fefb4ff9700 1 -- 172.21.15.112:0/1587693553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0013b20 con 0x7fefb8159f10 2023-11-08T12:30:57.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.537+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb80afcc0 con 0x7fefb8159f10 2023-11-08T12:30:57.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.537+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb8070290 con 0x7fefb8159f10 2023-11-08T12:30:57.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.541+0000 7fefb4ff9700 1 -- 172.21.15.112:0/1587693553 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fefa0023070 con 0x7fefb8159f10 2023-11-08T12:30:57.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.541+0000 7fefb4ff9700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef98064ee0 0x7fef98067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:57.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.541+0000 7fefb4ff9700 1 -- 172.21.15.112:0/1587693553 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefa0081de0 con 0x7fefb8159f10 2023-11-08T12:30:57.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.541+0000 7fefb77fe700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef98064ee0 0x7fef98067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:57.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.541+0000 7fefb77fe700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef98064ee0 0x7fef98067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000f60 tx=0x7fefa8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:57.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.545+0000 7fefb4ff9700 1 -- 172.21.15.112:0/1587693553 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fefa004fdc0 con 0x7fefb8159f10 2023-11-08T12:30:57.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:57.749+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fefb806cf30 con 0x7fefb8159f10 2023-11-08T12:30:58.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.321+0000 7fefb4ff9700 1 -- 172.21.15.112:0/1587693553 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fefa00533e0 con 0x7fefb8159f10 2023-11-08T12:30:58.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.321+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef98064ee0 msgr2=0x7fef98067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.321+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef98064ee0 0x7fef98067390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000f60 tx=0x7fefa8009040 comp rx=0 tx=0).stop 2023-11-08T12:30:58.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.321+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb8159f10 msgr2=0x7fefb80b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.321+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb8159f10 0x7fefb80b1540 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e810 tx=0x7fefa000ebd0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 shutdown_connections 2023-11-08T12:30:58.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fef98064ee0 0x7fef98067390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fefb815a9f0 0x7fefb8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb8159f10 0x7fefb80b1540 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 --2- 172.21.15.112:0/1587693553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb8070a90 0x7fefb81501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 >> 172.21.15.112:0/1587693553 conn(0x7fefb80cf280 msgr2=0x7fefb80c3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:58.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 shutdown_connections 2023-11-08T12:30:58.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.325+0000 7fefbc9a1700 1 -- 172.21.15.112:0/1587693553 wait complete. 2023-11-08T12:30:58.348 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-08T12:30:58.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:30:58.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 Processor -- start 2023-11-08T12:30:58.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 -- start start 2023-11-08T12:30:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5114071aa0 0x7f511406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5114069e00 0x7f511406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511406cef0 con 0x7f5114069e00 2023-11-08T12:30:58.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511406a7c0 con 0x7f5114071aa0 2023-11-08T12:30:58.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f511a0ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511406c600 con 0x7f511415c640 2023-11-08T12:30:58.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5114069e00 0x7f511406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51190a9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5114069e00 0x7f511406a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44242/0 (socket says 172.21.15.112:44242) 2023-11-08T12:30:58.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 -- 172.21.15.112:0/650985868 learned_addr learned my addr 172.21.15.112:0/650985868 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:58.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51188a8700 1 --2- 172.21.15.112:0/650985868 >> v2:172.21.15.133:3300/0 conn(0x7f5114071aa0 0x7f511406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 -- 172.21.15.112:0/650985868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 msgr2=0x7f51140d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:58.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 --2- 172.21.15.112:0/650985868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 -- 172.21.15.112:0/650985868 >> v2:172.21.15.133:3300/0 conn(0x7f5114071aa0 msgr2=0x7f511406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:58.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 --2- 172.21.15.112:0/650985868 >> v2:172.21.15.133:3300/0 conn(0x7f5114071aa0 0x7f511406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.537+0000 7f51198aa700 1 -- 172.21.15.112:0/650985868 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51140722f0 con 0x7f5114069e00 2023-11-08T12:30:58.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f51198aa700 1 --2- 172.21.15.112:0/650985868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114069e00 0x7f511406a280 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f511406fc90 tx=0x7f510c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36dddc856431ed2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:58.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f510bfff700 1 -- 172.21.15.112:0/650985868 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00e070 con 0x7f5114069e00 2023-11-08T12:30:58.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f510bfff700 1 -- 172.21.15.112:0/650985868 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c00b910 con 0x7f5114069e00 2023-11-08T12:30:58.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f510bfff700 1 -- 172.21.15.112:0/650985868 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c00bcc0 con 0x7f5114069e00 2023-11-08T12:30:58.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 -- 172.21.15.112:0/650985868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114069e00 msgr2=0x7f511406a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 --2- 172.21.15.112:0/650985868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114069e00 0x7f511406a280 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f511406fc90 tx=0x7f510c00b330 comp rx=0 tx=0).stop 2023-11-08T12:30:58.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 -- 172.21.15.112:0/650985868 shutdown_connections 2023-11-08T12:30:58.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 --2- 172.21.15.112:0/650985868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114069e00 0x7f511406a280 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 --2- 172.21.15.112:0/650985868 >> v2:172.21.15.133:3300/0 conn(0x7f5114071aa0 0x7f511406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 --2- 172.21.15.112:0/650985868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 -- 172.21.15.112:0/650985868 >> 172.21.15.112:0/650985868 conn(0x7f51140b6520 msgr2=0x7f5114071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:58.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 -- 172.21.15.112:0/650985868 shutdown_connections 2023-11-08T12:30:58.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.541+0000 7f511a0ab700 1 -- 172.21.15.112:0/650985868 wait complete. 2023-11-08T12:30:58.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 Processor -- start 2023-11-08T12:30:58.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 -- start start 2023-11-08T12:30:58.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5114069e00 0x7f51140cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114071aa0 0x7f51140b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140c7630 con 0x7f5114071aa0 2023-11-08T12:30:58.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140cc9c0 con 0x7f5114069e00 2023-11-08T12:30:58.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f511a0ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511415d310 con 0x7f511415c640 2023-11-08T12:30:58.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f51188a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114071aa0 0x7f51140b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f51188a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114071aa0 0x7f51140b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44244/0 (socket says 172.21.15.112:44244) 2023-11-08T12:30:58.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.545+0000 7f51188a8700 1 -- 172.21.15.112:0/574961707 learned_addr learned my addr 172.21.15.112:0/574961707 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:58.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51190a9700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5114069e00 0x7f51140cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51198aa700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51188a8700 1 -- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 msgr2=0x7f51140b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51188a8700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51188a8700 1 -- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5114069e00 msgr2=0x7f51140cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51188a8700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5114069e00 0x7f51140cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51188a8700 1 -- 172.21.15.112:0/574961707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c009b30 con 0x7f5114071aa0 2023-11-08T12:30:58.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f51188a8700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114071aa0 0x7f51140b3530 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f510400e7c0 tx=0x7f510400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:58.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f5109ffb700 1 -- 172.21.15.112:0/574961707 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104013680 con 0x7f5114071aa0 2023-11-08T12:30:58.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f5109ffb700 1 -- 172.21.15.112:0/574961707 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51040137e0 con 0x7f5114071aa0 2023-11-08T12:30:58.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5114072010 con 0x7f5114071aa0 2023-11-08T12:30:58.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f5109ffb700 1 -- 172.21.15.112:0/574961707 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104013b90 con 0x7f5114071aa0 2023-11-08T12:30:58.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.549+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511415ca10 con 0x7f5114071aa0 2023-11-08T12:30:58.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.553+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511406c830 con 0x7f5114071aa0 2023-11-08T12:30:58.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.553+0000 7f5109ffb700 1 -- 172.21.15.112:0/574961707 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5104019030 con 0x7f5114071aa0 2023-11-08T12:30:58.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.553+0000 7f5109ffb700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f8064f10 0x7f50f80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.553+0000 7f5109ffb700 1 -- 172.21.15.112:0/574961707 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5104081d30 con 0x7f5114071aa0 2023-11-08T12:30:58.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.553+0000 7f51190a9700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f8064f10 0x7f50f80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.557+0000 7f51190a9700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f8064f10 0x7f50f80673c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5110009bf0 tx=0x7f5110009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:58.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.557+0000 7f5109ffb700 1 -- 172.21.15.112:0/574961707 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f510404fca0 con 0x7f5114071aa0 2023-11-08T12:30:58.770 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.769+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5114066bb0 con 0x7f5114071aa0 2023-11-08T12:30:58.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.769+0000 7f5109ffb700 1 -- 172.21.15.112:0/574961707 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f51040532c0 con 0x7f5114071aa0 2023-11-08T12:30:58.771 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:58.772 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:55.282749+0000","modified":"2023-11-08T12:30:58.314109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2843990803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2843990803},{"type":"v1","addr":"172.21.15.112:6837","nonce":2843990803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T12:30:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f8064f10 msgr2=0x7f50f80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f8064f10 0x7f50f80673c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5110009bf0 tx=0x7f5110009240 comp rx=0 tx=0).stop 2023-11-08T12:30:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114071aa0 msgr2=0x7f51140b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114071aa0 0x7f51140b3530 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f510400e7c0 tx=0x7f510400ead0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 shutdown_connections 2023-11-08T12:30:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f50f8064f10 0x7f50f80673c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f511415c640 0x7f51140b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114071aa0 0x7f51140b3530 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 --2- 172.21.15.112:0/574961707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5114069e00 0x7f51140cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 >> 172.21.15.112:0/574961707 conn(0x7f51140b6520 msgr2=0x7f51140d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 shutdown_connections 2023-11-08T12:30:58.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.773+0000 7f511a0ab700 1 -- 172.21.15.112:0/574961707 wait complete. 2023-11-08T12:30:58.779 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 32 2023-11-08T12:30:58.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:30:58.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a759e700 1 Processor -- start 2023-11-08T12:30:58.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a759e700 1 -- start start 2023-11-08T12:30:58.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a759e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30a815c1a0 0x7f30a806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a8070790 0x7f30a806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a80adf90 con 0x7f30a80cdeb0 2023-11-08T12:30:58.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a759e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a8069bf0 con 0x7f30a815c1a0 2023-11-08T12:30:58.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80ce370 con 0x7f30a8070790 2023-11-08T12:30:58.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30a815c1a0 0x7f30a806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a659c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f30a815c1a0 0x7f30a806c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44260/0 (socket says 172.21.15.112:44260) 2023-11-08T12:30:58.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a659c700 1 -- 172.21.15.112:0/563881816 learned_addr learned my addr 172.21.15.112:0/563881816 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:58.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.969+0000 7f30a6d9d700 1 --2- 172.21.15.112:0/563881816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a8070790 0x7f30a806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a659c700 1 -- 172.21.15.112:0/563881816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a8070790 msgr2=0x7f30a806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:30:58.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a659c700 1 --2- 172.21.15.112:0/563881816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a8070790 0x7f30a806a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a659c700 1 -- 172.21.15.112:0/563881816 >> v1:172.21.15.133:6789/0 conn(0x7f30a80cdeb0 legacy=0x7f30a8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a659c700 1 -- 172.21.15.112:0/563881816 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a80cc4a0 con 0x7f30a815c1a0 2023-11-08T12:30:58.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a659c700 1 --2- 172.21.15.112:0/563881816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a806c8b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3098009910 tx=0x7f3098009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88930ca1b9faa2d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:58.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a559a700 1 -- 172.21.15.112:0/563881816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098011830 con 0x7f30a815c1a0 2023-11-08T12:30:58.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a559a700 1 -- 172.21.15.112:0/563881816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3098011990 con 0x7f30a815c1a0 2023-11-08T12:30:58.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a559a700 1 -- 172.21.15.112:0/563881816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098011d40 con 0x7f30a815c1a0 2023-11-08T12:30:58.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 -- 172.21.15.112:0/563881816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 msgr2=0x7f30a806c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 --2- 172.21.15.112:0/563881816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a806c8b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3098009910 tx=0x7f3098009c20 comp rx=0 tx=0).stop 2023-11-08T12:30:58.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 -- 172.21.15.112:0/563881816 shutdown_connections 2023-11-08T12:30:58.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 --2- 172.21.15.112:0/563881816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a8070790 0x7f30a806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 --2- 172.21.15.112:0/563881816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a806c8b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 -- 172.21.15.112:0/563881816 >> 172.21.15.112:0/563881816 conn(0x7f30a80b0f80 msgr2=0x7f30a80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:58.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 -- 172.21.15.112:0/563881816 shutdown_connections 2023-11-08T12:30:58.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.973+0000 7f30a759e700 1 -- 172.21.15.112:0/563881816 wait complete. 2023-11-08T12:30:58.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 Processor -- start 2023-11-08T12:30:58.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 -- start start 2023-11-08T12:30:58.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8070790 0x7f30a80c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a80cdeb0 0x7f30a81484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80b29c0 con 0x7f30a815c1a0 2023-11-08T12:30:58.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80b2ca0 con 0x7f30a8070790 2023-11-08T12:30:58.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80b2f80 con 0x7f30a80cdeb0 2023-11-08T12:30:58.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a6d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a815ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44270/0 (socket says 172.21.15.112:44270) 2023-11-08T12:30:58.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a6d9d700 1 -- 172.21.15.112:0/3312218623 learned_addr learned my addr 172.21.15.112:0/3312218623 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:58.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.977+0000 7f30a659c700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8070790 0x7f30a80c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a5d9b700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a80cdeb0 0x7f30a81484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a6d9d700 1 -- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a80cdeb0 msgr2=0x7f30a81484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a6d9d700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a80cdeb0 0x7f30a81484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a6d9d700 1 -- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8070790 msgr2=0x7f30a80c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:58.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a6d9d700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8070790 0x7f30a80c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:58.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a6d9d700 1 -- 172.21.15.112:0/3312218623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098009570 con 0x7f30a815c1a0 2023-11-08T12:30:58.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a6d9d700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a815ea20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f30a000efc0 tx=0x7f30a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:58.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f3096ffd700 1 -- 172.21.15.112:0/3312218623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000cd40 con 0x7f30a815c1a0 2023-11-08T12:30:58.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a806cdf0 con 0x7f30a815c1a0 2023-11-08T12:30:58.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f3096ffd700 1 -- 172.21.15.112:0/3312218623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a000f040 con 0x7f30a815c1a0 2023-11-08T12:30:58.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f3096ffd700 1 -- 172.21.15.112:0/3312218623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00146c0 con 0x7f30a815c1a0 2023-11-08T12:30:58.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a80cc780 con 0x7f30a815c1a0 2023-11-08T12:30:58.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.981+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a815c570 con 0x7f30a815c1a0 2023-11-08T12:30:58.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.985+0000 7f3096ffd700 1 -- 172.21.15.112:0/3312218623 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f30a0014820 con 0x7f30a815c1a0 2023-11-08T12:30:58.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.985+0000 7f3096ffd700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3088064ee0 0x7f3088067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:58.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.985+0000 7f3096ffd700 1 -- 172.21.15.112:0/3312218623 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f30a0082e00 con 0x7f30a815c1a0 2023-11-08T12:30:58.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.985+0000 7f30a659c700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3088064ee0 0x7f3088067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:58.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.985+0000 7f30a659c700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3088064ee0 0x7f3088067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3098009c60 tx=0x7f3098008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:58.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:58.989+0000 7f3096ffd700 1 -- 172.21.15.112:0/3312218623 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f30a0050e60 con 0x7f30a815c1a0 2023-11-08T12:30:59.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.161+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30a8073200 con 0x7f30a815c1a0 2023-11-08T12:30:59.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.165+0000 7f3096ffd700 1 -- 172.21.15.112:0/3312218623 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18135 (secure 0 0 0) 0x7f30a8073200 con 0x7f30a815c1a0 2023-11-08T12:30:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:59.172 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":70,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:30:56.288373+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:53.129272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:54.279849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:30:59.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3088064ee0 msgr2=0x7f3088067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3088064ee0 0x7f3088067390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3098009c60 tx=0x7f3098008030 comp rx=0 tx=0).stop 2023-11-08T12:30:59.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 msgr2=0x7f30a815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a815ea20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f30a000efc0 tx=0x7f30a000c3a0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 shutdown_connections 2023-11-08T12:30:59.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3088064ee0 0x7f3088067390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30a815c1a0 0x7f30a815ea20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30a80cdeb0 0x7f30a81484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 --2- 172.21.15.112:0/3312218623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a8070790 0x7f30a80c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 >> 172.21.15.112:0/3312218623 conn(0x7f30a80b0f80 msgr2=0x7f30a8069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:59.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 shutdown_connections 2023-11-08T12:30:59.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.169+0000 7f30a759e700 1 -- 172.21.15.112:0/3312218623 wait complete. 2023-11-08T12:30:59.192 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-08T12:30:59.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:30:59.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.365+0000 7fa4dd190700 1 Processor -- start 2023-11-08T12:30:59.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4dd190700 1 -- start start 2023-11-08T12:30:59.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4dd190700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa4d815c640 0x7fa4d80d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4dd190700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d806c600 con 0x7fa4d8071aa0 2023-11-08T12:30:59.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4dd190700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80722f0 con 0x7fa4d8069e00 2023-11-08T12:30:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4dd190700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d806cef0 con 0x7fa4d815c640 2023-11-08T12:30:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4cf7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa4d8071aa0 0x7fa4d806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51216/0 (socket says 172.21.15.112:51216) 2023-11-08T12:30:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4cf7fe700 1 -- 172.21.15.112:0/2449952194 learned_addr learned my addr 172.21.15.112:0/2449952194 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:59.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4d7fff700 1 --2- 172.21.15.112:0/2449952194 >> v2:172.21.15.112:3300/0 conn(0x7fa4d815c640 0x7fa4d80d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4d77fe700 1 -- 172.21.15.112:0/2449952194 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079312786 0 0) 0x7fa4d806c600 con 0x7fa4d8071aa0 2023-11-08T12:30:59.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.369+0000 7fa4d77fe700 1 -- 172.21.15.112:0/2449952194 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c40035d0 con 0x7fa4d8071aa0 2023-11-08T12:30:59.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d77fe700 1 -- 172.21.15.112:0/2449952194 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 72355500 0 0) 0x7fa4c40035d0 con 0x7fa4d8071aa0 2023-11-08T12:30:59.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d7fff700 1 -- 172.21.15.112:0/2449952194 >> v1:172.21.15.133:6789/0 conn(0x7fa4d8069e00 legacy=0x7fa4d80d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d7fff700 1 -- 172.21.15.112:0/2449952194 >> v1:172.21.15.112:6789/0 conn(0x7fa4d8071aa0 legacy=0x7fa4d806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d7fff700 1 -- 172.21.15.112:0/2449952194 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d806da20 con 0x7fa4d815c640 2023-11-08T12:30:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d7fff700 1 --2- 172.21.15.112:0/2449952194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d815c640 0x7fa4d80d31e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097d0 tx=0x7fa4c8009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4b0ab5802e62c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:59.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d77fe700 1 -- 172.21.15.112:0/2449952194 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8004230 con 0x7fa4d815c640 2023-11-08T12:30:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d77fe700 1 -- 172.21.15.112:0/2449952194 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8004390 con 0x7fa4d815c640 2023-11-08T12:30:59.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4d77fe700 1 -- 172.21.15.112:0/2449952194 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80036c0 con 0x7fa4d815c640 2023-11-08T12:30:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4dd190700 1 -- 172.21.15.112:0/2449952194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d815c640 msgr2=0x7fa4d80d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4dd190700 1 --2- 172.21.15.112:0/2449952194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d815c640 0x7fa4d80d31e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097d0 tx=0x7fa4c8009ae0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4dd190700 1 -- 172.21.15.112:0/2449952194 shutdown_connections 2023-11-08T12:30:59.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4dd190700 1 --2- 172.21.15.112:0/2449952194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d815c640 0x7fa4d80d31e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4dd190700 1 -- 172.21.15.112:0/2449952194 >> 172.21.15.112:0/2449952194 conn(0x7fa4d80b6520 msgr2=0x7fa4d8071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4dd190700 1 -- 172.21.15.112:0/2449952194 shutdown_connections 2023-11-08T12:30:59.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.373+0000 7fa4dd190700 1 -- 172.21.15.112:0/2449952194 wait complete. 2023-11-08T12:30:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 Processor -- start 2023-11-08T12:30:59.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 -- start start 2023-11-08T12:30:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4d8069e00 0x7fa4d81f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.381 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d8071aa0 0x7fa4d80c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d815c640 0x7fa4d80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c7f40 con 0x7fa4d8071aa0 2023-11-08T12:30:59.382 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c84c0 con 0x7fa4d815c640 2023-11-08T12:30:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4dd190700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80b29e0 con 0x7fa4d8069e00 2023-11-08T12:30:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4cf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d8071aa0 0x7fa4d80c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4cf7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d8071aa0 0x7fa4d80c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44276/0 (socket says 172.21.15.112:44276) 2023-11-08T12:30:59.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4cf7fe700 1 -- 172.21.15.112:0/807811673 learned_addr learned my addr 172.21.15.112:0/807811673 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:59.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.377+0000 7fa4d7fff700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4d8069e00 0x7fa4d81f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4dc98f700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d815c640 0x7fa4d80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4cf7fe700 1 -- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4d8069e00 msgr2=0x7fa4d81f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4cf7fe700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4d8069e00 0x7fa4d81f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4cf7fe700 1 -- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d815c640 msgr2=0x7fa4d80cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4cf7fe700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d815c640 0x7fa4d80cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4cf7fe700 1 -- 172.21.15.112:0/807811673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80094b0 con 0x7fa4d8071aa0 2023-11-08T12:30:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4cf7fe700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d8071aa0 0x7fa4d80c8950 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000c520 tx=0x7fa4c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:59.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4d57fa700 1 -- 172.21.15.112:0/807811673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0005d90 con 0x7fa4d8071aa0 2023-11-08T12:30:59.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4d57fa700 1 -- 172.21.15.112:0/807811673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c00070d0 con 0x7fa4d8071aa0 2023-11-08T12:30:59.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4d57fa700 1 -- 172.21.15.112:0/807811673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0007460 con 0x7fa4d8071aa0 2023-11-08T12:30:59.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d8072010 con 0x7fa4d8071aa0 2023-11-08T12:30:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d815ca10 con 0x7fa4d8071aa0 2023-11-08T12:30:59.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.381+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d806c830 con 0x7fa4d8071aa0 2023-11-08T12:30:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.385+0000 7fa4d57fa700 1 -- 172.21.15.112:0/807811673 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa4c0019030 con 0x7fa4d8071aa0 2023-11-08T12:30:59.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.385+0000 7fa4d57fa700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa4b8064ee0 0x7fa4b8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.385+0000 7fa4d57fa700 1 -- 172.21.15.112:0/807811673 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa4c00814a0 con 0x7fa4d8071aa0 2023-11-08T12:30:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.385+0000 7fa4d7fff700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa4b8064ee0 0x7fa4b8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.385+0000 7fa4d7fff700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa4b8064ee0 0x7fa4b8067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097d0 tx=0x7fa4c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:59.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.393+0000 7fa4d57fa700 1 -- 172.21.15.112:0/807811673 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa4c004f380 con 0x7fa4d8071aa0 2023-11-08T12:30:59.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.565+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4d806c550 con 0x7fa4b8064ee0 2023-11-08T12:30:59.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.581+0000 7fa4d57fa700 1 -- 172.21.15.112:0/807811673 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307204 (secure 0 0 0) 0x7fa4d806c550 con 0x7fa4b8064ee0 2023-11-08T12:30:59.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:30:59.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa4b8064ee0 msgr2=0x7fa4b8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa4b8064ee0 0x7fa4b8067390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097d0 tx=0x7fa4c8008030 comp rx=0 tx=0).stop 2023-11-08T12:30:59.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d8071aa0 msgr2=0x7fa4d80c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d8071aa0 0x7fa4d80c8950 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000c520 tx=0x7fa4c000c830 comp rx=0 tx=0).stop 2023-11-08T12:30:59.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 shutdown_connections 2023-11-08T12:30:59.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa4b8064ee0 0x7fa4b8067390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4d815c640 0x7fa4d80cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4d8071aa0 0x7fa4d80c8950 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 --2- 172.21.15.112:0/807811673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4d8069e00 0x7fa4d81f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 >> 172.21.15.112:0/807811673 conn(0x7fa4d80b6520 msgr2=0x7fa4d80d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:59.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 shutdown_connections 2023-11-08T12:30:59.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.589+0000 7fa4dd190700 1 -- 172.21.15.112:0/807811673 wait complete. 2023-11-08T12:30:59.595 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:30:59.613 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-08T12:30:58.774403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80148,"kb_used_data":7572,"kb_used_omap":0,"kb_used_meta":72512,"kb_avail":754894572,"statfs":{"total":773094113280,"available":773012041728,"internally_reserved":0,"allocated":7753728,"data_stored":4219750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74252288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.971624"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331748+0000","last_change":"2023-11-08T12:30:55.328953+0000","last_active":"2023-11-08T12:30:55.331748+0000","last_peered":"2023-11-08T12:30:55.331748+0000","last_clean":"2023-11-08T12:30:55.331748+0000","last_became_active":"2023-11-08T12:30:55.328518+0000","last_became_peered":"2023-11-08T12:30:55.328518+0000","last_unstale":"2023-11-08T12:30:55.331748+0000","last_undegraded":"2023-11-08T12:30:55.331748+0000","last_fullsized":"2023-11-08T12:30:55.331748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:04:49.078439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650079+0000","last_change":"2023-11-08T12:30:55.320721+0000","last_active":"2023-11-08T12:30:56.650079+0000","last_peered":"2023-11-08T12:30:56.650079+0000","last_clean":"2023-11-08T12:30:56.650079+0000","last_became_active":"2023-11-08T12:30:55.320483+0000","last_became_peered":"2023-11-08T12:30:55.320483+0000","last_unstale":"2023-11-08T12:30:56.650079+0000","last_undegraded":"2023-11-08T12:30:56.650079+0000","last_fullsized":"2023-11-08T12:30:56.650079+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:45.609313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321794+0000","last_change":"2023-11-08T12:30:55.319674+0000","last_active":"2023-11-08T12:30:55.321794+0000","last_peered":"2023-11-08T12:30:55.321794+0000","last_clean":"2023-11-08T12:30:55.321794+0000","last_became_active":"2023-11-08T12:30:55.319430+0000","last_became_peered":"2023-11-08T12:30:55.319430+0000","last_unstale":"2023-11-08T12:30:55.321794+0000","last_undegraded":"2023-11-08T12:30:55.321794+0000","last_fullsized":"2023-11-08T12:30:55.321794+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330610+0000","last_change":"2023-11-08T12:30:55.329331+0000","last_active":"2023-11-08T12:30:55.330610+0000","last_peered":"2023-11-08T12:30:55.330610+0000","last_clean":"2023-11-08T12:30:55.330610+0000","last_became_active":"2023-11-08T12:30:55.329078+0000","last_became_peered":"2023-11-08T12:30:55.329078+0000","last_unstale":"2023-11-08T12:30:55.330610+0000","last_undegraded":"2023-11-08T12:30:55.330610+0000","last_fullsized":"2023-11-08T12:30:55.330610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:38:53.919890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649426+0000","last_change":"2023-11-08T12:30:55.324724+0000","last_active":"2023-11-08T12:30:56.649426+0000","last_peered":"2023-11-08T12:30:56.649426+0000","last_clean":"2023-11-08T12:30:56.649426+0000","last_became_active":"2023-11-08T12:30:55.324468+0000","last_became_peered":"2023-11-08T12:30:55.324468+0000","last_unstale":"2023-11-08T12:30:56.649426+0000","last_undegraded":"2023-11-08T12:30:56.649426+0000","last_fullsized":"2023-11-08T12:30:56.649426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.317050+0000","last_change":"2023-11-08T12:30:55.309539+0000","last_active":"2023-11-08T12:30:55.317050+0000","last_peered":"2023-11-08T12:30:55.317050+0000","last_clean":"2023-11-08T12:30:55.317050+0000","last_became_active":"2023-11-08T12:30:55.309199+0000","last_became_peered":"2023-11-08T12:30:55.309199+0000","last_unstale":"2023-11-08T12:30:55.317050+0000","last_undegraded":"2023-11-08T12:30:55.317050+0000","last_fullsized":"2023-11-08T12:30:55.317050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647430+0000","last_change":"2023-11-08T12:30:55.323799+0000","last_active":"2023-11-08T12:30:56.647430+0000","last_peered":"2023-11-08T12:30:56.647430+0000","last_clean":"2023-11-08T12:30:56.647430+0000","last_became_active":"2023-11-08T12:30:55.322805+0000","last_became_peered":"2023-11-08T12:30:55.322805+0000","last_unstale":"2023-11-08T12:30:56.647430+0000","last_undegraded":"2023-11-08T12:30:56.647430+0000","last_fullsized":"2023-11-08T12:30:56.647430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:58:32.146431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650420+0000","last_change":"2023-11-08T12:30:55.325321+0000","last_active":"2023-11-08T12:30:56.650420+0000","last_peered":"2023-11-08T12:30:56.650420+0000","last_clean":"2023-11-08T12:30:56.650420+0000","last_became_active":"2023-11-08T12:30:55.324837+0000","last_became_peered":"2023-11-08T12:30:55.324837+0000","last_unstale":"2023-11-08T12:30:56.650420+0000","last_undegraded":"2023-11-08T12:30:56.650420+0000","last_fullsized":"2023-11-08T12:30:56.650420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334701+0000","last_change":"2023-11-08T12:30:55.331241+0000","last_active":"2023-11-08T12:30:55.334701+0000","last_peered":"2023-11-08T12:30:55.334701+0000","last_clean":"2023-11-08T12:30:55.334701+0000","last_became_active":"2023-11-08T12:30:55.330973+0000","last_became_peered":"2023-11-08T12:30:55.330973+0000","last_unstale":"2023-11-08T12:30:55.334701+0000","last_undegraded":"2023-11-08T12:30:55.334701+0000","last_fullsized":"2023-11-08T12:30:55.334701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:03:30.133538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330562+0000","last_change":"2023-11-08T12:30:55.322622+0000","last_active":"2023-11-08T12:30:55.330562+0000","last_peered":"2023-11-08T12:30:55.330562+0000","last_clean":"2023-11-08T12:30:55.330562+0000","last_became_active":"2023-11-08T12:30:55.322388+0000","last_became_peered":"2023-11-08T12:30:55.322388+0000","last_unstale":"2023-11-08T12:30:55.330562+0000","last_undegraded":"2023-11-08T12:30:55.330562+0000","last_fullsized":"2023-11-08T12:30:55.330562+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:00:17.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329728+0000","last_change":"2023-11-08T12:30:55.328399+0000","last_active":"2023-11-08T12:30:55.329728+0000","last_peered":"2023-11-08T12:30:55.329728+0000","last_clean":"2023-11-08T12:30:55.329728+0000","last_became_active":"2023-11-08T12:30:55.327392+0000","last_became_peered":"2023-11-08T12:30:55.327392+0000","last_unstale":"2023-11-08T12:30:55.329728+0000","last_undegraded":"2023-11-08T12:30:55.329728+0000","last_fullsized":"2023-11-08T12:30:55.329728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:31:15.497928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325002+0000","last_change":"2023-11-08T12:30:55.317752+0000","last_active":"2023-11-08T12:30:55.325002+0000","last_peered":"2023-11-08T12:30:55.325002+0000","last_clean":"2023-11-08T12:30:55.325002+0000","last_became_active":"2023-11-08T12:30:55.317496+0000","last_became_peered":"2023-11-08T12:30:55.317496+0000","last_unstale":"2023-11-08T12:30:55.325002+0000","last_undegraded":"2023-11-08T12:30:55.325002+0000","last_fullsized":"2023-11-08T12:30:55.325002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647309+0000","last_change":"2023-11-08T12:30:55.326903+0000","last_active":"2023-11-08T12:30:56.647309+0000","last_peered":"2023-11-08T12:30:56.647309+0000","last_clean":"2023-11-08T12:30:56.647309+0000","last_became_active":"2023-11-08T12:30:55.326660+0000","last_became_peered":"2023-11-08T12:30:55.326660+0000","last_unstale":"2023-11-08T12:30:56.647309+0000","last_undegraded":"2023-11-08T12:30:56.647309+0000","last_fullsized":"2023-11-08T12:30:56.647309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332470+0000","last_change":"2023-11-08T12:30:55.331216+0000","last_active":"2023-11-08T12:30:55.332470+0000","last_peered":"2023-11-08T12:30:55.332470+0000","last_clean":"2023-11-08T12:30:55.332470+0000","last_became_active":"2023-11-08T12:30:55.330893+0000","last_became_peered":"2023-11-08T12:30:55.330893+0000","last_unstale":"2023-11-08T12:30:55.332470+0000","last_undegraded":"2023-11-08T12:30:55.332470+0000","last_fullsized":"2023-11-08T12:30:55.332470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:35:52.148689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649345+0000","last_change":"2023-11-08T12:30:55.322352+0000","last_active":"2023-11-08T12:30:56.649345+0000","last_peered":"2023-11-08T12:30:56.649345+0000","last_clean":"2023-11-08T12:30:56.649345+0000","last_became_active":"2023-11-08T12:30:55.322091+0000","last_became_peered":"2023-11-08T12:30:55.322091+0000","last_unstale":"2023-11-08T12:30:56.649345+0000","last_undegraded":"2023-11-08T12:30:56.649345+0000","last_fullsized":"2023-11-08T12:30:56.649345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:44:24.238839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325072+0000","last_change":"2023-11-08T12:30:55.319873+0000","last_active":"2023-11-08T12:30:55.325072+0000","last_peered":"2023-11-08T12:30:55.325072+0000","last_clean":"2023-11-08T12:30:55.325072+0000","last_became_active":"2023-11-08T12:30:55.319631+0000","last_became_peered":"2023-11-08T12:30:55.319631+0000","last_unstale":"2023-11-08T12:30:55.325072+0000","last_undegraded":"2023-11-08T12:30:55.325072+0000","last_fullsized":"2023-11-08T12:30:55.325072+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:25:00.378994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650017+0000","last_change":"2023-11-08T12:30:55.321243+0000","last_active":"2023-11-08T12:30:56.650017+0000","last_peered":"2023-11-08T12:30:56.650017+0000","last_clean":"2023-11-08T12:30:56.650017+0000","last_became_active":"2023-11-08T12:30:55.320928+0000","last_became_peered":"2023-11-08T12:30:55.320928+0000","last_unstale":"2023-11-08T12:30:56.650017+0000","last_undegraded":"2023-11-08T12:30:56.650017+0000","last_fullsized":"2023-11-08T12:30:56.650017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649813+0000","last_change":"2023-11-08T12:30:55.314603+0000","last_active":"2023-11-08T12:30:56.649813+0000","last_peered":"2023-11-08T12:30:56.649813+0000","last_clean":"2023-11-08T12:30:56.649813+0000","last_became_active":"2023-11-08T12:30:55.314244+0000","last_became_peered":"2023-11-08T12:30:55.314244+0000","last_unstale":"2023-11-08T12:30:56.649813+0000","last_undegraded":"2023-11-08T12:30:56.649813+0000","last_fullsized":"2023-11-08T12:30:56.649813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329382+0000","last_change":"2023-11-08T12:30:55.324660+0000","last_active":"2023-11-08T12:30:55.329382+0000","last_peered":"2023-11-08T12:30:55.329382+0000","last_clean":"2023-11-08T12:30:55.329382+0000","last_became_active":"2023-11-08T12:30:55.324367+0000","last_became_peered":"2023-11-08T12:30:55.324367+0000","last_unstale":"2023-11-08T12:30:55.329382+0000","last_undegraded":"2023-11-08T12:30:55.329382+0000","last_fullsized":"2023-11-08T12:30:55.329382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336629+0000","last_change":"2023-11-08T12:30:55.331611+0000","last_active":"2023-11-08T12:30:55.336629+0000","last_peered":"2023-11-08T12:30:55.336629+0000","last_clean":"2023-11-08T12:30:55.336629+0000","last_became_active":"2023-11-08T12:30:55.331332+0000","last_became_peered":"2023-11-08T12:30:55.331332+0000","last_unstale":"2023-11-08T12:30:55.336629+0000","last_undegraded":"2023-11-08T12:30:55.336629+0000","last_fullsized":"2023-11-08T12:30:55.336629+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:07.030455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650350+0000","last_change":"2023-11-08T12:30:55.335185+0000","last_active":"2023-11-08T12:30:56.650350+0000","last_peered":"2023-11-08T12:30:56.650350+0000","last_clean":"2023-11-08T12:30:56.650350+0000","last_became_active":"2023-11-08T12:30:55.334582+0000","last_became_peered":"2023-11-08T12:30:55.334582+0000","last_unstale":"2023-11-08T12:30:56.650350+0000","last_undegraded":"2023-11-08T12:30:56.650350+0000","last_fullsized":"2023-11-08T12:30:56.650350+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:45.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334783+0000","last_change":"2023-11-08T12:30:55.330007+0000","last_active":"2023-11-08T12:30:55.334783+0000","last_peered":"2023-11-08T12:30:55.334783+0000","last_clean":"2023-11-08T12:30:55.334783+0000","last_became_active":"2023-11-08T12:30:55.326154+0000","last_became_peered":"2023-11-08T12:30:55.326154+0000","last_unstale":"2023-11-08T12:30:55.334783+0000","last_undegraded":"2023-11-08T12:30:55.334783+0000","last_fullsized":"2023-11-08T12:30:55.334783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321778+0000","last_change":"2023-11-08T12:30:55.316113+0000","last_active":"2023-11-08T12:30:55.321778+0000","last_peered":"2023-11-08T12:30:55.321778+0000","last_clean":"2023-11-08T12:30:55.321778+0000","last_became_active":"2023-11-08T12:30:55.315770+0000","last_became_peered":"2023-11-08T12:30:55.315770+0000","last_unstale":"2023-11-08T12:30:55.321778+0000","last_undegraded":"2023-11-08T12:30:55.321778+0000","last_fullsized":"2023-11-08T12:30:55.321778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650222+0000","last_change":"2023-11-08T12:30:55.319074+0000","last_active":"2023-11-08T12:30:56.650222+0000","last_peered":"2023-11-08T12:30:56.650222+0000","last_clean":"2023-11-08T12:30:56.650222+0000","last_became_active":"2023-11-08T12:30:55.318252+0000","last_became_peered":"2023-11-08T12:30:55.318252+0000","last_unstale":"2023-11-08T12:30:56.650222+0000","last_undegraded":"2023-11-08T12:30:56.650222+0000","last_fullsized":"2023-11-08T12:30:56.650222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.306389+0000","last_change":"2023-11-08T12:30:55.302817+0000","last_active":"2023-11-08T12:30:55.306389+0000","last_peered":"2023-11-08T12:30:55.306389+0000","last_clean":"2023-11-08T12:30:55.306389+0000","last_became_active":"2023-11-08T12:30:55.302532+0000","last_became_peered":"2023-11-08T12:30:55.302532+0000","last_unstale":"2023-11-08T12:30:55.306389+0000","last_undegraded":"2023-11-08T12:30:55.306389+0000","last_fullsized":"2023-11-08T12:30:55.306389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330572+0000","last_change":"2023-11-08T12:30:55.326527+0000","last_active":"2023-11-08T12:30:55.330572+0000","last_peered":"2023-11-08T12:30:55.330572+0000","last_clean":"2023-11-08T12:30:55.330572+0000","last_became_active":"2023-11-08T12:30:55.326149+0000","last_became_peered":"2023-11-08T12:30:55.326149+0000","last_unstale":"2023-11-08T12:30:55.330572+0000","last_undegraded":"2023-11-08T12:30:55.330572+0000","last_fullsized":"2023-11-08T12:30:55.330572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.309641+0000","last_change":"2023-11-08T12:30:55.304430+0000","last_active":"2023-11-08T12:30:55.309641+0000","last_peered":"2023-11-08T12:30:55.309641+0000","last_clean":"2023-11-08T12:30:55.309641+0000","last_became_active":"2023-11-08T12:30:55.304157+0000","last_became_peered":"2023-11-08T12:30:55.304157+0000","last_unstale":"2023-11-08T12:30:55.309641+0000","last_undegraded":"2023-11-08T12:30:55.309641+0000","last_fullsized":"2023-11-08T12:30:55.309641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:54:35.840622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647670+0000","last_change":"2023-11-08T12:30:55.321120+0000","last_active":"2023-11-08T12:30:56.647670+0000","last_peered":"2023-11-08T12:30:56.647670+0000","last_clean":"2023-11-08T12:30:56.647670+0000","last_became_active":"2023-11-08T12:30:55.320278+0000","last_became_peered":"2023-11-08T12:30:55.320278+0000","last_unstale":"2023-11-08T12:30:56.647670+0000","last_undegraded":"2023-11-08T12:30:56.647670+0000","last_fullsized":"2023-11-08T12:30:56.647670+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:02:47.585589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336724+0000","last_change":"2023-11-08T12:30:55.332770+0000","last_active":"2023-11-08T12:30:55.336724+0000","last_peered":"2023-11-08T12:30:55.336724+0000","last_clean":"2023-11-08T12:30:55.336724+0000","last_became_active":"2023-11-08T12:30:55.332517+0000","last_became_peered":"2023-11-08T12:30:55.332517+0000","last_unstale":"2023-11-08T12:30:55.336724+0000","last_undegraded":"2023-11-08T12:30:55.336724+0000","last_fullsized":"2023-11-08T12:30:55.336724+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332156+0000","last_change":"2023-11-08T12:30:54.846800+0000","last_active":"2023-11-08T12:30:55.332156+0000","last_peered":"2023-11-08T12:30:55.332156+0000","last_clean":"2023-11-08T12:30:55.332156+0000","last_became_active":"2023-11-08T12:30:54.846540+0000","last_became_peered":"2023-11-08T12:30:54.846540+0000","last_unstale":"2023-11-08T12:30:55.332156+0000","last_undegraded":"2023-11-08T12:30:55.332156+0000","last_fullsized":"2023-11-08T12:30:55.332156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:29:02.918713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325670+0000","last_change":"2023-11-08T12:30:54.849246+0000","last_active":"2023-11-08T12:30:55.325670+0000","last_peered":"2023-11-08T12:30:55.325670+0000","last_clean":"2023-11-08T12:30:55.325670+0000","last_became_active":"2023-11-08T12:30:54.848932+0000","last_became_peered":"2023-11-08T12:30:54.848932+0000","last_unstale":"2023-11-08T12:30:55.325670+0000","last_undegraded":"2023-11-08T12:30:55.325670+0000","last_fullsized":"2023-11-08T12:30:55.325670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649715+0000","last_change":"2023-11-08T12:30:55.323319+0000","last_active":"2023-11-08T12:30:56.649715+0000","last_peered":"2023-11-08T12:30:56.649715+0000","last_clean":"2023-11-08T12:30:56.649715+0000","last_became_active":"2023-11-08T12:30:55.323053+0000","last_became_peered":"2023-11-08T12:30:55.323053+0000","last_unstale":"2023-11-08T12:30:56.649715+0000","last_undegraded":"2023-11-08T12:30:56.649715+0000","last_fullsized":"2023-11-08T12:30:56.649715+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:12:40.881917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650330+0000","last_change":"2023-11-08T12:30:54.831895+0000","last_active":"2023-11-08T12:30:56.650330+0000","last_peered":"2023-11-08T12:30:56.650330+0000","last_clean":"2023-11-08T12:30:56.650330+0000","last_became_active":"2023-11-08T12:30:54.831579+0000","last_became_peered":"2023-11-08T12:30:54.831579+0000","last_unstale":"2023-11-08T12:30:56.650330+0000","last_undegraded":"2023-11-08T12:30:56.650330+0000","last_fullsized":"2023-11-08T12:30:56.650330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.324474+0000","last_change":"2023-11-08T12:30:55.318219+0000","last_active":"2023-11-08T12:30:55.324474+0000","last_peered":"2023-11-08T12:30:55.324474+0000","last_clean":"2023-11-08T12:30:55.324474+0000","last_became_active":"2023-11-08T12:30:55.317811+0000","last_became_peered":"2023-11-08T12:30:55.317811+0000","last_unstale":"2023-11-08T12:30:55.324474+0000","last_undegraded":"2023-11-08T12:30:55.324474+0000","last_fullsized":"2023-11-08T12:30:55.324474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649832+0000","last_change":"2023-11-08T12:30:54.843634+0000","last_active":"2023-11-08T12:30:56.649832+0000","last_peered":"2023-11-08T12:30:56.649832+0000","last_clean":"2023-11-08T12:30:56.649832+0000","last_became_active":"2023-11-08T12:30:54.843178+0000","last_became_peered":"2023-11-08T12:30:54.843178+0000","last_unstale":"2023-11-08T12:30:56.649832+0000","last_undegraded":"2023-11-08T12:30:56.649832+0000","last_fullsized":"2023-11-08T12:30:56.649832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:36:56.748105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310880+0000","last_change":"2023-11-08T12:30:55.305408+0000","last_active":"2023-11-08T12:30:55.310880+0000","last_peered":"2023-11-08T12:30:55.310880+0000","last_clean":"2023-11-08T12:30:55.310880+0000","last_became_active":"2023-11-08T12:30:55.305030+0000","last_became_peered":"2023-11-08T12:30:55.305030+0000","last_unstale":"2023-11-08T12:30:55.310880+0000","last_undegraded":"2023-11-08T12:30:55.310880+0000","last_fullsized":"2023-11-08T12:30:55.310880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:43.056426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328467+0000","last_change":"2023-11-08T12:30:54.835678+0000","last_active":"2023-11-08T12:30:55.328467+0000","last_peered":"2023-11-08T12:30:55.328467+0000","last_clean":"2023-11-08T12:30:55.328467+0000","last_became_active":"2023-11-08T12:30:54.833332+0000","last_became_peered":"2023-11-08T12:30:54.833332+0000","last_unstale":"2023-11-08T12:30:55.328467+0000","last_undegraded":"2023-11-08T12:30:55.328467+0000","last_fullsized":"2023-11-08T12:30:55.328467+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650059+0000","last_change":"2023-11-08T12:30:55.335120+0000","last_active":"2023-11-08T12:30:56.650059+0000","last_peered":"2023-11-08T12:30:56.650059+0000","last_clean":"2023-11-08T12:30:56.650059+0000","last_became_active":"2023-11-08T12:30:55.334810+0000","last_became_peered":"2023-11-08T12:30:55.334810+0000","last_unstale":"2023-11-08T12:30:56.650059+0000","last_undegraded":"2023-11-08T12:30:56.650059+0000","last_fullsized":"2023-11-08T12:30:56.650059+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:24.721389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649532+0000","last_change":"2023-11-08T12:30:54.844976+0000","last_active":"2023-11-08T12:30:56.649532+0000","last_peered":"2023-11-08T12:30:56.649532+0000","last_clean":"2023-11-08T12:30:56.649532+0000","last_became_active":"2023-11-08T12:30:54.844700+0000","last_became_peered":"2023-11-08T12:30:54.844700+0000","last_unstale":"2023-11-08T12:30:56.649532+0000","last_undegraded":"2023-11-08T12:30:56.649532+0000","last_fullsized":"2023-11-08T12:30:56.649532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:56:27.392361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303200+0000","last_change":"2023-11-08T12:30:54.839982+0000","last_active":"2023-11-08T12:30:55.303200+0000","last_peered":"2023-11-08T12:30:55.303200+0000","last_clean":"2023-11-08T12:30:55.303200+0000","last_became_active":"2023-11-08T12:30:54.839352+0000","last_became_peered":"2023-11-08T12:30:54.839352+0000","last_unstale":"2023-11-08T12:30:55.303200+0000","last_undegraded":"2023-11-08T12:30:55.303200+0000","last_fullsized":"2023-11-08T12:30:55.303200+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:30:19.689649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328548+0000","last_change":"2023-11-08T12:30:55.325624+0000","last_active":"2023-11-08T12:30:55.328548+0000","last_peered":"2023-11-08T12:30:55.328548+0000","last_clean":"2023-11-08T12:30:55.328548+0000","last_became_active":"2023-11-08T12:30:55.325215+0000","last_became_peered":"2023-11-08T12:30:55.325215+0000","last_unstale":"2023-11-08T12:30:55.328548+0000","last_undegraded":"2023-11-08T12:30:55.328548+0000","last_fullsized":"2023-11-08T12:30:55.328548+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.808191+0000","last_change":"2023-11-08T12:30:53.808191+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.808191+0000","last_undegraded":"2023-11-08T12:30:53.808191+0000","last_fullsized":"2023-11-08T12:30:53.808191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:57:06.225781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316655+0000","last_change":"2023-11-08T12:30:55.313267+0000","last_active":"2023-11-08T12:30:55.316655+0000","last_peered":"2023-11-08T12:30:55.316655+0000","last_clean":"2023-11-08T12:30:55.316655+0000","last_became_active":"2023-11-08T12:30:55.313008+0000","last_became_peered":"2023-11-08T12:30:55.313008+0000","last_unstale":"2023-11-08T12:30:55.316655+0000","last_undegraded":"2023-11-08T12:30:55.316655+0000","last_fullsized":"2023-11-08T12:30:55.316655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650448+0000","last_change":"2023-11-08T12:30:54.835906+0000","last_active":"2023-11-08T12:30:56.650448+0000","last_peered":"2023-11-08T12:30:56.650448+0000","last_clean":"2023-11-08T12:30:56.650448+0000","last_became_active":"2023-11-08T12:30:54.835646+0000","last_became_peered":"2023-11-08T12:30:54.835646+0000","last_unstale":"2023-11-08T12:30:56.650448+0000","last_undegraded":"2023-11-08T12:30:56.650448+0000","last_fullsized":"2023-11-08T12:30:56.650448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336682+0000","last_change":"2023-11-08T12:30:55.332691+0000","last_active":"2023-11-08T12:30:55.336682+0000","last_peered":"2023-11-08T12:30:55.336682+0000","last_clean":"2023-11-08T12:30:55.336682+0000","last_became_active":"2023-11-08T12:30:55.332466+0000","last_became_peered":"2023-11-08T12:30:55.332466+0000","last_unstale":"2023-11-08T12:30:55.336682+0000","last_undegraded":"2023-11-08T12:30:55.336682+0000","last_fullsized":"2023-11-08T12:30:55.336682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:32.086861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650156+0000","last_change":"2023-11-08T12:30:54.838927+0000","last_active":"2023-11-08T12:30:56.650156+0000","last_peered":"2023-11-08T12:30:56.650156+0000","last_clean":"2023-11-08T12:30:56.650156+0000","last_became_active":"2023-11-08T12:30:54.838387+0000","last_became_peered":"2023-11-08T12:30:54.838387+0000","last_unstale":"2023-11-08T12:30:56.650156+0000","last_undegraded":"2023-11-08T12:30:56.650156+0000","last_fullsized":"2023-11-08T12:30:56.650156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:02:00.436766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650138+0000","last_change":"2023-11-08T12:30:55.319414+0000","last_active":"2023-11-08T12:30:56.650138+0000","last_peered":"2023-11-08T12:30:56.650138+0000","last_clean":"2023-11-08T12:30:56.650138+0000","last_became_active":"2023-11-08T12:30:55.319072+0000","last_became_peered":"2023-11-08T12:30:55.319072+0000","last_unstale":"2023-11-08T12:30:56.650138+0000","last_undegraded":"2023-11-08T12:30:56.650138+0000","last_fullsized":"2023-11-08T12:30:56.650138+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:46.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321720+0000","last_change":"2023-11-08T12:30:54.834908+0000","last_active":"2023-11-08T12:30:55.321720+0000","last_peered":"2023-11-08T12:30:55.321720+0000","last_clean":"2023-11-08T12:30:55.321720+0000","last_became_active":"2023-11-08T12:30:54.834652+0000","last_became_peered":"2023-11-08T12:30:54.834652+0000","last_unstale":"2023-11-08T12:30:55.321720+0000","last_undegraded":"2023-11-08T12:30:55.321720+0000","last_fullsized":"2023-11-08T12:30:55.321720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"69'6","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334842+0000","last_change":"2023-11-08T12:30:54.849645+0000","last_active":"2023-11-08T12:30:55.334842+0000","last_peered":"2023-11-08T12:30:55.334842+0000","last_clean":"2023-11-08T12:30:55.334842+0000","last_became_active":"2023-11-08T12:30:54.849337+0000","last_became_peered":"2023-11-08T12:30:54.849337+0000","last_unstale":"2023-11-08T12:30:55.334842+0000","last_undegraded":"2023-11-08T12:30:55.334842+0000","last_fullsized":"2023-11-08T12:30:55.334842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.244426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.322459+0000","last_change":"2023-11-08T12:30:55.318084+0000","last_active":"2023-11-08T12:30:55.322459+0000","last_peered":"2023-11-08T12:30:55.322459+0000","last_clean":"2023-11-08T12:30:55.322459+0000","last_became_active":"2023-11-08T12:30:55.317807+0000","last_became_peered":"2023-11-08T12:30:55.317807+0000","last_unstale":"2023-11-08T12:30:55.322459+0000","last_undegraded":"2023-11-08T12:30:55.322459+0000","last_fullsized":"2023-11-08T12:30:55.322459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:01:11.195203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325446+0000","last_change":"2023-11-08T12:30:54.846257+0000","last_active":"2023-11-08T12:30:55.325446+0000","last_peered":"2023-11-08T12:30:55.325446+0000","last_clean":"2023-11-08T12:30:55.325446+0000","last_became_active":"2023-11-08T12:30:54.845973+0000","last_became_peered":"2023-11-08T12:30:54.845973+0000","last_unstale":"2023-11-08T12:30:55.325446+0000","last_undegraded":"2023-11-08T12:30:55.325446+0000","last_fullsized":"2023-11-08T12:30:55.325446+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:18.819505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329997+0000","last_change":"2023-11-08T12:30:55.324143+0000","last_active":"2023-11-08T12:30:55.329997+0000","last_peered":"2023-11-08T12:30:55.329997+0000","last_clean":"2023-11-08T12:30:55.329997+0000","last_became_active":"2023-11-08T12:30:55.319125+0000","last_became_peered":"2023-11-08T12:30:55.319125+0000","last_unstale":"2023-11-08T12:30:55.329997+0000","last_undegraded":"2023-11-08T12:30:55.329997+0000","last_fullsized":"2023-11-08T12:30:55.329997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:40.089625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649611+0000","last_change":"2023-11-08T12:30:54.838934+0000","last_active":"2023-11-08T12:30:56.649611+0000","last_peered":"2023-11-08T12:30:56.649611+0000","last_clean":"2023-11-08T12:30:56.649611+0000","last_became_active":"2023-11-08T12:30:54.838577+0000","last_became_peered":"2023-11-08T12:30:54.838577+0000","last_unstale":"2023-11-08T12:30:56.649611+0000","last_undegraded":"2023-11-08T12:30:56.649611+0000","last_fullsized":"2023-11-08T12:30:56.649611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:06.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332911+0000","last_change":"2023-11-08T12:30:55.331694+0000","last_active":"2023-11-08T12:30:55.332911+0000","last_peered":"2023-11-08T12:30:55.332911+0000","last_clean":"2023-11-08T12:30:55.332911+0000","last_became_active":"2023-11-08T12:30:55.330426+0000","last_became_peered":"2023-11-08T12:30:55.330426+0000","last_unstale":"2023-11-08T12:30:55.332911+0000","last_undegraded":"2023-11-08T12:30:55.332911+0000","last_fullsized":"2023-11-08T12:30:55.332911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295791+0000","last_change":"2023-11-08T12:30:54.832910+0000","last_active":"2023-11-08T12:30:55.295791+0000","last_peered":"2023-11-08T12:30:55.295791+0000","last_clean":"2023-11-08T12:30:55.295791+0000","last_became_active":"2023-11-08T12:30:54.832399+0000","last_became_peered":"2023-11-08T12:30:54.832399+0000","last_unstale":"2023-11-08T12:30:55.295791+0000","last_undegraded":"2023-11-08T12:30:55.295791+0000","last_fullsized":"2023-11-08T12:30:55.295791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:50:27.468368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"69'8","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647438+0000","last_change":"2023-11-08T12:30:54.843786+0000","last_active":"2023-11-08T12:30:56.647438+0000","last_peered":"2023-11-08T12:30:56.647438+0000","last_clean":"2023-11-08T12:30:56.647438+0000","last_became_active":"2023-11-08T12:30:54.843532+0000","last_became_peered":"2023-11-08T12:30:54.843532+0000","last_unstale":"2023-11-08T12:30:56.647438+0000","last_undegraded":"2023-11-08T12:30:56.647438+0000","last_fullsized":"2023-11-08T12:30:56.647438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328517+0000","last_change":"2023-11-08T12:30:55.324593+0000","last_active":"2023-11-08T12:30:55.328517+0000","last_peered":"2023-11-08T12:30:55.328517+0000","last_clean":"2023-11-08T12:30:55.328517+0000","last_became_active":"2023-11-08T12:30:55.324360+0000","last_became_peered":"2023-11-08T12:30:55.324360+0000","last_unstale":"2023-11-08T12:30:55.328517+0000","last_undegraded":"2023-11-08T12:30:55.328517+0000","last_fullsized":"2023-11-08T12:30:55.328517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650015+0000","last_change":"2023-11-08T12:30:54.836571+0000","last_active":"2023-11-08T12:30:56.650015+0000","last_peered":"2023-11-08T12:30:56.650015+0000","last_clean":"2023-11-08T12:30:56.650015+0000","last_became_active":"2023-11-08T12:30:54.836202+0000","last_became_peered":"2023-11-08T12:30:54.836202+0000","last_unstale":"2023-11-08T12:30:56.650015+0000","last_undegraded":"2023-11-08T12:30:56.650015+0000","last_fullsized":"2023-11-08T12:30:56.650015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:40:02.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321277+0000","last_change":"2023-11-08T12:30:55.316242+0000","last_active":"2023-11-08T12:30:55.321277+0000","last_peered":"2023-11-08T12:30:55.321277+0000","last_clean":"2023-11-08T12:30:55.321277+0000","last_became_active":"2023-11-08T12:30:55.315945+0000","last_became_peered":"2023-11-08T12:30:55.315945+0000","last_unstale":"2023-11-08T12:30:55.321277+0000","last_undegraded":"2023-11-08T12:30:55.321277+0000","last_fullsized":"2023-11-08T12:30:55.321277+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295880+0000","last_change":"2023-11-08T12:30:54.833269+0000","last_active":"2023-11-08T12:30:55.295880+0000","last_peered":"2023-11-08T12:30:55.295880+0000","last_clean":"2023-11-08T12:30:55.295880+0000","last_became_active":"2023-11-08T12:30:54.833032+0000","last_became_peered":"2023-11-08T12:30:54.833032+0000","last_unstale":"2023-11-08T12:30:55.295880+0000","last_undegraded":"2023-11-08T12:30:55.295880+0000","last_fullsized":"2023-11-08T12:30:55.295880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:32:31.381604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336618+0000","last_change":"2023-11-08T12:30:55.331577+0000","last_active":"2023-11-08T12:30:55.336618+0000","last_peered":"2023-11-08T12:30:55.336618+0000","last_clean":"2023-11-08T12:30:55.336618+0000","last_became_active":"2023-11-08T12:30:55.331235+0000","last_became_peered":"2023-11-08T12:30:55.331235+0000","last_unstale":"2023-11-08T12:30:55.336618+0000","last_undegraded":"2023-11-08T12:30:55.336618+0000","last_fullsized":"2023-11-08T12:30:55.336618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:49.959942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.809345+0000","last_change":"2023-11-08T12:30:53.809345+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.809345+0000","last_undegraded":"2023-11-08T12:30:53.809345+0000","last_fullsized":"2023-11-08T12:30:53.809345+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:49:51.257823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330920+0000","last_change":"2023-11-08T12:30:55.324576+0000","last_active":"2023-11-08T12:30:55.330920+0000","last_peered":"2023-11-08T12:30:55.330920+0000","last_clean":"2023-11-08T12:30:55.330920+0000","last_became_active":"2023-11-08T12:30:55.324241+0000","last_became_peered":"2023-11-08T12:30:55.324241+0000","last_unstale":"2023-11-08T12:30:55.330920+0000","last_undegraded":"2023-11-08T12:30:55.330920+0000","last_fullsized":"2023-11-08T12:30:55.330920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.308998+0000","last_change":"2023-11-08T12:30:54.833941+0000","last_active":"2023-11-08T12:30:55.308998+0000","last_peered":"2023-11-08T12:30:55.308998+0000","last_clean":"2023-11-08T12:30:55.308998+0000","last_became_active":"2023-11-08T12:30:54.833611+0000","last_became_peered":"2023-11-08T12:30:54.833611+0000","last_unstale":"2023-11-08T12:30:55.308998+0000","last_undegraded":"2023-11-08T12:30:55.308998+0000","last_fullsized":"2023-11-08T12:30:55.308998+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.808083+0000","last_change":"2023-11-08T12:30:53.808083+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.808083+0000","last_undegraded":"2023-11-08T12:30:53.808083+0000","last_fullsized":"2023-11-08T12:30:53.808083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:32:04.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649508+0000","last_change":"2023-11-08T12:30:55.319451+0000","last_active":"2023-11-08T12:30:56.649508+0000","last_peered":"2023-11-08T12:30:56.649508+0000","last_clean":"2023-11-08T12:30:56.649508+0000","last_became_active":"2023-11-08T12:30:55.319150+0000","last_became_peered":"2023-11-08T12:30:55.319150+0000","last_unstale":"2023-11-08T12:30:56.649508+0000","last_undegraded":"2023-11-08T12:30:56.649508+0000","last_fullsized":"2023-11-08T12:30:56.649508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:07:04.384929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303918+0000","last_change":"2023-11-08T12:30:54.841848+0000","last_active":"2023-11-08T12:30:55.303918+0000","last_peered":"2023-11-08T12:30:55.303918+0000","last_clean":"2023-11-08T12:30:55.303918+0000","last_became_active":"2023-11-08T12:30:54.841620+0000","last_became_peered":"2023-11-08T12:30:54.841620+0000","last_unstale":"2023-11-08T12:30:55.303918+0000","last_undegraded":"2023-11-08T12:30:55.303918+0000","last_fullsized":"2023-11-08T12:30:55.303918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:54:03.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325255+0000","last_change":"2023-11-08T12:30:55.316687+0000","last_active":"2023-11-08T12:30:55.325255+0000","last_peered":"2023-11-08T12:30:55.325255+0000","last_clean":"2023-11-08T12:30:55.325255+0000","last_became_active":"2023-11-08T12:30:55.316441+0000","last_became_peered":"2023-11-08T12:30:55.316441+0000","last_unstale":"2023-11-08T12:30:55.325255+0000","last_undegraded":"2023-11-08T12:30:55.325255+0000","last_fullsized":"2023-11-08T12:30:55.325255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649430+0000","last_change":"2023-11-08T12:30:54.844787+0000","last_active":"2023-11-08T12:30:56.649430+0000","last_peered":"2023-11-08T12:30:56.649430+0000","last_clean":"2023-11-08T12:30:56.649430+0000","last_became_active":"2023-11-08T12:30:54.844525+0000","last_became_peered":"2023-11-08T12:30:54.844525+0000","last_unstale":"2023-11-08T12:30:56.649430+0000","last_undegraded":"2023-11-08T12:30:56.649430+0000","last_fullsized":"2023-11-08T12:30:56.649430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649183+0000","last_change":"2023-11-08T12:30:55.318830+0000","last_active":"2023-11-08T12:30:56.649183+0000","last_peered":"2023-11-08T12:30:56.649183+0000","last_clean":"2023-11-08T12:30:56.649183+0000","last_became_active":"2023-11-08T12:30:55.318553+0000","last_became_peered":"2023-11-08T12:30:55.318553+0000","last_unstale":"2023-11-08T12:30:56.649183+0000","last_undegraded":"2023-11-08T12:30:56.649183+0000","last_fullsized":"2023-11-08T12:30:56.649183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:49.043898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.648476+0000","last_change":"2023-11-08T12:30:54.844323+0000","last_active":"2023-11-08T12:30:56.648476+0000","last_peered":"2023-11-08T12:30:56.648476+0000","last_clean":"2023-11-08T12:30:56.648476+0000","last_became_active":"2023-11-08T12:30:54.843554+0000","last_became_peered":"2023-11-08T12:30:54.843554+0000","last_unstale":"2023-11-08T12:30:56.648476+0000","last_undegraded":"2023-11-08T12:30:56.648476+0000","last_fullsized":"2023-11-08T12:30:56.648476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:50:49.520218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650476+0000","last_change":"2023-11-08T12:30:55.334426+0000","last_active":"2023-11-08T12:30:56.650476+0000","last_peered":"2023-11-08T12:30:56.650476+0000","last_clean":"2023-11-08T12:30:56.650476+0000","last_became_active":"2023-11-08T12:30:55.334150+0000","last_became_peered":"2023-11-08T12:30:55.334150+0000","last_unstale":"2023-11-08T12:30:56.650476+0000","last_undegraded":"2023-11-08T12:30:56.650476+0000","last_fullsized":"2023-11-08T12:30:56.650476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650113+0000","last_change":"2023-11-08T12:30:54.836504+0000","last_active":"2023-11-08T12:30:56.650113+0000","last_peered":"2023-11-08T12:30:56.650113+0000","last_clean":"2023-11-08T12:30:56.650113+0000","last_became_active":"2023-11-08T12:30:54.836192+0000","last_became_peered":"2023-11-08T12:30:54.836192+0000","last_unstale":"2023-11-08T12:30:56.650113+0000","last_undegraded":"2023-11-08T12:30:56.650113+0000","last_fullsized":"2023-11-08T12:30:56.650113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:57:06.832813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310120+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:30:55.310120+0000","last_peered":"2023-11-08T12:30:55.310120+0000","last_clean":"2023-11-08T12:30:55.310120+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:30:55.310120+0000","last_undegraded":"2023-11-08T12:30:55.310120+0000","last_fullsized":"2023-11-08T12:30:55.310120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331398+0000","last_change":"2023-11-08T12:30:55.326991+0000","last_active":"2023-11-08T12:30:55.331398+0000","last_peered":"2023-11-08T12:30:55.331398+0000","last_clean":"2023-11-08T12:30:55.331398+0000","last_became_active":"2023-11-08T12:30:55.326567+0000","last_became_peered":"2023-11-08T12:30:55.326567+0000","last_unstale":"2023-11-08T12:30:55.331398+0000","last_undegraded":"2023-11-08T12:30:55.331398+0000","last_fullsized":"2023-11-08T12:30:55.331398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650578+0000","last_change":"2023-11-08T12:30:54.833012+0000","last_active":"2023-11-08T12:30:56.650578+0000","last_peered":"2023-11-08T12:30:56.650578+0000","last_clean":"2023-11-08T12:30:56.650578+0000","last_became_active":"2023-11-08T12:30:54.832759+0000","last_became_peered":"2023-11-08T12:30:54.832759+0000","last_unstale":"2023-11-08T12:30:56.650578+0000","last_undegraded":"2023-11-08T12:30:56.650578+0000","last_fullsized":"2023-11-08T12:30:56.650578+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841432+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:30:54.841432+0000","last_peered":"2023-11-08T12:30:54.841432+0000","last_clean":"2023-11-08T12:30:54.841432+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:30:54.841432+0000","last_undegraded":"2023-11-08T12:30:54.841432+0000","last_fullsized":"2023-11-08T12:30:54.841432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330531+0000","last_change":"2023-11-08T12:30:55.321736+0000","last_active":"2023-11-08T12:30:55.330531+0000","last_peered":"2023-11-08T12:30:55.330531+0000","last_clean":"2023-11-08T12:30:55.330531+0000","last_became_active":"2023-11-08T12:30:55.321525+0000","last_became_peered":"2023-11-08T12:30:55.321525+0000","last_unstale":"2023-11-08T12:30:55.330531+0000","last_undegraded":"2023-11-08T12:30:55.330531+0000","last_fullsized":"2023-11-08T12:30:55.330531+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:26:42.972609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649816+0000","last_change":"2023-11-08T12:30:54.834063+0000","last_active":"2023-11-08T12:30:56.649816+0000","last_peered":"2023-11-08T12:30:56.649816+0000","last_clean":"2023-11-08T12:30:56.649816+0000","last_became_active":"2023-11-08T12:30:54.833800+0000","last_became_peered":"2023-11-08T12:30:54.833800+0000","last_unstale":"2023-11-08T12:30:56.649816+0000","last_undegraded":"2023-11-08T12:30:56.649816+0000","last_fullsized":"2023-11-08T12:30:56.649816+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:59:26.678216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.842098+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:30:54.842098+0000","last_peered":"2023-11-08T12:30:54.842098+0000","last_clean":"2023-11-08T12:30:54.842098+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:30:54.842098+0000","last_undegraded":"2023-11-08T12:30:54.842098+0000","last_fullsized":"2023-11-08T12:30:54.842098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.304512+0000","last_change":"2023-11-08T12:30:54.847512+0000","last_active":"2023-11-08T12:30:55.304512+0000","last_peered":"2023-11-08T12:30:55.304512+0000","last_clean":"2023-11-08T12:30:55.304512+0000","last_became_active":"2023-11-08T12:30:54.847274+0000","last_became_peered":"2023-11-08T12:30:54.847274+0000","last_unstale":"2023-11-08T12:30:55.304512+0000","last_undegraded":"2023-11-08T12:30:55.304512+0000","last_fullsized":"2023-11-08T12:30:55.304512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:44:24.515082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841103+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:30:54.841103+0000","last_peered":"2023-11-08T12:30:54.841103+0000","last_clean":"2023-11-08T12:30:54.841103+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:30:54.841103+0000","last_undegraded":"2023-11-08T12:30:54.841103+0000","last_fullsized":"2023-11-08T12:30:54.841103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316226+0000","last_change":"2023-11-08T12:30:55.309187+0000","last_active":"2023-11-08T12:30:55.316226+0000","last_peered":"2023-11-08T12:30:55.316226+0000","last_clean":"2023-11-08T12:30:55.316226+0000","last_became_active":"2023-11-08T12:30:55.308893+0000","last_became_peered":"2023-11-08T12:30:55.308893+0000","last_unstale":"2023-11-08T12:30:55.316226+0000","last_undegraded":"2023-11-08T12:30:55.316226+0000","last_fullsized":"2023-11-08T12:30:55.316226+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649658+0000","last_change":"2023-11-08T12:30:54.844094+0000","last_active":"2023-11-08T12:30:56.649658+0000","last_peered":"2023-11-08T12:30:56.649658+0000","last_clean":"2023-11-08T12:30:56.649658+0000","last_became_active":"2023-11-08T12:30:54.843807+0000","last_became_peered":"2023-11-08T12:30:54.843807+0000","last_unstale":"2023-11-08T12:30:56.649658+0000","last_undegraded":"2023-11-08T12:30:56.649658+0000","last_fullsized":"2023-11-08T12:30:56.649658+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:16:29.671187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.822533+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:30:54.822533+0000","last_peered":"2023-11-08T12:30:54.822533+0000","last_clean":"2023-11-08T12:30:54.822533+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:30:54.822533+0000","last_undegraded":"2023-11-08T12:30:54.822533+0000","last_fullsized":"2023-11-08T12:30:54.822533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332444+0000","last_change":"2023-11-08T12:30:55.327299+0000","last_active":"2023-11-08T12:30:55.332444+0000","last_peered":"2023-11-08T12:30:55.332444+0000","last_clean":"2023-11-08T12:30:55.332444+0000","last_became_active":"2023-11-08T12:30:55.327048+0000","last_became_peered":"2023-11-08T12:30:55.327048+0000","last_unstale":"2023-11-08T12:30:55.332444+0000","last_undegraded":"2023-11-08T12:30:55.332444+0000","last_fullsized":"2023-11-08T12:30:55.332444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.296000+0000","last_change":"2023-11-08T12:30:54.836886+0000","last_active":"2023-11-08T12:30:55.296000+0000","last_peered":"2023-11-08T12:30:55.296000+0000","last_clean":"2023-11-08T12:30:55.296000+0000","last_became_active":"2023-11-08T12:30:54.836409+0000","last_became_peered":"2023-11-08T12:30:54.836409+0000","last_unstale":"2023-11-08T12:30:55.296000+0000","last_undegraded":"2023-11-08T12:30:55.296000+0000","last_fullsized":"2023-11-08T12:30:55.296000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:19:36.880517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T12:30:50.536254+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:30:50.536254+0000","last_peered":"2023-11-08T12:30:50.536254+0000","last_clean":"2023-11-08T12:30:50.536254+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:30:50.536254+0000","last_undegraded":"2023-11-08T12:30:50.536254+0000","last_fullsized":"2023-11-08T12:30:50.536254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332474+0000","last_change":"2023-11-08T12:30:55.326952+0000","last_active":"2023-11-08T12:30:55.332474+0000","last_peered":"2023-11-08T12:30:55.332474+0000","last_clean":"2023-11-08T12:30:55.332474+0000","last_became_active":"2023-11-08T12:30:55.326675+0000","last_became_peered":"2023-11-08T12:30:55.326675+0000","last_unstale":"2023-11-08T12:30:55.332474+0000","last_undegraded":"2023-11-08T12:30:55.332474+0000","last_fullsized":"2023-11-08T12:30:55.332474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.312303+0000","last_change":"2023-11-08T12:30:54.837545+0000","last_active":"2023-11-08T12:30:55.312303+0000","last_peered":"2023-11-08T12:30:55.312303+0000","last_clean":"2023-11-08T12:30:55.312303+0000","last_became_active":"2023-11-08T12:30:54.837294+0000","last_became_peered":"2023-11-08T12:30:54.837294+0000","last_unstale":"2023-11-08T12:30:55.312303+0000","last_undegraded":"2023-11-08T12:30:55.312303+0000","last_fullsized":"2023-11-08T12:30:55.312303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841595+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:30:54.841595+0000","last_peered":"2023-11-08T12:30:54.841595+0000","last_clean":"2023-11-08T12:30:54.841595+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:30:54.841595+0000","last_undegraded":"2023-11-08T12:30:54.841595+0000","last_fullsized":"2023-11-08T12:30:54.841595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.319212+0000","last_change":"2023-11-08T12:30:55.316883+0000","last_active":"2023-11-08T12:30:55.319212+0000","last_peered":"2023-11-08T12:30:55.319212+0000","last_clean":"2023-11-08T12:30:55.319212+0000","last_became_active":"2023-11-08T12:30:55.316621+0000","last_became_peered":"2023-11-08T12:30:55.316621+0000","last_unstale":"2023-11-08T12:30:55.319212+0000","last_undegraded":"2023-11-08T12:30:55.319212+0000","last_fullsized":"2023-11-08T12:30:55.319212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649596+0000","last_change":"2023-11-08T12:30:54.843585+0000","last_active":"2023-11-08T12:30:56.649596+0000","last_peered":"2023-11-08T12:30:56.649596+0000","last_clean":"2023-11-08T12:30:56.649596+0000","last_became_active":"2023-11-08T12:30:54.843194+0000","last_became_peered":"2023-11-08T12:30:54.843194+0000","last_unstale":"2023-11-08T12:30:56.649596+0000","last_undegraded":"2023-11-08T12:30:56.649596+0000","last_fullsized":"2023-11-08T12:30:56.649596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:21:27.756624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.824217+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:30:54.824217+0000","last_peered":"2023-11-08T12:30:54.824217+0000","last_clean":"2023-11-08T12:30:54.824217+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:30:54.824217+0000","last_undegraded":"2023-11-08T12:30:54.824217+0000","last_fullsized":"2023-11-08T12:30:54.824217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":201,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.831352+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:30:54.831352+0000","last_peered":"2023-11-08T12:30:54.831352+0000","last_clean":"2023-11-08T12:30:54.831352+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:30:54.831352+0000","last_undegraded":"2023-11-08T12:30:54.831352+0000","last_fullsized":"2023-11-08T12:30:54.831352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9716,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362124,"statfs":{"total":96636764160,"available":96626814976,"internally_reserved":0,"allocated":831488,"data_stored":383521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.375,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.1040000000000001},"min":{"1min":0.71999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5669999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.72199999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.169,"15min":1.157},"min":{"1min":0.77100000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5649999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.179},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.80800000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.512,"5min":1.851,"15min":1.851},"last":0.90800000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.069,"15min":1.0589999999999999},"min":{"1min":0.90800000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.272,"15min":1.27},"min":{"1min":0.92300000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3360000000000001,"15min":1.341},"min":{"1min":0.89400000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6040000000000001,"5min":5.601,"15min":5.601},"last":1.004},{"interface":"front","average":{"1min":1.194,"5min":1.226,"15min":1.236},"min":{"1min":0.93600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.452,"5min":1.73,"15min":1.73},"last":0.97599999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.29,"15min":1.321},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.613,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.337,"15min":1.3660000000000001},"min":{"1min":0.96499999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6639999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.397}]},{"osd":5,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2629999999999999,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.694,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.385},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.4470000000000001,"15min":1.466},"min":{"1min":1.0880000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.734,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.456,"15min":1.482},"min":{"1min":1.0029999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.7649999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.417,"15min":1.4410000000000001},"min":{"1min":0.98999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7849999999999999,"5min":2.121,"15min":2.121},"last":1.284}]}]},{"osd":4,"up_from":16,"seq":68719476779,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9968,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361872,"statfs":{"total":96636764160,"available":96626556928,"internally_reserved":0,"allocated":827392,"data_stored":383499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.069,"15min":1.0569999999999999},"min":{"1min":0.61599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.03}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.159,"15min":1.1599999999999999},"min":{"1min":0.81299999999999994,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.639,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.157,"15min":1.1930000000000001},"min":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.343,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2050000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.2130000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.446,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4330000000000001,"5min":3.129,"15min":3.129},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1950000000000001,"15min":1.2150000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8140000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.159},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5189999999999999,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2490000000000001,"15min":1.2989999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2190000000000001,"15min":1.22},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.5409999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.28}]},{"osd":6,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5780000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.379},{"interface":"front","average":{"1min":1.306,"5min":1.3979999999999999,"15min":1.425},"min":{"1min":1.018,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.524,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3839999999999999,"15min":1.4099999999999999},"min":{"1min":0.94499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.734,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4299999999999999,"15min":1.448},"min":{"1min":0.95699999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.867,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4199999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10872,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360968,"statfs":{"total":96636764160,"available":96625631232,"internally_reserved":0,"allocated":1425408,"data_stored":974397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1519999999999999},"min":{"1min":0.67800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4319999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.145,"5min":1.1639999999999999,"15min":1.1719999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5329999999999999,"5min":1.7,"15min":1.7},"last":1}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.046},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.76000000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.409,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.123,"15min":1.121},"min":{"1min":0.84699999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.47,"5min":1.597,"15min":1.597},"last":1.254},{"interface":"front","average":{"1min":1.24,"5min":1.2090000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.651,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.298}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.198,"15min":1.222},"min":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3979999999999999,"5min":1.984,"15min":1.984},"last":1.121},{"interface":"front","average":{"1min":1.198,"5min":1.2529999999999999,"15min":1.2629999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.51,"5min":2.137,"15min":2.137},"last":1.177}]},{"osd":4,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.26,"15min":1.2889999999999999},"min":{"1min":0.70699999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.677,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.224,"15min":1.246},"min":{"1min":0.83699999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.353}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.86899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5760000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.238,"15min":1.264},"min":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6020000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3600000000000001,"15min":1.3660000000000001},"min":{"1min":0.97299999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.79,"5min":1.956,"15min":1.956},"last":1.391},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3859999999999999,"15min":1.415},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.798,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.591}]}]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.7629999999999999,"15min":2.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.623,"5min":20.099,"15min":20.099},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.823,"15min":2.141},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4379999999999999,"5min":21.238,"15min":21.238},"last":0.93600000000000005}]},{"osd":1,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.155,"15min":1.2110000000000001},"min":{"1min":0.71399999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.573,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.391,"15min":1.5369999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5149999999999999,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.038}]},{"osd":2,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.5569999999999999,"15min":1.7310000000000001},"min":{"1min":0.97599999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.4770000000000001,"5min":11.843,"15min":11.843},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.597,"15min":1.7749999999999999},"min":{"1min":0.80500000000000005,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8939999999999999,"5min":11.907,"15min":11.907},"last":1.167}]},{"osd":3,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.331,"15min":1.4059999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.556,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.4039999999999999,"15min":1.4930000000000001},"min":{"1min":0.90800000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.7529999999999999,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.133}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2070000000000001,"15min":1.2130000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.869,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2709999999999999,"15min":1.2889999999999999},"min":{"1min":0.75,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.966,"5min":2.073,"15min":2.073},"last":0.85099999999999998}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.262,"15min":1.3029999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.552,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.351,"5min":1.367,"15min":1.385},"min":{"1min":1.0449999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.097}]},{"osd":7,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.637,"15min":1.7889999999999999},"min":{"1min":1.002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.647,"5min":8.109,"15min":8.109},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.593,"15min":1.675},"min":{"1min":1.2190000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.101,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.27}]}]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":831488,"data_stored":383541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.91600000000000004,"15min":0.97799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96599999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.97799999999999998},"min":{"1min":0.61399999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.165,"5min":1.53,"15min":1.53},"last":0.97899999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.075,"5min":1.51,"15min":1.51},"last":0.752},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.4219999999999999,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.143,"15min":1.22},"min":{"1min":0.63600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.57899999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.226,"5min":1.972,"15min":1.972},"last":0.78700000000000003}]},{"osd":4,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2150000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.458,"5min":1.837,"15min":1.837},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.226,"5min":1.3089999999999999,"15min":1.339},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5960000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.044}]},{"osd":5,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.70599999999999996,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.649,"5min":1.897,"15min":1.897},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4059999999999999,"15min":1.474},"min":{"1min":0.77500000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6759999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.995}]},{"osd":6,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.319,"15min":1.347},"min":{"1min":0.875,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9079999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.292,"5min":1.321,"15min":1.339},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6679999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4370000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.427,"15min":1.4630000000000001},"min":{"1min":0.94399999999999995,"5min":0.875,"15min":0.875},"max":{"1min":1.9890000000000001,"5min":2.194,"15min":2.194},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.93600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.472,"15min":2.472},"last":1.3180000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.499,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.597,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":5.2009999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":5.0190000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5329999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1379999999999999},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.5940000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.474}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":1.546},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.032,"15min":1.0880000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.4550000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":3.73}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2410000000000001,"15min":1.2709999999999999},"min":{"1min":0.878,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":3.766},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3120000000000001,"15min":1.3320000000000001},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.663,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.573}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.375,"15min":1.411},"min":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":4.8620000000000001,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":3.8730000000000002},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.4590000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.9970000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.0920000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3400000000000001,"15min":1.3680000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":3.6880000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.357,"15min":1.3999999999999999},"min":{"1min":0.95999999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":5.1520000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.482,"15min":1.5269999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.956,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":4.8230000000000004},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.425,"15min":1.4710000000000001},"min":{"1min":1.087,"5min":0.996,"15min":0.996},"max":{"1min":1.6439999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.518}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10928,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":9536,"kb_avail":94360912,"statfs":{"total":96636764160,"available":96625573888,"internally_reserved":0,"allocated":1417216,"data_stored":973797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9764864},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0169999999999999,"15min":1.1140000000000001},"min":{"1min":0.58899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1679999999999999,"5min":6.54,"15min":6.54},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.0289999999999999,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1359999999999999,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.82899999999999996}]},{"osd":2,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97799999999999998,"15min":1.0249999999999999},"min":{"1min":0.60299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.2130000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0269999999999999,"15min":1.0609999999999999},"min":{"1min":0.623,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5720000000000001,"5min":3.069,"15min":3.069},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.327,"5min":2.673,"15min":2.673},"last":1.335},{"interface":"front","average":{"1min":1.024,"5min":1.272,"15min":1.3819999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.599,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.4870000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.3280000000000001,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5840000000000001,"5min":2.927,"15min":2.927},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3440000000000001,"15min":1.409},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5589999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.512}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3480000000000001,"15min":1.4119999999999999},"min":{"1min":0.99399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.4370000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.996},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.456,"15min":1.546},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.556,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.0860000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.4930000000000001,"15min":1.583},"min":{"1min":0.95099999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.52,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.4390000000000001,"15min":1.5189999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.6379999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.4690000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4550000000000001,"15min":1.5269999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.5409999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.478,"15min":1.573},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.528,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.542}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9492,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362348,"statfs":{"total":96636764160,"available":96627044352,"internally_reserved":0,"allocated":798720,"data_stored":369033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3620000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0109999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.079,"15min":1.1200000000000001},"min":{"1min":0.77000000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2569999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.91200000000000003,"15min":0.92000000000000004},"min":{"1min":0.60799999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.415,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2829999999999999,"5min":1.837,"15min":1.837},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.999,"5min":1.073,"15min":1.119},"min":{"1min":0.51600000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.304,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.4990000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.3220000000000001,"15min":1.3740000000000001},"min":{"1min":0.90200000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.3979999999999999,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.28}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.343,"15min":1.393},"min":{"1min":1.0669999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.5640000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.157},{"interface":"front","average":{"1min":1.198,"5min":1.278,"15min":1.3260000000000001},"min":{"1min":1.008,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.613,"5min":3.052,"15min":3.052},"last":1.3149999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.327,"15min":1.377},"min":{"1min":1.0740000000000001,"5min":0.753,"15min":0.753},"max":{"1min":1.6719999999999999,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3680000000000001,"15min":1.4139999999999999},"min":{"1min":1.048,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8,"5min":2.254,"15min":2.254},"last":1.351}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3620000000000001,"15min":1.4099999999999999},"min":{"1min":1.0820000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5389999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.425,"15min":1.4690000000000001},"min":{"1min":1.0680000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8959999999999999,"5min":3.5,"15min":3.5},"last":1.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:30:59.621 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:30:59.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.837+0000 7f678e3d2700 1 Processor -- start 2023-11-08T12:30:59.841 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.837+0000 7f678e3d2700 1 -- start start 2023-11-08T12:30:59.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f678e3d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67880b43a0 0x7f678815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f678e3d2700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678815a550 con 0x7f6788070790 2023-11-08T12:30:59.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f678e3d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678806b0a0 con 0x7f67880b1640 2023-11-08T12:30:59.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f678e3d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67880caac0 con 0x7f67880b43a0 2023-11-08T12:30:59.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f678d3d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67880b43a0 0x7f678815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f678dbd1700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6788070790 0x7f678806bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51222/0 (socket says 172.21.15.112:51222) 2023-11-08T12:30:59.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f678dbd1700 1 -- 172.21.15.112:0/3501109403 learned_addr learned my addr 172.21.15.112:0/3501109403 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:30:59.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f677ffff700 1 -- 172.21.15.112:0/3501109403 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846133616 0 0) 0x7f678806b0a0 con 0x7f67880b1640 2023-11-08T12:30:59.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.841+0000 7f677ffff700 1 -- 172.21.15.112:0/3501109403 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67740035d0 con 0x7f67880b1640 2023-11-08T12:30:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f677ffff700 1 -- 172.21.15.112:0/3501109403 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158736461 0 0) 0x7f6780001490 con 0x7f6788070790 2023-11-08T12:30:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678d3d0700 1 -- 172.21.15.112:0/3501109403 >> v1:172.21.15.133:6789/0 conn(0x7f67880b1640 legacy=0x7f6788070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678d3d0700 1 -- 172.21.15.112:0/3501109403 >> v1:172.21.15.112:6789/0 conn(0x7f6788070790 legacy=0x7f678806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678d3d0700 1 -- 172.21.15.112:0/3501109403 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880cada0 con 0x7f67880b43a0 2023-11-08T12:30:59.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678d3d0700 1 --2- 172.21.15.112:0/3501109403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 0x7f678815e5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6784009850 tx=0x7f6784009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ad868265fdc2898 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:59.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f677ffff700 1 -- 172.21.15.112:0/3501109403 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011830 con 0x7f67880b43a0 2023-11-08T12:30:59.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f677ffff700 1 -- 172.21.15.112:0/3501109403 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6784011990 con 0x7f67880b43a0 2023-11-08T12:30:59.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f677ffff700 1 -- 172.21.15.112:0/3501109403 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011d40 con 0x7f67880b43a0 2023-11-08T12:30:59.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678e3d2700 1 -- 172.21.15.112:0/3501109403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 msgr2=0x7f678815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678e3d2700 1 --2- 172.21.15.112:0/3501109403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 0x7f678815e5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6784009850 tx=0x7f6784009b60 comp rx=0 tx=0).stop 2023-11-08T12:30:59.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678e3d2700 1 -- 172.21.15.112:0/3501109403 shutdown_connections 2023-11-08T12:30:59.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678e3d2700 1 --2- 172.21.15.112:0/3501109403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 0x7f678815e5d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678e3d2700 1 -- 172.21.15.112:0/3501109403 >> 172.21.15.112:0/3501109403 conn(0x7f67880b0f80 msgr2=0x7f67880ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:30:59.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678e3d2700 1 -- 172.21.15.112:0/3501109403 shutdown_connections 2023-11-08T12:30:59.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.845+0000 7f678e3d2700 1 -- 172.21.15.112:0/3501109403 wait complete. 2023-11-08T12:30:59.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.849+0000 7f678e3d2700 1 Processor -- start 2023-11-08T12:30:59.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.849+0000 7f678e3d2700 1 -- start start 2023-11-08T12:30:59.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.849+0000 7f678e3d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6788070790 0x7f6788149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67880b1640 0x7f67880c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 0x7f67880c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880b2740 con 0x7f67880b1640 2023-11-08T12:30:59.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880b2a20 con 0x7f67880b43a0 2023-11-08T12:30:59.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880b2d00 con 0x7f6788070790 2023-11-08T12:30:59.857 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67880b1640 0x7f67880c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67880b1640 0x7f67880c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44284/0 (socket says 172.21.15.112:44284) 2023-11-08T12:30:59.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 -- 172.21.15.112:0/487606497 learned_addr learned my addr 172.21.15.112:0/487606497 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:30:59.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678d3d0700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6788070790 0x7f6788149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678dbd1700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 0x7f67880c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.858 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 -- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6788070790 msgr2=0x7f6788149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6788070790 0x7f6788149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 -- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 msgr2=0x7f67880c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:30:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 0x7f67880c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:30:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 -- 172.21.15.112:0/487606497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67840094b0 con 0x7f67880b1640 2023-11-08T12:30:59.859 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678d3d0700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6788070790 0x7f6788149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:30:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678cbcf700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67880b1640 0x7f67880c2240 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f677800c730 tx=0x7f677800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f677dffb700 1 -- 172.21.15.112:0/487606497 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780052d0 con 0x7f67880b1640 2023-11-08T12:30:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f677dffb700 1 -- 172.21.15.112:0/487606497 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778005430 con 0x7f67880b1640 2023-11-08T12:30:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f677dffb700 1 -- 172.21.15.112:0/487606497 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780055a0 con 0x7f67880b1640 2023-11-08T12:30:59.860 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678806b5d0 con 0x7f67880b1640 2023-11-08T12:30:59.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678806b2f0 con 0x7f67880b1640 2023-11-08T12:30:59.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.853+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678815eb10 con 0x7f67880b1640 2023-11-08T12:30:59.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.857+0000 7f677dffb700 1 -- 172.21.15.112:0/487606497 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6778019030 con 0x7f67880b1640 2023-11-08T12:30:59.862 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.857+0000 7f677dffb700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f676c064ee0 0x7f676c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:30:59.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.857+0000 7f677dffb700 1 -- 172.21.15.112:0/487606497 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6778081510 con 0x7f67880b1640 2023-11-08T12:30:59.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.857+0000 7f678d3d0700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f676c064ee0 0x7f676c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:30:59.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.857+0000 7f678d3d0700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f676c064ee0 0x7f676c067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f67840090b0 tx=0x7f678401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:30:59.866 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:30:59.865+0000 7f677dffb700 1 -- 172.21.15.112:0/487606497 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f677804f480 con 0x7f67880b1640 2023-11-08T12:31:00.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.037+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6788073cb0 con 0x7f676c064ee0 2023-11-08T12:31:00.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.057+0000 7f677dffb700 1 -- 172.21.15.112:0/487606497 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307204 (secure 0 0 0) 0x7f6788073cb0 con 0x7f676c064ee0 2023-11-08T12:31:00.063 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:00.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f676c064ee0 msgr2=0x7f676c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f676c064ee0 0x7f676c067390 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f67840090b0 tx=0x7f678401c040 comp rx=0 tx=0).stop 2023-11-08T12:31:00.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67880b1640 msgr2=0x7f67880c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67880b1640 0x7f67880c2240 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f677800c730 tx=0x7f677800caf0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 shutdown_connections 2023-11-08T12:31:00.066 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f676c064ee0 0x7f676c067390 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67880b43a0 0x7f67880c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f67880b1640 0x7f67880c2240 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 --2- 172.21.15.112:0/487606497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6788070790 0x7f6788149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 >> 172.21.15.112:0/487606497 conn(0x7f67880b0f80 msgr2=0x7f678806aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:00.067 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 shutdown_connections 2023-11-08T12:31:00.068 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.061+0000 7f678e3d2700 1 -- 172.21.15.112:0/487606497 wait complete. 2023-11-08T12:31:00.068 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:31:00.086 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-08T12:30:58.774403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80148,"kb_used_data":7572,"kb_used_omap":0,"kb_used_meta":72512,"kb_avail":754894572,"statfs":{"total":773094113280,"available":773012041728,"internally_reserved":0,"allocated":7753728,"data_stored":4219750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74252288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.971624"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331748+0000","last_change":"2023-11-08T12:30:55.328953+0000","last_active":"2023-11-08T12:30:55.331748+0000","last_peered":"2023-11-08T12:30:55.331748+0000","last_clean":"2023-11-08T12:30:55.331748+0000","last_became_active":"2023-11-08T12:30:55.328518+0000","last_became_peered":"2023-11-08T12:30:55.328518+0000","last_unstale":"2023-11-08T12:30:55.331748+0000","last_undegraded":"2023-11-08T12:30:55.331748+0000","last_fullsized":"2023-11-08T12:30:55.331748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:04:49.078439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650079+0000","last_change":"2023-11-08T12:30:55.320721+0000","last_active":"2023-11-08T12:30:56.650079+0000","last_peered":"2023-11-08T12:30:56.650079+0000","last_clean":"2023-11-08T12:30:56.650079+0000","last_became_active":"2023-11-08T12:30:55.320483+0000","last_became_peered":"2023-11-08T12:30:55.320483+0000","last_unstale":"2023-11-08T12:30:56.650079+0000","last_undegraded":"2023-11-08T12:30:56.650079+0000","last_fullsized":"2023-11-08T12:30:56.650079+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:45.609313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321794+0000","last_change":"2023-11-08T12:30:55.319674+0000","last_active":"2023-11-08T12:30:55.321794+0000","last_peered":"2023-11-08T12:30:55.321794+0000","last_clean":"2023-11-08T12:30:55.321794+0000","last_became_active":"2023-11-08T12:30:55.319430+0000","last_became_peered":"2023-11-08T12:30:55.319430+0000","last_unstale":"2023-11-08T12:30:55.321794+0000","last_undegraded":"2023-11-08T12:30:55.321794+0000","last_fullsized":"2023-11-08T12:30:55.321794+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330610+0000","last_change":"2023-11-08T12:30:55.329331+0000","last_active":"2023-11-08T12:30:55.330610+0000","last_peered":"2023-11-08T12:30:55.330610+0000","last_clean":"2023-11-08T12:30:55.330610+0000","last_became_active":"2023-11-08T12:30:55.329078+0000","last_became_peered":"2023-11-08T12:30:55.329078+0000","last_unstale":"2023-11-08T12:30:55.330610+0000","last_undegraded":"2023-11-08T12:30:55.330610+0000","last_fullsized":"2023-11-08T12:30:55.330610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:38:53.919890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649426+0000","last_change":"2023-11-08T12:30:55.324724+0000","last_active":"2023-11-08T12:30:56.649426+0000","last_peered":"2023-11-08T12:30:56.649426+0000","last_clean":"2023-11-08T12:30:56.649426+0000","last_became_active":"2023-11-08T12:30:55.324468+0000","last_became_peered":"2023-11-08T12:30:55.324468+0000","last_unstale":"2023-11-08T12:30:56.649426+0000","last_undegraded":"2023-11-08T12:30:56.649426+0000","last_fullsized":"2023-11-08T12:30:56.649426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.317050+0000","last_change":"2023-11-08T12:30:55.309539+0000","last_active":"2023-11-08T12:30:55.317050+0000","last_peered":"2023-11-08T12:30:55.317050+0000","last_clean":"2023-11-08T12:30:55.317050+0000","last_became_active":"2023-11-08T12:30:55.309199+0000","last_became_peered":"2023-11-08T12:30:55.309199+0000","last_unstale":"2023-11-08T12:30:55.317050+0000","last_undegraded":"2023-11-08T12:30:55.317050+0000","last_fullsized":"2023-11-08T12:30:55.317050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647430+0000","last_change":"2023-11-08T12:30:55.323799+0000","last_active":"2023-11-08T12:30:56.647430+0000","last_peered":"2023-11-08T12:30:56.647430+0000","last_clean":"2023-11-08T12:30:56.647430+0000","last_became_active":"2023-11-08T12:30:55.322805+0000","last_became_peered":"2023-11-08T12:30:55.322805+0000","last_unstale":"2023-11-08T12:30:56.647430+0000","last_undegraded":"2023-11-08T12:30:56.647430+0000","last_fullsized":"2023-11-08T12:30:56.647430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:58:32.146431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650420+0000","last_change":"2023-11-08T12:30:55.325321+0000","last_active":"2023-11-08T12:30:56.650420+0000","last_peered":"2023-11-08T12:30:56.650420+0000","last_clean":"2023-11-08T12:30:56.650420+0000","last_became_active":"2023-11-08T12:30:55.324837+0000","last_became_peered":"2023-11-08T12:30:55.324837+0000","last_unstale":"2023-11-08T12:30:56.650420+0000","last_undegraded":"2023-11-08T12:30:56.650420+0000","last_fullsized":"2023-11-08T12:30:56.650420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334701+0000","last_change":"2023-11-08T12:30:55.331241+0000","last_active":"2023-11-08T12:30:55.334701+0000","last_peered":"2023-11-08T12:30:55.334701+0000","last_clean":"2023-11-08T12:30:55.334701+0000","last_became_active":"2023-11-08T12:30:55.330973+0000","last_became_peered":"2023-11-08T12:30:55.330973+0000","last_unstale":"2023-11-08T12:30:55.334701+0000","last_undegraded":"2023-11-08T12:30:55.334701+0000","last_fullsized":"2023-11-08T12:30:55.334701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:03:30.133538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330562+0000","last_change":"2023-11-08T12:30:55.322622+0000","last_active":"2023-11-08T12:30:55.330562+0000","last_peered":"2023-11-08T12:30:55.330562+0000","last_clean":"2023-11-08T12:30:55.330562+0000","last_became_active":"2023-11-08T12:30:55.322388+0000","last_became_peered":"2023-11-08T12:30:55.322388+0000","last_unstale":"2023-11-08T12:30:55.330562+0000","last_undegraded":"2023-11-08T12:30:55.330562+0000","last_fullsized":"2023-11-08T12:30:55.330562+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:00:17.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329728+0000","last_change":"2023-11-08T12:30:55.328399+0000","last_active":"2023-11-08T12:30:55.329728+0000","last_peered":"2023-11-08T12:30:55.329728+0000","last_clean":"2023-11-08T12:30:55.329728+0000","last_became_active":"2023-11-08T12:30:55.327392+0000","last_became_peered":"2023-11-08T12:30:55.327392+0000","last_unstale":"2023-11-08T12:30:55.329728+0000","last_undegraded":"2023-11-08T12:30:55.329728+0000","last_fullsized":"2023-11-08T12:30:55.329728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:31:15.497928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325002+0000","last_change":"2023-11-08T12:30:55.317752+0000","last_active":"2023-11-08T12:30:55.325002+0000","last_peered":"2023-11-08T12:30:55.325002+0000","last_clean":"2023-11-08T12:30:55.325002+0000","last_became_active":"2023-11-08T12:30:55.317496+0000","last_became_peered":"2023-11-08T12:30:55.317496+0000","last_unstale":"2023-11-08T12:30:55.325002+0000","last_undegraded":"2023-11-08T12:30:55.325002+0000","last_fullsized":"2023-11-08T12:30:55.325002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647309+0000","last_change":"2023-11-08T12:30:55.326903+0000","last_active":"2023-11-08T12:30:56.647309+0000","last_peered":"2023-11-08T12:30:56.647309+0000","last_clean":"2023-11-08T12:30:56.647309+0000","last_became_active":"2023-11-08T12:30:55.326660+0000","last_became_peered":"2023-11-08T12:30:55.326660+0000","last_unstale":"2023-11-08T12:30:56.647309+0000","last_undegraded":"2023-11-08T12:30:56.647309+0000","last_fullsized":"2023-11-08T12:30:56.647309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332470+0000","last_change":"2023-11-08T12:30:55.331216+0000","last_active":"2023-11-08T12:30:55.332470+0000","last_peered":"2023-11-08T12:30:55.332470+0000","last_clean":"2023-11-08T12:30:55.332470+0000","last_became_active":"2023-11-08T12:30:55.330893+0000","last_became_peered":"2023-11-08T12:30:55.330893+0000","last_unstale":"2023-11-08T12:30:55.332470+0000","last_undegraded":"2023-11-08T12:30:55.332470+0000","last_fullsized":"2023-11-08T12:30:55.332470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:35:52.148689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649345+0000","last_change":"2023-11-08T12:30:55.322352+0000","last_active":"2023-11-08T12:30:56.649345+0000","last_peered":"2023-11-08T12:30:56.649345+0000","last_clean":"2023-11-08T12:30:56.649345+0000","last_became_active":"2023-11-08T12:30:55.322091+0000","last_became_peered":"2023-11-08T12:30:55.322091+0000","last_unstale":"2023-11-08T12:30:56.649345+0000","last_undegraded":"2023-11-08T12:30:56.649345+0000","last_fullsized":"2023-11-08T12:30:56.649345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:44:24.238839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325072+0000","last_change":"2023-11-08T12:30:55.319873+0000","last_active":"2023-11-08T12:30:55.325072+0000","last_peered":"2023-11-08T12:30:55.325072+0000","last_clean":"2023-11-08T12:30:55.325072+0000","last_became_active":"2023-11-08T12:30:55.319631+0000","last_became_peered":"2023-11-08T12:30:55.319631+0000","last_unstale":"2023-11-08T12:30:55.325072+0000","last_undegraded":"2023-11-08T12:30:55.325072+0000","last_fullsized":"2023-11-08T12:30:55.325072+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:25:00.378994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650017+0000","last_change":"2023-11-08T12:30:55.321243+0000","last_active":"2023-11-08T12:30:56.650017+0000","last_peered":"2023-11-08T12:30:56.650017+0000","last_clean":"2023-11-08T12:30:56.650017+0000","last_became_active":"2023-11-08T12:30:55.320928+0000","last_became_peered":"2023-11-08T12:30:55.320928+0000","last_unstale":"2023-11-08T12:30:56.650017+0000","last_undegraded":"2023-11-08T12:30:56.650017+0000","last_fullsized":"2023-11-08T12:30:56.650017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649813+0000","last_change":"2023-11-08T12:30:55.314603+0000","last_active":"2023-11-08T12:30:56.649813+0000","last_peered":"2023-11-08T12:30:56.649813+0000","last_clean":"2023-11-08T12:30:56.649813+0000","last_became_active":"2023-11-08T12:30:55.314244+0000","last_became_peered":"2023-11-08T12:30:55.314244+0000","last_unstale":"2023-11-08T12:30:56.649813+0000","last_undegraded":"2023-11-08T12:30:56.649813+0000","last_fullsized":"2023-11-08T12:30:56.649813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329382+0000","last_change":"2023-11-08T12:30:55.324660+0000","last_active":"2023-11-08T12:30:55.329382+0000","last_peered":"2023-11-08T12:30:55.329382+0000","last_clean":"2023-11-08T12:30:55.329382+0000","last_became_active":"2023-11-08T12:30:55.324367+0000","last_became_peered":"2023-11-08T12:30:55.324367+0000","last_unstale":"2023-11-08T12:30:55.329382+0000","last_undegraded":"2023-11-08T12:30:55.329382+0000","last_fullsized":"2023-11-08T12:30:55.329382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336629+0000","last_change":"2023-11-08T12:30:55.331611+0000","last_active":"2023-11-08T12:30:55.336629+0000","last_peered":"2023-11-08T12:30:55.336629+0000","last_clean":"2023-11-08T12:30:55.336629+0000","last_became_active":"2023-11-08T12:30:55.331332+0000","last_became_peered":"2023-11-08T12:30:55.331332+0000","last_unstale":"2023-11-08T12:30:55.336629+0000","last_undegraded":"2023-11-08T12:30:55.336629+0000","last_fullsized":"2023-11-08T12:30:55.336629+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:07.030455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650350+0000","last_change":"2023-11-08T12:30:55.335185+0000","last_active":"2023-11-08T12:30:56.650350+0000","last_peered":"2023-11-08T12:30:56.650350+0000","last_clean":"2023-11-08T12:30:56.650350+0000","last_became_active":"2023-11-08T12:30:55.334582+0000","last_became_peered":"2023-11-08T12:30:55.334582+0000","last_unstale":"2023-11-08T12:30:56.650350+0000","last_undegraded":"2023-11-08T12:30:56.650350+0000","last_fullsized":"2023-11-08T12:30:56.650350+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:45.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334783+0000","last_change":"2023-11-08T12:30:55.330007+0000","last_active":"2023-11-08T12:30:55.334783+0000","last_peered":"2023-11-08T12:30:55.334783+0000","last_clean":"2023-11-08T12:30:55.334783+0000","last_became_active":"2023-11-08T12:30:55.326154+0000","last_became_peered":"2023-11-08T12:30:55.326154+0000","last_unstale":"2023-11-08T12:30:55.334783+0000","last_undegraded":"2023-11-08T12:30:55.334783+0000","last_fullsized":"2023-11-08T12:30:55.334783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321778+0000","last_change":"2023-11-08T12:30:55.316113+0000","last_active":"2023-11-08T12:30:55.321778+0000","last_peered":"2023-11-08T12:30:55.321778+0000","last_clean":"2023-11-08T12:30:55.321778+0000","last_became_active":"2023-11-08T12:30:55.315770+0000","last_became_peered":"2023-11-08T12:30:55.315770+0000","last_unstale":"2023-11-08T12:30:55.321778+0000","last_undegraded":"2023-11-08T12:30:55.321778+0000","last_fullsized":"2023-11-08T12:30:55.321778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650222+0000","last_change":"2023-11-08T12:30:55.319074+0000","last_active":"2023-11-08T12:30:56.650222+0000","last_peered":"2023-11-08T12:30:56.650222+0000","last_clean":"2023-11-08T12:30:56.650222+0000","last_became_active":"2023-11-08T12:30:55.318252+0000","last_became_peered":"2023-11-08T12:30:55.318252+0000","last_unstale":"2023-11-08T12:30:56.650222+0000","last_undegraded":"2023-11-08T12:30:56.650222+0000","last_fullsized":"2023-11-08T12:30:56.650222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.306389+0000","last_change":"2023-11-08T12:30:55.302817+0000","last_active":"2023-11-08T12:30:55.306389+0000","last_peered":"2023-11-08T12:30:55.306389+0000","last_clean":"2023-11-08T12:30:55.306389+0000","last_became_active":"2023-11-08T12:30:55.302532+0000","last_became_peered":"2023-11-08T12:30:55.302532+0000","last_unstale":"2023-11-08T12:30:55.306389+0000","last_undegraded":"2023-11-08T12:30:55.306389+0000","last_fullsized":"2023-11-08T12:30:55.306389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330572+0000","last_change":"2023-11-08T12:30:55.326527+0000","last_active":"2023-11-08T12:30:55.330572+0000","last_peered":"2023-11-08T12:30:55.330572+0000","last_clean":"2023-11-08T12:30:55.330572+0000","last_became_active":"2023-11-08T12:30:55.326149+0000","last_became_peered":"2023-11-08T12:30:55.326149+0000","last_unstale":"2023-11-08T12:30:55.330572+0000","last_undegraded":"2023-11-08T12:30:55.330572+0000","last_fullsized":"2023-11-08T12:30:55.330572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.309641+0000","last_change":"2023-11-08T12:30:55.304430+0000","last_active":"2023-11-08T12:30:55.309641+0000","last_peered":"2023-11-08T12:30:55.309641+0000","last_clean":"2023-11-08T12:30:55.309641+0000","last_became_active":"2023-11-08T12:30:55.304157+0000","last_became_peered":"2023-11-08T12:30:55.304157+0000","last_unstale":"2023-11-08T12:30:55.309641+0000","last_undegraded":"2023-11-08T12:30:55.309641+0000","last_fullsized":"2023-11-08T12:30:55.309641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:54:35.840622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647670+0000","last_change":"2023-11-08T12:30:55.321120+0000","last_active":"2023-11-08T12:30:56.647670+0000","last_peered":"2023-11-08T12:30:56.647670+0000","last_clean":"2023-11-08T12:30:56.647670+0000","last_became_active":"2023-11-08T12:30:55.320278+0000","last_became_peered":"2023-11-08T12:30:55.320278+0000","last_unstale":"2023-11-08T12:30:56.647670+0000","last_undegraded":"2023-11-08T12:30:56.647670+0000","last_fullsized":"2023-11-08T12:30:56.647670+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:02:47.585589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336724+0000","last_change":"2023-11-08T12:30:55.332770+0000","last_active":"2023-11-08T12:30:55.336724+0000","last_peered":"2023-11-08T12:30:55.336724+0000","last_clean":"2023-11-08T12:30:55.336724+0000","last_became_active":"2023-11-08T12:30:55.332517+0000","last_became_peered":"2023-11-08T12:30:55.332517+0000","last_unstale":"2023-11-08T12:30:55.336724+0000","last_undegraded":"2023-11-08T12:30:55.336724+0000","last_fullsized":"2023-11-08T12:30:55.336724+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332156+0000","last_change":"2023-11-08T12:30:54.846800+0000","last_active":"2023-11-08T12:30:55.332156+0000","last_peered":"2023-11-08T12:30:55.332156+0000","last_clean":"2023-11-08T12:30:55.332156+0000","last_became_active":"2023-11-08T12:30:54.846540+0000","last_became_peered":"2023-11-08T12:30:54.846540+0000","last_unstale":"2023-11-08T12:30:55.332156+0000","last_undegraded":"2023-11-08T12:30:55.332156+0000","last_fullsized":"2023-11-08T12:30:55.332156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:29:02.918713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325670+0000","last_change":"2023-11-08T12:30:54.849246+0000","last_active":"2023-11-08T12:30:55.325670+0000","last_peered":"2023-11-08T12:30:55.325670+0000","last_clean":"2023-11-08T12:30:55.325670+0000","last_became_active":"2023-11-08T12:30:54.848932+0000","last_became_peered":"2023-11-08T12:30:54.848932+0000","last_unstale":"2023-11-08T12:30:55.325670+0000","last_undegraded":"2023-11-08T12:30:55.325670+0000","last_fullsized":"2023-11-08T12:30:55.325670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649715+0000","last_change":"2023-11-08T12:30:55.323319+0000","last_active":"2023-11-08T12:30:56.649715+0000","last_peered":"2023-11-08T12:30:56.649715+0000","last_clean":"2023-11-08T12:30:56.649715+0000","last_became_active":"2023-11-08T12:30:55.323053+0000","last_became_peered":"2023-11-08T12:30:55.323053+0000","last_unstale":"2023-11-08T12:30:56.649715+0000","last_undegraded":"2023-11-08T12:30:56.649715+0000","last_fullsized":"2023-11-08T12:30:56.649715+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:12:40.881917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650330+0000","last_change":"2023-11-08T12:30:54.831895+0000","last_active":"2023-11-08T12:30:56.650330+0000","last_peered":"2023-11-08T12:30:56.650330+0000","last_clean":"2023-11-08T12:30:56.650330+0000","last_became_active":"2023-11-08T12:30:54.831579+0000","last_became_peered":"2023-11-08T12:30:54.831579+0000","last_unstale":"2023-11-08T12:30:56.650330+0000","last_undegraded":"2023-11-08T12:30:56.650330+0000","last_fullsized":"2023-11-08T12:30:56.650330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.324474+0000","last_change":"2023-11-08T12:30:55.318219+0000","last_active":"2023-11-08T12:30:55.324474+0000","last_peered":"2023-11-08T12:30:55.324474+0000","last_clean":"2023-11-08T12:30:55.324474+0000","last_became_active":"2023-11-08T12:30:55.317811+0000","last_became_peered":"2023-11-08T12:30:55.317811+0000","last_unstale":"2023-11-08T12:30:55.324474+0000","last_undegraded":"2023-11-08T12:30:55.324474+0000","last_fullsized":"2023-11-08T12:30:55.324474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649832+0000","last_change":"2023-11-08T12:30:54.843634+0000","last_active":"2023-11-08T12:30:56.649832+0000","last_peered":"2023-11-08T12:30:56.649832+0000","last_clean":"2023-11-08T12:30:56.649832+0000","last_became_active":"2023-11-08T12:30:54.843178+0000","last_became_peered":"2023-11-08T12:30:54.843178+0000","last_unstale":"2023-11-08T12:30:56.649832+0000","last_undegraded":"2023-11-08T12:30:56.649832+0000","last_fullsized":"2023-11-08T12:30:56.649832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:36:56.748105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310880+0000","last_change":"2023-11-08T12:30:55.305408+0000","last_active":"2023-11-08T12:30:55.310880+0000","last_peered":"2023-11-08T12:30:55.310880+0000","last_clean":"2023-11-08T12:30:55.310880+0000","last_became_active":"2023-11-08T12:30:55.305030+0000","last_became_peered":"2023-11-08T12:30:55.305030+0000","last_unstale":"2023-11-08T12:30:55.310880+0000","last_undegraded":"2023-11-08T12:30:55.310880+0000","last_fullsized":"2023-11-08T12:30:55.310880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:43.056426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328467+0000","last_change":"2023-11-08T12:30:54.835678+0000","last_active":"2023-11-08T12:30:55.328467+0000","last_peered":"2023-11-08T12:30:55.328467+0000","last_clean":"2023-11-08T12:30:55.328467+0000","last_became_active":"2023-11-08T12:30:54.833332+0000","last_became_peered":"2023-11-08T12:30:54.833332+0000","last_unstale":"2023-11-08T12:30:55.328467+0000","last_undegraded":"2023-11-08T12:30:55.328467+0000","last_fullsized":"2023-11-08T12:30:55.328467+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650059+0000","last_change":"2023-11-08T12:30:55.335120+0000","last_active":"2023-11-08T12:30:56.650059+0000","last_peered":"2023-11-08T12:30:56.650059+0000","last_clean":"2023-11-08T12:30:56.650059+0000","last_became_active":"2023-11-08T12:30:55.334810+0000","last_became_peered":"2023-11-08T12:30:55.334810+0000","last_unstale":"2023-11-08T12:30:56.650059+0000","last_undegraded":"2023-11-08T12:30:56.650059+0000","last_fullsized":"2023-11-08T12:30:56.650059+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:24.721389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649532+0000","last_change":"2023-11-08T12:30:54.844976+0000","last_active":"2023-11-08T12:30:56.649532+0000","last_peered":"2023-11-08T12:30:56.649532+0000","last_clean":"2023-11-08T12:30:56.649532+0000","last_became_active":"2023-11-08T12:30:54.844700+0000","last_became_peered":"2023-11-08T12:30:54.844700+0000","last_unstale":"2023-11-08T12:30:56.649532+0000","last_undegraded":"2023-11-08T12:30:56.649532+0000","last_fullsized":"2023-11-08T12:30:56.649532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:56:27.392361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303200+0000","last_change":"2023-11-08T12:30:54.839982+0000","last_active":"2023-11-08T12:30:55.303200+0000","last_peered":"2023-11-08T12:30:55.303200+0000","last_clean":"2023-11-08T12:30:55.303200+0000","last_became_active":"2023-11-08T12:30:54.839352+0000","last_became_peered":"2023-11-08T12:30:54.839352+0000","last_unstale":"2023-11-08T12:30:55.303200+0000","last_undegraded":"2023-11-08T12:30:55.303200+0000","last_fullsized":"2023-11-08T12:30:55.303200+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:30:19.689649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328548+0000","last_change":"2023-11-08T12:30:55.325624+0000","last_active":"2023-11-08T12:30:55.328548+0000","last_peered":"2023-11-08T12:30:55.328548+0000","last_clean":"2023-11-08T12:30:55.328548+0000","last_became_active":"2023-11-08T12:30:55.325215+0000","last_became_peered":"2023-11-08T12:30:55.325215+0000","last_unstale":"2023-11-08T12:30:55.328548+0000","last_undegraded":"2023-11-08T12:30:55.328548+0000","last_fullsized":"2023-11-08T12:30:55.328548+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.808191+0000","last_change":"2023-11-08T12:30:53.808191+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.808191+0000","last_undegraded":"2023-11-08T12:30:53.808191+0000","last_fullsized":"2023-11-08T12:30:53.808191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:57:06.225781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316655+0000","last_change":"2023-11-08T12:30:55.313267+0000","last_active":"2023-11-08T12:30:55.316655+0000","last_peered":"2023-11-08T12:30:55.316655+0000","last_clean":"2023-11-08T12:30:55.316655+0000","last_became_active":"2023-11-08T12:30:55.313008+0000","last_became_peered":"2023-11-08T12:30:55.313008+0000","last_unstale":"2023-11-08T12:30:55.316655+0000","last_undegraded":"2023-11-08T12:30:55.316655+0000","last_fullsized":"2023-11-08T12:30:55.316655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650448+0000","last_change":"2023-11-08T12:30:54.835906+0000","last_active":"2023-11-08T12:30:56.650448+0000","last_peered":"2023-11-08T12:30:56.650448+0000","last_clean":"2023-11-08T12:30:56.650448+0000","last_became_active":"2023-11-08T12:30:54.835646+0000","last_became_peered":"2023-11-08T12:30:54.835646+0000","last_unstale":"2023-11-08T12:30:56.650448+0000","last_undegraded":"2023-11-08T12:30:56.650448+0000","last_fullsized":"2023-11-08T12:30:56.650448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336682+0000","last_change":"2023-11-08T12:30:55.332691+0000","last_active":"2023-11-08T12:30:55.336682+0000","last_peered":"2023-11-08T12:30:55.336682+0000","last_clean":"2023-11-08T12:30:55.336682+0000","last_became_active":"2023-11-08T12:30:55.332466+0000","last_became_peered":"2023-11-08T12:30:55.332466+0000","last_unstale":"2023-11-08T12:30:55.336682+0000","last_undegraded":"2023-11-08T12:30:55.336682+0000","last_fullsized":"2023-11-08T12:30:55.336682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:32.086861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650156+0000","last_change":"2023-11-08T12:30:54.838927+0000","last_active":"2023-11-08T12:30:56.650156+0000","last_peered":"2023-11-08T12:30:56.650156+0000","last_clean":"2023-11-08T12:30:56.650156+0000","last_became_active":"2023-11-08T12:30:54.838387+0000","last_became_peered":"2023-11-08T12:30:54.838387+0000","last_unstale":"2023-11-08T12:30:56.650156+0000","last_undegraded":"2023-11-08T12:30:56.650156+0000","last_fullsized":"2023-11-08T12:30:56.650156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:02:00.436766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650138+0000","last_change":"2023-11-08T12:30:55.319414+0000","last_active":"2023-11-08T12:30:56.650138+0000","last_peered":"2023-11-08T12:30:56.650138+0000","last_clean":"2023-11-08T12:30:56.650138+0000","last_became_active":"2023-11-08T12:30:55.319072+0000","last_became_peered":"2023-11-08T12:30:55.319072+0000","last_unstale":"2023-11-08T12:30:56.650138+0000","last_undegraded":"2023-11-08T12:30:56.650138+0000","last_fullsized":"2023-11-08T12:30:56.650138+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:46.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321720+0000","last_change":"2023-11-08T12:30:54.834908+0000","last_active":"2023-11-08T12:30:55.321720+0000","last_peered":"2023-11-08T12:30:55.321720+0000","last_clean":"2023-11-08T12:30:55.321720+0000","last_became_active":"2023-11-08T12:30:54.834652+0000","last_became_peered":"2023-11-08T12:30:54.834652+0000","last_unstale":"2023-11-08T12:30:55.321720+0000","last_undegraded":"2023-11-08T12:30:55.321720+0000","last_fullsized":"2023-11-08T12:30:55.321720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"69'6","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334842+0000","last_change":"2023-11-08T12:30:54.849645+0000","last_active":"2023-11-08T12:30:55.334842+0000","last_peered":"2023-11-08T12:30:55.334842+0000","last_clean":"2023-11-08T12:30:55.334842+0000","last_became_active":"2023-11-08T12:30:54.849337+0000","last_became_peered":"2023-11-08T12:30:54.849337+0000","last_unstale":"2023-11-08T12:30:55.334842+0000","last_undegraded":"2023-11-08T12:30:55.334842+0000","last_fullsized":"2023-11-08T12:30:55.334842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.244426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.322459+0000","last_change":"2023-11-08T12:30:55.318084+0000","last_active":"2023-11-08T12:30:55.322459+0000","last_peered":"2023-11-08T12:30:55.322459+0000","last_clean":"2023-11-08T12:30:55.322459+0000","last_became_active":"2023-11-08T12:30:55.317807+0000","last_became_peered":"2023-11-08T12:30:55.317807+0000","last_unstale":"2023-11-08T12:30:55.322459+0000","last_undegraded":"2023-11-08T12:30:55.322459+0000","last_fullsized":"2023-11-08T12:30:55.322459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:01:11.195203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325446+0000","last_change":"2023-11-08T12:30:54.846257+0000","last_active":"2023-11-08T12:30:55.325446+0000","last_peered":"2023-11-08T12:30:55.325446+0000","last_clean":"2023-11-08T12:30:55.325446+0000","last_became_active":"2023-11-08T12:30:54.845973+0000","last_became_peered":"2023-11-08T12:30:54.845973+0000","last_unstale":"2023-11-08T12:30:55.325446+0000","last_undegraded":"2023-11-08T12:30:55.325446+0000","last_fullsized":"2023-11-08T12:30:55.325446+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:18.819505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329997+0000","last_change":"2023-11-08T12:30:55.324143+0000","last_active":"2023-11-08T12:30:55.329997+0000","last_peered":"2023-11-08T12:30:55.329997+0000","last_clean":"2023-11-08T12:30:55.329997+0000","last_became_active":"2023-11-08T12:30:55.319125+0000","last_became_peered":"2023-11-08T12:30:55.319125+0000","last_unstale":"2023-11-08T12:30:55.329997+0000","last_undegraded":"2023-11-08T12:30:55.329997+0000","last_fullsized":"2023-11-08T12:30:55.329997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:40.089625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649611+0000","last_change":"2023-11-08T12:30:54.838934+0000","last_active":"2023-11-08T12:30:56.649611+0000","last_peered":"2023-11-08T12:30:56.649611+0000","last_clean":"2023-11-08T12:30:56.649611+0000","last_became_active":"2023-11-08T12:30:54.838577+0000","last_became_peered":"2023-11-08T12:30:54.838577+0000","last_unstale":"2023-11-08T12:30:56.649611+0000","last_undegraded":"2023-11-08T12:30:56.649611+0000","last_fullsized":"2023-11-08T12:30:56.649611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:06.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332911+0000","last_change":"2023-11-08T12:30:55.331694+0000","last_active":"2023-11-08T12:30:55.332911+0000","last_peered":"2023-11-08T12:30:55.332911+0000","last_clean":"2023-11-08T12:30:55.332911+0000","last_became_active":"2023-11-08T12:30:55.330426+0000","last_became_peered":"2023-11-08T12:30:55.330426+0000","last_unstale":"2023-11-08T12:30:55.332911+0000","last_undegraded":"2023-11-08T12:30:55.332911+0000","last_fullsized":"2023-11-08T12:30:55.332911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295791+0000","last_change":"2023-11-08T12:30:54.832910+0000","last_active":"2023-11-08T12:30:55.295791+0000","last_peered":"2023-11-08T12:30:55.295791+0000","last_clean":"2023-11-08T12:30:55.295791+0000","last_became_active":"2023-11-08T12:30:54.832399+0000","last_became_peered":"2023-11-08T12:30:54.832399+0000","last_unstale":"2023-11-08T12:30:55.295791+0000","last_undegraded":"2023-11-08T12:30:55.295791+0000","last_fullsized":"2023-11-08T12:30:55.295791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:50:27.468368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"69'8","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647438+0000","last_change":"2023-11-08T12:30:54.843786+0000","last_active":"2023-11-08T12:30:56.647438+0000","last_peered":"2023-11-08T12:30:56.647438+0000","last_clean":"2023-11-08T12:30:56.647438+0000","last_became_active":"2023-11-08T12:30:54.843532+0000","last_became_peered":"2023-11-08T12:30:54.843532+0000","last_unstale":"2023-11-08T12:30:56.647438+0000","last_undegraded":"2023-11-08T12:30:56.647438+0000","last_fullsized":"2023-11-08T12:30:56.647438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328517+0000","last_change":"2023-11-08T12:30:55.324593+0000","last_active":"2023-11-08T12:30:55.328517+0000","last_peered":"2023-11-08T12:30:55.328517+0000","last_clean":"2023-11-08T12:30:55.328517+0000","last_became_active":"2023-11-08T12:30:55.324360+0000","last_became_peered":"2023-11-08T12:30:55.324360+0000","last_unstale":"2023-11-08T12:30:55.328517+0000","last_undegraded":"2023-11-08T12:30:55.328517+0000","last_fullsized":"2023-11-08T12:30:55.328517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650015+0000","last_change":"2023-11-08T12:30:54.836571+0000","last_active":"2023-11-08T12:30:56.650015+0000","last_peered":"2023-11-08T12:30:56.650015+0000","last_clean":"2023-11-08T12:30:56.650015+0000","last_became_active":"2023-11-08T12:30:54.836202+0000","last_became_peered":"2023-11-08T12:30:54.836202+0000","last_unstale":"2023-11-08T12:30:56.650015+0000","last_undegraded":"2023-11-08T12:30:56.650015+0000","last_fullsized":"2023-11-08T12:30:56.650015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:40:02.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321277+0000","last_change":"2023-11-08T12:30:55.316242+0000","last_active":"2023-11-08T12:30:55.321277+0000","last_peered":"2023-11-08T12:30:55.321277+0000","last_clean":"2023-11-08T12:30:55.321277+0000","last_became_active":"2023-11-08T12:30:55.315945+0000","last_became_peered":"2023-11-08T12:30:55.315945+0000","last_unstale":"2023-11-08T12:30:55.321277+0000","last_undegraded":"2023-11-08T12:30:55.321277+0000","last_fullsized":"2023-11-08T12:30:55.321277+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295880+0000","last_change":"2023-11-08T12:30:54.833269+0000","last_active":"2023-11-08T12:30:55.295880+0000","last_peered":"2023-11-08T12:30:55.295880+0000","last_clean":"2023-11-08T12:30:55.295880+0000","last_became_active":"2023-11-08T12:30:54.833032+0000","last_became_peered":"2023-11-08T12:30:54.833032+0000","last_unstale":"2023-11-08T12:30:55.295880+0000","last_undegraded":"2023-11-08T12:30:55.295880+0000","last_fullsized":"2023-11-08T12:30:55.295880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:32:31.381604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336618+0000","last_change":"2023-11-08T12:30:55.331577+0000","last_active":"2023-11-08T12:30:55.336618+0000","last_peered":"2023-11-08T12:30:55.336618+0000","last_clean":"2023-11-08T12:30:55.336618+0000","last_became_active":"2023-11-08T12:30:55.331235+0000","last_became_peered":"2023-11-08T12:30:55.331235+0000","last_unstale":"2023-11-08T12:30:55.336618+0000","last_undegraded":"2023-11-08T12:30:55.336618+0000","last_fullsized":"2023-11-08T12:30:55.336618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:49.959942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.809345+0000","last_change":"2023-11-08T12:30:53.809345+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.809345+0000","last_undegraded":"2023-11-08T12:30:53.809345+0000","last_fullsized":"2023-11-08T12:30:53.809345+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:49:51.257823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330920+0000","last_change":"2023-11-08T12:30:55.324576+0000","last_active":"2023-11-08T12:30:55.330920+0000","last_peered":"2023-11-08T12:30:55.330920+0000","last_clean":"2023-11-08T12:30:55.330920+0000","last_became_active":"2023-11-08T12:30:55.324241+0000","last_became_peered":"2023-11-08T12:30:55.324241+0000","last_unstale":"2023-11-08T12:30:55.330920+0000","last_undegraded":"2023-11-08T12:30:55.330920+0000","last_fullsized":"2023-11-08T12:30:55.330920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.308998+0000","last_change":"2023-11-08T12:30:54.833941+0000","last_active":"2023-11-08T12:30:55.308998+0000","last_peered":"2023-11-08T12:30:55.308998+0000","last_clean":"2023-11-08T12:30:55.308998+0000","last_became_active":"2023-11-08T12:30:54.833611+0000","last_became_peered":"2023-11-08T12:30:54.833611+0000","last_unstale":"2023-11-08T12:30:55.308998+0000","last_undegraded":"2023-11-08T12:30:55.308998+0000","last_fullsized":"2023-11-08T12:30:55.308998+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.808083+0000","last_change":"2023-11-08T12:30:53.808083+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.808083+0000","last_undegraded":"2023-11-08T12:30:53.808083+0000","last_fullsized":"2023-11-08T12:30:53.808083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:32:04.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649508+0000","last_change":"2023-11-08T12:30:55.319451+0000","last_active":"2023-11-08T12:30:56.649508+0000","last_peered":"2023-11-08T12:30:56.649508+0000","last_clean":"2023-11-08T12:30:56.649508+0000","last_became_active":"2023-11-08T12:30:55.319150+0000","last_became_peered":"2023-11-08T12:30:55.319150+0000","last_unstale":"2023-11-08T12:30:56.649508+0000","last_undegraded":"2023-11-08T12:30:56.649508+0000","last_fullsized":"2023-11-08T12:30:56.649508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:07:04.384929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303918+0000","last_change":"2023-11-08T12:30:54.841848+0000","last_active":"2023-11-08T12:30:55.303918+0000","last_peered":"2023-11-08T12:30:55.303918+0000","last_clean":"2023-11-08T12:30:55.303918+0000","last_became_active":"2023-11-08T12:30:54.841620+0000","last_became_peered":"2023-11-08T12:30:54.841620+0000","last_unstale":"2023-11-08T12:30:55.303918+0000","last_undegraded":"2023-11-08T12:30:55.303918+0000","last_fullsized":"2023-11-08T12:30:55.303918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:54:03.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325255+0000","last_change":"2023-11-08T12:30:55.316687+0000","last_active":"2023-11-08T12:30:55.325255+0000","last_peered":"2023-11-08T12:30:55.325255+0000","last_clean":"2023-11-08T12:30:55.325255+0000","last_became_active":"2023-11-08T12:30:55.316441+0000","last_became_peered":"2023-11-08T12:30:55.316441+0000","last_unstale":"2023-11-08T12:30:55.325255+0000","last_undegraded":"2023-11-08T12:30:55.325255+0000","last_fullsized":"2023-11-08T12:30:55.325255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649430+0000","last_change":"2023-11-08T12:30:54.844787+0000","last_active":"2023-11-08T12:30:56.649430+0000","last_peered":"2023-11-08T12:30:56.649430+0000","last_clean":"2023-11-08T12:30:56.649430+0000","last_became_active":"2023-11-08T12:30:54.844525+0000","last_became_peered":"2023-11-08T12:30:54.844525+0000","last_unstale":"2023-11-08T12:30:56.649430+0000","last_undegraded":"2023-11-08T12:30:56.649430+0000","last_fullsized":"2023-11-08T12:30:56.649430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649183+0000","last_change":"2023-11-08T12:30:55.318830+0000","last_active":"2023-11-08T12:30:56.649183+0000","last_peered":"2023-11-08T12:30:56.649183+0000","last_clean":"2023-11-08T12:30:56.649183+0000","last_became_active":"2023-11-08T12:30:55.318553+0000","last_became_peered":"2023-11-08T12:30:55.318553+0000","last_unstale":"2023-11-08T12:30:56.649183+0000","last_undegraded":"2023-11-08T12:30:56.649183+0000","last_fullsized":"2023-11-08T12:30:56.649183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:49.043898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.648476+0000","last_change":"2023-11-08T12:30:54.844323+0000","last_active":"2023-11-08T12:30:56.648476+0000","last_peered":"2023-11-08T12:30:56.648476+0000","last_clean":"2023-11-08T12:30:56.648476+0000","last_became_active":"2023-11-08T12:30:54.843554+0000","last_became_peered":"2023-11-08T12:30:54.843554+0000","last_unstale":"2023-11-08T12:30:56.648476+0000","last_undegraded":"2023-11-08T12:30:56.648476+0000","last_fullsized":"2023-11-08T12:30:56.648476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:50:49.520218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650476+0000","last_change":"2023-11-08T12:30:55.334426+0000","last_active":"2023-11-08T12:30:56.650476+0000","last_peered":"2023-11-08T12:30:56.650476+0000","last_clean":"2023-11-08T12:30:56.650476+0000","last_became_active":"2023-11-08T12:30:55.334150+0000","last_became_peered":"2023-11-08T12:30:55.334150+0000","last_unstale":"2023-11-08T12:30:56.650476+0000","last_undegraded":"2023-11-08T12:30:56.650476+0000","last_fullsized":"2023-11-08T12:30:56.650476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650113+0000","last_change":"2023-11-08T12:30:54.836504+0000","last_active":"2023-11-08T12:30:56.650113+0000","last_peered":"2023-11-08T12:30:56.650113+0000","last_clean":"2023-11-08T12:30:56.650113+0000","last_became_active":"2023-11-08T12:30:54.836192+0000","last_became_peered":"2023-11-08T12:30:54.836192+0000","last_unstale":"2023-11-08T12:30:56.650113+0000","last_undegraded":"2023-11-08T12:30:56.650113+0000","last_fullsized":"2023-11-08T12:30:56.650113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:57:06.832813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310120+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:30:55.310120+0000","last_peered":"2023-11-08T12:30:55.310120+0000","last_clean":"2023-11-08T12:30:55.310120+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:30:55.310120+0000","last_undegraded":"2023-11-08T12:30:55.310120+0000","last_fullsized":"2023-11-08T12:30:55.310120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331398+0000","last_change":"2023-11-08T12:30:55.326991+0000","last_active":"2023-11-08T12:30:55.331398+0000","last_peered":"2023-11-08T12:30:55.331398+0000","last_clean":"2023-11-08T12:30:55.331398+0000","last_became_active":"2023-11-08T12:30:55.326567+0000","last_became_peered":"2023-11-08T12:30:55.326567+0000","last_unstale":"2023-11-08T12:30:55.331398+0000","last_undegraded":"2023-11-08T12:30:55.331398+0000","last_fullsized":"2023-11-08T12:30:55.331398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650578+0000","last_change":"2023-11-08T12:30:54.833012+0000","last_active":"2023-11-08T12:30:56.650578+0000","last_peered":"2023-11-08T12:30:56.650578+0000","last_clean":"2023-11-08T12:30:56.650578+0000","last_became_active":"2023-11-08T12:30:54.832759+0000","last_became_peered":"2023-11-08T12:30:54.832759+0000","last_unstale":"2023-11-08T12:30:56.650578+0000","last_undegraded":"2023-11-08T12:30:56.650578+0000","last_fullsized":"2023-11-08T12:30:56.650578+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841432+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:30:54.841432+0000","last_peered":"2023-11-08T12:30:54.841432+0000","last_clean":"2023-11-08T12:30:54.841432+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:30:54.841432+0000","last_undegraded":"2023-11-08T12:30:54.841432+0000","last_fullsized":"2023-11-08T12:30:54.841432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330531+0000","last_change":"2023-11-08T12:30:55.321736+0000","last_active":"2023-11-08T12:30:55.330531+0000","last_peered":"2023-11-08T12:30:55.330531+0000","last_clean":"2023-11-08T12:30:55.330531+0000","last_became_active":"2023-11-08T12:30:55.321525+0000","last_became_peered":"2023-11-08T12:30:55.321525+0000","last_unstale":"2023-11-08T12:30:55.330531+0000","last_undegraded":"2023-11-08T12:30:55.330531+0000","last_fullsized":"2023-11-08T12:30:55.330531+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:26:42.972609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649816+0000","last_change":"2023-11-08T12:30:54.834063+0000","last_active":"2023-11-08T12:30:56.649816+0000","last_peered":"2023-11-08T12:30:56.649816+0000","last_clean":"2023-11-08T12:30:56.649816+0000","last_became_active":"2023-11-08T12:30:54.833800+0000","last_became_peered":"2023-11-08T12:30:54.833800+0000","last_unstale":"2023-11-08T12:30:56.649816+0000","last_undegraded":"2023-11-08T12:30:56.649816+0000","last_fullsized":"2023-11-08T12:30:56.649816+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:59:26.678216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.842098+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:30:54.842098+0000","last_peered":"2023-11-08T12:30:54.842098+0000","last_clean":"2023-11-08T12:30:54.842098+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:30:54.842098+0000","last_undegraded":"2023-11-08T12:30:54.842098+0000","last_fullsized":"2023-11-08T12:30:54.842098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.304512+0000","last_change":"2023-11-08T12:30:54.847512+0000","last_active":"2023-11-08T12:30:55.304512+0000","last_peered":"2023-11-08T12:30:55.304512+0000","last_clean":"2023-11-08T12:30:55.304512+0000","last_became_active":"2023-11-08T12:30:54.847274+0000","last_became_peered":"2023-11-08T12:30:54.847274+0000","last_unstale":"2023-11-08T12:30:55.304512+0000","last_undegraded":"2023-11-08T12:30:55.304512+0000","last_fullsized":"2023-11-08T12:30:55.304512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:44:24.515082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841103+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:30:54.841103+0000","last_peered":"2023-11-08T12:30:54.841103+0000","last_clean":"2023-11-08T12:30:54.841103+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:30:54.841103+0000","last_undegraded":"2023-11-08T12:30:54.841103+0000","last_fullsized":"2023-11-08T12:30:54.841103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316226+0000","last_change":"2023-11-08T12:30:55.309187+0000","last_active":"2023-11-08T12:30:55.316226+0000","last_peered":"2023-11-08T12:30:55.316226+0000","last_clean":"2023-11-08T12:30:55.316226+0000","last_became_active":"2023-11-08T12:30:55.308893+0000","last_became_peered":"2023-11-08T12:30:55.308893+0000","last_unstale":"2023-11-08T12:30:55.316226+0000","last_undegraded":"2023-11-08T12:30:55.316226+0000","last_fullsized":"2023-11-08T12:30:55.316226+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649658+0000","last_change":"2023-11-08T12:30:54.844094+0000","last_active":"2023-11-08T12:30:56.649658+0000","last_peered":"2023-11-08T12:30:56.649658+0000","last_clean":"2023-11-08T12:30:56.649658+0000","last_became_active":"2023-11-08T12:30:54.843807+0000","last_became_peered":"2023-11-08T12:30:54.843807+0000","last_unstale":"2023-11-08T12:30:56.649658+0000","last_undegraded":"2023-11-08T12:30:56.649658+0000","last_fullsized":"2023-11-08T12:30:56.649658+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:16:29.671187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.822533+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:30:54.822533+0000","last_peered":"2023-11-08T12:30:54.822533+0000","last_clean":"2023-11-08T12:30:54.822533+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:30:54.822533+0000","last_undegraded":"2023-11-08T12:30:54.822533+0000","last_fullsized":"2023-11-08T12:30:54.822533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332444+0000","last_change":"2023-11-08T12:30:55.327299+0000","last_active":"2023-11-08T12:30:55.332444+0000","last_peered":"2023-11-08T12:30:55.332444+0000","last_clean":"2023-11-08T12:30:55.332444+0000","last_became_active":"2023-11-08T12:30:55.327048+0000","last_became_peered":"2023-11-08T12:30:55.327048+0000","last_unstale":"2023-11-08T12:30:55.332444+0000","last_undegraded":"2023-11-08T12:30:55.332444+0000","last_fullsized":"2023-11-08T12:30:55.332444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.296000+0000","last_change":"2023-11-08T12:30:54.836886+0000","last_active":"2023-11-08T12:30:55.296000+0000","last_peered":"2023-11-08T12:30:55.296000+0000","last_clean":"2023-11-08T12:30:55.296000+0000","last_became_active":"2023-11-08T12:30:54.836409+0000","last_became_peered":"2023-11-08T12:30:54.836409+0000","last_unstale":"2023-11-08T12:30:55.296000+0000","last_undegraded":"2023-11-08T12:30:55.296000+0000","last_fullsized":"2023-11-08T12:30:55.296000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:19:36.880517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T12:30:50.536254+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:30:50.536254+0000","last_peered":"2023-11-08T12:30:50.536254+0000","last_clean":"2023-11-08T12:30:50.536254+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:30:50.536254+0000","last_undegraded":"2023-11-08T12:30:50.536254+0000","last_fullsized":"2023-11-08T12:30:50.536254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332474+0000","last_change":"2023-11-08T12:30:55.326952+0000","last_active":"2023-11-08T12:30:55.332474+0000","last_peered":"2023-11-08T12:30:55.332474+0000","last_clean":"2023-11-08T12:30:55.332474+0000","last_became_active":"2023-11-08T12:30:55.326675+0000","last_became_peered":"2023-11-08T12:30:55.326675+0000","last_unstale":"2023-11-08T12:30:55.332474+0000","last_undegraded":"2023-11-08T12:30:55.332474+0000","last_fullsized":"2023-11-08T12:30:55.332474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.312303+0000","last_change":"2023-11-08T12:30:54.837545+0000","last_active":"2023-11-08T12:30:55.312303+0000","last_peered":"2023-11-08T12:30:55.312303+0000","last_clean":"2023-11-08T12:30:55.312303+0000","last_became_active":"2023-11-08T12:30:54.837294+0000","last_became_peered":"2023-11-08T12:30:54.837294+0000","last_unstale":"2023-11-08T12:30:55.312303+0000","last_undegraded":"2023-11-08T12:30:55.312303+0000","last_fullsized":"2023-11-08T12:30:55.312303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841595+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:30:54.841595+0000","last_peered":"2023-11-08T12:30:54.841595+0000","last_clean":"2023-11-08T12:30:54.841595+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:30:54.841595+0000","last_undegraded":"2023-11-08T12:30:54.841595+0000","last_fullsized":"2023-11-08T12:30:54.841595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.319212+0000","last_change":"2023-11-08T12:30:55.316883+0000","last_active":"2023-11-08T12:30:55.319212+0000","last_peered":"2023-11-08T12:30:55.319212+0000","last_clean":"2023-11-08T12:30:55.319212+0000","last_became_active":"2023-11-08T12:30:55.316621+0000","last_became_peered":"2023-11-08T12:30:55.316621+0000","last_unstale":"2023-11-08T12:30:55.319212+0000","last_undegraded":"2023-11-08T12:30:55.319212+0000","last_fullsized":"2023-11-08T12:30:55.319212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649596+0000","last_change":"2023-11-08T12:30:54.843585+0000","last_active":"2023-11-08T12:30:56.649596+0000","last_peered":"2023-11-08T12:30:56.649596+0000","last_clean":"2023-11-08T12:30:56.649596+0000","last_became_active":"2023-11-08T12:30:54.843194+0000","last_became_peered":"2023-11-08T12:30:54.843194+0000","last_unstale":"2023-11-08T12:30:56.649596+0000","last_undegraded":"2023-11-08T12:30:56.649596+0000","last_fullsized":"2023-11-08T12:30:56.649596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:21:27.756624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.824217+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:30:54.824217+0000","last_peered":"2023-11-08T12:30:54.824217+0000","last_clean":"2023-11-08T12:30:54.824217+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:30:54.824217+0000","last_undegraded":"2023-11-08T12:30:54.824217+0000","last_fullsized":"2023-11-08T12:30:54.824217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":201,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.831352+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:30:54.831352+0000","last_peered":"2023-11-08T12:30:54.831352+0000","last_clean":"2023-11-08T12:30:54.831352+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:30:54.831352+0000","last_undegraded":"2023-11-08T12:30:54.831352+0000","last_fullsized":"2023-11-08T12:30:54.831352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9716,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362124,"statfs":{"total":96636764160,"available":96626814976,"internally_reserved":0,"allocated":831488,"data_stored":383521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.375,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.1040000000000001},"min":{"1min":0.71999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5669999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.72199999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.169,"15min":1.157},"min":{"1min":0.77100000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5649999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.179},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.80800000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.512,"5min":1.851,"15min":1.851},"last":0.90800000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.069,"15min":1.0589999999999999},"min":{"1min":0.90800000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.272,"15min":1.27},"min":{"1min":0.92300000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3360000000000001,"15min":1.341},"min":{"1min":0.89400000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6040000000000001,"5min":5.601,"15min":5.601},"last":1.004},{"interface":"front","average":{"1min":1.194,"5min":1.226,"15min":1.236},"min":{"1min":0.93600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.452,"5min":1.73,"15min":1.73},"last":0.97599999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.29,"15min":1.321},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.613,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.337,"15min":1.3660000000000001},"min":{"1min":0.96499999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6639999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.397}]},{"osd":5,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2629999999999999,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.694,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.385},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.4470000000000001,"15min":1.466},"min":{"1min":1.0880000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.734,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.456,"15min":1.482},"min":{"1min":1.0029999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.7649999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.417,"15min":1.4410000000000001},"min":{"1min":0.98999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7849999999999999,"5min":2.121,"15min":2.121},"last":1.284}]}]},{"osd":4,"up_from":16,"seq":68719476779,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9968,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361872,"statfs":{"total":96636764160,"available":96626556928,"internally_reserved":0,"allocated":827392,"data_stored":383499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.069,"15min":1.0569999999999999},"min":{"1min":0.61599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.03}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.159,"15min":1.1599999999999999},"min":{"1min":0.81299999999999994,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.639,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.157,"15min":1.1930000000000001},"min":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.343,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2050000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.2130000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.446,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4330000000000001,"5min":3.129,"15min":3.129},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1950000000000001,"15min":1.2150000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8140000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.159},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5189999999999999,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2490000000000001,"15min":1.2989999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2190000000000001,"15min":1.22},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.5409999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.28}]},{"osd":6,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5780000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.379},{"interface":"front","average":{"1min":1.306,"5min":1.3979999999999999,"15min":1.425},"min":{"1min":1.018,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.524,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3839999999999999,"15min":1.4099999999999999},"min":{"1min":0.94499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.734,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4299999999999999,"15min":1.448},"min":{"1min":0.95699999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.867,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4199999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10872,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360968,"statfs":{"total":96636764160,"available":96625631232,"internally_reserved":0,"allocated":1425408,"data_stored":974397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1519999999999999},"min":{"1min":0.67800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4319999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.145,"5min":1.1639999999999999,"15min":1.1719999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5329999999999999,"5min":1.7,"15min":1.7},"last":1}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.046},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.76000000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.409,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.123,"15min":1.121},"min":{"1min":0.84699999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.47,"5min":1.597,"15min":1.597},"last":1.254},{"interface":"front","average":{"1min":1.24,"5min":1.2090000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.651,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.298}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.198,"15min":1.222},"min":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3979999999999999,"5min":1.984,"15min":1.984},"last":1.121},{"interface":"front","average":{"1min":1.198,"5min":1.2529999999999999,"15min":1.2629999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.51,"5min":2.137,"15min":2.137},"last":1.177}]},{"osd":4,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.26,"15min":1.2889999999999999},"min":{"1min":0.70699999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.677,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.224,"15min":1.246},"min":{"1min":0.83699999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.353}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.86899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5760000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.238,"15min":1.264},"min":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6020000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3600000000000001,"15min":1.3660000000000001},"min":{"1min":0.97299999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.79,"5min":1.956,"15min":1.956},"last":1.391},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3859999999999999,"15min":1.415},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.798,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.591}]}]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.7629999999999999,"15min":2.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.623,"5min":20.099,"15min":20.099},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.823,"15min":2.141},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4379999999999999,"5min":21.238,"15min":21.238},"last":0.93600000000000005}]},{"osd":1,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.155,"15min":1.2110000000000001},"min":{"1min":0.71399999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.573,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.391,"15min":1.5369999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5149999999999999,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.038}]},{"osd":2,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.5569999999999999,"15min":1.7310000000000001},"min":{"1min":0.97599999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.4770000000000001,"5min":11.843,"15min":11.843},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.597,"15min":1.7749999999999999},"min":{"1min":0.80500000000000005,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8939999999999999,"5min":11.907,"15min":11.907},"last":1.167}]},{"osd":3,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.331,"15min":1.4059999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.556,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.4039999999999999,"15min":1.4930000000000001},"min":{"1min":0.90800000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.7529999999999999,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.133}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2070000000000001,"15min":1.2130000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.869,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2709999999999999,"15min":1.2889999999999999},"min":{"1min":0.75,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.966,"5min":2.073,"15min":2.073},"last":0.85099999999999998}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.262,"15min":1.3029999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.552,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.351,"5min":1.367,"15min":1.385},"min":{"1min":1.0449999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.097}]},{"osd":7,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.637,"15min":1.7889999999999999},"min":{"1min":1.002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.647,"5min":8.109,"15min":8.109},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.593,"15min":1.675},"min":{"1min":1.2190000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.101,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.27}]}]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":831488,"data_stored":383541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.91600000000000004,"15min":0.97799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96599999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.97799999999999998},"min":{"1min":0.61399999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.165,"5min":1.53,"15min":1.53},"last":0.97899999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.075,"5min":1.51,"15min":1.51},"last":0.752},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.4219999999999999,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.143,"15min":1.22},"min":{"1min":0.63600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.57899999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.226,"5min":1.972,"15min":1.972},"last":0.78700000000000003}]},{"osd":4,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2150000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.458,"5min":1.837,"15min":1.837},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.226,"5min":1.3089999999999999,"15min":1.339},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5960000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.044}]},{"osd":5,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.70599999999999996,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.649,"5min":1.897,"15min":1.897},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4059999999999999,"15min":1.474},"min":{"1min":0.77500000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6759999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.995}]},{"osd":6,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.319,"15min":1.347},"min":{"1min":0.875,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9079999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.292,"5min":1.321,"15min":1.339},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6679999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4370000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.427,"15min":1.4630000000000001},"min":{"1min":0.94399999999999995,"5min":0.875,"15min":0.875},"max":{"1min":1.9890000000000001,"5min":2.194,"15min":2.194},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.93600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.472,"15min":2.472},"last":1.3180000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.499,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.597,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":5.2009999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":5.0190000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5329999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1379999999999999},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.5940000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.474}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":1.546},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.032,"15min":1.0880000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.4550000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":3.73}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2410000000000001,"15min":1.2709999999999999},"min":{"1min":0.878,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":3.766},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3120000000000001,"15min":1.3320000000000001},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.663,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.573}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.375,"15min":1.411},"min":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":4.8620000000000001,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":3.8730000000000002},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.4590000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.9970000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.0920000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3400000000000001,"15min":1.3680000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":3.6880000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.357,"15min":1.3999999999999999},"min":{"1min":0.95999999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":5.1520000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.482,"15min":1.5269999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.956,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":4.8230000000000004},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.425,"15min":1.4710000000000001},"min":{"1min":1.087,"5min":0.996,"15min":0.996},"max":{"1min":1.6439999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.518}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10928,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":9536,"kb_avail":94360912,"statfs":{"total":96636764160,"available":96625573888,"internally_reserved":0,"allocated":1417216,"data_stored":973797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9764864},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0169999999999999,"15min":1.1140000000000001},"min":{"1min":0.58899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1679999999999999,"5min":6.54,"15min":6.54},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.0289999999999999,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1359999999999999,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.82899999999999996}]},{"osd":2,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97799999999999998,"15min":1.0249999999999999},"min":{"1min":0.60299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.2130000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0269999999999999,"15min":1.0609999999999999},"min":{"1min":0.623,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5720000000000001,"5min":3.069,"15min":3.069},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.327,"5min":2.673,"15min":2.673},"last":1.335},{"interface":"front","average":{"1min":1.024,"5min":1.272,"15min":1.3819999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.599,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.4870000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.3280000000000001,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5840000000000001,"5min":2.927,"15min":2.927},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3440000000000001,"15min":1.409},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5589999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.512}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3480000000000001,"15min":1.4119999999999999},"min":{"1min":0.99399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.4370000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.996},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.456,"15min":1.546},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.556,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.0860000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.4930000000000001,"15min":1.583},"min":{"1min":0.95099999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.52,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.4390000000000001,"15min":1.5189999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.6379999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.4690000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4550000000000001,"15min":1.5269999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.5409999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.478,"15min":1.573},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.528,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.542}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9492,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362348,"statfs":{"total":96636764160,"available":96627044352,"internally_reserved":0,"allocated":798720,"data_stored":369033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3620000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0109999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.079,"15min":1.1200000000000001},"min":{"1min":0.77000000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2569999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.91200000000000003,"15min":0.92000000000000004},"min":{"1min":0.60799999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.415,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2829999999999999,"5min":1.837,"15min":1.837},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.999,"5min":1.073,"15min":1.119},"min":{"1min":0.51600000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.304,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.4990000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.3220000000000001,"15min":1.3740000000000001},"min":{"1min":0.90200000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.3979999999999999,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.28}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.343,"15min":1.393},"min":{"1min":1.0669999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.5640000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.157},{"interface":"front","average":{"1min":1.198,"5min":1.278,"15min":1.3260000000000001},"min":{"1min":1.008,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.613,"5min":3.052,"15min":3.052},"last":1.3149999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.327,"15min":1.377},"min":{"1min":1.0740000000000001,"5min":0.753,"15min":0.753},"max":{"1min":1.6719999999999999,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3680000000000001,"15min":1.4139999999999999},"min":{"1min":1.048,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8,"5min":2.254,"15min":2.254},"last":1.351}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3620000000000001,"15min":1.4099999999999999},"min":{"1min":1.0820000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5389999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.425,"15min":1.4690000000000001},"min":{"1min":1.0680000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8959999999999999,"5min":3.5,"15min":3.5},"last":1.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:31:00.093 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:31:00.094 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-11-08T12:31:00.089+0000 7f06124c7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:31:00.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.269+0000 7f602adcb700 1 Processor -- start 2023-11-08T12:31:00.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f602adcb700 1 -- start start 2023-11-08T12:31:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f602adcb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f602406ad70 0x7f6024165210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f602adcb700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602415a850 con 0x7f602415a480 2023-11-08T12:31:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f602adcb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240cada0 con 0x7f60240c8d10 2023-11-08T12:31:00.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f602adcb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240cd0b0 con 0x7f602406ad70 2023-11-08T12:31:00.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f6028b67700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f602415a480 0x7f60240cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51230/0 (socket says 172.21.15.112:51230) 2023-11-08T12:31:00.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f6028b67700 1 -- 172.21.15.112:0/2729905760 learned_addr learned my addr 172.21.15.112:0/2729905760 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:00.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f6029368700 1 --2- 172.21.15.112:0/2729905760 >> v2:172.21.15.133:3300/0 conn(0x7f602406ad70 0x7f6024165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f60237fe700 1 -- 172.21.15.112:0/2729905760 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748234618 0 0) 0x7f602415a850 con 0x7f602415a480 2023-11-08T12:31:00.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f60237fe700 1 -- 172.21.15.112:0/2729905760 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60140035d0 con 0x7f602415a480 2023-11-08T12:31:00.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f60237fe700 1 -- 172.21.15.112:0/2729905760 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061962643 0 0) 0x7f60240cada0 con 0x7f60240c8d10 2023-11-08T12:31:00.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.273+0000 7f60237fe700 1 -- 172.21.15.112:0/2729905760 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f602415a850 con 0x7f60240c8d10 2023-11-08T12:31:00.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f6029368700 1 -- 172.21.15.112:0/2729905760 >> v1:172.21.15.133:6789/0 conn(0x7f60240c8d10 legacy=0x7f60240cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f6029368700 1 -- 172.21.15.112:0/2729905760 >> v1:172.21.15.112:6789/0 conn(0x7f602415a480 legacy=0x7f60240cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f6029368700 1 -- 172.21.15.112:0/2729905760 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240ce060 con 0x7f602406ad70 2023-11-08T12:31:00.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f6029368700 1 --2- 172.21.15.112:0/2729905760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 0x7f6024165210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a081576a98891a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:00.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f60237fe700 1 -- 172.21.15.112:0/2729905760 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00e070 con 0x7f602406ad70 2023-11-08T12:31:00.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f60237fe700 1 -- 172.21.15.112:0/2729905760 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c00bb20 con 0x7f602406ad70 2023-11-08T12:31:00.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f60237fe700 1 -- 172.21.15.112:0/2729905760 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c012430 con 0x7f602406ad70 2023-11-08T12:31:00.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f602adcb700 1 -- 172.21.15.112:0/2729905760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 msgr2=0x7f6024165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f602adcb700 1 --2- 172.21.15.112:0/2729905760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 0x7f6024165210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c00b330 comp rx=0 tx=0).stop 2023-11-08T12:31:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f602adcb700 1 -- 172.21.15.112:0/2729905760 shutdown_connections 2023-11-08T12:31:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f602adcb700 1 --2- 172.21.15.112:0/2729905760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 0x7f6024165210 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f602adcb700 1 -- 172.21.15.112:0/2729905760 >> 172.21.15.112:0/2729905760 conn(0x7f60240cf350 msgr2=0x7f60240b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f602adcb700 1 -- 172.21.15.112:0/2729905760 shutdown_connections 2023-11-08T12:31:00.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.277+0000 7f602adcb700 1 -- 172.21.15.112:0/2729905760 wait complete. 2023-11-08T12:31:00.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.281+0000 7f602adcb700 1 Processor -- start 2023-11-08T12:31:00.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.281+0000 7f602adcb700 1 -- start start 2023-11-08T12:31:00.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.281+0000 7f602adcb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 0x7f60240c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.281+0000 7f602adcb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60240c8d10 0x7f60240c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f602adcb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f602415a480 0x7f6024151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f602adcb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241efd70 con 0x7f602415a480 2023-11-08T12:31:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f602adcb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c6660 con 0x7f602406ad70 2023-11-08T12:31:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f602adcb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c6940 con 0x7f60240c8d10 2023-11-08T12:31:00.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f602415a480 0x7f6024151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f602415a480 0x7f6024151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44300/0 (socket says 172.21.15.112:44300) 2023-11-08T12:31:00.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6028b67700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 0x7f60240c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 -- 172.21.15.112:0/3893914244 learned_addr learned my addr 172.21.15.112:0/3893914244 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:00.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6023fff700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60240c8d10 0x7f60240c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 -- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60240c8d10 msgr2=0x7f60240c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60240c8d10 0x7f60240c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 -- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 msgr2=0x7f60240c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 0x7f60240c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 -- 172.21.15.112:0/3893914244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009a70 con 0x7f602415a480 2023-11-08T12:31:00.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6023fff700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60240c8d10 0x7f60240c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:00.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f6029368700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f602415a480 0x7f6024151780 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f602406b9d0 tx=0x7f601c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:00.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f60217fa700 1 -- 172.21.15.112:0/3893914244 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c01b810 con 0x7f602415a480 2023-11-08T12:31:00.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f60217fa700 1 -- 172.21.15.112:0/3893914244 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c020070 con 0x7f602415a480 2023-11-08T12:31:00.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f60217fa700 1 -- 172.21.15.112:0/3893914244 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c01bbd0 con 0x7f602415a480 2023-11-08T12:31:00.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60240caa30 con 0x7f602415a480 2023-11-08T12:31:00.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.285+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60240ce300 con 0x7f602415a480 2023-11-08T12:31:00.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.289+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60240add50 con 0x7f602415a480 2023-11-08T12:31:00.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.289+0000 7f60217fa700 1 -- 172.21.15.112:0/3893914244 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f601c02e070 con 0x7f602415a480 2023-11-08T12:31:00.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.289+0000 7f60217fa700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6008064ee0 0x7f6008067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.289+0000 7f60217fa700 1 -- 172.21.15.112:0/3893914244 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f601c022070 con 0x7f602415a480 2023-11-08T12:31:00.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.293+0000 7f6028b67700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6008064ee0 0x7f6008067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.293+0000 7f6028b67700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6008064ee0 0x7f6008067390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6018000f60 tx=0x7f6018007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:00.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.297+0000 7f60217fa700 1 -- 172.21.15.112:0/3893914244 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f601c052040 con 0x7f602415a480 2023-11-08T12:31:00.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.469+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60240726c0 con 0x7f6008064ee0 2023-11-08T12:31:00.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.477+0000 7f60217fa700 1 -- 172.21.15.112:0/3893914244 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307204 (secure 0 0 0) 0x7f60240726c0 con 0x7f6008064ee0 2023-11-08T12:31:00.485 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:00.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.485+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6008064ee0 msgr2=0x7f6008067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.485+0000 7f602adcb700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6008064ee0 0x7f6008067390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6018000f60 tx=0x7f6018007e20 comp rx=0 tx=0).stop 2023-11-08T12:31:00.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.485+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f602415a480 msgr2=0x7f6024151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.485+0000 7f602adcb700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f602415a480 0x7f6024151780 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f602406b9d0 tx=0x7f601c004af0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 shutdown_connections 2023-11-08T12:31:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6008064ee0 0x7f6008067390 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f602415a480 0x7f6024151780 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60240c8d10 0x7f60240c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 --2- 172.21.15.112:0/3893914244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f602406ad70 0x7f60240c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 >> 172.21.15.112:0/3893914244 conn(0x7f60240cf350 msgr2=0x7f6024159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 shutdown_connections 2023-11-08T12:31:00.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.489+0000 7f602adcb700 1 -- 172.21.15.112:0/3893914244 wait complete. 2023-11-08T12:31:00.493 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:31:00.510 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-11-08T12:30:58.774403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80148,"kb_used_data":7572,"kb_used_omap":0,"kb_used_meta":72512,"kb_avail":754894572,"statfs":{"total":773094113280,"available":773012041728,"internally_reserved":0,"allocated":7753728,"data_stored":4219750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74252288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.971624"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331748+0000","last_change":"2023-11-08T12:30:55.328953+0000","last_active":"2023-11-08T12:30:55.331748+0000","last_peered":"2023-11-08T12:30:55.331748+0000","last_clean":"2023-11-08T12:30:55.331748+0000","last_became_active":"2023-11-08T12:30:55.328518+0000","last_became_peered":"2023-11-08T12:30:55.328518+0000","last_unstale":"2023-11-08T12:30:55.331748+0000","last_undegraded":"2023-11-08T12:30:55.331748+0000","last_fullsized":"2023-11-08T12:30:55.331748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:04:49.078439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650079+0000","last_change":"2023-11-08T12:30:55.320721+0000","last_active":"2023-11-08T12:30:56.650079+0000","last_peered":"2023-11-08T12:30:56.650079+0000","last_clean":"2023-11-08T12:30:56.650079+0000","last_became_active":"2023-11-08T12:30:55.320483+0000","last_became_peered":"2023-11-08T12:30:55.320483+0000","last_unstale":"2023-11-08T12:30:56.650079+0000","last_undegraded":"2023-11-08T12:30:56.650079+0000","last_fullsized":"2023-11-08T12:30:56.650079+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:45.609313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321794+0000","last_change":"2023-11-08T12:30:55.319674+0000","last_active":"2023-11-08T12:30:55.321794+0000","last_peered":"2023-11-08T12:30:55.321794+0000","last_clean":"2023-11-08T12:30:55.321794+0000","last_became_active":"2023-11-08T12:30:55.319430+0000","last_became_peered":"2023-11-08T12:30:55.319430+0000","last_unstale":"2023-11-08T12:30:55.321794+0000","last_undegraded":"2023-11-08T12:30:55.321794+0000","last_fullsized":"2023-11-08T12:30:55.321794+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330610+0000","last_change":"2023-11-08T12:30:55.329331+0000","last_active":"2023-11-08T12:30:55.330610+0000","last_peered":"2023-11-08T12:30:55.330610+0000","last_clean":"2023-11-08T12:30:55.330610+0000","last_became_active":"2023-11-08T12:30:55.329078+0000","last_became_peered":"2023-11-08T12:30:55.329078+0000","last_unstale":"2023-11-08T12:30:55.330610+0000","last_undegraded":"2023-11-08T12:30:55.330610+0000","last_fullsized":"2023-11-08T12:30:55.330610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:38:53.919890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649426+0000","last_change":"2023-11-08T12:30:55.324724+0000","last_active":"2023-11-08T12:30:56.649426+0000","last_peered":"2023-11-08T12:30:56.649426+0000","last_clean":"2023-11-08T12:30:56.649426+0000","last_became_active":"2023-11-08T12:30:55.324468+0000","last_became_peered":"2023-11-08T12:30:55.324468+0000","last_unstale":"2023-11-08T12:30:56.649426+0000","last_undegraded":"2023-11-08T12:30:56.649426+0000","last_fullsized":"2023-11-08T12:30:56.649426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.317050+0000","last_change":"2023-11-08T12:30:55.309539+0000","last_active":"2023-11-08T12:30:55.317050+0000","last_peered":"2023-11-08T12:30:55.317050+0000","last_clean":"2023-11-08T12:30:55.317050+0000","last_became_active":"2023-11-08T12:30:55.309199+0000","last_became_peered":"2023-11-08T12:30:55.309199+0000","last_unstale":"2023-11-08T12:30:55.317050+0000","last_undegraded":"2023-11-08T12:30:55.317050+0000","last_fullsized":"2023-11-08T12:30:55.317050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647430+0000","last_change":"2023-11-08T12:30:55.323799+0000","last_active":"2023-11-08T12:30:56.647430+0000","last_peered":"2023-11-08T12:30:56.647430+0000","last_clean":"2023-11-08T12:30:56.647430+0000","last_became_active":"2023-11-08T12:30:55.322805+0000","last_became_peered":"2023-11-08T12:30:55.322805+0000","last_unstale":"2023-11-08T12:30:56.647430+0000","last_undegraded":"2023-11-08T12:30:56.647430+0000","last_fullsized":"2023-11-08T12:30:56.647430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:58:32.146431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650420+0000","last_change":"2023-11-08T12:30:55.325321+0000","last_active":"2023-11-08T12:30:56.650420+0000","last_peered":"2023-11-08T12:30:56.650420+0000","last_clean":"2023-11-08T12:30:56.650420+0000","last_became_active":"2023-11-08T12:30:55.324837+0000","last_became_peered":"2023-11-08T12:30:55.324837+0000","last_unstale":"2023-11-08T12:30:56.650420+0000","last_undegraded":"2023-11-08T12:30:56.650420+0000","last_fullsized":"2023-11-08T12:30:56.650420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334701+0000","last_change":"2023-11-08T12:30:55.331241+0000","last_active":"2023-11-08T12:30:55.334701+0000","last_peered":"2023-11-08T12:30:55.334701+0000","last_clean":"2023-11-08T12:30:55.334701+0000","last_became_active":"2023-11-08T12:30:55.330973+0000","last_became_peered":"2023-11-08T12:30:55.330973+0000","last_unstale":"2023-11-08T12:30:55.334701+0000","last_undegraded":"2023-11-08T12:30:55.334701+0000","last_fullsized":"2023-11-08T12:30:55.334701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:03:30.133538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330562+0000","last_change":"2023-11-08T12:30:55.322622+0000","last_active":"2023-11-08T12:30:55.330562+0000","last_peered":"2023-11-08T12:30:55.330562+0000","last_clean":"2023-11-08T12:30:55.330562+0000","last_became_active":"2023-11-08T12:30:55.322388+0000","last_became_peered":"2023-11-08T12:30:55.322388+0000","last_unstale":"2023-11-08T12:30:55.330562+0000","last_undegraded":"2023-11-08T12:30:55.330562+0000","last_fullsized":"2023-11-08T12:30:55.330562+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:00:17.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329728+0000","last_change":"2023-11-08T12:30:55.328399+0000","last_active":"2023-11-08T12:30:55.329728+0000","last_peered":"2023-11-08T12:30:55.329728+0000","last_clean":"2023-11-08T12:30:55.329728+0000","last_became_active":"2023-11-08T12:30:55.327392+0000","last_became_peered":"2023-11-08T12:30:55.327392+0000","last_unstale":"2023-11-08T12:30:55.329728+0000","last_undegraded":"2023-11-08T12:30:55.329728+0000","last_fullsized":"2023-11-08T12:30:55.329728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:31:15.497928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325002+0000","last_change":"2023-11-08T12:30:55.317752+0000","last_active":"2023-11-08T12:30:55.325002+0000","last_peered":"2023-11-08T12:30:55.325002+0000","last_clean":"2023-11-08T12:30:55.325002+0000","last_became_active":"2023-11-08T12:30:55.317496+0000","last_became_peered":"2023-11-08T12:30:55.317496+0000","last_unstale":"2023-11-08T12:30:55.325002+0000","last_undegraded":"2023-11-08T12:30:55.325002+0000","last_fullsized":"2023-11-08T12:30:55.325002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647309+0000","last_change":"2023-11-08T12:30:55.326903+0000","last_active":"2023-11-08T12:30:56.647309+0000","last_peered":"2023-11-08T12:30:56.647309+0000","last_clean":"2023-11-08T12:30:56.647309+0000","last_became_active":"2023-11-08T12:30:55.326660+0000","last_became_peered":"2023-11-08T12:30:55.326660+0000","last_unstale":"2023-11-08T12:30:56.647309+0000","last_undegraded":"2023-11-08T12:30:56.647309+0000","last_fullsized":"2023-11-08T12:30:56.647309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332470+0000","last_change":"2023-11-08T12:30:55.331216+0000","last_active":"2023-11-08T12:30:55.332470+0000","last_peered":"2023-11-08T12:30:55.332470+0000","last_clean":"2023-11-08T12:30:55.332470+0000","last_became_active":"2023-11-08T12:30:55.330893+0000","last_became_peered":"2023-11-08T12:30:55.330893+0000","last_unstale":"2023-11-08T12:30:55.332470+0000","last_undegraded":"2023-11-08T12:30:55.332470+0000","last_fullsized":"2023-11-08T12:30:55.332470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:35:52.148689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649345+0000","last_change":"2023-11-08T12:30:55.322352+0000","last_active":"2023-11-08T12:30:56.649345+0000","last_peered":"2023-11-08T12:30:56.649345+0000","last_clean":"2023-11-08T12:30:56.649345+0000","last_became_active":"2023-11-08T12:30:55.322091+0000","last_became_peered":"2023-11-08T12:30:55.322091+0000","last_unstale":"2023-11-08T12:30:56.649345+0000","last_undegraded":"2023-11-08T12:30:56.649345+0000","last_fullsized":"2023-11-08T12:30:56.649345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:44:24.238839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325072+0000","last_change":"2023-11-08T12:30:55.319873+0000","last_active":"2023-11-08T12:30:55.325072+0000","last_peered":"2023-11-08T12:30:55.325072+0000","last_clean":"2023-11-08T12:30:55.325072+0000","last_became_active":"2023-11-08T12:30:55.319631+0000","last_became_peered":"2023-11-08T12:30:55.319631+0000","last_unstale":"2023-11-08T12:30:55.325072+0000","last_undegraded":"2023-11-08T12:30:55.325072+0000","last_fullsized":"2023-11-08T12:30:55.325072+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:25:00.378994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650017+0000","last_change":"2023-11-08T12:30:55.321243+0000","last_active":"2023-11-08T12:30:56.650017+0000","last_peered":"2023-11-08T12:30:56.650017+0000","last_clean":"2023-11-08T12:30:56.650017+0000","last_became_active":"2023-11-08T12:30:55.320928+0000","last_became_peered":"2023-11-08T12:30:55.320928+0000","last_unstale":"2023-11-08T12:30:56.650017+0000","last_undegraded":"2023-11-08T12:30:56.650017+0000","last_fullsized":"2023-11-08T12:30:56.650017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649813+0000","last_change":"2023-11-08T12:30:55.314603+0000","last_active":"2023-11-08T12:30:56.649813+0000","last_peered":"2023-11-08T12:30:56.649813+0000","last_clean":"2023-11-08T12:30:56.649813+0000","last_became_active":"2023-11-08T12:30:55.314244+0000","last_became_peered":"2023-11-08T12:30:55.314244+0000","last_unstale":"2023-11-08T12:30:56.649813+0000","last_undegraded":"2023-11-08T12:30:56.649813+0000","last_fullsized":"2023-11-08T12:30:56.649813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329382+0000","last_change":"2023-11-08T12:30:55.324660+0000","last_active":"2023-11-08T12:30:55.329382+0000","last_peered":"2023-11-08T12:30:55.329382+0000","last_clean":"2023-11-08T12:30:55.329382+0000","last_became_active":"2023-11-08T12:30:55.324367+0000","last_became_peered":"2023-11-08T12:30:55.324367+0000","last_unstale":"2023-11-08T12:30:55.329382+0000","last_undegraded":"2023-11-08T12:30:55.329382+0000","last_fullsized":"2023-11-08T12:30:55.329382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336629+0000","last_change":"2023-11-08T12:30:55.331611+0000","last_active":"2023-11-08T12:30:55.336629+0000","last_peered":"2023-11-08T12:30:55.336629+0000","last_clean":"2023-11-08T12:30:55.336629+0000","last_became_active":"2023-11-08T12:30:55.331332+0000","last_became_peered":"2023-11-08T12:30:55.331332+0000","last_unstale":"2023-11-08T12:30:55.336629+0000","last_undegraded":"2023-11-08T12:30:55.336629+0000","last_fullsized":"2023-11-08T12:30:55.336629+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:07.030455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650350+0000","last_change":"2023-11-08T12:30:55.335185+0000","last_active":"2023-11-08T12:30:56.650350+0000","last_peered":"2023-11-08T12:30:56.650350+0000","last_clean":"2023-11-08T12:30:56.650350+0000","last_became_active":"2023-11-08T12:30:55.334582+0000","last_became_peered":"2023-11-08T12:30:55.334582+0000","last_unstale":"2023-11-08T12:30:56.650350+0000","last_undegraded":"2023-11-08T12:30:56.650350+0000","last_fullsized":"2023-11-08T12:30:56.650350+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:45.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334783+0000","last_change":"2023-11-08T12:30:55.330007+0000","last_active":"2023-11-08T12:30:55.334783+0000","last_peered":"2023-11-08T12:30:55.334783+0000","last_clean":"2023-11-08T12:30:55.334783+0000","last_became_active":"2023-11-08T12:30:55.326154+0000","last_became_peered":"2023-11-08T12:30:55.326154+0000","last_unstale":"2023-11-08T12:30:55.334783+0000","last_undegraded":"2023-11-08T12:30:55.334783+0000","last_fullsized":"2023-11-08T12:30:55.334783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321778+0000","last_change":"2023-11-08T12:30:55.316113+0000","last_active":"2023-11-08T12:30:55.321778+0000","last_peered":"2023-11-08T12:30:55.321778+0000","last_clean":"2023-11-08T12:30:55.321778+0000","last_became_active":"2023-11-08T12:30:55.315770+0000","last_became_peered":"2023-11-08T12:30:55.315770+0000","last_unstale":"2023-11-08T12:30:55.321778+0000","last_undegraded":"2023-11-08T12:30:55.321778+0000","last_fullsized":"2023-11-08T12:30:55.321778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650222+0000","last_change":"2023-11-08T12:30:55.319074+0000","last_active":"2023-11-08T12:30:56.650222+0000","last_peered":"2023-11-08T12:30:56.650222+0000","last_clean":"2023-11-08T12:30:56.650222+0000","last_became_active":"2023-11-08T12:30:55.318252+0000","last_became_peered":"2023-11-08T12:30:55.318252+0000","last_unstale":"2023-11-08T12:30:56.650222+0000","last_undegraded":"2023-11-08T12:30:56.650222+0000","last_fullsized":"2023-11-08T12:30:56.650222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.306389+0000","last_change":"2023-11-08T12:30:55.302817+0000","last_active":"2023-11-08T12:30:55.306389+0000","last_peered":"2023-11-08T12:30:55.306389+0000","last_clean":"2023-11-08T12:30:55.306389+0000","last_became_active":"2023-11-08T12:30:55.302532+0000","last_became_peered":"2023-11-08T12:30:55.302532+0000","last_unstale":"2023-11-08T12:30:55.306389+0000","last_undegraded":"2023-11-08T12:30:55.306389+0000","last_fullsized":"2023-11-08T12:30:55.306389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330572+0000","last_change":"2023-11-08T12:30:55.326527+0000","last_active":"2023-11-08T12:30:55.330572+0000","last_peered":"2023-11-08T12:30:55.330572+0000","last_clean":"2023-11-08T12:30:55.330572+0000","last_became_active":"2023-11-08T12:30:55.326149+0000","last_became_peered":"2023-11-08T12:30:55.326149+0000","last_unstale":"2023-11-08T12:30:55.330572+0000","last_undegraded":"2023-11-08T12:30:55.330572+0000","last_fullsized":"2023-11-08T12:30:55.330572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.309641+0000","last_change":"2023-11-08T12:30:55.304430+0000","last_active":"2023-11-08T12:30:55.309641+0000","last_peered":"2023-11-08T12:30:55.309641+0000","last_clean":"2023-11-08T12:30:55.309641+0000","last_became_active":"2023-11-08T12:30:55.304157+0000","last_became_peered":"2023-11-08T12:30:55.304157+0000","last_unstale":"2023-11-08T12:30:55.309641+0000","last_undegraded":"2023-11-08T12:30:55.309641+0000","last_fullsized":"2023-11-08T12:30:55.309641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:54:35.840622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647670+0000","last_change":"2023-11-08T12:30:55.321120+0000","last_active":"2023-11-08T12:30:56.647670+0000","last_peered":"2023-11-08T12:30:56.647670+0000","last_clean":"2023-11-08T12:30:56.647670+0000","last_became_active":"2023-11-08T12:30:55.320278+0000","last_became_peered":"2023-11-08T12:30:55.320278+0000","last_unstale":"2023-11-08T12:30:56.647670+0000","last_undegraded":"2023-11-08T12:30:56.647670+0000","last_fullsized":"2023-11-08T12:30:56.647670+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:02:47.585589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336724+0000","last_change":"2023-11-08T12:30:55.332770+0000","last_active":"2023-11-08T12:30:55.336724+0000","last_peered":"2023-11-08T12:30:55.336724+0000","last_clean":"2023-11-08T12:30:55.336724+0000","last_became_active":"2023-11-08T12:30:55.332517+0000","last_became_peered":"2023-11-08T12:30:55.332517+0000","last_unstale":"2023-11-08T12:30:55.336724+0000","last_undegraded":"2023-11-08T12:30:55.336724+0000","last_fullsized":"2023-11-08T12:30:55.336724+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332156+0000","last_change":"2023-11-08T12:30:54.846800+0000","last_active":"2023-11-08T12:30:55.332156+0000","last_peered":"2023-11-08T12:30:55.332156+0000","last_clean":"2023-11-08T12:30:55.332156+0000","last_became_active":"2023-11-08T12:30:54.846540+0000","last_became_peered":"2023-11-08T12:30:54.846540+0000","last_unstale":"2023-11-08T12:30:55.332156+0000","last_undegraded":"2023-11-08T12:30:55.332156+0000","last_fullsized":"2023-11-08T12:30:55.332156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:29:02.918713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325670+0000","last_change":"2023-11-08T12:30:54.849246+0000","last_active":"2023-11-08T12:30:55.325670+0000","last_peered":"2023-11-08T12:30:55.325670+0000","last_clean":"2023-11-08T12:30:55.325670+0000","last_became_active":"2023-11-08T12:30:54.848932+0000","last_became_peered":"2023-11-08T12:30:54.848932+0000","last_unstale":"2023-11-08T12:30:55.325670+0000","last_undegraded":"2023-11-08T12:30:55.325670+0000","last_fullsized":"2023-11-08T12:30:55.325670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649715+0000","last_change":"2023-11-08T12:30:55.323319+0000","last_active":"2023-11-08T12:30:56.649715+0000","last_peered":"2023-11-08T12:30:56.649715+0000","last_clean":"2023-11-08T12:30:56.649715+0000","last_became_active":"2023-11-08T12:30:55.323053+0000","last_became_peered":"2023-11-08T12:30:55.323053+0000","last_unstale":"2023-11-08T12:30:56.649715+0000","last_undegraded":"2023-11-08T12:30:56.649715+0000","last_fullsized":"2023-11-08T12:30:56.649715+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:12:40.881917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650330+0000","last_change":"2023-11-08T12:30:54.831895+0000","last_active":"2023-11-08T12:30:56.650330+0000","last_peered":"2023-11-08T12:30:56.650330+0000","last_clean":"2023-11-08T12:30:56.650330+0000","last_became_active":"2023-11-08T12:30:54.831579+0000","last_became_peered":"2023-11-08T12:30:54.831579+0000","last_unstale":"2023-11-08T12:30:56.650330+0000","last_undegraded":"2023-11-08T12:30:56.650330+0000","last_fullsized":"2023-11-08T12:30:56.650330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.324474+0000","last_change":"2023-11-08T12:30:55.318219+0000","last_active":"2023-11-08T12:30:55.324474+0000","last_peered":"2023-11-08T12:30:55.324474+0000","last_clean":"2023-11-08T12:30:55.324474+0000","last_became_active":"2023-11-08T12:30:55.317811+0000","last_became_peered":"2023-11-08T12:30:55.317811+0000","last_unstale":"2023-11-08T12:30:55.324474+0000","last_undegraded":"2023-11-08T12:30:55.324474+0000","last_fullsized":"2023-11-08T12:30:55.324474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649832+0000","last_change":"2023-11-08T12:30:54.843634+0000","last_active":"2023-11-08T12:30:56.649832+0000","last_peered":"2023-11-08T12:30:56.649832+0000","last_clean":"2023-11-08T12:30:56.649832+0000","last_became_active":"2023-11-08T12:30:54.843178+0000","last_became_peered":"2023-11-08T12:30:54.843178+0000","last_unstale":"2023-11-08T12:30:56.649832+0000","last_undegraded":"2023-11-08T12:30:56.649832+0000","last_fullsized":"2023-11-08T12:30:56.649832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:36:56.748105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310880+0000","last_change":"2023-11-08T12:30:55.305408+0000","last_active":"2023-11-08T12:30:55.310880+0000","last_peered":"2023-11-08T12:30:55.310880+0000","last_clean":"2023-11-08T12:30:55.310880+0000","last_became_active":"2023-11-08T12:30:55.305030+0000","last_became_peered":"2023-11-08T12:30:55.305030+0000","last_unstale":"2023-11-08T12:30:55.310880+0000","last_undegraded":"2023-11-08T12:30:55.310880+0000","last_fullsized":"2023-11-08T12:30:55.310880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:43.056426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328467+0000","last_change":"2023-11-08T12:30:54.835678+0000","last_active":"2023-11-08T12:30:55.328467+0000","last_peered":"2023-11-08T12:30:55.328467+0000","last_clean":"2023-11-08T12:30:55.328467+0000","last_became_active":"2023-11-08T12:30:54.833332+0000","last_became_peered":"2023-11-08T12:30:54.833332+0000","last_unstale":"2023-11-08T12:30:55.328467+0000","last_undegraded":"2023-11-08T12:30:55.328467+0000","last_fullsized":"2023-11-08T12:30:55.328467+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650059+0000","last_change":"2023-11-08T12:30:55.335120+0000","last_active":"2023-11-08T12:30:56.650059+0000","last_peered":"2023-11-08T12:30:56.650059+0000","last_clean":"2023-11-08T12:30:56.650059+0000","last_became_active":"2023-11-08T12:30:55.334810+0000","last_became_peered":"2023-11-08T12:30:55.334810+0000","last_unstale":"2023-11-08T12:30:56.650059+0000","last_undegraded":"2023-11-08T12:30:56.650059+0000","last_fullsized":"2023-11-08T12:30:56.650059+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:24.721389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649532+0000","last_change":"2023-11-08T12:30:54.844976+0000","last_active":"2023-11-08T12:30:56.649532+0000","last_peered":"2023-11-08T12:30:56.649532+0000","last_clean":"2023-11-08T12:30:56.649532+0000","last_became_active":"2023-11-08T12:30:54.844700+0000","last_became_peered":"2023-11-08T12:30:54.844700+0000","last_unstale":"2023-11-08T12:30:56.649532+0000","last_undegraded":"2023-11-08T12:30:56.649532+0000","last_fullsized":"2023-11-08T12:30:56.649532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:56:27.392361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303200+0000","last_change":"2023-11-08T12:30:54.839982+0000","last_active":"2023-11-08T12:30:55.303200+0000","last_peered":"2023-11-08T12:30:55.303200+0000","last_clean":"2023-11-08T12:30:55.303200+0000","last_became_active":"2023-11-08T12:30:54.839352+0000","last_became_peered":"2023-11-08T12:30:54.839352+0000","last_unstale":"2023-11-08T12:30:55.303200+0000","last_undegraded":"2023-11-08T12:30:55.303200+0000","last_fullsized":"2023-11-08T12:30:55.303200+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:30:19.689649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328548+0000","last_change":"2023-11-08T12:30:55.325624+0000","last_active":"2023-11-08T12:30:55.328548+0000","last_peered":"2023-11-08T12:30:55.328548+0000","last_clean":"2023-11-08T12:30:55.328548+0000","last_became_active":"2023-11-08T12:30:55.325215+0000","last_became_peered":"2023-11-08T12:30:55.325215+0000","last_unstale":"2023-11-08T12:30:55.328548+0000","last_undegraded":"2023-11-08T12:30:55.328548+0000","last_fullsized":"2023-11-08T12:30:55.328548+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.808191+0000","last_change":"2023-11-08T12:30:53.808191+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.808191+0000","last_undegraded":"2023-11-08T12:30:53.808191+0000","last_fullsized":"2023-11-08T12:30:53.808191+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:57:06.225781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316655+0000","last_change":"2023-11-08T12:30:55.313267+0000","last_active":"2023-11-08T12:30:55.316655+0000","last_peered":"2023-11-08T12:30:55.316655+0000","last_clean":"2023-11-08T12:30:55.316655+0000","last_became_active":"2023-11-08T12:30:55.313008+0000","last_became_peered":"2023-11-08T12:30:55.313008+0000","last_unstale":"2023-11-08T12:30:55.316655+0000","last_undegraded":"2023-11-08T12:30:55.316655+0000","last_fullsized":"2023-11-08T12:30:55.316655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650448+0000","last_change":"2023-11-08T12:30:54.835906+0000","last_active":"2023-11-08T12:30:56.650448+0000","last_peered":"2023-11-08T12:30:56.650448+0000","last_clean":"2023-11-08T12:30:56.650448+0000","last_became_active":"2023-11-08T12:30:54.835646+0000","last_became_peered":"2023-11-08T12:30:54.835646+0000","last_unstale":"2023-11-08T12:30:56.650448+0000","last_undegraded":"2023-11-08T12:30:56.650448+0000","last_fullsized":"2023-11-08T12:30:56.650448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336682+0000","last_change":"2023-11-08T12:30:55.332691+0000","last_active":"2023-11-08T12:30:55.336682+0000","last_peered":"2023-11-08T12:30:55.336682+0000","last_clean":"2023-11-08T12:30:55.336682+0000","last_became_active":"2023-11-08T12:30:55.332466+0000","last_became_peered":"2023-11-08T12:30:55.332466+0000","last_unstale":"2023-11-08T12:30:55.336682+0000","last_undegraded":"2023-11-08T12:30:55.336682+0000","last_fullsized":"2023-11-08T12:30:55.336682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:32.086861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650156+0000","last_change":"2023-11-08T12:30:54.838927+0000","last_active":"2023-11-08T12:30:56.650156+0000","last_peered":"2023-11-08T12:30:56.650156+0000","last_clean":"2023-11-08T12:30:56.650156+0000","last_became_active":"2023-11-08T12:30:54.838387+0000","last_became_peered":"2023-11-08T12:30:54.838387+0000","last_unstale":"2023-11-08T12:30:56.650156+0000","last_undegraded":"2023-11-08T12:30:56.650156+0000","last_fullsized":"2023-11-08T12:30:56.650156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:02:00.436766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650138+0000","last_change":"2023-11-08T12:30:55.319414+0000","last_active":"2023-11-08T12:30:56.650138+0000","last_peered":"2023-11-08T12:30:56.650138+0000","last_clean":"2023-11-08T12:30:56.650138+0000","last_became_active":"2023-11-08T12:30:55.319072+0000","last_became_peered":"2023-11-08T12:30:55.319072+0000","last_unstale":"2023-11-08T12:30:56.650138+0000","last_undegraded":"2023-11-08T12:30:56.650138+0000","last_fullsized":"2023-11-08T12:30:56.650138+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:46.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321720+0000","last_change":"2023-11-08T12:30:54.834908+0000","last_active":"2023-11-08T12:30:55.321720+0000","last_peered":"2023-11-08T12:30:55.321720+0000","last_clean":"2023-11-08T12:30:55.321720+0000","last_became_active":"2023-11-08T12:30:54.834652+0000","last_became_peered":"2023-11-08T12:30:54.834652+0000","last_unstale":"2023-11-08T12:30:55.321720+0000","last_undegraded":"2023-11-08T12:30:55.321720+0000","last_fullsized":"2023-11-08T12:30:55.321720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"69'6","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334842+0000","last_change":"2023-11-08T12:30:54.849645+0000","last_active":"2023-11-08T12:30:55.334842+0000","last_peered":"2023-11-08T12:30:55.334842+0000","last_clean":"2023-11-08T12:30:55.334842+0000","last_became_active":"2023-11-08T12:30:54.849337+0000","last_became_peered":"2023-11-08T12:30:54.849337+0000","last_unstale":"2023-11-08T12:30:55.334842+0000","last_undegraded":"2023-11-08T12:30:55.334842+0000","last_fullsized":"2023-11-08T12:30:55.334842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.244426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.322459+0000","last_change":"2023-11-08T12:30:55.318084+0000","last_active":"2023-11-08T12:30:55.322459+0000","last_peered":"2023-11-08T12:30:55.322459+0000","last_clean":"2023-11-08T12:30:55.322459+0000","last_became_active":"2023-11-08T12:30:55.317807+0000","last_became_peered":"2023-11-08T12:30:55.317807+0000","last_unstale":"2023-11-08T12:30:55.322459+0000","last_undegraded":"2023-11-08T12:30:55.322459+0000","last_fullsized":"2023-11-08T12:30:55.322459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:01:11.195203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325446+0000","last_change":"2023-11-08T12:30:54.846257+0000","last_active":"2023-11-08T12:30:55.325446+0000","last_peered":"2023-11-08T12:30:55.325446+0000","last_clean":"2023-11-08T12:30:55.325446+0000","last_became_active":"2023-11-08T12:30:54.845973+0000","last_became_peered":"2023-11-08T12:30:54.845973+0000","last_unstale":"2023-11-08T12:30:55.325446+0000","last_undegraded":"2023-11-08T12:30:55.325446+0000","last_fullsized":"2023-11-08T12:30:55.325446+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:18.819505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329997+0000","last_change":"2023-11-08T12:30:55.324143+0000","last_active":"2023-11-08T12:30:55.329997+0000","last_peered":"2023-11-08T12:30:55.329997+0000","last_clean":"2023-11-08T12:30:55.329997+0000","last_became_active":"2023-11-08T12:30:55.319125+0000","last_became_peered":"2023-11-08T12:30:55.319125+0000","last_unstale":"2023-11-08T12:30:55.329997+0000","last_undegraded":"2023-11-08T12:30:55.329997+0000","last_fullsized":"2023-11-08T12:30:55.329997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:40.089625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649611+0000","last_change":"2023-11-08T12:30:54.838934+0000","last_active":"2023-11-08T12:30:56.649611+0000","last_peered":"2023-11-08T12:30:56.649611+0000","last_clean":"2023-11-08T12:30:56.649611+0000","last_became_active":"2023-11-08T12:30:54.838577+0000","last_became_peered":"2023-11-08T12:30:54.838577+0000","last_unstale":"2023-11-08T12:30:56.649611+0000","last_undegraded":"2023-11-08T12:30:56.649611+0000","last_fullsized":"2023-11-08T12:30:56.649611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:06.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332911+0000","last_change":"2023-11-08T12:30:55.331694+0000","last_active":"2023-11-08T12:30:55.332911+0000","last_peered":"2023-11-08T12:30:55.332911+0000","last_clean":"2023-11-08T12:30:55.332911+0000","last_became_active":"2023-11-08T12:30:55.330426+0000","last_became_peered":"2023-11-08T12:30:55.330426+0000","last_unstale":"2023-11-08T12:30:55.332911+0000","last_undegraded":"2023-11-08T12:30:55.332911+0000","last_fullsized":"2023-11-08T12:30:55.332911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295791+0000","last_change":"2023-11-08T12:30:54.832910+0000","last_active":"2023-11-08T12:30:55.295791+0000","last_peered":"2023-11-08T12:30:55.295791+0000","last_clean":"2023-11-08T12:30:55.295791+0000","last_became_active":"2023-11-08T12:30:54.832399+0000","last_became_peered":"2023-11-08T12:30:54.832399+0000","last_unstale":"2023-11-08T12:30:55.295791+0000","last_undegraded":"2023-11-08T12:30:55.295791+0000","last_fullsized":"2023-11-08T12:30:55.295791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:50:27.468368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"69'8","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647438+0000","last_change":"2023-11-08T12:30:54.843786+0000","last_active":"2023-11-08T12:30:56.647438+0000","last_peered":"2023-11-08T12:30:56.647438+0000","last_clean":"2023-11-08T12:30:56.647438+0000","last_became_active":"2023-11-08T12:30:54.843532+0000","last_became_peered":"2023-11-08T12:30:54.843532+0000","last_unstale":"2023-11-08T12:30:56.647438+0000","last_undegraded":"2023-11-08T12:30:56.647438+0000","last_fullsized":"2023-11-08T12:30:56.647438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328517+0000","last_change":"2023-11-08T12:30:55.324593+0000","last_active":"2023-11-08T12:30:55.328517+0000","last_peered":"2023-11-08T12:30:55.328517+0000","last_clean":"2023-11-08T12:30:55.328517+0000","last_became_active":"2023-11-08T12:30:55.324360+0000","last_became_peered":"2023-11-08T12:30:55.324360+0000","last_unstale":"2023-11-08T12:30:55.328517+0000","last_undegraded":"2023-11-08T12:30:55.328517+0000","last_fullsized":"2023-11-08T12:30:55.328517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650015+0000","last_change":"2023-11-08T12:30:54.836571+0000","last_active":"2023-11-08T12:30:56.650015+0000","last_peered":"2023-11-08T12:30:56.650015+0000","last_clean":"2023-11-08T12:30:56.650015+0000","last_became_active":"2023-11-08T12:30:54.836202+0000","last_became_peered":"2023-11-08T12:30:54.836202+0000","last_unstale":"2023-11-08T12:30:56.650015+0000","last_undegraded":"2023-11-08T12:30:56.650015+0000","last_fullsized":"2023-11-08T12:30:56.650015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:40:02.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321277+0000","last_change":"2023-11-08T12:30:55.316242+0000","last_active":"2023-11-08T12:30:55.321277+0000","last_peered":"2023-11-08T12:30:55.321277+0000","last_clean":"2023-11-08T12:30:55.321277+0000","last_became_active":"2023-11-08T12:30:55.315945+0000","last_became_peered":"2023-11-08T12:30:55.315945+0000","last_unstale":"2023-11-08T12:30:55.321277+0000","last_undegraded":"2023-11-08T12:30:55.321277+0000","last_fullsized":"2023-11-08T12:30:55.321277+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295880+0000","last_change":"2023-11-08T12:30:54.833269+0000","last_active":"2023-11-08T12:30:55.295880+0000","last_peered":"2023-11-08T12:30:55.295880+0000","last_clean":"2023-11-08T12:30:55.295880+0000","last_became_active":"2023-11-08T12:30:54.833032+0000","last_became_peered":"2023-11-08T12:30:54.833032+0000","last_unstale":"2023-11-08T12:30:55.295880+0000","last_undegraded":"2023-11-08T12:30:55.295880+0000","last_fullsized":"2023-11-08T12:30:55.295880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:32:31.381604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336618+0000","last_change":"2023-11-08T12:30:55.331577+0000","last_active":"2023-11-08T12:30:55.336618+0000","last_peered":"2023-11-08T12:30:55.336618+0000","last_clean":"2023-11-08T12:30:55.336618+0000","last_became_active":"2023-11-08T12:30:55.331235+0000","last_became_peered":"2023-11-08T12:30:55.331235+0000","last_unstale":"2023-11-08T12:30:55.336618+0000","last_undegraded":"2023-11-08T12:30:55.336618+0000","last_fullsized":"2023-11-08T12:30:55.336618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:49.959942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.809345+0000","last_change":"2023-11-08T12:30:53.809345+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.809345+0000","last_undegraded":"2023-11-08T12:30:53.809345+0000","last_fullsized":"2023-11-08T12:30:53.809345+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:49:51.257823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330920+0000","last_change":"2023-11-08T12:30:55.324576+0000","last_active":"2023-11-08T12:30:55.330920+0000","last_peered":"2023-11-08T12:30:55.330920+0000","last_clean":"2023-11-08T12:30:55.330920+0000","last_became_active":"2023-11-08T12:30:55.324241+0000","last_became_peered":"2023-11-08T12:30:55.324241+0000","last_unstale":"2023-11-08T12:30:55.330920+0000","last_undegraded":"2023-11-08T12:30:55.330920+0000","last_fullsized":"2023-11-08T12:30:55.330920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.308998+0000","last_change":"2023-11-08T12:30:54.833941+0000","last_active":"2023-11-08T12:30:55.308998+0000","last_peered":"2023-11-08T12:30:55.308998+0000","last_clean":"2023-11-08T12:30:55.308998+0000","last_became_active":"2023-11-08T12:30:54.833611+0000","last_became_peered":"2023-11-08T12:30:54.833611+0000","last_unstale":"2023-11-08T12:30:55.308998+0000","last_undegraded":"2023-11-08T12:30:55.308998+0000","last_fullsized":"2023-11-08T12:30:55.308998+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-11-08T12:30:53.808083+0000","last_change":"2023-11-08T12:30:53.808083+0000","last_active":"2023-11-08T12:30:53.794820+0000","last_peered":"2023-11-08T12:30:53.794820+0000","last_clean":"2023-11-08T12:30:53.794820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:53.808083+0000","last_undegraded":"2023-11-08T12:30:53.808083+0000","last_fullsized":"2023-11-08T12:30:53.808083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:32:04.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649508+0000","last_change":"2023-11-08T12:30:55.319451+0000","last_active":"2023-11-08T12:30:56.649508+0000","last_peered":"2023-11-08T12:30:56.649508+0000","last_clean":"2023-11-08T12:30:56.649508+0000","last_became_active":"2023-11-08T12:30:55.319150+0000","last_became_peered":"2023-11-08T12:30:55.319150+0000","last_unstale":"2023-11-08T12:30:56.649508+0000","last_undegraded":"2023-11-08T12:30:56.649508+0000","last_fullsized":"2023-11-08T12:30:56.649508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:07:04.384929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303918+0000","last_change":"2023-11-08T12:30:54.841848+0000","last_active":"2023-11-08T12:30:55.303918+0000","last_peered":"2023-11-08T12:30:55.303918+0000","last_clean":"2023-11-08T12:30:55.303918+0000","last_became_active":"2023-11-08T12:30:54.841620+0000","last_became_peered":"2023-11-08T12:30:54.841620+0000","last_unstale":"2023-11-08T12:30:55.303918+0000","last_undegraded":"2023-11-08T12:30:55.303918+0000","last_fullsized":"2023-11-08T12:30:55.303918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:54:03.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325255+0000","last_change":"2023-11-08T12:30:55.316687+0000","last_active":"2023-11-08T12:30:55.325255+0000","last_peered":"2023-11-08T12:30:55.325255+0000","last_clean":"2023-11-08T12:30:55.325255+0000","last_became_active":"2023-11-08T12:30:55.316441+0000","last_became_peered":"2023-11-08T12:30:55.316441+0000","last_unstale":"2023-11-08T12:30:55.325255+0000","last_undegraded":"2023-11-08T12:30:55.325255+0000","last_fullsized":"2023-11-08T12:30:55.325255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649430+0000","last_change":"2023-11-08T12:30:54.844787+0000","last_active":"2023-11-08T12:30:56.649430+0000","last_peered":"2023-11-08T12:30:56.649430+0000","last_clean":"2023-11-08T12:30:56.649430+0000","last_became_active":"2023-11-08T12:30:54.844525+0000","last_became_peered":"2023-11-08T12:30:54.844525+0000","last_unstale":"2023-11-08T12:30:56.649430+0000","last_undegraded":"2023-11-08T12:30:56.649430+0000","last_fullsized":"2023-11-08T12:30:56.649430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649183+0000","last_change":"2023-11-08T12:30:55.318830+0000","last_active":"2023-11-08T12:30:56.649183+0000","last_peered":"2023-11-08T12:30:56.649183+0000","last_clean":"2023-11-08T12:30:56.649183+0000","last_became_active":"2023-11-08T12:30:55.318553+0000","last_became_peered":"2023-11-08T12:30:55.318553+0000","last_unstale":"2023-11-08T12:30:56.649183+0000","last_undegraded":"2023-11-08T12:30:56.649183+0000","last_fullsized":"2023-11-08T12:30:56.649183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:49.043898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.648476+0000","last_change":"2023-11-08T12:30:54.844323+0000","last_active":"2023-11-08T12:30:56.648476+0000","last_peered":"2023-11-08T12:30:56.648476+0000","last_clean":"2023-11-08T12:30:56.648476+0000","last_became_active":"2023-11-08T12:30:54.843554+0000","last_became_peered":"2023-11-08T12:30:54.843554+0000","last_unstale":"2023-11-08T12:30:56.648476+0000","last_undegraded":"2023-11-08T12:30:56.648476+0000","last_fullsized":"2023-11-08T12:30:56.648476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:50:49.520218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650476+0000","last_change":"2023-11-08T12:30:55.334426+0000","last_active":"2023-11-08T12:30:56.650476+0000","last_peered":"2023-11-08T12:30:56.650476+0000","last_clean":"2023-11-08T12:30:56.650476+0000","last_became_active":"2023-11-08T12:30:55.334150+0000","last_became_peered":"2023-11-08T12:30:55.334150+0000","last_unstale":"2023-11-08T12:30:56.650476+0000","last_undegraded":"2023-11-08T12:30:56.650476+0000","last_fullsized":"2023-11-08T12:30:56.650476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650113+0000","last_change":"2023-11-08T12:30:54.836504+0000","last_active":"2023-11-08T12:30:56.650113+0000","last_peered":"2023-11-08T12:30:56.650113+0000","last_clean":"2023-11-08T12:30:56.650113+0000","last_became_active":"2023-11-08T12:30:54.836192+0000","last_became_peered":"2023-11-08T12:30:54.836192+0000","last_unstale":"2023-11-08T12:30:56.650113+0000","last_undegraded":"2023-11-08T12:30:56.650113+0000","last_fullsized":"2023-11-08T12:30:56.650113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:57:06.832813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310120+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:30:55.310120+0000","last_peered":"2023-11-08T12:30:55.310120+0000","last_clean":"2023-11-08T12:30:55.310120+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:30:55.310120+0000","last_undegraded":"2023-11-08T12:30:55.310120+0000","last_fullsized":"2023-11-08T12:30:55.310120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331398+0000","last_change":"2023-11-08T12:30:55.326991+0000","last_active":"2023-11-08T12:30:55.331398+0000","last_peered":"2023-11-08T12:30:55.331398+0000","last_clean":"2023-11-08T12:30:55.331398+0000","last_became_active":"2023-11-08T12:30:55.326567+0000","last_became_peered":"2023-11-08T12:30:55.326567+0000","last_unstale":"2023-11-08T12:30:55.331398+0000","last_undegraded":"2023-11-08T12:30:55.331398+0000","last_fullsized":"2023-11-08T12:30:55.331398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650578+0000","last_change":"2023-11-08T12:30:54.833012+0000","last_active":"2023-11-08T12:30:56.650578+0000","last_peered":"2023-11-08T12:30:56.650578+0000","last_clean":"2023-11-08T12:30:56.650578+0000","last_became_active":"2023-11-08T12:30:54.832759+0000","last_became_peered":"2023-11-08T12:30:54.832759+0000","last_unstale":"2023-11-08T12:30:56.650578+0000","last_undegraded":"2023-11-08T12:30:56.650578+0000","last_fullsized":"2023-11-08T12:30:56.650578+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841432+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:30:54.841432+0000","last_peered":"2023-11-08T12:30:54.841432+0000","last_clean":"2023-11-08T12:30:54.841432+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:30:54.841432+0000","last_undegraded":"2023-11-08T12:30:54.841432+0000","last_fullsized":"2023-11-08T12:30:54.841432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330531+0000","last_change":"2023-11-08T12:30:55.321736+0000","last_active":"2023-11-08T12:30:55.330531+0000","last_peered":"2023-11-08T12:30:55.330531+0000","last_clean":"2023-11-08T12:30:55.330531+0000","last_became_active":"2023-11-08T12:30:55.321525+0000","last_became_peered":"2023-11-08T12:30:55.321525+0000","last_unstale":"2023-11-08T12:30:55.330531+0000","last_undegraded":"2023-11-08T12:30:55.330531+0000","last_fullsized":"2023-11-08T12:30:55.330531+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:26:42.972609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649816+0000","last_change":"2023-11-08T12:30:54.834063+0000","last_active":"2023-11-08T12:30:56.649816+0000","last_peered":"2023-11-08T12:30:56.649816+0000","last_clean":"2023-11-08T12:30:56.649816+0000","last_became_active":"2023-11-08T12:30:54.833800+0000","last_became_peered":"2023-11-08T12:30:54.833800+0000","last_unstale":"2023-11-08T12:30:56.649816+0000","last_undegraded":"2023-11-08T12:30:56.649816+0000","last_fullsized":"2023-11-08T12:30:56.649816+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:59:26.678216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.842098+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:30:54.842098+0000","last_peered":"2023-11-08T12:30:54.842098+0000","last_clean":"2023-11-08T12:30:54.842098+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:30:54.842098+0000","last_undegraded":"2023-11-08T12:30:54.842098+0000","last_fullsized":"2023-11-08T12:30:54.842098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-08T12:30:54.801393+0000","last_change":"2023-11-08T12:30:54.801393+0000","last_active":"2023-11-08T12:30:54.801393+0000","last_peered":"2023-11-08T12:30:54.801393+0000","last_clean":"2023-11-08T12:30:54.801393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-08T12:30:54.801393+0000","last_undegraded":"2023-11-08T12:30:54.801393+0000","last_fullsized":"2023-11-08T12:30:54.801393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.304512+0000","last_change":"2023-11-08T12:30:54.847512+0000","last_active":"2023-11-08T12:30:55.304512+0000","last_peered":"2023-11-08T12:30:55.304512+0000","last_clean":"2023-11-08T12:30:55.304512+0000","last_became_active":"2023-11-08T12:30:54.847274+0000","last_became_peered":"2023-11-08T12:30:54.847274+0000","last_unstale":"2023-11-08T12:30:55.304512+0000","last_undegraded":"2023-11-08T12:30:55.304512+0000","last_fullsized":"2023-11-08T12:30:55.304512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:44:24.515082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841103+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:30:54.841103+0000","last_peered":"2023-11-08T12:30:54.841103+0000","last_clean":"2023-11-08T12:30:54.841103+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:30:54.841103+0000","last_undegraded":"2023-11-08T12:30:54.841103+0000","last_fullsized":"2023-11-08T12:30:54.841103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316226+0000","last_change":"2023-11-08T12:30:55.309187+0000","last_active":"2023-11-08T12:30:55.316226+0000","last_peered":"2023-11-08T12:30:55.316226+0000","last_clean":"2023-11-08T12:30:55.316226+0000","last_became_active":"2023-11-08T12:30:55.308893+0000","last_became_peered":"2023-11-08T12:30:55.308893+0000","last_unstale":"2023-11-08T12:30:55.316226+0000","last_undegraded":"2023-11-08T12:30:55.316226+0000","last_fullsized":"2023-11-08T12:30:55.316226+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649658+0000","last_change":"2023-11-08T12:30:54.844094+0000","last_active":"2023-11-08T12:30:56.649658+0000","last_peered":"2023-11-08T12:30:56.649658+0000","last_clean":"2023-11-08T12:30:56.649658+0000","last_became_active":"2023-11-08T12:30:54.843807+0000","last_became_peered":"2023-11-08T12:30:54.843807+0000","last_unstale":"2023-11-08T12:30:56.649658+0000","last_undegraded":"2023-11-08T12:30:56.649658+0000","last_fullsized":"2023-11-08T12:30:56.649658+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:16:29.671187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.822533+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:30:54.822533+0000","last_peered":"2023-11-08T12:30:54.822533+0000","last_clean":"2023-11-08T12:30:54.822533+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:30:54.822533+0000","last_undegraded":"2023-11-08T12:30:54.822533+0000","last_fullsized":"2023-11-08T12:30:54.822533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332444+0000","last_change":"2023-11-08T12:30:55.327299+0000","last_active":"2023-11-08T12:30:55.332444+0000","last_peered":"2023-11-08T12:30:55.332444+0000","last_clean":"2023-11-08T12:30:55.332444+0000","last_became_active":"2023-11-08T12:30:55.327048+0000","last_became_peered":"2023-11-08T12:30:55.327048+0000","last_unstale":"2023-11-08T12:30:55.332444+0000","last_undegraded":"2023-11-08T12:30:55.332444+0000","last_fullsized":"2023-11-08T12:30:55.332444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.296000+0000","last_change":"2023-11-08T12:30:54.836886+0000","last_active":"2023-11-08T12:30:55.296000+0000","last_peered":"2023-11-08T12:30:55.296000+0000","last_clean":"2023-11-08T12:30:55.296000+0000","last_became_active":"2023-11-08T12:30:54.836409+0000","last_became_peered":"2023-11-08T12:30:54.836409+0000","last_unstale":"2023-11-08T12:30:55.296000+0000","last_undegraded":"2023-11-08T12:30:55.296000+0000","last_fullsized":"2023-11-08T12:30:55.296000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:19:36.880517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-08T12:30:50.536254+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:30:50.536254+0000","last_peered":"2023-11-08T12:30:50.536254+0000","last_clean":"2023-11-08T12:30:50.536254+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:30:50.536254+0000","last_undegraded":"2023-11-08T12:30:50.536254+0000","last_fullsized":"2023-11-08T12:30:50.536254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332474+0000","last_change":"2023-11-08T12:30:55.326952+0000","last_active":"2023-11-08T12:30:55.332474+0000","last_peered":"2023-11-08T12:30:55.332474+0000","last_clean":"2023-11-08T12:30:55.332474+0000","last_became_active":"2023-11-08T12:30:55.326675+0000","last_became_peered":"2023-11-08T12:30:55.326675+0000","last_unstale":"2023-11-08T12:30:55.332474+0000","last_undegraded":"2023-11-08T12:30:55.332474+0000","last_fullsized":"2023-11-08T12:30:55.332474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.312303+0000","last_change":"2023-11-08T12:30:54.837545+0000","last_active":"2023-11-08T12:30:55.312303+0000","last_peered":"2023-11-08T12:30:55.312303+0000","last_clean":"2023-11-08T12:30:55.312303+0000","last_became_active":"2023-11-08T12:30:54.837294+0000","last_became_peered":"2023-11-08T12:30:54.837294+0000","last_unstale":"2023-11-08T12:30:55.312303+0000","last_undegraded":"2023-11-08T12:30:55.312303+0000","last_fullsized":"2023-11-08T12:30:55.312303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841595+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:30:54.841595+0000","last_peered":"2023-11-08T12:30:54.841595+0000","last_clean":"2023-11-08T12:30:54.841595+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:30:54.841595+0000","last_undegraded":"2023-11-08T12:30:54.841595+0000","last_fullsized":"2023-11-08T12:30:54.841595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.319212+0000","last_change":"2023-11-08T12:30:55.316883+0000","last_active":"2023-11-08T12:30:55.319212+0000","last_peered":"2023-11-08T12:30:55.319212+0000","last_clean":"2023-11-08T12:30:55.319212+0000","last_became_active":"2023-11-08T12:30:55.316621+0000","last_became_peered":"2023-11-08T12:30:55.316621+0000","last_unstale":"2023-11-08T12:30:55.319212+0000","last_undegraded":"2023-11-08T12:30:55.319212+0000","last_fullsized":"2023-11-08T12:30:55.319212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649596+0000","last_change":"2023-11-08T12:30:54.843585+0000","last_active":"2023-11-08T12:30:56.649596+0000","last_peered":"2023-11-08T12:30:56.649596+0000","last_clean":"2023-11-08T12:30:56.649596+0000","last_became_active":"2023-11-08T12:30:54.843194+0000","last_became_peered":"2023-11-08T12:30:54.843194+0000","last_unstale":"2023-11-08T12:30:56.649596+0000","last_undegraded":"2023-11-08T12:30:56.649596+0000","last_fullsized":"2023-11-08T12:30:56.649596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:21:27.756624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.824217+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:30:54.824217+0000","last_peered":"2023-11-08T12:30:54.824217+0000","last_clean":"2023-11-08T12:30:54.824217+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:30:54.824217+0000","last_undegraded":"2023-11-08T12:30:54.824217+0000","last_fullsized":"2023-11-08T12:30:54.824217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":201,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.831352+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:30:54.831352+0000","last_peered":"2023-11-08T12:30:54.831352+0000","last_clean":"2023-11-08T12:30:54.831352+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:30:54.831352+0000","last_undegraded":"2023-11-08T12:30:54.831352+0000","last_fullsized":"2023-11-08T12:30:54.831352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9716,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362124,"statfs":{"total":96636764160,"available":96626814976,"internally_reserved":0,"allocated":831488,"data_stored":383521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.375,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.1040000000000001},"min":{"1min":0.71999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5669999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.72199999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.169,"15min":1.157},"min":{"1min":0.77100000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5649999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.179},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.80800000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.512,"5min":1.851,"15min":1.851},"last":0.90800000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.069,"15min":1.0589999999999999},"min":{"1min":0.90800000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.272,"15min":1.27},"min":{"1min":0.92300000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3360000000000001,"15min":1.341},"min":{"1min":0.89400000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6040000000000001,"5min":5.601,"15min":5.601},"last":1.004},{"interface":"front","average":{"1min":1.194,"5min":1.226,"15min":1.236},"min":{"1min":0.93600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.452,"5min":1.73,"15min":1.73},"last":0.97599999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.29,"15min":1.321},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.613,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.337,"15min":1.3660000000000001},"min":{"1min":0.96499999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6639999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.397}]},{"osd":5,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2629999999999999,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.694,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.385},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.4470000000000001,"15min":1.466},"min":{"1min":1.0880000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.734,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.456,"15min":1.482},"min":{"1min":1.0029999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.7649999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.417,"15min":1.4410000000000001},"min":{"1min":0.98999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7849999999999999,"5min":2.121,"15min":2.121},"last":1.284}]}]},{"osd":4,"up_from":16,"seq":68719476779,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9968,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361872,"statfs":{"total":96636764160,"available":96626556928,"internally_reserved":0,"allocated":827392,"data_stored":383499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.069,"15min":1.0569999999999999},"min":{"1min":0.61599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.03}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.159,"15min":1.1599999999999999},"min":{"1min":0.81299999999999994,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.639,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.157,"15min":1.1930000000000001},"min":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.343,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2050000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.2130000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.446,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4330000000000001,"5min":3.129,"15min":3.129},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1950000000000001,"15min":1.2150000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8140000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.159},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5189999999999999,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2490000000000001,"15min":1.2989999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2190000000000001,"15min":1.22},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.5409999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.28}]},{"osd":6,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5780000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.379},{"interface":"front","average":{"1min":1.306,"5min":1.3979999999999999,"15min":1.425},"min":{"1min":1.018,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.524,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3839999999999999,"15min":1.4099999999999999},"min":{"1min":0.94499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.734,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4299999999999999,"15min":1.448},"min":{"1min":0.95699999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.867,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4199999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10872,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360968,"statfs":{"total":96636764160,"available":96625631232,"internally_reserved":0,"allocated":1425408,"data_stored":974397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1519999999999999},"min":{"1min":0.67800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4319999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.145,"5min":1.1639999999999999,"15min":1.1719999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5329999999999999,"5min":1.7,"15min":1.7},"last":1}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.046},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.76000000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.409,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.123,"15min":1.121},"min":{"1min":0.84699999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.47,"5min":1.597,"15min":1.597},"last":1.254},{"interface":"front","average":{"1min":1.24,"5min":1.2090000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.651,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.298}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.198,"15min":1.222},"min":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3979999999999999,"5min":1.984,"15min":1.984},"last":1.121},{"interface":"front","average":{"1min":1.198,"5min":1.2529999999999999,"15min":1.2629999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.51,"5min":2.137,"15min":2.137},"last":1.177}]},{"osd":4,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.26,"15min":1.2889999999999999},"min":{"1min":0.70699999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.677,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.224,"15min":1.246},"min":{"1min":0.83699999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.353}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.86899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5760000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.238,"15min":1.264},"min":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6020000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3600000000000001,"15min":1.3660000000000001},"min":{"1min":0.97299999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.79,"5min":1.956,"15min":1.956},"last":1.391},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3859999999999999,"15min":1.415},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.798,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.591}]}]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.7629999999999999,"15min":2.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.623,"5min":20.099,"15min":20.099},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.823,"15min":2.141},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4379999999999999,"5min":21.238,"15min":21.238},"last":0.93600000000000005}]},{"osd":1,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.155,"15min":1.2110000000000001},"min":{"1min":0.71399999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.573,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.391,"15min":1.5369999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5149999999999999,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.038}]},{"osd":2,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.5569999999999999,"15min":1.7310000000000001},"min":{"1min":0.97599999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.4770000000000001,"5min":11.843,"15min":11.843},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.597,"15min":1.7749999999999999},"min":{"1min":0.80500000000000005,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8939999999999999,"5min":11.907,"15min":11.907},"last":1.167}]},{"osd":3,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.331,"15min":1.4059999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.556,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.4039999999999999,"15min":1.4930000000000001},"min":{"1min":0.90800000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.7529999999999999,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.133}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2070000000000001,"15min":1.2130000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.869,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2709999999999999,"15min":1.2889999999999999},"min":{"1min":0.75,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.966,"5min":2.073,"15min":2.073},"last":0.85099999999999998}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.262,"15min":1.3029999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.552,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.351,"5min":1.367,"15min":1.385},"min":{"1min":1.0449999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.097}]},{"osd":7,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.637,"15min":1.7889999999999999},"min":{"1min":1.002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.647,"5min":8.109,"15min":8.109},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.593,"15min":1.675},"min":{"1min":1.2190000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.101,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.27}]}]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":831488,"data_stored":383541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.91600000000000004,"15min":0.97799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96599999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.97799999999999998},"min":{"1min":0.61399999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.165,"5min":1.53,"15min":1.53},"last":0.97899999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.075,"5min":1.51,"15min":1.51},"last":0.752},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.4219999999999999,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.143,"15min":1.22},"min":{"1min":0.63600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.57899999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.226,"5min":1.972,"15min":1.972},"last":0.78700000000000003}]},{"osd":4,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2150000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.458,"5min":1.837,"15min":1.837},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.226,"5min":1.3089999999999999,"15min":1.339},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5960000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.044}]},{"osd":5,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.70599999999999996,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.649,"5min":1.897,"15min":1.897},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4059999999999999,"15min":1.474},"min":{"1min":0.77500000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6759999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.995}]},{"osd":6,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.319,"15min":1.347},"min":{"1min":0.875,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9079999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.292,"5min":1.321,"15min":1.339},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6679999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4370000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.427,"15min":1.4630000000000001},"min":{"1min":0.94399999999999995,"5min":0.875,"15min":0.875},"max":{"1min":1.9890000000000001,"5min":2.194,"15min":2.194},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.93600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.472,"15min":2.472},"last":1.3180000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.499,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.597,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":5.2009999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":5.0190000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5329999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1379999999999999},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.5940000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.474}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":1.546},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.032,"15min":1.0880000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.4550000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":3.73}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2410000000000001,"15min":1.2709999999999999},"min":{"1min":0.878,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":3.766},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3120000000000001,"15min":1.3320000000000001},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.663,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.573}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.375,"15min":1.411},"min":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":4.8620000000000001,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":3.8730000000000002},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.4590000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.9970000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.0920000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3400000000000001,"15min":1.3680000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":3.6880000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.357,"15min":1.3999999999999999},"min":{"1min":0.95999999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":5.1520000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.482,"15min":1.5269999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.956,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":4.8230000000000004},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.425,"15min":1.4710000000000001},"min":{"1min":1.087,"5min":0.996,"15min":0.996},"max":{"1min":1.6439999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.518}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10928,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":9536,"kb_avail":94360912,"statfs":{"total":96636764160,"available":96625573888,"internally_reserved":0,"allocated":1417216,"data_stored":973797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9764864},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0169999999999999,"15min":1.1140000000000001},"min":{"1min":0.58899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1679999999999999,"5min":6.54,"15min":6.54},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.0289999999999999,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1359999999999999,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.82899999999999996}]},{"osd":2,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97799999999999998,"15min":1.0249999999999999},"min":{"1min":0.60299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.2130000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0269999999999999,"15min":1.0609999999999999},"min":{"1min":0.623,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5720000000000001,"5min":3.069,"15min":3.069},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.327,"5min":2.673,"15min":2.673},"last":1.335},{"interface":"front","average":{"1min":1.024,"5min":1.272,"15min":1.3819999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.599,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.4870000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.3280000000000001,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5840000000000001,"5min":2.927,"15min":2.927},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3440000000000001,"15min":1.409},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5589999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.512}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3480000000000001,"15min":1.4119999999999999},"min":{"1min":0.99399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.4370000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.996},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.456,"15min":1.546},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.556,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.0860000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.4930000000000001,"15min":1.583},"min":{"1min":0.95099999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.52,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.4390000000000001,"15min":1.5189999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.6379999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.4690000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4550000000000001,"15min":1.5269999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.5409999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.478,"15min":1.573},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.528,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.542}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9492,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362348,"statfs":{"total":96636764160,"available":96627044352,"internally_reserved":0,"allocated":798720,"data_stored":369033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3620000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0109999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.079,"15min":1.1200000000000001},"min":{"1min":0.77000000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2569999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.91200000000000003,"15min":0.92000000000000004},"min":{"1min":0.60799999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.415,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2829999999999999,"5min":1.837,"15min":1.837},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.999,"5min":1.073,"15min":1.119},"min":{"1min":0.51600000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.304,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.4990000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.3220000000000001,"15min":1.3740000000000001},"min":{"1min":0.90200000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.3979999999999999,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.28}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.343,"15min":1.393},"min":{"1min":1.0669999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.5640000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.157},{"interface":"front","average":{"1min":1.198,"5min":1.278,"15min":1.3260000000000001},"min":{"1min":1.008,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.613,"5min":3.052,"15min":3.052},"last":1.3149999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.327,"15min":1.377},"min":{"1min":1.0740000000000001,"5min":0.753,"15min":0.753},"max":{"1min":1.6719999999999999,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3680000000000001,"15min":1.4139999999999999},"min":{"1min":1.048,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8,"5min":2.254,"15min":2.254},"last":1.351}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3620000000000001,"15min":1.4099999999999999},"min":{"1min":1.0820000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5389999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.425,"15min":1.4690000000000001},"min":{"1min":1.0680000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8959999999999999,"5min":3.5,"15min":3.5},"last":1.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:31:00.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-08T12:31:00.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-08T12:31:00.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-08T12:31:00.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-08T12:31:00.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-08T12:31:00.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-08T12:31:00.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-11-08T12:31:00.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-11-08T12:30:53.808191+0000', 'last_change': '2023-11-08T12:30:53.808191+0000', 'last_active': '2023-11-08T12:30:53.794820+0000', 'last_peered': '2023-11-08T12:30:53.794820+0000', 'last_clean': '2023-11-08T12:30:53.794820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:53.808191+0000', 'last_undegraded': '2023-11-08T12:30:53.808191+0000', 'last_fullsized': '2023-11-08T12:30:53.808191+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T12:57:06.225781+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T12:31:00.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-08T12:31:00.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-08T12:31:00.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-11-08T12:31:00.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-11-08T12:30:53.809345+0000', 'last_change': '2023-11-08T12:30:53.809345+0000', 'last_active': '2023-11-08T12:30:53.794820+0000', 'last_peered': '2023-11-08T12:30:53.794820+0000', 'last_clean': '2023-11-08T12:30:53.794820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:53.809345+0000', 'last_undegraded': '2023-11-08T12:30:53.809345+0000', 'last_fullsized': '2023-11-08T12:30:53.809345+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T23:49:51.257823+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T12:31:00.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-08T12:31:00.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-11-08T12:31:00.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-11-08T12:30:53.808083+0000', 'last_change': '2023-11-08T12:30:53.808083+0000', 'last_active': '2023-11-08T12:30:53.794820+0000', 'last_peered': '2023-11-08T12:30:53.794820+0000', 'last_clean': '2023-11-08T12:30:53.794820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:53.808083+0000', 'last_undegraded': '2023-11-08T12:30:53.808083+0000', 'last_fullsized': '2023-11-08T12:30:53.808083+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:53.794820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-09T23:32:04.906777+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-08T12:31:00.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-08T12:31:00.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-08T12:30:54.801393+0000', 'last_change': '2023-11-08T12:30:54.801393+0000', 'last_active': '2023-11-08T12:30:54.801393+0000', 'last_peered': '2023-11-08T12:30:54.801393+0000', 'last_clean': '2023-11-08T12:30:54.801393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-08T12:30:54.801393+0000', 'last_undegraded': '2023-11-08T12:30:54.801393+0000', 'last_fullsized': '2023-11-08T12:30:54.801393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'last_clean_scrub_stamp': '2023-11-08T12:30:54.801393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-08T12:31:00.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-08T12:31:00.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feee1c51700 1 Processor -- start 2023-11-08T12:31:00.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feee1c51700 1 -- start start 2023-11-08T12:31:00.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feee1c51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feedc0714d0 0x7feedc06c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feee1c51700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc15dd30 con 0x7feedc15a310 2023-11-08T12:31:00.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feee1c51700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc15eb90 con 0x7feedc0cbff0 2023-11-08T12:31:00.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feee1c51700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feedc0b12b0 con 0x7feedc0714d0 2023-11-08T12:31:00.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feedb7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7feedc15a310 0x7feedc0cb8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51238/0 (socket says 172.21.15.112:51238) 2023-11-08T12:31:00.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.729+0000 7feedb7fe700 1 -- 172.21.15.112:0/1004587326 learned_addr learned my addr 172.21.15.112:0/1004587326 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:00.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedbfff700 1 --2- 172.21.15.112:0/1004587326 >> v2:172.21.15.133:3300/0 conn(0x7feedc0714d0 0x7feedc06c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedaffd700 1 -- 172.21.15.112:0/1004587326 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939232776 0 0) 0x7feedc15dd30 con 0x7feedc15a310 2023-11-08T12:31:00.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedbfff700 1 -- 172.21.15.112:0/1004587326 >> v1:172.21.15.133:6789/0 conn(0x7feedc0cbff0 legacy=0x7feedc06c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedbfff700 1 -- 172.21.15.112:0/1004587326 >> v1:172.21.15.112:6789/0 conn(0x7feedc15a310 legacy=0x7feedc0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedbfff700 1 -- 172.21.15.112:0/1004587326 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc15df80 con 0x7feedc0714d0 2023-11-08T12:31:00.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedbfff700 1 --2- 172.21.15.112:0/1004587326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc0714d0 0x7feedc06c960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feed4009d90 tx=0x7feed400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3217e286b42036 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedaffd700 1 -- 172.21.15.112:0/1004587326 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed400e070 con 0x7feedc0714d0 2023-11-08T12:31:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedaffd700 1 -- 172.21.15.112:0/1004587326 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed400bad0 con 0x7feedc0714d0 2023-11-08T12:31:00.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feedaffd700 1 -- 172.21.15.112:0/1004587326 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed400be80 con 0x7feedc0714d0 2023-11-08T12:31:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feee1c51700 1 -- 172.21.15.112:0/1004587326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc0714d0 msgr2=0x7feedc06c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feee1c51700 1 --2- 172.21.15.112:0/1004587326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc0714d0 0x7feedc06c960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feed4009d90 tx=0x7feed400b330 comp rx=0 tx=0).stop 2023-11-08T12:31:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feee1c51700 1 -- 172.21.15.112:0/1004587326 shutdown_connections 2023-11-08T12:31:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feee1c51700 1 --2- 172.21.15.112:0/1004587326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc0714d0 0x7feedc06c960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feee1c51700 1 -- 172.21.15.112:0/1004587326 >> 172.21.15.112:0/1004587326 conn(0x7feedc0cf380 msgr2=0x7feedc0cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:00.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feee1c51700 1 -- 172.21.15.112:0/1004587326 shutdown_connections 2023-11-08T12:31:00.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.733+0000 7feee1c51700 1 -- 172.21.15.112:0/1004587326 wait complete. 2023-11-08T12:31:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.737+0000 7feee1c51700 1 Processor -- start 2023-11-08T12:31:00.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 -- start start 2023-11-08T12:31:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feedc0714d0 0x7feedc14c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feedc0cbff0 0x7feedc15d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc15a310 0x7feedc14dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc151ec0 con 0x7feedc0cbff0 2023-11-08T12:31:00.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc152d20 con 0x7feedc15a310 2023-11-08T12:31:00.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc1531b0 con 0x7feedc0714d0 2023-11-08T12:31:00.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feedc0cbff0 0x7feedc15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feedc0cbff0 0x7feedc15d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44306/0 (socket says 172.21.15.112:44306) 2023-11-08T12:31:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 -- 172.21.15.112:0/2892153167 learned_addr learned my addr 172.21.15.112:0/2892153167 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feedbfff700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc15a310 0x7feedc14dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feedb7fe700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feedc0714d0 0x7feedc14c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 -- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feedc0714d0 msgr2=0x7feedc14c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feedc0714d0 0x7feedc14c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 -- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc15a310 msgr2=0x7feedc14dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc15a310 0x7feedc14dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 -- 172.21.15.112:0/2892153167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4009a70 con 0x7feedc0cbff0 2023-11-08T12:31:00.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feedbfff700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc15a310 0x7feedc14dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed2ffd700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feedc0cbff0 0x7feedc15d050 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feec400c780 tx=0x7feec400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed8ff9700 1 -- 172.21.15.112:0/2892153167 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40054e0 con 0x7feedc0cbff0 2023-11-08T12:31:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed8ff9700 1 -- 172.21.15.112:0/2892153167 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec40036a0 con 0x7feedc0cbff0 2023-11-08T12:31:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feed8ff9700 1 -- 172.21.15.112:0/2892153167 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4003a50 con 0x7feedc0cbff0 2023-11-08T12:31:00.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.741+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc15e540 con 0x7feedc0cbff0 2023-11-08T12:31:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.745+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feedc15e260 con 0x7feedc0cbff0 2023-11-08T12:31:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.745+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc15e820 con 0x7feedc0cbff0 2023-11-08T12:31:00.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.745+0000 7feed8ff9700 1 -- 172.21.15.112:0/2892153167 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7feec4019030 con 0x7feedc0cbff0 2023-11-08T12:31:00.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.749+0000 7feed8ff9700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feebc064ee0 0x7feebc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:00.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.749+0000 7feed8ff9700 1 -- 172.21.15.112:0/2892153167 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feec40813a0 con 0x7feedc0cbff0 2023-11-08T12:31:00.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.749+0000 7feedb7fe700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feebc064ee0 0x7feebc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:00.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.749+0000 7feedb7fe700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feebc064ee0 0x7feebc067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feecc000f60 tx=0x7feecc007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:00.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.753+0000 7feed8ff9700 1 -- 172.21.15.112:0/2892153167 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7feec404f310 con 0x7feedc0cbff0 2023-11-08T12:31:00.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.985+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7feedc0726c0 con 0x7feedc0cbff0 2023-11-08T12:31:00.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feed8ff9700 1 -- 172.21.15.112:0/2892153167 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1174 (secure 0 0 0) 0x7feec4052930 con 0x7feedc0cbff0 2023-11-08T12:31:00.990 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:00.990 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":213,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":70,"num_osds":8,"num_up_osds":8,"osd_up_since":1699446461,"num_in_osds":8,"osd_in_since":1699446451,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"unknown","count":10},{"state_name":"creating+peering","count":3}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592698,"bytes_used":82071552,"bytes_avail":773012041728,"bytes_total":773094113280,"unknown_pgs_ratio":0.095238097012042999,"inactive_pgs_ratio":0.02857142873108387,"write_bytes_sec":2883,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-08T12:29:00.733525+0000","services":{}},"progress_events":{}} 2023-11-08T12:31:00.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feebc064ee0 msgr2=0x7feebc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feebc064ee0 0x7feebc067390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feecc000f60 tx=0x7feecc007e00 comp rx=0 tx=0).stop 2023-11-08T12:31:00.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feedc0cbff0 msgr2=0x7feedc15d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:00.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feedc0cbff0 0x7feedc15d050 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7feec400c780 tx=0x7feec400ca90 comp rx=0 tx=0).stop 2023-11-08T12:31:00.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 shutdown_connections 2023-11-08T12:31:00.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feebc064ee0 0x7feebc067390 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc15a310 0x7feedc14dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feedc0cbff0 0x7feedc15d050 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 --2- 172.21.15.112:0/2892153167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feedc0714d0 0x7feedc14c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:00.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 >> 172.21.15.112:0/2892153167 conn(0x7feedc0cf380 msgr2=0x7feedc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:00.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 shutdown_connections 2023-11-08T12:31:00.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:00.989+0000 7feee1c51700 1 -- 172.21.15.112:0/2892153167 wait complete. 2023-11-08T12:31:01.012 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-08T12:31:01.013 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:31:01.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cf22f700 1 Processor -- start 2023-11-08T12:31:01.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cf22f700 1 -- start start 2023-11-08T12:31:01.196 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cf22f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63c80b43a0 0x7f63c815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:01.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cf22f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80b1640 0x7f63c8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:01.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cf22f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c815a550 con 0x7f63c80c9040 2023-11-08T12:31:01.197 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cf22f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c806b0a0 con 0x7f63c80b43a0 2023-11-08T12:31:01.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cf22f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80caac0 con 0x7f63c80b1640 2023-11-08T12:31:01.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63ce22d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63c80b43a0 0x7f63c815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:01.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63cda2c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80b1640 0x7f63c8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:01.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63ce22d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63c80b43a0 0x7f63c815e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:35870/0 (socket says 172.21.15.112:35870) 2023-11-08T12:31:01.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.193+0000 7f63ce22d700 1 -- 172.21.15.112:0/1206370069 learned_addr learned my addr 172.21.15.112:0/1206370069 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:01.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63ce22d700 1 -- 172.21.15.112:0/1206370069 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80b1640 msgr2=0x7f63c8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:01.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63ce22d700 1 --2- 172.21.15.112:0/1206370069 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80b1640 0x7f63c8070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63ce22d700 1 -- 172.21.15.112:0/1206370069 >> v1:172.21.15.133:6789/0 conn(0x7f63c80c9040 legacy=0x7f63c8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:01.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cd22b700 1 -- 172.21.15.112:0/1206370069 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083790385 0 0) 0x7f63c0001490 con 0x7f63c80c9040 2023-11-08T12:31:01.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63ce22d700 1 -- 172.21.15.112:0/1206370069 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80cada0 con 0x7f63c80b43a0 2023-11-08T12:31:01.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63ce22d700 1 --2- 172.21.15.112:0/1206370069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 0x7f63c815e5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009910 tx=0x7f63c4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c588198cbe6da338 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:01.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cd22b700 1 -- 172.21.15.112:0/1206370069 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4011830 con 0x7f63c80b43a0 2023-11-08T12:31:01.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cd22b700 1 -- 172.21.15.112:0/1206370069 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4011990 con 0x7f63c80b43a0 2023-11-08T12:31:01.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cd22b700 1 -- 172.21.15.112:0/1206370069 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4011d40 con 0x7f63c80b43a0 2023-11-08T12:31:01.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 -- 172.21.15.112:0/1206370069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 msgr2=0x7f63c815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:01.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1206370069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 0x7f63c815e5d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009910 tx=0x7f63c4009c20 comp rx=0 tx=0).stop 2023-11-08T12:31:01.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 -- 172.21.15.112:0/1206370069 shutdown_connections 2023-11-08T12:31:01.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1206370069 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80b1640 0x7f63c8070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1206370069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 0x7f63c815e5d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 -- 172.21.15.112:0/1206370069 >> 172.21.15.112:0/1206370069 conn(0x7f63c80b0f80 msgr2=0x7f63c80ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:01.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 -- 172.21.15.112:0/1206370069 shutdown_connections 2023-11-08T12:31:01.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.197+0000 7f63cf22f700 1 -- 172.21.15.112:0/1206370069 wait complete. 2023-11-08T12:31:01.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.201+0000 7f63cf22f700 1 Processor -- start 2023-11-08T12:31:01.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.201+0000 7f63cf22f700 1 -- start start 2023-11-08T12:31:01.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c80b1640 0x7f63c80c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:01.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 0x7f63c814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:01.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80c9040 0x7f63c815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:01.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80c4cc0 con 0x7f63c80b1640 2023-11-08T12:31:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80c4830 con 0x7f63c80b43a0 2023-11-08T12:31:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80c3c20 con 0x7f63c80c9040 2023-11-08T12:31:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c80b1640 0x7f63c80c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c80b1640 0x7f63c80c3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44308/0 (socket says 172.21.15.112:44308) 2023-11-08T12:31:01.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 -- 172.21.15.112:0/1922347598 learned_addr learned my addr 172.21.15.112:0/1922347598 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:01.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cda2c700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 0x7f63c814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:01.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cea2e700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80c9040 0x7f63c815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:01.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 -- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80c9040 msgr2=0x7f63c815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:01.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80c9040 0x7f63c815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 -- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 msgr2=0x7f63c814e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:01.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 0x7f63c814e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 -- 172.21.15.112:0/1922347598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4009570 con 0x7f63c80b1640 2023-11-08T12:31:01.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63ce22d700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c80b1640 0x7f63c80c3640 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009f70 tx=0x7f63c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:01.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63beffd700 1 -- 172.21.15.112:0/1922347598 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400b9a0 con 0x7f63c80b1640 2023-11-08T12:31:01.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63beffd700 1 -- 172.21.15.112:0/1922347598 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c401f070 con 0x7f63c80b1640 2023-11-08T12:31:01.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c806b5d0 con 0x7f63c80b1640 2023-11-08T12:31:01.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63beffd700 1 -- 172.21.15.112:0/1922347598 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400bd60 con 0x7f63c80b1640 2023-11-08T12:31:01.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.205+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c806b2f0 con 0x7f63c80b1640 2023-11-08T12:31:01.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.209+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c815eb10 con 0x7f63c80b1640 2023-11-08T12:31:01.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.209+0000 7f63beffd700 1 -- 172.21.15.112:0/1922347598 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f63c400f050 con 0x7f63c80b1640 2023-11-08T12:31:01.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.213+0000 7f63beffd700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63ac064ee0 0x7f63ac067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:01.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.213+0000 7f63beffd700 1 -- 172.21.15.112:0/1922347598 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f63c4021070 con 0x7f63c80b1640 2023-11-08T12:31:01.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.213+0000 7f63cda2c700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63ac064ee0 0x7f63ac067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:01.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.213+0000 7f63cda2c700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63ac064ee0 0x7f63ac067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f63c80c8cc0 tx=0x7f63b8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:01.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.217+0000 7f63beffd700 1 -- 172.21.15.112:0/1922347598 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f63c4051920 con 0x7f63c80b1640 2023-11-08T12:31:01.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.385+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63c80c4970 con 0x7f63ac064ee0 2023-11-08T12:31:01.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.401+0000 7f63beffd700 1 -- 172.21.15.112:0/1922347598 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308782 (secure 0 0 0) 0x7f63b8011780 con 0x7f63ac064ee0 2023-11-08T12:31:01.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:01.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63ac064ee0 msgr2=0x7f63ac067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:01.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63ac064ee0 0x7f63ac067390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f63c80c8cc0 tx=0x7f63b8009240 comp rx=0 tx=0).stop 2023-11-08T12:31:01.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c80b1640 msgr2=0x7f63c80c3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:01.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c80b1640 0x7f63c80c3640 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009f70 tx=0x7f63c4004770 comp rx=0 tx=0).stop 2023-11-08T12:31:01.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 shutdown_connections 2023-11-08T12:31:01.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f63ac064ee0 0x7f63ac067390 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c80c9040 0x7f63c815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c80b43a0 0x7f63c814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 --2- 172.21.15.112:0/1922347598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63c80b1640 0x7f63c80c3640 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:01.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 >> 172.21.15.112:0/1922347598 conn(0x7f63c80b0f80 msgr2=0x7f63c806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:01.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 shutdown_connections 2023-11-08T12:31:01.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:01.413+0000 7f63cf22f700 1 -- 172.21.15.112:0/1922347598 wait complete. 2023-11-08T12:31:01.417 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:31:01.436 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2023-11-08T12:31:00.774905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80324,"kb_used_data":7620,"kb_used_omap":0,"kb_used_meta":72640,"kb_avail":754894396,"statfs":{"total":773094113280,"available":773011861504,"internally_reserved":0,"allocated":7802880,"data_stored":4242667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74383360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001655"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331748+0000","last_change":"2023-11-08T12:30:55.328953+0000","last_active":"2023-11-08T12:30:55.331748+0000","last_peered":"2023-11-08T12:30:55.331748+0000","last_clean":"2023-11-08T12:30:55.331748+0000","last_became_active":"2023-11-08T12:30:55.328518+0000","last_became_peered":"2023-11-08T12:30:55.328518+0000","last_unstale":"2023-11-08T12:30:55.331748+0000","last_undegraded":"2023-11-08T12:30:55.331748+0000","last_fullsized":"2023-11-08T12:30:55.331748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:04:49.078439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650079+0000","last_change":"2023-11-08T12:30:55.320721+0000","last_active":"2023-11-08T12:30:56.650079+0000","last_peered":"2023-11-08T12:30:56.650079+0000","last_clean":"2023-11-08T12:30:56.650079+0000","last_became_active":"2023-11-08T12:30:55.320483+0000","last_became_peered":"2023-11-08T12:30:55.320483+0000","last_unstale":"2023-11-08T12:30:56.650079+0000","last_undegraded":"2023-11-08T12:30:56.650079+0000","last_fullsized":"2023-11-08T12:30:56.650079+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:45.609313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321794+0000","last_change":"2023-11-08T12:30:55.319674+0000","last_active":"2023-11-08T12:30:55.321794+0000","last_peered":"2023-11-08T12:30:55.321794+0000","last_clean":"2023-11-08T12:30:55.321794+0000","last_became_active":"2023-11-08T12:30:55.319430+0000","last_became_peered":"2023-11-08T12:30:55.319430+0000","last_unstale":"2023-11-08T12:30:55.321794+0000","last_undegraded":"2023-11-08T12:30:55.321794+0000","last_fullsized":"2023-11-08T12:30:55.321794+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330610+0000","last_change":"2023-11-08T12:30:55.329331+0000","last_active":"2023-11-08T12:30:55.330610+0000","last_peered":"2023-11-08T12:30:55.330610+0000","last_clean":"2023-11-08T12:30:55.330610+0000","last_became_active":"2023-11-08T12:30:55.329078+0000","last_became_peered":"2023-11-08T12:30:55.329078+0000","last_unstale":"2023-11-08T12:30:55.330610+0000","last_undegraded":"2023-11-08T12:30:55.330610+0000","last_fullsized":"2023-11-08T12:30:55.330610+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:38:53.919890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307590+0000","last_change":"2023-11-08T12:30:55.313956+0000","last_active":"2023-11-08T12:30:56.307590+0000","last_peered":"2023-11-08T12:30:56.307590+0000","last_clean":"2023-11-08T12:30:56.307590+0000","last_became_active":"2023-11-08T12:30:55.313667+0000","last_became_peered":"2023-11-08T12:30:55.313667+0000","last_unstale":"2023-11-08T12:30:56.307590+0000","last_undegraded":"2023-11-08T12:30:56.307590+0000","last_fullsized":"2023-11-08T12:30:56.307590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:34.583047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649426+0000","last_change":"2023-11-08T12:30:55.324724+0000","last_active":"2023-11-08T12:30:56.649426+0000","last_peered":"2023-11-08T12:30:56.649426+0000","last_clean":"2023-11-08T12:30:56.649426+0000","last_became_active":"2023-11-08T12:30:55.324468+0000","last_became_peered":"2023-11-08T12:30:55.324468+0000","last_unstale":"2023-11-08T12:30:56.649426+0000","last_undegraded":"2023-11-08T12:30:56.649426+0000","last_fullsized":"2023-11-08T12:30:56.649426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.317050+0000","last_change":"2023-11-08T12:30:55.309539+0000","last_active":"2023-11-08T12:30:55.317050+0000","last_peered":"2023-11-08T12:30:55.317050+0000","last_clean":"2023-11-08T12:30:55.317050+0000","last_became_active":"2023-11-08T12:30:55.309199+0000","last_became_peered":"2023-11-08T12:30:55.309199+0000","last_unstale":"2023-11-08T12:30:55.317050+0000","last_undegraded":"2023-11-08T12:30:55.317050+0000","last_fullsized":"2023-11-08T12:30:55.317050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647430+0000","last_change":"2023-11-08T12:30:55.323799+0000","last_active":"2023-11-08T12:30:56.647430+0000","last_peered":"2023-11-08T12:30:56.647430+0000","last_clean":"2023-11-08T12:30:56.647430+0000","last_became_active":"2023-11-08T12:30:55.322805+0000","last_became_peered":"2023-11-08T12:30:55.322805+0000","last_unstale":"2023-11-08T12:30:56.647430+0000","last_undegraded":"2023-11-08T12:30:56.647430+0000","last_fullsized":"2023-11-08T12:30:56.647430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:58:32.146431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307949+0000","last_change":"2023-11-08T12:30:55.307531+0000","last_active":"2023-11-08T12:30:56.307949+0000","last_peered":"2023-11-08T12:30:56.307949+0000","last_clean":"2023-11-08T12:30:56.307949+0000","last_became_active":"2023-11-08T12:30:55.307168+0000","last_became_peered":"2023-11-08T12:30:55.307168+0000","last_unstale":"2023-11-08T12:30:56.307949+0000","last_undegraded":"2023-11-08T12:30:56.307949+0000","last_fullsized":"2023-11-08T12:30:56.307949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:44:17.581724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650420+0000","last_change":"2023-11-08T12:30:55.325321+0000","last_active":"2023-11-08T12:30:56.650420+0000","last_peered":"2023-11-08T12:30:56.650420+0000","last_clean":"2023-11-08T12:30:56.650420+0000","last_became_active":"2023-11-08T12:30:55.324837+0000","last_became_peered":"2023-11-08T12:30:55.324837+0000","last_unstale":"2023-11-08T12:30:56.650420+0000","last_undegraded":"2023-11-08T12:30:56.650420+0000","last_fullsized":"2023-11-08T12:30:56.650420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334701+0000","last_change":"2023-11-08T12:30:55.331241+0000","last_active":"2023-11-08T12:30:55.334701+0000","last_peered":"2023-11-08T12:30:55.334701+0000","last_clean":"2023-11-08T12:30:55.334701+0000","last_became_active":"2023-11-08T12:30:55.330973+0000","last_became_peered":"2023-11-08T12:30:55.330973+0000","last_unstale":"2023-11-08T12:30:55.334701+0000","last_undegraded":"2023-11-08T12:30:55.334701+0000","last_fullsized":"2023-11-08T12:30:55.334701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:03:30.133538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330562+0000","last_change":"2023-11-08T12:30:55.322622+0000","last_active":"2023-11-08T12:30:55.330562+0000","last_peered":"2023-11-08T12:30:55.330562+0000","last_clean":"2023-11-08T12:30:55.330562+0000","last_became_active":"2023-11-08T12:30:55.322388+0000","last_became_peered":"2023-11-08T12:30:55.322388+0000","last_unstale":"2023-11-08T12:30:55.330562+0000","last_undegraded":"2023-11-08T12:30:55.330562+0000","last_fullsized":"2023-11-08T12:30:55.330562+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:00:17.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329728+0000","last_change":"2023-11-08T12:30:55.328399+0000","last_active":"2023-11-08T12:30:55.329728+0000","last_peered":"2023-11-08T12:30:55.329728+0000","last_clean":"2023-11-08T12:30:55.329728+0000","last_became_active":"2023-11-08T12:30:55.327392+0000","last_became_peered":"2023-11-08T12:30:55.327392+0000","last_unstale":"2023-11-08T12:30:55.329728+0000","last_undegraded":"2023-11-08T12:30:55.329728+0000","last_fullsized":"2023-11-08T12:30:55.329728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:31:15.497928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307506+0000","last_change":"2023-11-08T12:30:55.311563+0000","last_active":"2023-11-08T12:30:56.307506+0000","last_peered":"2023-11-08T12:30:56.307506+0000","last_clean":"2023-11-08T12:30:56.307506+0000","last_became_active":"2023-11-08T12:30:55.311356+0000","last_became_peered":"2023-11-08T12:30:55.311356+0000","last_unstale":"2023-11-08T12:30:56.307506+0000","last_undegraded":"2023-11-08T12:30:56.307506+0000","last_fullsized":"2023-11-08T12:30:56.307506+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:03.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325002+0000","last_change":"2023-11-08T12:30:55.317752+0000","last_active":"2023-11-08T12:30:55.325002+0000","last_peered":"2023-11-08T12:30:55.325002+0000","last_clean":"2023-11-08T12:30:55.325002+0000","last_became_active":"2023-11-08T12:30:55.317496+0000","last_became_peered":"2023-11-08T12:30:55.317496+0000","last_unstale":"2023-11-08T12:30:55.325002+0000","last_undegraded":"2023-11-08T12:30:55.325002+0000","last_fullsized":"2023-11-08T12:30:55.325002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647309+0000","last_change":"2023-11-08T12:30:55.326903+0000","last_active":"2023-11-08T12:30:56.647309+0000","last_peered":"2023-11-08T12:30:56.647309+0000","last_clean":"2023-11-08T12:30:56.647309+0000","last_became_active":"2023-11-08T12:30:55.326660+0000","last_became_peered":"2023-11-08T12:30:55.326660+0000","last_unstale":"2023-11-08T12:30:56.647309+0000","last_undegraded":"2023-11-08T12:30:56.647309+0000","last_fullsized":"2023-11-08T12:30:56.647309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.308068+0000","last_change":"2023-11-08T12:30:55.307421+0000","last_active":"2023-11-08T12:30:56.308068+0000","last_peered":"2023-11-08T12:30:56.308068+0000","last_clean":"2023-11-08T12:30:56.308068+0000","last_became_active":"2023-11-08T12:30:55.307082+0000","last_became_peered":"2023-11-08T12:30:55.307082+0000","last_unstale":"2023-11-08T12:30:56.308068+0000","last_undegraded":"2023-11-08T12:30:56.308068+0000","last_fullsized":"2023-11-08T12:30:56.308068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:25:52.604915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332470+0000","last_change":"2023-11-08T12:30:55.331216+0000","last_active":"2023-11-08T12:30:55.332470+0000","last_peered":"2023-11-08T12:30:55.332470+0000","last_clean":"2023-11-08T12:30:55.332470+0000","last_became_active":"2023-11-08T12:30:55.330893+0000","last_became_peered":"2023-11-08T12:30:55.330893+0000","last_unstale":"2023-11-08T12:30:55.332470+0000","last_undegraded":"2023-11-08T12:30:55.332470+0000","last_fullsized":"2023-11-08T12:30:55.332470+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:35:52.148689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649345+0000","last_change":"2023-11-08T12:30:55.322352+0000","last_active":"2023-11-08T12:30:56.649345+0000","last_peered":"2023-11-08T12:30:56.649345+0000","last_clean":"2023-11-08T12:30:56.649345+0000","last_became_active":"2023-11-08T12:30:55.322091+0000","last_became_peered":"2023-11-08T12:30:55.322091+0000","last_unstale":"2023-11-08T12:30:56.649345+0000","last_undegraded":"2023-11-08T12:30:56.649345+0000","last_fullsized":"2023-11-08T12:30:56.649345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:44:24.238839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325072+0000","last_change":"2023-11-08T12:30:55.319873+0000","last_active":"2023-11-08T12:30:55.325072+0000","last_peered":"2023-11-08T12:30:55.325072+0000","last_clean":"2023-11-08T12:30:55.325072+0000","last_became_active":"2023-11-08T12:30:55.319631+0000","last_became_peered":"2023-11-08T12:30:55.319631+0000","last_unstale":"2023-11-08T12:30:55.325072+0000","last_undegraded":"2023-11-08T12:30:55.325072+0000","last_fullsized":"2023-11-08T12:30:55.325072+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:25:00.378994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650017+0000","last_change":"2023-11-08T12:30:55.321243+0000","last_active":"2023-11-08T12:30:56.650017+0000","last_peered":"2023-11-08T12:30:56.650017+0000","last_clean":"2023-11-08T12:30:56.650017+0000","last_became_active":"2023-11-08T12:30:55.320928+0000","last_became_peered":"2023-11-08T12:30:55.320928+0000","last_unstale":"2023-11-08T12:30:56.650017+0000","last_undegraded":"2023-11-08T12:30:56.650017+0000","last_fullsized":"2023-11-08T12:30:56.650017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649813+0000","last_change":"2023-11-08T12:30:55.314603+0000","last_active":"2023-11-08T12:30:56.649813+0000","last_peered":"2023-11-08T12:30:56.649813+0000","last_clean":"2023-11-08T12:30:56.649813+0000","last_became_active":"2023-11-08T12:30:55.314244+0000","last_became_peered":"2023-11-08T12:30:55.314244+0000","last_unstale":"2023-11-08T12:30:56.649813+0000","last_undegraded":"2023-11-08T12:30:56.649813+0000","last_fullsized":"2023-11-08T12:30:56.649813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329382+0000","last_change":"2023-11-08T12:30:55.324660+0000","last_active":"2023-11-08T12:30:55.329382+0000","last_peered":"2023-11-08T12:30:55.329382+0000","last_clean":"2023-11-08T12:30:55.329382+0000","last_became_active":"2023-11-08T12:30:55.324367+0000","last_became_peered":"2023-11-08T12:30:55.324367+0000","last_unstale":"2023-11-08T12:30:55.329382+0000","last_undegraded":"2023-11-08T12:30:55.329382+0000","last_fullsized":"2023-11-08T12:30:55.329382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336629+0000","last_change":"2023-11-08T12:30:55.331611+0000","last_active":"2023-11-08T12:30:55.336629+0000","last_peered":"2023-11-08T12:30:55.336629+0000","last_clean":"2023-11-08T12:30:55.336629+0000","last_became_active":"2023-11-08T12:30:55.331332+0000","last_became_peered":"2023-11-08T12:30:55.331332+0000","last_unstale":"2023-11-08T12:30:55.336629+0000","last_undegraded":"2023-11-08T12:30:55.336629+0000","last_fullsized":"2023-11-08T12:30:55.336629+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:07.030455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650350+0000","last_change":"2023-11-08T12:30:55.335185+0000","last_active":"2023-11-08T12:30:56.650350+0000","last_peered":"2023-11-08T12:30:56.650350+0000","last_clean":"2023-11-08T12:30:56.650350+0000","last_became_active":"2023-11-08T12:30:55.334582+0000","last_became_peered":"2023-11-08T12:30:55.334582+0000","last_unstale":"2023-11-08T12:30:56.650350+0000","last_undegraded":"2023-11-08T12:30:56.650350+0000","last_fullsized":"2023-11-08T12:30:56.650350+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:45.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334783+0000","last_change":"2023-11-08T12:30:55.330007+0000","last_active":"2023-11-08T12:30:55.334783+0000","last_peered":"2023-11-08T12:30:55.334783+0000","last_clean":"2023-11-08T12:30:55.334783+0000","last_became_active":"2023-11-08T12:30:55.326154+0000","last_became_peered":"2023-11-08T12:30:55.326154+0000","last_unstale":"2023-11-08T12:30:55.334783+0000","last_undegraded":"2023-11-08T12:30:55.334783+0000","last_fullsized":"2023-11-08T12:30:55.334783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321778+0000","last_change":"2023-11-08T12:30:55.316113+0000","last_active":"2023-11-08T12:30:55.321778+0000","last_peered":"2023-11-08T12:30:55.321778+0000","last_clean":"2023-11-08T12:30:55.321778+0000","last_became_active":"2023-11-08T12:30:55.315770+0000","last_became_peered":"2023-11-08T12:30:55.315770+0000","last_unstale":"2023-11-08T12:30:55.321778+0000","last_undegraded":"2023-11-08T12:30:55.321778+0000","last_fullsized":"2023-11-08T12:30:55.321778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650222+0000","last_change":"2023-11-08T12:30:55.319074+0000","last_active":"2023-11-08T12:30:56.650222+0000","last_peered":"2023-11-08T12:30:56.650222+0000","last_clean":"2023-11-08T12:30:56.650222+0000","last_became_active":"2023-11-08T12:30:55.318252+0000","last_became_peered":"2023-11-08T12:30:55.318252+0000","last_unstale":"2023-11-08T12:30:56.650222+0000","last_undegraded":"2023-11-08T12:30:56.650222+0000","last_fullsized":"2023-11-08T12:30:56.650222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.306389+0000","last_change":"2023-11-08T12:30:55.302817+0000","last_active":"2023-11-08T12:30:55.306389+0000","last_peered":"2023-11-08T12:30:55.306389+0000","last_clean":"2023-11-08T12:30:55.306389+0000","last_became_active":"2023-11-08T12:30:55.302532+0000","last_became_peered":"2023-11-08T12:30:55.302532+0000","last_unstale":"2023-11-08T12:30:55.306389+0000","last_undegraded":"2023-11-08T12:30:55.306389+0000","last_fullsized":"2023-11-08T12:30:55.306389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330572+0000","last_change":"2023-11-08T12:30:55.326527+0000","last_active":"2023-11-08T12:30:55.330572+0000","last_peered":"2023-11-08T12:30:55.330572+0000","last_clean":"2023-11-08T12:30:55.330572+0000","last_became_active":"2023-11-08T12:30:55.326149+0000","last_became_peered":"2023-11-08T12:30:55.326149+0000","last_unstale":"2023-11-08T12:30:55.330572+0000","last_undegraded":"2023-11-08T12:30:55.330572+0000","last_fullsized":"2023-11-08T12:30:55.330572+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.309641+0000","last_change":"2023-11-08T12:30:55.304430+0000","last_active":"2023-11-08T12:30:55.309641+0000","last_peered":"2023-11-08T12:30:55.309641+0000","last_clean":"2023-11-08T12:30:55.309641+0000","last_became_active":"2023-11-08T12:30:55.304157+0000","last_became_peered":"2023-11-08T12:30:55.304157+0000","last_unstale":"2023-11-08T12:30:55.309641+0000","last_undegraded":"2023-11-08T12:30:55.309641+0000","last_fullsized":"2023-11-08T12:30:55.309641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:54:35.840622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647670+0000","last_change":"2023-11-08T12:30:55.321120+0000","last_active":"2023-11-08T12:30:56.647670+0000","last_peered":"2023-11-08T12:30:56.647670+0000","last_clean":"2023-11-08T12:30:56.647670+0000","last_became_active":"2023-11-08T12:30:55.320278+0000","last_became_peered":"2023-11-08T12:30:55.320278+0000","last_unstale":"2023-11-08T12:30:56.647670+0000","last_undegraded":"2023-11-08T12:30:56.647670+0000","last_fullsized":"2023-11-08T12:30:56.647670+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:02:47.585589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336724+0000","last_change":"2023-11-08T12:30:55.332770+0000","last_active":"2023-11-08T12:30:55.336724+0000","last_peered":"2023-11-08T12:30:55.336724+0000","last_clean":"2023-11-08T12:30:55.336724+0000","last_became_active":"2023-11-08T12:30:55.332517+0000","last_became_peered":"2023-11-08T12:30:55.332517+0000","last_unstale":"2023-11-08T12:30:55.336724+0000","last_undegraded":"2023-11-08T12:30:55.336724+0000","last_fullsized":"2023-11-08T12:30:55.336724+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'4","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332156+0000","last_change":"2023-11-08T12:30:54.846800+0000","last_active":"2023-11-08T12:30:55.332156+0000","last_peered":"2023-11-08T12:30:55.332156+0000","last_clean":"2023-11-08T12:30:55.332156+0000","last_became_active":"2023-11-08T12:30:54.846540+0000","last_became_peered":"2023-11-08T12:30:54.846540+0000","last_unstale":"2023-11-08T12:30:55.332156+0000","last_undegraded":"2023-11-08T12:30:55.332156+0000","last_fullsized":"2023-11-08T12:30:55.332156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:29:02.918713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.308055+0000","last_change":"2023-11-08T12:30:55.307344+0000","last_active":"2023-11-08T12:30:56.308055+0000","last_peered":"2023-11-08T12:30:56.308055+0000","last_clean":"2023-11-08T12:30:56.308055+0000","last_became_active":"2023-11-08T12:30:55.306806+0000","last_became_peered":"2023-11-08T12:30:55.306806+0000","last_unstale":"2023-11-08T12:30:56.308055+0000","last_undegraded":"2023-11-08T12:30:56.308055+0000","last_fullsized":"2023-11-08T12:30:56.308055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:29:45.421251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325670+0000","last_change":"2023-11-08T12:30:54.849246+0000","last_active":"2023-11-08T12:30:55.325670+0000","last_peered":"2023-11-08T12:30:55.325670+0000","last_clean":"2023-11-08T12:30:55.325670+0000","last_became_active":"2023-11-08T12:30:54.848932+0000","last_became_peered":"2023-11-08T12:30:54.848932+0000","last_unstale":"2023-11-08T12:30:55.325670+0000","last_undegraded":"2023-11-08T12:30:55.325670+0000","last_fullsized":"2023-11-08T12:30:55.325670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649715+0000","last_change":"2023-11-08T12:30:55.323319+0000","last_active":"2023-11-08T12:30:56.649715+0000","last_peered":"2023-11-08T12:30:56.649715+0000","last_clean":"2023-11-08T12:30:56.649715+0000","last_became_active":"2023-11-08T12:30:55.323053+0000","last_became_peered":"2023-11-08T12:30:55.323053+0000","last_unstale":"2023-11-08T12:30:56.649715+0000","last_undegraded":"2023-11-08T12:30:56.649715+0000","last_fullsized":"2023-11-08T12:30:56.649715+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:12:40.881917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650330+0000","last_change":"2023-11-08T12:30:54.831895+0000","last_active":"2023-11-08T12:30:56.650330+0000","last_peered":"2023-11-08T12:30:56.650330+0000","last_clean":"2023-11-08T12:30:56.650330+0000","last_became_active":"2023-11-08T12:30:54.831579+0000","last_became_peered":"2023-11-08T12:30:54.831579+0000","last_unstale":"2023-11-08T12:30:56.650330+0000","last_undegraded":"2023-11-08T12:30:56.650330+0000","last_fullsized":"2023-11-08T12:30:56.650330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.324474+0000","last_change":"2023-11-08T12:30:55.318219+0000","last_active":"2023-11-08T12:30:55.324474+0000","last_peered":"2023-11-08T12:30:55.324474+0000","last_clean":"2023-11-08T12:30:55.324474+0000","last_became_active":"2023-11-08T12:30:55.317811+0000","last_became_peered":"2023-11-08T12:30:55.317811+0000","last_unstale":"2023-11-08T12:30:55.324474+0000","last_undegraded":"2023-11-08T12:30:55.324474+0000","last_fullsized":"2023-11-08T12:30:55.324474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649832+0000","last_change":"2023-11-08T12:30:54.843634+0000","last_active":"2023-11-08T12:30:56.649832+0000","last_peered":"2023-11-08T12:30:56.649832+0000","last_clean":"2023-11-08T12:30:56.649832+0000","last_became_active":"2023-11-08T12:30:54.843178+0000","last_became_peered":"2023-11-08T12:30:54.843178+0000","last_unstale":"2023-11-08T12:30:56.649832+0000","last_undegraded":"2023-11-08T12:30:56.649832+0000","last_fullsized":"2023-11-08T12:30:56.649832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:36:56.748105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310880+0000","last_change":"2023-11-08T12:30:55.305408+0000","last_active":"2023-11-08T12:30:55.310880+0000","last_peered":"2023-11-08T12:30:55.310880+0000","last_clean":"2023-11-08T12:30:55.310880+0000","last_became_active":"2023-11-08T12:30:55.305030+0000","last_became_peered":"2023-11-08T12:30:55.305030+0000","last_unstale":"2023-11-08T12:30:55.310880+0000","last_undegraded":"2023-11-08T12:30:55.310880+0000","last_fullsized":"2023-11-08T12:30:55.310880+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:43.056426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"69'1","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328467+0000","last_change":"2023-11-08T12:30:54.835678+0000","last_active":"2023-11-08T12:30:55.328467+0000","last_peered":"2023-11-08T12:30:55.328467+0000","last_clean":"2023-11-08T12:30:55.328467+0000","last_became_active":"2023-11-08T12:30:54.833332+0000","last_became_peered":"2023-11-08T12:30:54.833332+0000","last_unstale":"2023-11-08T12:30:55.328467+0000","last_undegraded":"2023-11-08T12:30:55.328467+0000","last_fullsized":"2023-11-08T12:30:55.328467+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650059+0000","last_change":"2023-11-08T12:30:55.335120+0000","last_active":"2023-11-08T12:30:56.650059+0000","last_peered":"2023-11-08T12:30:56.650059+0000","last_clean":"2023-11-08T12:30:56.650059+0000","last_became_active":"2023-11-08T12:30:55.334810+0000","last_became_peered":"2023-11-08T12:30:55.334810+0000","last_unstale":"2023-11-08T12:30:56.650059+0000","last_undegraded":"2023-11-08T12:30:56.650059+0000","last_fullsized":"2023-11-08T12:30:56.650059+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:24.721389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649532+0000","last_change":"2023-11-08T12:30:54.844976+0000","last_active":"2023-11-08T12:30:56.649532+0000","last_peered":"2023-11-08T12:30:56.649532+0000","last_clean":"2023-11-08T12:30:56.649532+0000","last_became_active":"2023-11-08T12:30:54.844700+0000","last_became_peered":"2023-11-08T12:30:54.844700+0000","last_unstale":"2023-11-08T12:30:56.649532+0000","last_undegraded":"2023-11-08T12:30:56.649532+0000","last_fullsized":"2023-11-08T12:30:56.649532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:56:27.392361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307056+0000","last_change":"2023-11-08T12:30:55.326495+0000","last_active":"2023-11-08T12:30:56.307056+0000","last_peered":"2023-11-08T12:30:56.307056+0000","last_clean":"2023-11-08T12:30:56.307056+0000","last_became_active":"2023-11-08T12:30:55.326243+0000","last_became_peered":"2023-11-08T12:30:55.326243+0000","last_unstale":"2023-11-08T12:30:56.307056+0000","last_undegraded":"2023-11-08T12:30:56.307056+0000","last_fullsized":"2023-11-08T12:30:56.307056+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:05:16.321688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303200+0000","last_change":"2023-11-08T12:30:54.839982+0000","last_active":"2023-11-08T12:30:55.303200+0000","last_peered":"2023-11-08T12:30:55.303200+0000","last_clean":"2023-11-08T12:30:55.303200+0000","last_became_active":"2023-11-08T12:30:54.839352+0000","last_became_peered":"2023-11-08T12:30:54.839352+0000","last_unstale":"2023-11-08T12:30:55.303200+0000","last_undegraded":"2023-11-08T12:30:55.303200+0000","last_fullsized":"2023-11-08T12:30:55.303200+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:30:19.689649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328548+0000","last_change":"2023-11-08T12:30:55.325624+0000","last_active":"2023-11-08T12:30:55.328548+0000","last_peered":"2023-11-08T12:30:55.328548+0000","last_clean":"2023-11-08T12:30:55.328548+0000","last_became_active":"2023-11-08T12:30:55.325215+0000","last_became_peered":"2023-11-08T12:30:55.325215+0000","last_unstale":"2023-11-08T12:30:55.328548+0000","last_undegraded":"2023-11-08T12:30:55.328548+0000","last_fullsized":"2023-11-08T12:30:55.328548+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.299964+0000","last_change":"2023-11-08T12:30:54.841406+0000","last_active":"2023-11-08T12:30:55.299964+0000","last_peered":"2023-11-08T12:30:55.299964+0000","last_clean":"2023-11-08T12:30:55.299964+0000","last_became_active":"2023-11-08T12:30:54.841169+0000","last_became_peered":"2023-11-08T12:30:54.841169+0000","last_unstale":"2023-11-08T12:30:55.299964+0000","last_undegraded":"2023-11-08T12:30:55.299964+0000","last_fullsized":"2023-11-08T12:30:55.299964+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:57:06.225781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316655+0000","last_change":"2023-11-08T12:30:55.313267+0000","last_active":"2023-11-08T12:30:55.316655+0000","last_peered":"2023-11-08T12:30:55.316655+0000","last_clean":"2023-11-08T12:30:55.316655+0000","last_became_active":"2023-11-08T12:30:55.313008+0000","last_became_peered":"2023-11-08T12:30:55.313008+0000","last_unstale":"2023-11-08T12:30:55.316655+0000","last_undegraded":"2023-11-08T12:30:55.316655+0000","last_fullsized":"2023-11-08T12:30:55.316655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650448+0000","last_change":"2023-11-08T12:30:54.835906+0000","last_active":"2023-11-08T12:30:56.650448+0000","last_peered":"2023-11-08T12:30:56.650448+0000","last_clean":"2023-11-08T12:30:56.650448+0000","last_became_active":"2023-11-08T12:30:54.835646+0000","last_became_peered":"2023-11-08T12:30:54.835646+0000","last_unstale":"2023-11-08T12:30:56.650448+0000","last_undegraded":"2023-11-08T12:30:56.650448+0000","last_fullsized":"2023-11-08T12:30:56.650448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336682+0000","last_change":"2023-11-08T12:30:55.332691+0000","last_active":"2023-11-08T12:30:55.336682+0000","last_peered":"2023-11-08T12:30:55.336682+0000","last_clean":"2023-11-08T12:30:55.336682+0000","last_became_active":"2023-11-08T12:30:55.332466+0000","last_became_peered":"2023-11-08T12:30:55.332466+0000","last_unstale":"2023-11-08T12:30:55.336682+0000","last_undegraded":"2023-11-08T12:30:55.336682+0000","last_fullsized":"2023-11-08T12:30:55.336682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:32.086861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650156+0000","last_change":"2023-11-08T12:30:54.838927+0000","last_active":"2023-11-08T12:30:56.650156+0000","last_peered":"2023-11-08T12:30:56.650156+0000","last_clean":"2023-11-08T12:30:56.650156+0000","last_became_active":"2023-11-08T12:30:54.838387+0000","last_became_peered":"2023-11-08T12:30:54.838387+0000","last_unstale":"2023-11-08T12:30:56.650156+0000","last_undegraded":"2023-11-08T12:30:56.650156+0000","last_fullsized":"2023-11-08T12:30:56.650156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:02:00.436766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650138+0000","last_change":"2023-11-08T12:30:55.319414+0000","last_active":"2023-11-08T12:30:56.650138+0000","last_peered":"2023-11-08T12:30:56.650138+0000","last_clean":"2023-11-08T12:30:56.650138+0000","last_became_active":"2023-11-08T12:30:55.319072+0000","last_became_peered":"2023-11-08T12:30:55.319072+0000","last_unstale":"2023-11-08T12:30:56.650138+0000","last_undegraded":"2023-11-08T12:30:56.650138+0000","last_fullsized":"2023-11-08T12:30:56.650138+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:46.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321720+0000","last_change":"2023-11-08T12:30:54.834908+0000","last_active":"2023-11-08T12:30:55.321720+0000","last_peered":"2023-11-08T12:30:55.321720+0000","last_clean":"2023-11-08T12:30:55.321720+0000","last_became_active":"2023-11-08T12:30:54.834652+0000","last_became_peered":"2023-11-08T12:30:54.834652+0000","last_unstale":"2023-11-08T12:30:55.321720+0000","last_undegraded":"2023-11-08T12:30:55.321720+0000","last_fullsized":"2023-11-08T12:30:55.321720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307642+0000","last_change":"2023-11-08T12:30:55.321368+0000","last_active":"2023-11-08T12:30:56.307642+0000","last_peered":"2023-11-08T12:30:56.307642+0000","last_clean":"2023-11-08T12:30:56.307642+0000","last_became_active":"2023-11-08T12:30:55.320748+0000","last_became_peered":"2023-11-08T12:30:55.320748+0000","last_unstale":"2023-11-08T12:30:56.307642+0000","last_undegraded":"2023-11-08T12:30:56.307642+0000","last_fullsized":"2023-11-08T12:30:56.307642+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:56:54.467342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"69'6","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.334842+0000","last_change":"2023-11-08T12:30:54.849645+0000","last_active":"2023-11-08T12:30:55.334842+0000","last_peered":"2023-11-08T12:30:55.334842+0000","last_clean":"2023-11-08T12:30:55.334842+0000","last_became_active":"2023-11-08T12:30:54.849337+0000","last_became_peered":"2023-11-08T12:30:54.849337+0000","last_unstale":"2023-11-08T12:30:55.334842+0000","last_undegraded":"2023-11-08T12:30:55.334842+0000","last_fullsized":"2023-11-08T12:30:55.334842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.244426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.322459+0000","last_change":"2023-11-08T12:30:55.318084+0000","last_active":"2023-11-08T12:30:55.322459+0000","last_peered":"2023-11-08T12:30:55.322459+0000","last_clean":"2023-11-08T12:30:55.322459+0000","last_became_active":"2023-11-08T12:30:55.317807+0000","last_became_peered":"2023-11-08T12:30:55.317807+0000","last_unstale":"2023-11-08T12:30:55.322459+0000","last_undegraded":"2023-11-08T12:30:55.322459+0000","last_fullsized":"2023-11-08T12:30:55.322459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:01:11.195203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'2","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325446+0000","last_change":"2023-11-08T12:30:54.846257+0000","last_active":"2023-11-08T12:30:55.325446+0000","last_peered":"2023-11-08T12:30:55.325446+0000","last_clean":"2023-11-08T12:30:55.325446+0000","last_became_active":"2023-11-08T12:30:54.845973+0000","last_became_peered":"2023-11-08T12:30:54.845973+0000","last_unstale":"2023-11-08T12:30:55.325446+0000","last_undegraded":"2023-11-08T12:30:55.325446+0000","last_fullsized":"2023-11-08T12:30:55.325446+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:18.819505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.329997+0000","last_change":"2023-11-08T12:30:55.324143+0000","last_active":"2023-11-08T12:30:55.329997+0000","last_peered":"2023-11-08T12:30:55.329997+0000","last_clean":"2023-11-08T12:30:55.329997+0000","last_became_active":"2023-11-08T12:30:55.319125+0000","last_became_peered":"2023-11-08T12:30:55.319125+0000","last_unstale":"2023-11-08T12:30:55.329997+0000","last_undegraded":"2023-11-08T12:30:55.329997+0000","last_fullsized":"2023-11-08T12:30:55.329997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:40.089625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649611+0000","last_change":"2023-11-08T12:30:54.838934+0000","last_active":"2023-11-08T12:30:56.649611+0000","last_peered":"2023-11-08T12:30:56.649611+0000","last_clean":"2023-11-08T12:30:56.649611+0000","last_became_active":"2023-11-08T12:30:54.838577+0000","last_became_peered":"2023-11-08T12:30:54.838577+0000","last_unstale":"2023-11-08T12:30:56.649611+0000","last_undegraded":"2023-11-08T12:30:56.649611+0000","last_fullsized":"2023-11-08T12:30:56.649611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:06.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332911+0000","last_change":"2023-11-08T12:30:55.331694+0000","last_active":"2023-11-08T12:30:55.332911+0000","last_peered":"2023-11-08T12:30:55.332911+0000","last_clean":"2023-11-08T12:30:55.332911+0000","last_became_active":"2023-11-08T12:30:55.330426+0000","last_became_peered":"2023-11-08T12:30:55.330426+0000","last_unstale":"2023-11-08T12:30:55.332911+0000","last_undegraded":"2023-11-08T12:30:55.332911+0000","last_fullsized":"2023-11-08T12:30:55.332911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295791+0000","last_change":"2023-11-08T12:30:54.832910+0000","last_active":"2023-11-08T12:30:55.295791+0000","last_peered":"2023-11-08T12:30:55.295791+0000","last_clean":"2023-11-08T12:30:55.295791+0000","last_became_active":"2023-11-08T12:30:54.832399+0000","last_became_peered":"2023-11-08T12:30:54.832399+0000","last_unstale":"2023-11-08T12:30:55.295791+0000","last_undegraded":"2023-11-08T12:30:55.295791+0000","last_fullsized":"2023-11-08T12:30:55.295791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:50:27.468368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.306691+0000","last_change":"2023-11-08T12:30:55.309810+0000","last_active":"2023-11-08T12:30:56.306691+0000","last_peered":"2023-11-08T12:30:56.306691+0000","last_clean":"2023-11-08T12:30:56.306691+0000","last_became_active":"2023-11-08T12:30:55.309488+0000","last_became_peered":"2023-11-08T12:30:55.309488+0000","last_unstale":"2023-11-08T12:30:56.306691+0000","last_undegraded":"2023-11-08T12:30:56.306691+0000","last_fullsized":"2023-11-08T12:30:56.306691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:22:03.959642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"69'8","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647438+0000","last_change":"2023-11-08T12:30:54.843786+0000","last_active":"2023-11-08T12:30:56.647438+0000","last_peered":"2023-11-08T12:30:56.647438+0000","last_clean":"2023-11-08T12:30:56.647438+0000","last_became_active":"2023-11-08T12:30:54.843532+0000","last_became_peered":"2023-11-08T12:30:54.843532+0000","last_unstale":"2023-11-08T12:30:56.647438+0000","last_undegraded":"2023-11-08T12:30:56.647438+0000","last_fullsized":"2023-11-08T12:30:56.647438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.328517+0000","last_change":"2023-11-08T12:30:55.324593+0000","last_active":"2023-11-08T12:30:55.328517+0000","last_peered":"2023-11-08T12:30:55.328517+0000","last_clean":"2023-11-08T12:30:55.328517+0000","last_became_active":"2023-11-08T12:30:55.324360+0000","last_became_peered":"2023-11-08T12:30:55.324360+0000","last_unstale":"2023-11-08T12:30:55.328517+0000","last_undegraded":"2023-11-08T12:30:55.328517+0000","last_fullsized":"2023-11-08T12:30:55.328517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650015+0000","last_change":"2023-11-08T12:30:54.836571+0000","last_active":"2023-11-08T12:30:56.650015+0000","last_peered":"2023-11-08T12:30:56.650015+0000","last_clean":"2023-11-08T12:30:56.650015+0000","last_became_active":"2023-11-08T12:30:54.836202+0000","last_became_peered":"2023-11-08T12:30:54.836202+0000","last_unstale":"2023-11-08T12:30:56.650015+0000","last_undegraded":"2023-11-08T12:30:56.650015+0000","last_fullsized":"2023-11-08T12:30:56.650015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:40:02.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.321277+0000","last_change":"2023-11-08T12:30:55.316242+0000","last_active":"2023-11-08T12:30:55.321277+0000","last_peered":"2023-11-08T12:30:55.321277+0000","last_clean":"2023-11-08T12:30:55.321277+0000","last_became_active":"2023-11-08T12:30:55.315945+0000","last_became_peered":"2023-11-08T12:30:55.315945+0000","last_unstale":"2023-11-08T12:30:55.321277+0000","last_undegraded":"2023-11-08T12:30:55.321277+0000","last_fullsized":"2023-11-08T12:30:55.321277+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295880+0000","last_change":"2023-11-08T12:30:54.833269+0000","last_active":"2023-11-08T12:30:55.295880+0000","last_peered":"2023-11-08T12:30:55.295880+0000","last_clean":"2023-11-08T12:30:55.295880+0000","last_became_active":"2023-11-08T12:30:54.833032+0000","last_became_peered":"2023-11-08T12:30:54.833032+0000","last_unstale":"2023-11-08T12:30:55.295880+0000","last_undegraded":"2023-11-08T12:30:55.295880+0000","last_fullsized":"2023-11-08T12:30:55.295880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:32:31.381604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.336618+0000","last_change":"2023-11-08T12:30:55.331577+0000","last_active":"2023-11-08T12:30:55.336618+0000","last_peered":"2023-11-08T12:30:55.336618+0000","last_clean":"2023-11-08T12:30:55.336618+0000","last_became_active":"2023-11-08T12:30:55.331235+0000","last_became_peered":"2023-11-08T12:30:55.331235+0000","last_unstale":"2023-11-08T12:30:55.336618+0000","last_undegraded":"2023-11-08T12:30:55.336618+0000","last_fullsized":"2023-11-08T12:30:55.336618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:49.959942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.298801+0000","last_change":"2023-11-08T12:30:54.843541+0000","last_active":"2023-11-08T12:30:55.298801+0000","last_peered":"2023-11-08T12:30:55.298801+0000","last_clean":"2023-11-08T12:30:55.298801+0000","last_became_active":"2023-11-08T12:30:54.843157+0000","last_became_peered":"2023-11-08T12:30:54.843157+0000","last_unstale":"2023-11-08T12:30:55.298801+0000","last_undegraded":"2023-11-08T12:30:55.298801+0000","last_fullsized":"2023-11-08T12:30:55.298801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:49:51.257823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330920+0000","last_change":"2023-11-08T12:30:55.324576+0000","last_active":"2023-11-08T12:30:55.330920+0000","last_peered":"2023-11-08T12:30:55.330920+0000","last_clean":"2023-11-08T12:30:55.330920+0000","last_became_active":"2023-11-08T12:30:55.324241+0000","last_became_peered":"2023-11-08T12:30:55.324241+0000","last_unstale":"2023-11-08T12:30:55.330920+0000","last_undegraded":"2023-11-08T12:30:55.330920+0000","last_fullsized":"2023-11-08T12:30:55.330920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.308998+0000","last_change":"2023-11-08T12:30:54.833941+0000","last_active":"2023-11-08T12:30:55.308998+0000","last_peered":"2023-11-08T12:30:55.308998+0000","last_clean":"2023-11-08T12:30:55.308998+0000","last_became_active":"2023-11-08T12:30:54.833611+0000","last_became_peered":"2023-11-08T12:30:54.833611+0000","last_unstale":"2023-11-08T12:30:55.308998+0000","last_undegraded":"2023-11-08T12:30:55.308998+0000","last_fullsized":"2023-11-08T12:30:55.308998+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307652+0000","last_change":"2023-11-08T12:30:55.307094+0000","last_active":"2023-11-08T12:30:56.307652+0000","last_peered":"2023-11-08T12:30:56.307652+0000","last_clean":"2023-11-08T12:30:56.307652+0000","last_became_active":"2023-11-08T12:30:55.306772+0000","last_became_peered":"2023-11-08T12:30:55.306772+0000","last_unstale":"2023-11-08T12:30:56.307652+0000","last_undegraded":"2023-11-08T12:30:56.307652+0000","last_fullsized":"2023-11-08T12:30:56.307652+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:31:44.469123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.298347+0000","last_change":"2023-11-08T12:30:54.847462+0000","last_active":"2023-11-08T12:30:55.298347+0000","last_peered":"2023-11-08T12:30:55.298347+0000","last_clean":"2023-11-08T12:30:55.298347+0000","last_became_active":"2023-11-08T12:30:54.847128+0000","last_became_peered":"2023-11-08T12:30:54.847128+0000","last_unstale":"2023-11-08T12:30:55.298347+0000","last_undegraded":"2023-11-08T12:30:55.298347+0000","last_fullsized":"2023-11-08T12:30:55.298347+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:32:04.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649508+0000","last_change":"2023-11-08T12:30:55.319451+0000","last_active":"2023-11-08T12:30:56.649508+0000","last_peered":"2023-11-08T12:30:56.649508+0000","last_clean":"2023-11-08T12:30:56.649508+0000","last_became_active":"2023-11-08T12:30:55.319150+0000","last_became_peered":"2023-11-08T12:30:55.319150+0000","last_unstale":"2023-11-08T12:30:56.649508+0000","last_undegraded":"2023-11-08T12:30:56.649508+0000","last_fullsized":"2023-11-08T12:30:56.649508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:07:04.384929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.303918+0000","last_change":"2023-11-08T12:30:54.841848+0000","last_active":"2023-11-08T12:30:55.303918+0000","last_peered":"2023-11-08T12:30:55.303918+0000","last_clean":"2023-11-08T12:30:55.303918+0000","last_became_active":"2023-11-08T12:30:54.841620+0000","last_became_peered":"2023-11-08T12:30:54.841620+0000","last_unstale":"2023-11-08T12:30:55.303918+0000","last_undegraded":"2023-11-08T12:30:55.303918+0000","last_fullsized":"2023-11-08T12:30:55.303918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:54:03.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.325255+0000","last_change":"2023-11-08T12:30:55.316687+0000","last_active":"2023-11-08T12:30:55.325255+0000","last_peered":"2023-11-08T12:30:55.325255+0000","last_clean":"2023-11-08T12:30:55.325255+0000","last_became_active":"2023-11-08T12:30:55.316441+0000","last_became_peered":"2023-11-08T12:30:55.316441+0000","last_unstale":"2023-11-08T12:30:55.325255+0000","last_undegraded":"2023-11-08T12:30:55.325255+0000","last_fullsized":"2023-11-08T12:30:55.325255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649430+0000","last_change":"2023-11-08T12:30:54.844787+0000","last_active":"2023-11-08T12:30:56.649430+0000","last_peered":"2023-11-08T12:30:56.649430+0000","last_clean":"2023-11-08T12:30:56.649430+0000","last_became_active":"2023-11-08T12:30:54.844525+0000","last_became_peered":"2023-11-08T12:30:54.844525+0000","last_unstale":"2023-11-08T12:30:56.649430+0000","last_undegraded":"2023-11-08T12:30:56.649430+0000","last_fullsized":"2023-11-08T12:30:56.649430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649183+0000","last_change":"2023-11-08T12:30:55.318830+0000","last_active":"2023-11-08T12:30:56.649183+0000","last_peered":"2023-11-08T12:30:56.649183+0000","last_clean":"2023-11-08T12:30:56.649183+0000","last_became_active":"2023-11-08T12:30:55.318553+0000","last_became_peered":"2023-11-08T12:30:55.318553+0000","last_unstale":"2023-11-08T12:30:56.649183+0000","last_undegraded":"2023-11-08T12:30:56.649183+0000","last_fullsized":"2023-11-08T12:30:56.649183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:49.043898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.648476+0000","last_change":"2023-11-08T12:30:54.844323+0000","last_active":"2023-11-08T12:30:56.648476+0000","last_peered":"2023-11-08T12:30:56.648476+0000","last_clean":"2023-11-08T12:30:56.648476+0000","last_became_active":"2023-11-08T12:30:54.843554+0000","last_became_peered":"2023-11-08T12:30:54.843554+0000","last_unstale":"2023-11-08T12:30:56.648476+0000","last_undegraded":"2023-11-08T12:30:56.648476+0000","last_fullsized":"2023-11-08T12:30:56.648476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:50:49.520218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650476+0000","last_change":"2023-11-08T12:30:55.334426+0000","last_active":"2023-11-08T12:30:56.650476+0000","last_peered":"2023-11-08T12:30:56.650476+0000","last_clean":"2023-11-08T12:30:56.650476+0000","last_became_active":"2023-11-08T12:30:55.334150+0000","last_became_peered":"2023-11-08T12:30:55.334150+0000","last_unstale":"2023-11-08T12:30:56.650476+0000","last_undegraded":"2023-11-08T12:30:56.650476+0000","last_fullsized":"2023-11-08T12:30:56.650476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650113+0000","last_change":"2023-11-08T12:30:54.836504+0000","last_active":"2023-11-08T12:30:56.650113+0000","last_peered":"2023-11-08T12:30:56.650113+0000","last_clean":"2023-11-08T12:30:56.650113+0000","last_became_active":"2023-11-08T12:30:54.836192+0000","last_became_peered":"2023-11-08T12:30:54.836192+0000","last_unstale":"2023-11-08T12:30:56.650113+0000","last_undegraded":"2023-11-08T12:30:56.650113+0000","last_fullsized":"2023-11-08T12:30:56.650113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:57:06.832813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310120+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:30:55.310120+0000","last_peered":"2023-11-08T12:30:55.310120+0000","last_clean":"2023-11-08T12:30:55.310120+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:30:55.310120+0000","last_undegraded":"2023-11-08T12:30:55.310120+0000","last_fullsized":"2023-11-08T12:30:55.310120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.331398+0000","last_change":"2023-11-08T12:30:55.326991+0000","last_active":"2023-11-08T12:30:55.331398+0000","last_peered":"2023-11-08T12:30:55.331398+0000","last_clean":"2023-11-08T12:30:55.331398+0000","last_became_active":"2023-11-08T12:30:55.326567+0000","last_became_peered":"2023-11-08T12:30:55.326567+0000","last_unstale":"2023-11-08T12:30:55.331398+0000","last_undegraded":"2023-11-08T12:30:55.331398+0000","last_fullsized":"2023-11-08T12:30:55.331398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650578+0000","last_change":"2023-11-08T12:30:54.833012+0000","last_active":"2023-11-08T12:30:56.650578+0000","last_peered":"2023-11-08T12:30:56.650578+0000","last_clean":"2023-11-08T12:30:56.650578+0000","last_became_active":"2023-11-08T12:30:54.832759+0000","last_became_peered":"2023-11-08T12:30:54.832759+0000","last_unstale":"2023-11-08T12:30:56.650578+0000","last_undegraded":"2023-11-08T12:30:56.650578+0000","last_fullsized":"2023-11-08T12:30:56.650578+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841432+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:30:54.841432+0000","last_peered":"2023-11-08T12:30:54.841432+0000","last_clean":"2023-11-08T12:30:54.841432+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:30:54.841432+0000","last_undegraded":"2023-11-08T12:30:54.841432+0000","last_fullsized":"2023-11-08T12:30:54.841432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.330531+0000","last_change":"2023-11-08T12:30:55.321736+0000","last_active":"2023-11-08T12:30:55.330531+0000","last_peered":"2023-11-08T12:30:55.330531+0000","last_clean":"2023-11-08T12:30:55.330531+0000","last_became_active":"2023-11-08T12:30:55.321525+0000","last_became_peered":"2023-11-08T12:30:55.321525+0000","last_unstale":"2023-11-08T12:30:55.330531+0000","last_undegraded":"2023-11-08T12:30:55.330531+0000","last_fullsized":"2023-11-08T12:30:55.330531+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:26:42.972609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649816+0000","last_change":"2023-11-08T12:30:54.834063+0000","last_active":"2023-11-08T12:30:56.649816+0000","last_peered":"2023-11-08T12:30:56.649816+0000","last_clean":"2023-11-08T12:30:56.649816+0000","last_became_active":"2023-11-08T12:30:54.833800+0000","last_became_peered":"2023-11-08T12:30:54.833800+0000","last_unstale":"2023-11-08T12:30:56.649816+0000","last_undegraded":"2023-11-08T12:30:56.649816+0000","last_fullsized":"2023-11-08T12:30:56.649816+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:59:26.678216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.842098+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:30:54.842098+0000","last_peered":"2023-11-08T12:30:54.842098+0000","last_clean":"2023-11-08T12:30:54.842098+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:30:54.842098+0000","last_undegraded":"2023-11-08T12:30:54.842098+0000","last_fullsized":"2023-11-08T12:30:54.842098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307869+0000","last_change":"2023-11-08T12:30:55.326437+0000","last_active":"2023-11-08T12:30:56.307869+0000","last_peered":"2023-11-08T12:30:56.307869+0000","last_clean":"2023-11-08T12:30:56.307869+0000","last_became_active":"2023-11-08T12:30:55.326064+0000","last_became_peered":"2023-11-08T12:30:55.326064+0000","last_unstale":"2023-11-08T12:30:56.307869+0000","last_undegraded":"2023-11-08T12:30:56.307869+0000","last_fullsized":"2023-11-08T12:30:56.307869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:27:32.391791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.304512+0000","last_change":"2023-11-08T12:30:54.847512+0000","last_active":"2023-11-08T12:30:55.304512+0000","last_peered":"2023-11-08T12:30:55.304512+0000","last_clean":"2023-11-08T12:30:55.304512+0000","last_became_active":"2023-11-08T12:30:54.847274+0000","last_became_peered":"2023-11-08T12:30:54.847274+0000","last_unstale":"2023-11-08T12:30:55.304512+0000","last_undegraded":"2023-11-08T12:30:55.304512+0000","last_fullsized":"2023-11-08T12:30:55.304512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:44:24.515082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841103+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:30:54.841103+0000","last_peered":"2023-11-08T12:30:54.841103+0000","last_clean":"2023-11-08T12:30:54.841103+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:30:54.841103+0000","last_undegraded":"2023-11-08T12:30:54.841103+0000","last_fullsized":"2023-11-08T12:30:54.841103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.316226+0000","last_change":"2023-11-08T12:30:55.309187+0000","last_active":"2023-11-08T12:30:55.316226+0000","last_peered":"2023-11-08T12:30:55.316226+0000","last_clean":"2023-11-08T12:30:55.316226+0000","last_became_active":"2023-11-08T12:30:55.308893+0000","last_became_peered":"2023-11-08T12:30:55.308893+0000","last_unstale":"2023-11-08T12:30:55.316226+0000","last_undegraded":"2023-11-08T12:30:55.316226+0000","last_fullsized":"2023-11-08T12:30:55.316226+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649658+0000","last_change":"2023-11-08T12:30:54.844094+0000","last_active":"2023-11-08T12:30:56.649658+0000","last_peered":"2023-11-08T12:30:56.649658+0000","last_clean":"2023-11-08T12:30:56.649658+0000","last_became_active":"2023-11-08T12:30:54.843807+0000","last_became_peered":"2023-11-08T12:30:54.843807+0000","last_unstale":"2023-11-08T12:30:56.649658+0000","last_undegraded":"2023-11-08T12:30:56.649658+0000","last_fullsized":"2023-11-08T12:30:56.649658+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:16:29.671187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.822533+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:30:54.822533+0000","last_peered":"2023-11-08T12:30:54.822533+0000","last_clean":"2023-11-08T12:30:54.822533+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:30:54.822533+0000","last_undegraded":"2023-11-08T12:30:54.822533+0000","last_fullsized":"2023-11-08T12:30:54.822533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332444+0000","last_change":"2023-11-08T12:30:55.327299+0000","last_active":"2023-11-08T12:30:55.332444+0000","last_peered":"2023-11-08T12:30:55.332444+0000","last_clean":"2023-11-08T12:30:55.332444+0000","last_became_active":"2023-11-08T12:30:55.327048+0000","last_became_peered":"2023-11-08T12:30:55.327048+0000","last_unstale":"2023-11-08T12:30:55.332444+0000","last_undegraded":"2023-11-08T12:30:55.332444+0000","last_fullsized":"2023-11-08T12:30:55.332444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.296000+0000","last_change":"2023-11-08T12:30:54.836886+0000","last_active":"2023-11-08T12:30:55.296000+0000","last_peered":"2023-11-08T12:30:55.296000+0000","last_clean":"2023-11-08T12:30:55.296000+0000","last_became_active":"2023-11-08T12:30:54.836409+0000","last_became_peered":"2023-11-08T12:30:54.836409+0000","last_unstale":"2023-11-08T12:30:55.296000+0000","last_undegraded":"2023-11-08T12:30:55.296000+0000","last_fullsized":"2023-11-08T12:30:55.296000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:19:36.880517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.297144+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:30:55.297144+0000","last_peered":"2023-11-08T12:30:55.297144+0000","last_clean":"2023-11-08T12:30:55.297144+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:30:55.297144+0000","last_undegraded":"2023-11-08T12:30:55.297144+0000","last_fullsized":"2023-11-08T12:30:55.297144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.332474+0000","last_change":"2023-11-08T12:30:55.326952+0000","last_active":"2023-11-08T12:30:55.332474+0000","last_peered":"2023-11-08T12:30:55.332474+0000","last_clean":"2023-11-08T12:30:55.332474+0000","last_became_active":"2023-11-08T12:30:55.326675+0000","last_became_peered":"2023-11-08T12:30:55.326675+0000","last_unstale":"2023-11-08T12:30:55.332474+0000","last_undegraded":"2023-11-08T12:30:55.332474+0000","last_fullsized":"2023-11-08T12:30:55.332474+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.312303+0000","last_change":"2023-11-08T12:30:54.837545+0000","last_active":"2023-11-08T12:30:55.312303+0000","last_peered":"2023-11-08T12:30:55.312303+0000","last_clean":"2023-11-08T12:30:55.312303+0000","last_became_active":"2023-11-08T12:30:54.837294+0000","last_became_peered":"2023-11-08T12:30:54.837294+0000","last_unstale":"2023-11-08T12:30:55.312303+0000","last_undegraded":"2023-11-08T12:30:55.312303+0000","last_fullsized":"2023-11-08T12:30:55.312303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.841595+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:30:54.841595+0000","last_peered":"2023-11-08T12:30:54.841595+0000","last_clean":"2023-11-08T12:30:54.841595+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:30:54.841595+0000","last_undegraded":"2023-11-08T12:30:54.841595+0000","last_fullsized":"2023-11-08T12:30:54.841595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.319212+0000","last_change":"2023-11-08T12:30:55.316883+0000","last_active":"2023-11-08T12:30:55.319212+0000","last_peered":"2023-11-08T12:30:55.319212+0000","last_clean":"2023-11-08T12:30:55.319212+0000","last_became_active":"2023-11-08T12:30:55.316621+0000","last_became_peered":"2023-11-08T12:30:55.316621+0000","last_unstale":"2023-11-08T12:30:55.319212+0000","last_undegraded":"2023-11-08T12:30:55.319212+0000","last_fullsized":"2023-11-08T12:30:55.319212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649596+0000","last_change":"2023-11-08T12:30:54.843585+0000","last_active":"2023-11-08T12:30:56.649596+0000","last_peered":"2023-11-08T12:30:56.649596+0000","last_clean":"2023-11-08T12:30:56.649596+0000","last_became_active":"2023-11-08T12:30:54.843194+0000","last_became_peered":"2023-11-08T12:30:54.843194+0000","last_unstale":"2023-11-08T12:30:56.649596+0000","last_undegraded":"2023-11-08T12:30:56.649596+0000","last_fullsized":"2023-11-08T12:30:56.649596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:21:27.756624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.824217+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:30:54.824217+0000","last_peered":"2023-11-08T12:30:54.824217+0000","last_clean":"2023-11-08T12:30:54.824217+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:30:54.824217+0000","last_undegraded":"2023-11-08T12:30:54.824217+0000","last_fullsized":"2023-11-08T12:30:54.824217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":201,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-11-08T12:30:54.831352+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:30:54.831352+0000","last_peered":"2023-11-08T12:30:54.831352+0000","last_clean":"2023-11-08T12:30:54.831352+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:30:54.831352+0000","last_undegraded":"2023-11-08T12:30:54.831352+0000","last_fullsized":"2023-11-08T12:30:54.831352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9716,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362124,"statfs":{"total":96636764160,"available":96626814976,"internally_reserved":0,"allocated":831488,"data_stored":383521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.375,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.1040000000000001},"min":{"1min":0.71999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5669999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.72199999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.169,"15min":1.157},"min":{"1min":0.77100000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5649999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.179},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.80800000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.512,"5min":1.851,"15min":1.851},"last":0.90800000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.069,"15min":1.0589999999999999},"min":{"1min":0.90800000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.272,"15min":1.27},"min":{"1min":0.92300000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3360000000000001,"15min":1.341},"min":{"1min":0.89400000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6040000000000001,"5min":5.601,"15min":5.601},"last":1.004},{"interface":"front","average":{"1min":1.194,"5min":1.226,"15min":1.236},"min":{"1min":0.93600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.452,"5min":1.73,"15min":1.73},"last":0.97599999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.29,"15min":1.321},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.613,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.337,"15min":1.3660000000000001},"min":{"1min":0.96499999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6639999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.397}]},{"osd":5,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2629999999999999,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.694,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.385},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.4470000000000001,"15min":1.466},"min":{"1min":1.0880000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.734,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.456,"15min":1.482},"min":{"1min":1.0029999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.7649999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.417,"15min":1.4410000000000001},"min":{"1min":0.98999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7849999999999999,"5min":2.121,"15min":2.121},"last":1.284}]}]},{"osd":4,"up_from":16,"seq":68719476779,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9968,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361872,"statfs":{"total":96636764160,"available":96626556928,"internally_reserved":0,"allocated":827392,"data_stored":383499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.069,"15min":1.0569999999999999},"min":{"1min":0.61599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.03}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.159,"15min":1.1599999999999999},"min":{"1min":0.81299999999999994,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.639,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.157,"15min":1.1930000000000001},"min":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.343,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.2050000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.2130000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.446,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4330000000000001,"5min":3.129,"15min":3.129},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1950000000000001,"15min":1.2150000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8140000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.159},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5189999999999999,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2490000000000001,"15min":1.2989999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2190000000000001,"15min":1.22},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.5409999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.28}]},{"osd":6,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5780000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.379},{"interface":"front","average":{"1min":1.306,"5min":1.3979999999999999,"15min":1.425},"min":{"1min":1.018,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.524,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3839999999999999,"15min":1.4099999999999999},"min":{"1min":0.94499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.734,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4299999999999999,"15min":1.448},"min":{"1min":0.95699999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.867,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4199999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10872,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360968,"statfs":{"total":96636764160,"available":96625631232,"internally_reserved":0,"allocated":1425408,"data_stored":974397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1519999999999999},"min":{"1min":0.67800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4319999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.145,"5min":1.1639999999999999,"15min":1.1719999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5329999999999999,"5min":1.7,"15min":1.7},"last":1}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.046},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.76000000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.409,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.123,"15min":1.121},"min":{"1min":0.84699999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.47,"5min":1.597,"15min":1.597},"last":1.254},{"interface":"front","average":{"1min":1.24,"5min":1.2090000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.651,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.298}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.198,"15min":1.222},"min":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3979999999999999,"5min":1.984,"15min":1.984},"last":1.121},{"interface":"front","average":{"1min":1.198,"5min":1.2529999999999999,"15min":1.2629999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.51,"5min":2.137,"15min":2.137},"last":1.177}]},{"osd":4,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.26,"15min":1.2889999999999999},"min":{"1min":0.70699999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.677,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.224,"15min":1.246},"min":{"1min":0.83699999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.353}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.86899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5760000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.238,"15min":1.264},"min":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6020000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3600000000000001,"15min":1.3660000000000001},"min":{"1min":0.97299999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.79,"5min":1.956,"15min":1.956},"last":1.391},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3859999999999999,"15min":1.415},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.798,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.591}]}]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.7629999999999999,"15min":2.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.623,"5min":20.099,"15min":20.099},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.823,"15min":2.141},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4379999999999999,"5min":21.238,"15min":21.238},"last":0.93600000000000005}]},{"osd":1,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.155,"15min":1.2110000000000001},"min":{"1min":0.71399999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.573,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.391,"15min":1.5369999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5149999999999999,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.038}]},{"osd":2,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.5569999999999999,"15min":1.7310000000000001},"min":{"1min":0.97599999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.4770000000000001,"5min":11.843,"15min":11.843},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.597,"15min":1.7749999999999999},"min":{"1min":0.80500000000000005,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8939999999999999,"5min":11.907,"15min":11.907},"last":1.167}]},{"osd":3,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.331,"15min":1.4059999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.556,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.4039999999999999,"15min":1.4930000000000001},"min":{"1min":0.90800000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.7529999999999999,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.133}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2070000000000001,"15min":1.2130000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.869,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2709999999999999,"15min":1.2889999999999999},"min":{"1min":0.75,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.966,"5min":2.073,"15min":2.073},"last":0.85099999999999998}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.262,"15min":1.3029999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.552,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.351,"5min":1.367,"15min":1.385},"min":{"1min":1.0449999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.097}]},{"osd":7,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.637,"15min":1.7889999999999999},"min":{"1min":1.002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.647,"5min":8.109,"15min":8.109},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.593,"15min":1.675},"min":{"1min":1.2190000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.101,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.27}]}]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9908,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361932,"statfs":{"total":96636764160,"available":96626618368,"internally_reserved":0,"allocated":831488,"data_stored":383541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.91600000000000004,"15min":0.97799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96599999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.97799999999999998},"min":{"1min":0.61399999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.165,"5min":1.53,"15min":1.53},"last":0.97899999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.075,"5min":1.51,"15min":1.51},"last":0.752},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.4219999999999999,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.143,"15min":1.22},"min":{"1min":0.63600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.57899999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.226,"5min":1.972,"15min":1.972},"last":0.78700000000000003}]},{"osd":4,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2150000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.458,"5min":1.837,"15min":1.837},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.226,"5min":1.3089999999999999,"15min":1.339},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5960000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.044}]},{"osd":5,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.70599999999999996,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.649,"5min":1.897,"15min":1.897},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4059999999999999,"15min":1.474},"min":{"1min":0.77500000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6759999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.995}]},{"osd":6,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.319,"15min":1.347},"min":{"1min":0.875,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9079999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.292,"5min":1.321,"15min":1.339},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6679999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4370000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.427,"15min":1.4630000000000001},"min":{"1min":0.94399999999999995,"5min":0.875,"15min":0.875},"max":{"1min":1.9890000000000001,"5min":2.194,"15min":2.194},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.93600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.472,"15min":2.472},"last":1.3180000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9632,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362208,"statfs":{"total":96636764160,"available":96626900992,"internally_reserved":0,"allocated":811008,"data_stored":375981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.499,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.597,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":5.2009999999999996},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":5.0190000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5329999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1379999999999999},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.5940000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.474}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":1.546},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.032,"15min":1.0880000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.4550000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":3.73}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2410000000000001,"15min":1.2709999999999999},"min":{"1min":0.878,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":3.766},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3120000000000001,"15min":1.3320000000000001},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.663,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.573}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.375,"15min":1.411},"min":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":4.8620000000000001,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":3.8730000000000002},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.4590000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.9970000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.0920000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3400000000000001,"15min":1.3680000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":3.6880000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.357,"15min":1.3999999999999999},"min":{"1min":0.95999999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":5.1520000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.482,"15min":1.5269999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.956,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":4.8230000000000004},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.425,"15min":1.4710000000000001},"min":{"1min":1.087,"5min":0.996,"15min":0.996},"max":{"1min":1.6439999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.518}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10928,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":9536,"kb_avail":94360912,"statfs":{"total":96636764160,"available":96625573888,"internally_reserved":0,"allocated":1417216,"data_stored":973797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9764864},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0169999999999999,"15min":1.1140000000000001},"min":{"1min":0.58899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1679999999999999,"5min":6.54,"15min":6.54},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.0289999999999999,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1359999999999999,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.82899999999999996}]},{"osd":2,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97799999999999998,"15min":1.0249999999999999},"min":{"1min":0.60299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.2130000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0269999999999999,"15min":1.0609999999999999},"min":{"1min":0.623,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5720000000000001,"5min":3.069,"15min":3.069},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.327,"5min":2.673,"15min":2.673},"last":1.335},{"interface":"front","average":{"1min":1.024,"5min":1.272,"15min":1.3819999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.599,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.4870000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.3280000000000001,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5840000000000001,"5min":2.927,"15min":2.927},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3440000000000001,"15min":1.409},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5589999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.512}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3480000000000001,"15min":1.4119999999999999},"min":{"1min":0.99399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.4370000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.996},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.456,"15min":1.546},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.556,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.0860000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.4930000000000001,"15min":1.583},"min":{"1min":0.95099999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.52,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.4390000000000001,"15min":1.5189999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.6379999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.4690000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4550000000000001,"15min":1.5269999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.5409999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.478,"15min":1.573},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.528,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.542}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":847872,"data_stored":391950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3620000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.079,"15min":1.1200000000000001},"min":{"1min":0.77000000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2569999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.91200000000000003,"15min":0.92000000000000004},"min":{"1min":0.60799999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.415,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2829999999999999,"5min":1.837,"15min":1.837},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.073,"15min":1.119},"min":{"1min":0.51600000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.304,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.98699999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.4990000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.198,"5min":1.3220000000000001,"15min":1.3740000000000001},"min":{"1min":0.90200000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.3979999999999999,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.3360000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.343,"15min":1.393},"min":{"1min":1.0669999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.5640000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.278,"15min":1.3260000000000001},"min":{"1min":1.008,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.613,"5min":3.052,"15min":3.052},"last":0.92100000000000004}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.327,"15min":1.377},"min":{"1min":1.0740000000000001,"5min":0.753,"15min":0.753},"max":{"1min":1.6719999999999999,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3680000000000001,"15min":1.4139999999999999},"min":{"1min":1.048,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8,"5min":2.254,"15min":2.254},"last":1.0469999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3620000000000001,"15min":1.4099999999999999},"min":{"1min":1.0820000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5389999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.425,"15min":1.4690000000000001},"min":{"1min":1.0680000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8959999999999999,"5min":3.5,"15min":3.5},"last":1.2849999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:31:04.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:31:04.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.621+0000 7f90f6cb1700 1 Processor -- start 2023-11-08T12:31:04.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.621+0000 7f90f6cb1700 1 -- start start 2023-11-08T12:31:04.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f6cb1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f90f015c3b0 0x7f90f0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:04.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f6cb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f00705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f6cb1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f0069bf0 con 0x7f90f0158840 2023-11-08T12:31:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f6cb1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f006b090 con 0x7f90f015c3b0 2023-11-08T12:31:04.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f6cb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00ae100 con 0x7f90f00c8da0 2023-11-08T12:31:04.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f5caf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f90f0158840 0x7f90f00ad9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:35186/0 (socket says 172.21.15.112:35186) 2023-11-08T12:31:04.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f5caf700 1 -- 172.21.15.112:0/2475573000 learned_addr learned my addr 172.21.15.112:0/2475573000 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:04.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f64b0700 1 --2- 172.21.15.112:0/2475573000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f00705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:04.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.625+0000 7f90f54ae700 1 --2- 172.21.15.112:0/2475573000 >> v2:172.21.15.112:3300/0 conn(0x7f90f015c3b0 0x7f90f0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:04.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f4cad700 1 -- 172.21.15.112:0/2475573000 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507081697 0 0) 0x7f90f0069bf0 con 0x7f90f0158840 2023-11-08T12:31:04.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f4cad700 1 -- 172.21.15.112:0/2475573000 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90dc0035d0 con 0x7f90f0158840 2023-11-08T12:31:04.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f64b0700 1 -- 172.21.15.112:0/2475573000 >> v2:172.21.15.112:3300/0 conn(0x7f90f015c3b0 msgr2=0x7f90f0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:04.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f64b0700 1 --2- 172.21.15.112:0/2475573000 >> v2:172.21.15.112:3300/0 conn(0x7f90f015c3b0 0x7f90f0070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f64b0700 1 -- 172.21.15.112:0/2475573000 >> v1:172.21.15.133:6789/0 conn(0x7f90f0158840 legacy=0x7f90f00ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:04.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f64b0700 1 -- 172.21.15.112:0/2475573000 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f015c890 con 0x7f90f00c8da0 2023-11-08T12:31:04.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f54ae700 1 --2- 172.21.15.112:0/2475573000 >> v2:172.21.15.112:3300/0 conn(0x7f90f015c3b0 0x7f90f0070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:04.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f64b0700 1 --2- 172.21.15.112:0/2475573000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f00705c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009d90 tx=0x7f90e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=358680194c6ece13 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:04.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f4cad700 1 -- 172.21.15.112:0/2475573000 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800e070 con 0x7f90f00c8da0 2023-11-08T12:31:04.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f4cad700 1 -- 172.21.15.112:0/2475573000 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e800bb20 con 0x7f90f00c8da0 2023-11-08T12:31:04.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f4cad700 1 -- 172.21.15.112:0/2475573000 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8012430 con 0x7f90f00c8da0 2023-11-08T12:31:04.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 -- 172.21.15.112:0/2475573000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 msgr2=0x7f90f00705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:04.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/2475573000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f00705c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009d90 tx=0x7f90e800b330 comp rx=0 tx=0).stop 2023-11-08T12:31:04.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 -- 172.21.15.112:0/2475573000 shutdown_connections 2023-11-08T12:31:04.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/2475573000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f00705c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/2475573000 >> v2:172.21.15.112:3300/0 conn(0x7f90f015c3b0 0x7f90f0070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.640 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 -- 172.21.15.112:0/2475573000 >> 172.21.15.112:0/2475573000 conn(0x7f90f00b0f80 msgr2=0x7f90f00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:04.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 -- 172.21.15.112:0/2475573000 shutdown_connections 2023-11-08T12:31:04.641 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.629+0000 7f90f6cb1700 1 -- 172.21.15.112:0/2475573000 wait complete. 2023-11-08T12:31:04.644 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 Processor -- start 2023-11-08T12:31:04.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 -- start start 2023-11-08T12:31:04.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:04.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f0158840 0x7f90f006c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:04.645 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f015c3b0 0x7f90f01508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:04.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00b2530 con 0x7f90f015c3b0 2023-11-08T12:31:04.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00b1640 con 0x7f90f0158840 2023-11-08T12:31:04.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f6cb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00b1920 con 0x7f90f00c8da0 2023-11-08T12:31:04.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f015c3b0 0x7f90f01508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:04.646 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f015c3b0 0x7f90f01508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44328/0 (socket says 172.21.15.112:44328) 2023-11-08T12:31:04.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 -- 172.21.15.112:0/33305378 learned_addr learned my addr 172.21.15.112:0/33305378 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:04.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f5caf700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:04.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f54ae700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f0158840 0x7f90f006c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:04.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 -- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 msgr2=0x7f90f006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:04.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.647 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 -- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f0158840 msgr2=0x7f90f006c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:04.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f0158840 0x7f90f006c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.633+0000 7f90f64b0700 1 -- 172.21.15.112:0/33305378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e000a650 con 0x7f90f015c3b0 2023-11-08T12:31:04.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90f64b0700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f015c3b0 0x7f90f01508c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f90e8014040 tx=0x7f90e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:04.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90e67fc700 1 -- 172.21.15.112:0/33305378 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8012430 con 0x7f90f015c3b0 2023-11-08T12:31:04.648 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90e67fc700 1 -- 172.21.15.112:0/33305378 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e8020070 con 0x7f90f015c3b0 2023-11-08T12:31:04.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90e67fc700 1 -- 172.21.15.112:0/33305378 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8004280 con 0x7f90f015c3b0 2023-11-08T12:31:04.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e8009a70 con 0x7f90f015c3b0 2023-11-08T12:31:04.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f015ce50 con 0x7f90f015c3b0 2023-11-08T12:31:04.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f015cb70 con 0x7f90f015c3b0 2023-11-08T12:31:04.649 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.637+0000 7f90e67fc700 1 -- 172.21.15.112:0/33305378 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f90e802e070 con 0x7f90f015c3b0 2023-11-08T12:31:04.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.641+0000 7f90e67fc700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f90d4064ee0 0x7f90d4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:04.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.641+0000 7f90e67fc700 1 -- 172.21.15.112:0/33305378 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f90e8022070 con 0x7f90f015c3b0 2023-11-08T12:31:04.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.641+0000 7f90f5caf700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f90d4064ee0 0x7f90d4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:04.650 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.641+0000 7f90f5caf700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f90d4064ee0 0x7f90d4067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0011e0 tx=0x7f90ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:04.651 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.645+0000 7f90e67fc700 1 -- 172.21.15.112:0/33305378 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f90e8051ce0 con 0x7f90f015c3b0 2023-11-08T12:31:04.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.817+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90f015d130 con 0x7f90d4064ee0 2023-11-08T12:31:04.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.833+0000 7f90e67fc700 1 -- 172.21.15.112:0/33305378 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308825 (secure 0 0 0) 0x7f90f015d130 con 0x7f90d4064ee0 2023-11-08T12:31:04.839 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:04.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f90d4064ee0 msgr2=0x7f90d4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:04.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f90d4064ee0 0x7f90d4067390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0011e0 tx=0x7f90ec009040 comp rx=0 tx=0).stop 2023-11-08T12:31:04.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f015c3b0 msgr2=0x7f90f01508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:04.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f015c3b0 0x7f90f01508c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f90e8014040 tx=0x7f90e8004af0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 shutdown_connections 2023-11-08T12:31:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f90d4064ee0 0x7f90d4067390 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90f015c3b0 0x7f90f01508c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f0158840 0x7f90f006c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 --2- 172.21.15.112:0/33305378 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f90f00c8da0 0x7f90f006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:04.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 >> 172.21.15.112:0/33305378 conn(0x7f90f00b0f80 msgr2=0x7f90f00ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 shutdown_connections 2023-11-08T12:31:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:04.841+0000 7f90f6cb1700 1 -- 172.21.15.112:0/33305378 wait complete. 2023-11-08T12:31:04.846 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:31:04.870 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2023-11-08T12:31:04.776475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":80648,"kb_used_data":7752,"kb_used_omap":0,"kb_used_meta":72832,"kb_avail":754894072,"statfs":{"total":773094113280,"available":773011529728,"internally_reserved":0,"allocated":7938048,"data_stored":4308612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74579968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.486919"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827093+0000","last_change":"2023-11-08T12:30:55.328953+0000","last_active":"2023-11-08T12:30:55.827093+0000","last_peered":"2023-11-08T12:30:55.827093+0000","last_clean":"2023-11-08T12:30:55.827093+0000","last_became_active":"2023-11-08T12:30:55.328518+0000","last_became_peered":"2023-11-08T12:30:55.328518+0000","last_unstale":"2023-11-08T12:30:55.827093+0000","last_undegraded":"2023-11-08T12:30:55.827093+0000","last_fullsized":"2023-11-08T12:30:55.827093+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:04:49.078439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650079+0000","last_change":"2023-11-08T12:30:55.320721+0000","last_active":"2023-11-08T12:30:56.650079+0000","last_peered":"2023-11-08T12:30:56.650079+0000","last_clean":"2023-11-08T12:30:56.650079+0000","last_became_active":"2023-11-08T12:30:55.320483+0000","last_became_peered":"2023-11-08T12:30:55.320483+0000","last_unstale":"2023-11-08T12:30:56.650079+0000","last_undegraded":"2023-11-08T12:30:56.650079+0000","last_fullsized":"2023-11-08T12:30:56.650079+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:50:45.609313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817893+0000","last_change":"2023-11-08T12:30:55.319674+0000","last_active":"2023-11-08T12:30:55.817893+0000","last_peered":"2023-11-08T12:30:55.817893+0000","last_clean":"2023-11-08T12:30:55.817893+0000","last_became_active":"2023-11-08T12:30:55.319430+0000","last_became_peered":"2023-11-08T12:30:55.319430+0000","last_unstale":"2023-11-08T12:30:55.817893+0000","last_undegraded":"2023-11-08T12:30:55.817893+0000","last_fullsized":"2023-11-08T12:30:55.817893+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818769+0000","last_change":"2023-11-08T12:30:55.329331+0000","last_active":"2023-11-08T12:30:55.818769+0000","last_peered":"2023-11-08T12:30:55.818769+0000","last_clean":"2023-11-08T12:30:55.818769+0000","last_became_active":"2023-11-08T12:30:55.329078+0000","last_became_peered":"2023-11-08T12:30:55.329078+0000","last_unstale":"2023-11-08T12:30:55.818769+0000","last_undegraded":"2023-11-08T12:30:55.818769+0000","last_fullsized":"2023-11-08T12:30:55.818769+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:38:53.919890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307590+0000","last_change":"2023-11-08T12:30:55.313956+0000","last_active":"2023-11-08T12:30:56.307590+0000","last_peered":"2023-11-08T12:30:56.307590+0000","last_clean":"2023-11-08T12:30:56.307590+0000","last_became_active":"2023-11-08T12:30:55.313667+0000","last_became_peered":"2023-11-08T12:30:55.313667+0000","last_unstale":"2023-11-08T12:30:56.307590+0000","last_undegraded":"2023-11-08T12:30:56.307590+0000","last_fullsized":"2023-11-08T12:30:56.307590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:16:34.583047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649426+0000","last_change":"2023-11-08T12:30:55.324724+0000","last_active":"2023-11-08T12:30:56.649426+0000","last_peered":"2023-11-08T12:30:56.649426+0000","last_clean":"2023-11-08T12:30:56.649426+0000","last_became_active":"2023-11-08T12:30:55.324468+0000","last_became_peered":"2023-11-08T12:30:55.324468+0000","last_unstale":"2023-11-08T12:30:56.649426+0000","last_undegraded":"2023-11-08T12:30:56.649426+0000","last_fullsized":"2023-11-08T12:30:56.649426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827686+0000","last_change":"2023-11-08T12:30:55.309539+0000","last_active":"2023-11-08T12:30:55.827686+0000","last_peered":"2023-11-08T12:30:55.827686+0000","last_clean":"2023-11-08T12:30:55.827686+0000","last_became_active":"2023-11-08T12:30:55.309199+0000","last_became_peered":"2023-11-08T12:30:55.309199+0000","last_unstale":"2023-11-08T12:30:55.827686+0000","last_undegraded":"2023-11-08T12:30:55.827686+0000","last_fullsized":"2023-11-08T12:30:55.827686+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647430+0000","last_change":"2023-11-08T12:30:55.323799+0000","last_active":"2023-11-08T12:30:56.647430+0000","last_peered":"2023-11-08T12:30:56.647430+0000","last_clean":"2023-11-08T12:30:56.647430+0000","last_became_active":"2023-11-08T12:30:55.322805+0000","last_became_peered":"2023-11-08T12:30:55.322805+0000","last_unstale":"2023-11-08T12:30:56.647430+0000","last_undegraded":"2023-11-08T12:30:56.647430+0000","last_fullsized":"2023-11-08T12:30:56.647430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:58:32.146431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307949+0000","last_change":"2023-11-08T12:30:55.307531+0000","last_active":"2023-11-08T12:30:56.307949+0000","last_peered":"2023-11-08T12:30:56.307949+0000","last_clean":"2023-11-08T12:30:56.307949+0000","last_became_active":"2023-11-08T12:30:55.307168+0000","last_became_peered":"2023-11-08T12:30:55.307168+0000","last_unstale":"2023-11-08T12:30:56.307949+0000","last_undegraded":"2023-11-08T12:30:56.307949+0000","last_fullsized":"2023-11-08T12:30:56.307949+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:44:17.581724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650420+0000","last_change":"2023-11-08T12:30:55.325321+0000","last_active":"2023-11-08T12:30:56.650420+0000","last_peered":"2023-11-08T12:30:56.650420+0000","last_clean":"2023-11-08T12:30:56.650420+0000","last_became_active":"2023-11-08T12:30:55.324837+0000","last_became_peered":"2023-11-08T12:30:55.324837+0000","last_unstale":"2023-11-08T12:30:56.650420+0000","last_undegraded":"2023-11-08T12:30:56.650420+0000","last_fullsized":"2023-11-08T12:30:56.650420+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827048+0000","last_change":"2023-11-08T12:30:55.331241+0000","last_active":"2023-11-08T12:30:55.827048+0000","last_peered":"2023-11-08T12:30:55.827048+0000","last_clean":"2023-11-08T12:30:55.827048+0000","last_became_active":"2023-11-08T12:30:55.330973+0000","last_became_peered":"2023-11-08T12:30:55.330973+0000","last_unstale":"2023-11-08T12:30:55.827048+0000","last_undegraded":"2023-11-08T12:30:55.827048+0000","last_fullsized":"2023-11-08T12:30:55.827048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:03:30.133538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818785+0000","last_change":"2023-11-08T12:30:55.322622+0000","last_active":"2023-11-08T12:30:55.818785+0000","last_peered":"2023-11-08T12:30:55.818785+0000","last_clean":"2023-11-08T12:30:55.818785+0000","last_became_active":"2023-11-08T12:30:55.322388+0000","last_became_peered":"2023-11-08T12:30:55.322388+0000","last_unstale":"2023-11-08T12:30:55.818785+0000","last_undegraded":"2023-11-08T12:30:55.818785+0000","last_fullsized":"2023-11-08T12:30:55.818785+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:00:17.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830482+0000","last_change":"2023-11-08T12:30:55.328399+0000","last_active":"2023-11-08T12:30:55.830482+0000","last_peered":"2023-11-08T12:30:55.830482+0000","last_clean":"2023-11-08T12:30:55.830482+0000","last_became_active":"2023-11-08T12:30:55.327392+0000","last_became_peered":"2023-11-08T12:30:55.327392+0000","last_unstale":"2023-11-08T12:30:55.830482+0000","last_undegraded":"2023-11-08T12:30:55.830482+0000","last_fullsized":"2023-11-08T12:30:55.830482+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:31:15.497928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307506+0000","last_change":"2023-11-08T12:30:55.311563+0000","last_active":"2023-11-08T12:30:56.307506+0000","last_peered":"2023-11-08T12:30:56.307506+0000","last_clean":"2023-11-08T12:30:56.307506+0000","last_became_active":"2023-11-08T12:30:55.311356+0000","last_became_peered":"2023-11-08T12:30:55.311356+0000","last_unstale":"2023-11-08T12:30:56.307506+0000","last_undegraded":"2023-11-08T12:30:56.307506+0000","last_fullsized":"2023-11-08T12:30:56.307506+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:26:03.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830460+0000","last_change":"2023-11-08T12:30:55.317752+0000","last_active":"2023-11-08T12:30:55.830460+0000","last_peered":"2023-11-08T12:30:55.830460+0000","last_clean":"2023-11-08T12:30:55.830460+0000","last_became_active":"2023-11-08T12:30:55.317496+0000","last_became_peered":"2023-11-08T12:30:55.317496+0000","last_unstale":"2023-11-08T12:30:55.830460+0000","last_undegraded":"2023-11-08T12:30:55.830460+0000","last_fullsized":"2023-11-08T12:30:55.830460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647309+0000","last_change":"2023-11-08T12:30:55.326903+0000","last_active":"2023-11-08T12:30:56.647309+0000","last_peered":"2023-11-08T12:30:56.647309+0000","last_clean":"2023-11-08T12:30:56.647309+0000","last_became_active":"2023-11-08T12:30:55.326660+0000","last_became_peered":"2023-11-08T12:30:55.326660+0000","last_unstale":"2023-11-08T12:30:56.647309+0000","last_undegraded":"2023-11-08T12:30:56.647309+0000","last_fullsized":"2023-11-08T12:30:56.647309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.308068+0000","last_change":"2023-11-08T12:30:55.307421+0000","last_active":"2023-11-08T12:30:56.308068+0000","last_peered":"2023-11-08T12:30:56.308068+0000","last_clean":"2023-11-08T12:30:56.308068+0000","last_became_active":"2023-11-08T12:30:55.307082+0000","last_became_peered":"2023-11-08T12:30:55.307082+0000","last_unstale":"2023-11-08T12:30:56.308068+0000","last_undegraded":"2023-11-08T12:30:56.308068+0000","last_fullsized":"2023-11-08T12:30:56.308068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:25:52.604915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818846+0000","last_change":"2023-11-08T12:30:55.331216+0000","last_active":"2023-11-08T12:30:55.818846+0000","last_peered":"2023-11-08T12:30:55.818846+0000","last_clean":"2023-11-08T12:30:55.818846+0000","last_became_active":"2023-11-08T12:30:55.330893+0000","last_became_peered":"2023-11-08T12:30:55.330893+0000","last_unstale":"2023-11-08T12:30:55.818846+0000","last_undegraded":"2023-11-08T12:30:55.818846+0000","last_fullsized":"2023-11-08T12:30:55.818846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:35:52.148689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649345+0000","last_change":"2023-11-08T12:30:55.322352+0000","last_active":"2023-11-08T12:30:56.649345+0000","last_peered":"2023-11-08T12:30:56.649345+0000","last_clean":"2023-11-08T12:30:56.649345+0000","last_became_active":"2023-11-08T12:30:55.322091+0000","last_became_peered":"2023-11-08T12:30:55.322091+0000","last_unstale":"2023-11-08T12:30:56.649345+0000","last_undegraded":"2023-11-08T12:30:56.649345+0000","last_fullsized":"2023-11-08T12:30:56.649345+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:44:24.238839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830493+0000","last_change":"2023-11-08T12:30:55.319873+0000","last_active":"2023-11-08T12:30:55.830493+0000","last_peered":"2023-11-08T12:30:55.830493+0000","last_clean":"2023-11-08T12:30:55.830493+0000","last_became_active":"2023-11-08T12:30:55.319631+0000","last_became_peered":"2023-11-08T12:30:55.319631+0000","last_unstale":"2023-11-08T12:30:55.830493+0000","last_undegraded":"2023-11-08T12:30:55.830493+0000","last_fullsized":"2023-11-08T12:30:55.830493+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:25:00.378994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650017+0000","last_change":"2023-11-08T12:30:55.321243+0000","last_active":"2023-11-08T12:30:56.650017+0000","last_peered":"2023-11-08T12:30:56.650017+0000","last_clean":"2023-11-08T12:30:56.650017+0000","last_became_active":"2023-11-08T12:30:55.320928+0000","last_became_peered":"2023-11-08T12:30:55.320928+0000","last_unstale":"2023-11-08T12:30:56.650017+0000","last_undegraded":"2023-11-08T12:30:56.650017+0000","last_fullsized":"2023-11-08T12:30:56.650017+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649813+0000","last_change":"2023-11-08T12:30:55.314603+0000","last_active":"2023-11-08T12:30:56.649813+0000","last_peered":"2023-11-08T12:30:56.649813+0000","last_clean":"2023-11-08T12:30:56.649813+0000","last_became_active":"2023-11-08T12:30:55.314244+0000","last_became_peered":"2023-11-08T12:30:55.314244+0000","last_unstale":"2023-11-08T12:30:56.649813+0000","last_undegraded":"2023-11-08T12:30:56.649813+0000","last_fullsized":"2023-11-08T12:30:56.649813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827008+0000","last_change":"2023-11-08T12:30:55.324660+0000","last_active":"2023-11-08T12:30:55.827008+0000","last_peered":"2023-11-08T12:30:55.827008+0000","last_clean":"2023-11-08T12:30:55.827008+0000","last_became_active":"2023-11-08T12:30:55.324367+0000","last_became_peered":"2023-11-08T12:30:55.324367+0000","last_unstale":"2023-11-08T12:30:55.827008+0000","last_undegraded":"2023-11-08T12:30:55.827008+0000","last_fullsized":"2023-11-08T12:30:55.827008+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.826969+0000","last_change":"2023-11-08T12:30:55.331611+0000","last_active":"2023-11-08T12:30:55.826969+0000","last_peered":"2023-11-08T12:30:55.826969+0000","last_clean":"2023-11-08T12:30:55.826969+0000","last_became_active":"2023-11-08T12:30:55.331332+0000","last_became_peered":"2023-11-08T12:30:55.331332+0000","last_unstale":"2023-11-08T12:30:55.826969+0000","last_undegraded":"2023-11-08T12:30:55.826969+0000","last_fullsized":"2023-11-08T12:30:55.826969+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:07.030455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650350+0000","last_change":"2023-11-08T12:30:55.335185+0000","last_active":"2023-11-08T12:30:56.650350+0000","last_peered":"2023-11-08T12:30:56.650350+0000","last_clean":"2023-11-08T12:30:56.650350+0000","last_became_active":"2023-11-08T12:30:55.334582+0000","last_became_peered":"2023-11-08T12:30:55.334582+0000","last_unstale":"2023-11-08T12:30:56.650350+0000","last_undegraded":"2023-11-08T12:30:56.650350+0000","last_fullsized":"2023-11-08T12:30:56.650350+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-10T00:30:45.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827968+0000","last_change":"2023-11-08T12:30:55.330007+0000","last_active":"2023-11-08T12:30:55.827968+0000","last_peered":"2023-11-08T12:30:55.827968+0000","last_clean":"2023-11-08T12:30:55.827968+0000","last_became_active":"2023-11-08T12:30:55.326154+0000","last_became_peered":"2023-11-08T12:30:55.326154+0000","last_unstale":"2023-11-08T12:30:55.827968+0000","last_undegraded":"2023-11-08T12:30:55.827968+0000","last_fullsized":"2023-11-08T12:30:55.827968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817909+0000","last_change":"2023-11-08T12:30:55.316113+0000","last_active":"2023-11-08T12:30:55.817909+0000","last_peered":"2023-11-08T12:30:55.817909+0000","last_clean":"2023-11-08T12:30:55.817909+0000","last_became_active":"2023-11-08T12:30:55.315770+0000","last_became_peered":"2023-11-08T12:30:55.315770+0000","last_unstale":"2023-11-08T12:30:55.817909+0000","last_undegraded":"2023-11-08T12:30:55.817909+0000","last_fullsized":"2023-11-08T12:30:55.817909+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:42:28.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650222+0000","last_change":"2023-11-08T12:30:55.319074+0000","last_active":"2023-11-08T12:30:56.650222+0000","last_peered":"2023-11-08T12:30:56.650222+0000","last_clean":"2023-11-08T12:30:56.650222+0000","last_became_active":"2023-11-08T12:30:55.318252+0000","last_became_peered":"2023-11-08T12:30:55.318252+0000","last_unstale":"2023-11-08T12:30:56.650222+0000","last_undegraded":"2023-11-08T12:30:56.650222+0000","last_fullsized":"2023-11-08T12:30:56.650222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817817+0000","last_change":"2023-11-08T12:30:55.302817+0000","last_active":"2023-11-08T12:30:55.817817+0000","last_peered":"2023-11-08T12:30:55.817817+0000","last_clean":"2023-11-08T12:30:55.817817+0000","last_became_active":"2023-11-08T12:30:55.302532+0000","last_became_peered":"2023-11-08T12:30:55.302532+0000","last_unstale":"2023-11-08T12:30:55.817817+0000","last_undegraded":"2023-11-08T12:30:55.817817+0000","last_fullsized":"2023-11-08T12:30:55.817817+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:26:37.965778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827829+0000","last_change":"2023-11-08T12:30:55.326527+0000","last_active":"2023-11-08T12:30:55.827829+0000","last_peered":"2023-11-08T12:30:55.827829+0000","last_clean":"2023-11-08T12:30:55.827829+0000","last_became_active":"2023-11-08T12:30:55.326149+0000","last_became_peered":"2023-11-08T12:30:55.326149+0000","last_unstale":"2023-11-08T12:30:55.827829+0000","last_undegraded":"2023-11-08T12:30:55.827829+0000","last_fullsized":"2023-11-08T12:30:55.827829+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827766+0000","last_change":"2023-11-08T12:30:55.304430+0000","last_active":"2023-11-08T12:30:55.827766+0000","last_peered":"2023-11-08T12:30:55.827766+0000","last_clean":"2023-11-08T12:30:55.827766+0000","last_became_active":"2023-11-08T12:30:55.304157+0000","last_became_peered":"2023-11-08T12:30:55.304157+0000","last_unstale":"2023-11-08T12:30:55.827766+0000","last_undegraded":"2023-11-08T12:30:55.827766+0000","last_fullsized":"2023-11-08T12:30:55.827766+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:54:35.840622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647670+0000","last_change":"2023-11-08T12:30:55.321120+0000","last_active":"2023-11-08T12:30:56.647670+0000","last_peered":"2023-11-08T12:30:56.647670+0000","last_clean":"2023-11-08T12:30:56.647670+0000","last_became_active":"2023-11-08T12:30:55.320278+0000","last_became_peered":"2023-11-08T12:30:55.320278+0000","last_unstale":"2023-11-08T12:30:56.647670+0000","last_undegraded":"2023-11-08T12:30:56.647670+0000","last_fullsized":"2023-11-08T12:30:56.647670+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:02:47.585589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827082+0000","last_change":"2023-11-08T12:30:55.332770+0000","last_active":"2023-11-08T12:30:55.827082+0000","last_peered":"2023-11-08T12:30:55.827082+0000","last_clean":"2023-11-08T12:30:55.827082+0000","last_became_active":"2023-11-08T12:30:55.332517+0000","last_became_peered":"2023-11-08T12:30:55.332517+0000","last_unstale":"2023-11-08T12:30:55.827082+0000","last_undegraded":"2023-11-08T12:30:55.827082+0000","last_fullsized":"2023-11-08T12:30:55.827082+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:03.879418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"69'4","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827125+0000","last_change":"2023-11-08T12:30:54.846800+0000","last_active":"2023-11-08T12:30:55.827125+0000","last_peered":"2023-11-08T12:30:55.827125+0000","last_clean":"2023-11-08T12:30:55.827125+0000","last_became_active":"2023-11-08T12:30:54.846540+0000","last_became_peered":"2023-11-08T12:30:54.846540+0000","last_unstale":"2023-11-08T12:30:55.827125+0000","last_undegraded":"2023-11-08T12:30:55.827125+0000","last_fullsized":"2023-11-08T12:30:55.827125+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:29:02.918713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.308055+0000","last_change":"2023-11-08T12:30:55.307344+0000","last_active":"2023-11-08T12:30:56.308055+0000","last_peered":"2023-11-08T12:30:56.308055+0000","last_clean":"2023-11-08T12:30:56.308055+0000","last_became_active":"2023-11-08T12:30:55.306806+0000","last_became_peered":"2023-11-08T12:30:55.306806+0000","last_unstale":"2023-11-08T12:30:56.308055+0000","last_undegraded":"2023-11-08T12:30:56.308055+0000","last_fullsized":"2023-11-08T12:30:56.308055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:29:45.421251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"69'1","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830527+0000","last_change":"2023-11-08T12:30:54.849246+0000","last_active":"2023-11-08T12:30:55.830527+0000","last_peered":"2023-11-08T12:30:55.830527+0000","last_clean":"2023-11-08T12:30:55.830527+0000","last_became_active":"2023-11-08T12:30:54.848932+0000","last_became_peered":"2023-11-08T12:30:54.848932+0000","last_unstale":"2023-11-08T12:30:55.830527+0000","last_undegraded":"2023-11-08T12:30:55.830527+0000","last_fullsized":"2023-11-08T12:30:55.830527+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649715+0000","last_change":"2023-11-08T12:30:55.323319+0000","last_active":"2023-11-08T12:30:56.649715+0000","last_peered":"2023-11-08T12:30:56.649715+0000","last_clean":"2023-11-08T12:30:56.649715+0000","last_became_active":"2023-11-08T12:30:55.323053+0000","last_became_peered":"2023-11-08T12:30:55.323053+0000","last_unstale":"2023-11-08T12:30:56.649715+0000","last_undegraded":"2023-11-08T12:30:56.649715+0000","last_fullsized":"2023-11-08T12:30:56.649715+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:12:40.881917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650330+0000","last_change":"2023-11-08T12:30:54.831895+0000","last_active":"2023-11-08T12:30:56.650330+0000","last_peered":"2023-11-08T12:30:56.650330+0000","last_clean":"2023-11-08T12:30:56.650330+0000","last_became_active":"2023-11-08T12:30:54.831579+0000","last_became_peered":"2023-11-08T12:30:54.831579+0000","last_unstale":"2023-11-08T12:30:56.650330+0000","last_undegraded":"2023-11-08T12:30:56.650330+0000","last_fullsized":"2023-11-08T12:30:56.650330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:28.678844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827057+0000","last_change":"2023-11-08T12:30:55.318219+0000","last_active":"2023-11-08T12:30:55.827057+0000","last_peered":"2023-11-08T12:30:55.827057+0000","last_clean":"2023-11-08T12:30:55.827057+0000","last_became_active":"2023-11-08T12:30:55.317811+0000","last_became_peered":"2023-11-08T12:30:55.317811+0000","last_unstale":"2023-11-08T12:30:55.827057+0000","last_undegraded":"2023-11-08T12:30:55.827057+0000","last_fullsized":"2023-11-08T12:30:55.827057+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:17:34.332109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649832+0000","last_change":"2023-11-08T12:30:54.843634+0000","last_active":"2023-11-08T12:30:56.649832+0000","last_peered":"2023-11-08T12:30:56.649832+0000","last_clean":"2023-11-08T12:30:56.649832+0000","last_became_active":"2023-11-08T12:30:54.843178+0000","last_became_peered":"2023-11-08T12:30:54.843178+0000","last_unstale":"2023-11-08T12:30:56.649832+0000","last_undegraded":"2023-11-08T12:30:56.649832+0000","last_fullsized":"2023-11-08T12:30:56.649832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:36:56.748105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827861+0000","last_change":"2023-11-08T12:30:55.305408+0000","last_active":"2023-11-08T12:30:55.827861+0000","last_peered":"2023-11-08T12:30:55.827861+0000","last_clean":"2023-11-08T12:30:55.827861+0000","last_became_active":"2023-11-08T12:30:55.305030+0000","last_became_peered":"2023-11-08T12:30:55.305030+0000","last_unstale":"2023-11-08T12:30:55.827861+0000","last_undegraded":"2023-11-08T12:30:55.827861+0000","last_fullsized":"2023-11-08T12:30:55.827861+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:22:43.056426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"69'1","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817874+0000","last_change":"2023-11-08T12:30:54.835678+0000","last_active":"2023-11-08T12:30:55.817874+0000","last_peered":"2023-11-08T12:30:55.817874+0000","last_clean":"2023-11-08T12:30:55.817874+0000","last_became_active":"2023-11-08T12:30:54.833332+0000","last_became_peered":"2023-11-08T12:30:54.833332+0000","last_unstale":"2023-11-08T12:30:55.817874+0000","last_undegraded":"2023-11-08T12:30:55.817874+0000","last_fullsized":"2023-11-08T12:30:55.817874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650059+0000","last_change":"2023-11-08T12:30:55.335120+0000","last_active":"2023-11-08T12:30:56.650059+0000","last_peered":"2023-11-08T12:30:56.650059+0000","last_clean":"2023-11-08T12:30:56.650059+0000","last_became_active":"2023-11-08T12:30:55.334810+0000","last_became_peered":"2023-11-08T12:30:55.334810+0000","last_unstale":"2023-11-08T12:30:56.650059+0000","last_undegraded":"2023-11-08T12:30:56.650059+0000","last_fullsized":"2023-11-08T12:30:56.650059+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:09:24.721389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649532+0000","last_change":"2023-11-08T12:30:54.844976+0000","last_active":"2023-11-08T12:30:56.649532+0000","last_peered":"2023-11-08T12:30:56.649532+0000","last_clean":"2023-11-08T12:30:56.649532+0000","last_became_active":"2023-11-08T12:30:54.844700+0000","last_became_peered":"2023-11-08T12:30:54.844700+0000","last_unstale":"2023-11-08T12:30:56.649532+0000","last_undegraded":"2023-11-08T12:30:56.649532+0000","last_fullsized":"2023-11-08T12:30:56.649532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:56:27.392361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307056+0000","last_change":"2023-11-08T12:30:55.326495+0000","last_active":"2023-11-08T12:30:56.307056+0000","last_peered":"2023-11-08T12:30:56.307056+0000","last_clean":"2023-11-08T12:30:56.307056+0000","last_became_active":"2023-11-08T12:30:55.326243+0000","last_became_peered":"2023-11-08T12:30:55.326243+0000","last_unstale":"2023-11-08T12:30:56.307056+0000","last_undegraded":"2023-11-08T12:30:56.307056+0000","last_fullsized":"2023-11-08T12:30:56.307056+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:05:16.321688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818713+0000","last_change":"2023-11-08T12:30:54.839982+0000","last_active":"2023-11-08T12:30:55.818713+0000","last_peered":"2023-11-08T12:30:55.818713+0000","last_clean":"2023-11-08T12:30:55.818713+0000","last_became_active":"2023-11-08T12:30:54.839352+0000","last_became_peered":"2023-11-08T12:30:54.839352+0000","last_unstale":"2023-11-08T12:30:55.818713+0000","last_undegraded":"2023-11-08T12:30:55.818713+0000","last_fullsized":"2023-11-08T12:30:55.818713+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:30:19.689649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830471+0000","last_change":"2023-11-08T12:30:55.325624+0000","last_active":"2023-11-08T12:30:55.830471+0000","last_peered":"2023-11-08T12:30:55.830471+0000","last_clean":"2023-11-08T12:30:55.830471+0000","last_became_active":"2023-11-08T12:30:55.325215+0000","last_became_peered":"2023-11-08T12:30:55.325215+0000","last_unstale":"2023-11-08T12:30:55.830471+0000","last_undegraded":"2023-11-08T12:30:55.830471+0000","last_fullsized":"2023-11-08T12:30:55.830471+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.299964+0000","last_change":"2023-11-08T12:30:54.841406+0000","last_active":"2023-11-08T12:30:55.299964+0000","last_peered":"2023-11-08T12:30:55.299964+0000","last_clean":"2023-11-08T12:30:55.299964+0000","last_became_active":"2023-11-08T12:30:54.841169+0000","last_became_peered":"2023-11-08T12:30:54.841169+0000","last_unstale":"2023-11-08T12:30:55.299964+0000","last_undegraded":"2023-11-08T12:30:55.299964+0000","last_fullsized":"2023-11-08T12:30:55.299964+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:57:06.225781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827999+0000","last_change":"2023-11-08T12:30:55.313267+0000","last_active":"2023-11-08T12:30:55.827999+0000","last_peered":"2023-11-08T12:30:55.827999+0000","last_clean":"2023-11-08T12:30:55.827999+0000","last_became_active":"2023-11-08T12:30:55.313008+0000","last_became_peered":"2023-11-08T12:30:55.313008+0000","last_unstale":"2023-11-08T12:30:55.827999+0000","last_undegraded":"2023-11-08T12:30:55.827999+0000","last_fullsized":"2023-11-08T12:30:55.827999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:43.915645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650448+0000","last_change":"2023-11-08T12:30:54.835906+0000","last_active":"2023-11-08T12:30:56.650448+0000","last_peered":"2023-11-08T12:30:56.650448+0000","last_clean":"2023-11-08T12:30:56.650448+0000","last_became_active":"2023-11-08T12:30:54.835646+0000","last_became_peered":"2023-11-08T12:30:54.835646+0000","last_unstale":"2023-11-08T12:30:56.650448+0000","last_undegraded":"2023-11-08T12:30:56.650448+0000","last_fullsized":"2023-11-08T12:30:56.650448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827104+0000","last_change":"2023-11-08T12:30:55.332691+0000","last_active":"2023-11-08T12:30:55.827104+0000","last_peered":"2023-11-08T12:30:55.827104+0000","last_clean":"2023-11-08T12:30:55.827104+0000","last_became_active":"2023-11-08T12:30:55.332466+0000","last_became_peered":"2023-11-08T12:30:55.332466+0000","last_unstale":"2023-11-08T12:30:55.827104+0000","last_undegraded":"2023-11-08T12:30:55.827104+0000","last_fullsized":"2023-11-08T12:30:55.827104+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:49:32.086861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650156+0000","last_change":"2023-11-08T12:30:54.838927+0000","last_active":"2023-11-08T12:30:56.650156+0000","last_peered":"2023-11-08T12:30:56.650156+0000","last_clean":"2023-11-08T12:30:56.650156+0000","last_became_active":"2023-11-08T12:30:54.838387+0000","last_became_peered":"2023-11-08T12:30:54.838387+0000","last_unstale":"2023-11-08T12:30:56.650156+0000","last_undegraded":"2023-11-08T12:30:56.650156+0000","last_fullsized":"2023-11-08T12:30:56.650156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:02:00.436766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650138+0000","last_change":"2023-11-08T12:30:55.319414+0000","last_active":"2023-11-08T12:30:56.650138+0000","last_peered":"2023-11-08T12:30:56.650138+0000","last_clean":"2023-11-08T12:30:56.650138+0000","last_became_active":"2023-11-08T12:30:55.319072+0000","last_became_peered":"2023-11-08T12:30:55.319072+0000","last_unstale":"2023-11-08T12:30:56.650138+0000","last_undegraded":"2023-11-08T12:30:56.650138+0000","last_fullsized":"2023-11-08T12:30:56.650138+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:46.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"69'3","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817925+0000","last_change":"2023-11-08T12:30:54.834908+0000","last_active":"2023-11-08T12:30:55.817925+0000","last_peered":"2023-11-08T12:30:55.817925+0000","last_clean":"2023-11-08T12:30:55.817925+0000","last_became_active":"2023-11-08T12:30:54.834652+0000","last_became_peered":"2023-11-08T12:30:54.834652+0000","last_unstale":"2023-11-08T12:30:55.817925+0000","last_undegraded":"2023-11-08T12:30:55.817925+0000","last_fullsized":"2023-11-08T12:30:55.817925+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307642+0000","last_change":"2023-11-08T12:30:55.321368+0000","last_active":"2023-11-08T12:30:56.307642+0000","last_peered":"2023-11-08T12:30:56.307642+0000","last_clean":"2023-11-08T12:30:56.307642+0000","last_became_active":"2023-11-08T12:30:55.320748+0000","last_became_peered":"2023-11-08T12:30:55.320748+0000","last_unstale":"2023-11-08T12:30:56.307642+0000","last_undegraded":"2023-11-08T12:30:56.307642+0000","last_fullsized":"2023-11-08T12:30:56.307642+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:56:54.467342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"69'6","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818819+0000","last_change":"2023-11-08T12:30:54.849645+0000","last_active":"2023-11-08T12:30:55.818819+0000","last_peered":"2023-11-08T12:30:55.818819+0000","last_clean":"2023-11-08T12:30:55.818819+0000","last_became_active":"2023-11-08T12:30:54.849337+0000","last_became_peered":"2023-11-08T12:30:54.849337+0000","last_unstale":"2023-11-08T12:30:55.818819+0000","last_undegraded":"2023-11-08T12:30:55.818819+0000","last_fullsized":"2023-11-08T12:30:55.818819+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:17:45.244426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827018+0000","last_change":"2023-11-08T12:30:55.318084+0000","last_active":"2023-11-08T12:30:55.827018+0000","last_peered":"2023-11-08T12:30:55.827018+0000","last_clean":"2023-11-08T12:30:55.827018+0000","last_became_active":"2023-11-08T12:30:55.317807+0000","last_became_peered":"2023-11-08T12:30:55.317807+0000","last_unstale":"2023-11-08T12:30:55.827018+0000","last_undegraded":"2023-11-08T12:30:55.827018+0000","last_fullsized":"2023-11-08T12:30:55.827018+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:01:11.195203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"69'2","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818750+0000","last_change":"2023-11-08T12:30:54.846257+0000","last_active":"2023-11-08T12:30:55.818750+0000","last_peered":"2023-11-08T12:30:55.818750+0000","last_clean":"2023-11-08T12:30:55.818750+0000","last_became_active":"2023-11-08T12:30:54.845973+0000","last_became_peered":"2023-11-08T12:30:54.845973+0000","last_unstale":"2023-11-08T12:30:55.818750+0000","last_undegraded":"2023-11-08T12:30:55.818750+0000","last_fullsized":"2023-11-08T12:30:55.818750+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:05:18.819505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827908+0000","last_change":"2023-11-08T12:30:55.324143+0000","last_active":"2023-11-08T12:30:55.827908+0000","last_peered":"2023-11-08T12:30:55.827908+0000","last_clean":"2023-11-08T12:30:55.827908+0000","last_became_active":"2023-11-08T12:30:55.319125+0000","last_became_peered":"2023-11-08T12:30:55.319125+0000","last_unstale":"2023-11-08T12:30:55.827908+0000","last_undegraded":"2023-11-08T12:30:55.827908+0000","last_fullsized":"2023-11-08T12:30:55.827908+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:35:40.089625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649611+0000","last_change":"2023-11-08T12:30:54.838934+0000","last_active":"2023-11-08T12:30:56.649611+0000","last_peered":"2023-11-08T12:30:56.649611+0000","last_clean":"2023-11-08T12:30:56.649611+0000","last_became_active":"2023-11-08T12:30:54.838577+0000","last_became_peered":"2023-11-08T12:30:54.838577+0000","last_unstale":"2023-11-08T12:30:56.649611+0000","last_undegraded":"2023-11-08T12:30:56.649611+0000","last_fullsized":"2023-11-08T12:30:56.649611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:31:06.932234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830448+0000","last_change":"2023-11-08T12:30:55.331694+0000","last_active":"2023-11-08T12:30:55.830448+0000","last_peered":"2023-11-08T12:30:55.830448+0000","last_clean":"2023-11-08T12:30:55.830448+0000","last_became_active":"2023-11-08T12:30:55.330426+0000","last_became_peered":"2023-11-08T12:30:55.330426+0000","last_unstale":"2023-11-08T12:30:55.830448+0000","last_undegraded":"2023-11-08T12:30:55.830448+0000","last_fullsized":"2023-11-08T12:30:55.830448+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:11:54.793587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827726+0000","last_change":"2023-11-08T12:30:54.832910+0000","last_active":"2023-11-08T12:30:55.827726+0000","last_peered":"2023-11-08T12:30:55.827726+0000","last_clean":"2023-11-08T12:30:55.827726+0000","last_became_active":"2023-11-08T12:30:54.832399+0000","last_became_peered":"2023-11-08T12:30:54.832399+0000","last_unstale":"2023-11-08T12:30:55.827726+0000","last_undegraded":"2023-11-08T12:30:55.827726+0000","last_fullsized":"2023-11-08T12:30:55.827726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:50:27.468368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.306691+0000","last_change":"2023-11-08T12:30:55.309810+0000","last_active":"2023-11-08T12:30:56.306691+0000","last_peered":"2023-11-08T12:30:56.306691+0000","last_clean":"2023-11-08T12:30:56.306691+0000","last_became_active":"2023-11-08T12:30:55.309488+0000","last_became_peered":"2023-11-08T12:30:55.309488+0000","last_unstale":"2023-11-08T12:30:56.306691+0000","last_undegraded":"2023-11-08T12:30:56.306691+0000","last_fullsized":"2023-11-08T12:30:56.306691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:22:03.959642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"69'8","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.647438+0000","last_change":"2023-11-08T12:30:54.843786+0000","last_active":"2023-11-08T12:30:56.647438+0000","last_peered":"2023-11-08T12:30:56.647438+0000","last_clean":"2023-11-08T12:30:56.647438+0000","last_became_active":"2023-11-08T12:30:54.843532+0000","last_became_peered":"2023-11-08T12:30:54.843532+0000","last_unstale":"2023-11-08T12:30:56.647438+0000","last_undegraded":"2023-11-08T12:30:56.647438+0000","last_fullsized":"2023-11-08T12:30:56.647438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830515+0000","last_change":"2023-11-08T12:30:55.324593+0000","last_active":"2023-11-08T12:30:55.830515+0000","last_peered":"2023-11-08T12:30:55.830515+0000","last_clean":"2023-11-08T12:30:55.830515+0000","last_became_active":"2023-11-08T12:30:55.324360+0000","last_became_peered":"2023-11-08T12:30:55.324360+0000","last_unstale":"2023-11-08T12:30:55.830515+0000","last_undegraded":"2023-11-08T12:30:55.830515+0000","last_fullsized":"2023-11-08T12:30:55.830515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650015+0000","last_change":"2023-11-08T12:30:54.836571+0000","last_active":"2023-11-08T12:30:56.650015+0000","last_peered":"2023-11-08T12:30:56.650015+0000","last_clean":"2023-11-08T12:30:56.650015+0000","last_became_active":"2023-11-08T12:30:54.836202+0000","last_became_peered":"2023-11-08T12:30:54.836202+0000","last_unstale":"2023-11-08T12:30:56.650015+0000","last_undegraded":"2023-11-08T12:30:56.650015+0000","last_fullsized":"2023-11-08T12:30:56.650015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:40:02.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.828059+0000","last_change":"2023-11-08T12:30:55.316242+0000","last_active":"2023-11-08T12:30:55.828059+0000","last_peered":"2023-11-08T12:30:55.828059+0000","last_clean":"2023-11-08T12:30:55.828059+0000","last_became_active":"2023-11-08T12:30:55.315945+0000","last_became_peered":"2023-11-08T12:30:55.315945+0000","last_unstale":"2023-11-08T12:30:55.828059+0000","last_undegraded":"2023-11-08T12:30:55.828059+0000","last_fullsized":"2023-11-08T12:30:55.828059+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"70'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649198+0000","last_change":"2023-11-08T12:30:54.833269+0000","last_active":"2023-11-08T12:30:56.649198+0000","last_peered":"2023-11-08T12:30:56.649198+0000","last_clean":"2023-11-08T12:30:56.649198+0000","last_became_active":"2023-11-08T12:30:54.833032+0000","last_became_peered":"2023-11-08T12:30:54.833032+0000","last_unstale":"2023-11-08T12:30:56.649198+0000","last_undegraded":"2023-11-08T12:30:56.649198+0000","last_fullsized":"2023-11-08T12:30:56.649198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:32:31.381604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827029+0000","last_change":"2023-11-08T12:30:55.331577+0000","last_active":"2023-11-08T12:30:55.827029+0000","last_peered":"2023-11-08T12:30:55.827029+0000","last_clean":"2023-11-08T12:30:55.827029+0000","last_became_active":"2023-11-08T12:30:55.331235+0000","last_became_peered":"2023-11-08T12:30:55.331235+0000","last_unstale":"2023-11-08T12:30:55.827029+0000","last_undegraded":"2023-11-08T12:30:55.827029+0000","last_fullsized":"2023-11-08T12:30:55.827029+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:49.959942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.298801+0000","last_change":"2023-11-08T12:30:54.843541+0000","last_active":"2023-11-08T12:30:55.298801+0000","last_peered":"2023-11-08T12:30:55.298801+0000","last_clean":"2023-11-08T12:30:55.298801+0000","last_became_active":"2023-11-08T12:30:54.843157+0000","last_became_peered":"2023-11-08T12:30:54.843157+0000","last_unstale":"2023-11-08T12:30:55.298801+0000","last_undegraded":"2023-11-08T12:30:55.298801+0000","last_fullsized":"2023-11-08T12:30:55.298801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:49:51.257823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827067+0000","last_change":"2023-11-08T12:30:55.324576+0000","last_active":"2023-11-08T12:30:55.827067+0000","last_peered":"2023-11-08T12:30:55.827067+0000","last_clean":"2023-11-08T12:30:55.827067+0000","last_became_active":"2023-11-08T12:30:55.324241+0000","last_became_peered":"2023-11-08T12:30:55.324241+0000","last_unstale":"2023-11-08T12:30:55.827067+0000","last_undegraded":"2023-11-08T12:30:55.827067+0000","last_fullsized":"2023-11-08T12:30:55.827067+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:53:00.247971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830504+0000","last_change":"2023-11-08T12:30:54.833941+0000","last_active":"2023-11-08T12:30:55.830504+0000","last_peered":"2023-11-08T12:30:55.830504+0000","last_clean":"2023-11-08T12:30:55.830504+0000","last_became_active":"2023-11-08T12:30:54.833611+0000","last_became_peered":"2023-11-08T12:30:54.833611+0000","last_unstale":"2023-11-08T12:30:55.830504+0000","last_undegraded":"2023-11-08T12:30:55.830504+0000","last_fullsized":"2023-11-08T12:30:55.830504+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:53:42.909072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307652+0000","last_change":"2023-11-08T12:30:55.307094+0000","last_active":"2023-11-08T12:30:56.307652+0000","last_peered":"2023-11-08T12:30:56.307652+0000","last_clean":"2023-11-08T12:30:56.307652+0000","last_became_active":"2023-11-08T12:30:55.306772+0000","last_became_peered":"2023-11-08T12:30:55.306772+0000","last_unstale":"2023-11-08T12:30:56.307652+0000","last_undegraded":"2023-11-08T12:30:56.307652+0000","last_fullsized":"2023-11-08T12:30:56.307652+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:31:44.469123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.298347+0000","last_change":"2023-11-08T12:30:54.847462+0000","last_active":"2023-11-08T12:30:55.298347+0000","last_peered":"2023-11-08T12:30:55.298347+0000","last_clean":"2023-11-08T12:30:55.298347+0000","last_became_active":"2023-11-08T12:30:54.847128+0000","last_became_peered":"2023-11-08T12:30:54.847128+0000","last_unstale":"2023-11-08T12:30:55.298347+0000","last_undegraded":"2023-11-08T12:30:55.298347+0000","last_fullsized":"2023-11-08T12:30:55.298347+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T23:32:04.906777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649508+0000","last_change":"2023-11-08T12:30:55.319451+0000","last_active":"2023-11-08T12:30:56.649508+0000","last_peered":"2023-11-08T12:30:56.649508+0000","last_clean":"2023-11-08T12:30:56.649508+0000","last_became_active":"2023-11-08T12:30:55.319150+0000","last_became_peered":"2023-11-08T12:30:55.319150+0000","last_unstale":"2023-11-08T12:30:56.649508+0000","last_undegraded":"2023-11-08T12:30:56.649508+0000","last_fullsized":"2023-11-08T12:30:56.649508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:07:04.384929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818732+0000","last_change":"2023-11-08T12:30:54.841848+0000","last_active":"2023-11-08T12:30:55.818732+0000","last_peered":"2023-11-08T12:30:55.818732+0000","last_clean":"2023-11-08T12:30:55.818732+0000","last_became_active":"2023-11-08T12:30:54.841620+0000","last_became_peered":"2023-11-08T12:30:54.841620+0000","last_unstale":"2023-11-08T12:30:55.818732+0000","last_undegraded":"2023-11-08T12:30:55.818732+0000","last_fullsized":"2023-11-08T12:30:55.818732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:54:03.086038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818691+0000","last_change":"2023-11-08T12:30:55.316687+0000","last_active":"2023-11-08T12:30:55.818691+0000","last_peered":"2023-11-08T12:30:55.818691+0000","last_clean":"2023-11-08T12:30:55.818691+0000","last_became_active":"2023-11-08T12:30:55.316441+0000","last_became_peered":"2023-11-08T12:30:55.316441+0000","last_unstale":"2023-11-08T12:30:55.818691+0000","last_undegraded":"2023-11-08T12:30:55.818691+0000","last_fullsized":"2023-11-08T12:30:55.818691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:51:22.840210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649430+0000","last_change":"2023-11-08T12:30:54.844787+0000","last_active":"2023-11-08T12:30:56.649430+0000","last_peered":"2023-11-08T12:30:56.649430+0000","last_clean":"2023-11-08T12:30:56.649430+0000","last_became_active":"2023-11-08T12:30:54.844525+0000","last_became_peered":"2023-11-08T12:30:54.844525+0000","last_unstale":"2023-11-08T12:30:56.649430+0000","last_undegraded":"2023-11-08T12:30:56.649430+0000","last_fullsized":"2023-11-08T12:30:56.649430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:56:48.953369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649183+0000","last_change":"2023-11-08T12:30:55.318830+0000","last_active":"2023-11-08T12:30:56.649183+0000","last_peered":"2023-11-08T12:30:56.649183+0000","last_clean":"2023-11-08T12:30:56.649183+0000","last_became_active":"2023-11-08T12:30:55.318553+0000","last_became_peered":"2023-11-08T12:30:55.318553+0000","last_unstale":"2023-11-08T12:30:56.649183+0000","last_undegraded":"2023-11-08T12:30:56.649183+0000","last_fullsized":"2023-11-08T12:30:56.649183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T22:12:49.043898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.648476+0000","last_change":"2023-11-08T12:30:54.844323+0000","last_active":"2023-11-08T12:30:56.648476+0000","last_peered":"2023-11-08T12:30:56.648476+0000","last_clean":"2023-11-08T12:30:56.648476+0000","last_became_active":"2023-11-08T12:30:54.843554+0000","last_became_peered":"2023-11-08T12:30:54.843554+0000","last_unstale":"2023-11-08T12:30:56.648476+0000","last_undegraded":"2023-11-08T12:30:56.648476+0000","last_fullsized":"2023-11-08T12:30:56.648476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T19:50:49.520218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650476+0000","last_change":"2023-11-08T12:30:55.334426+0000","last_active":"2023-11-08T12:30:56.650476+0000","last_peered":"2023-11-08T12:30:56.650476+0000","last_clean":"2023-11-08T12:30:56.650476+0000","last_became_active":"2023-11-08T12:30:55.334150+0000","last_became_peered":"2023-11-08T12:30:55.334150+0000","last_unstale":"2023-11-08T12:30:56.650476+0000","last_undegraded":"2023-11-08T12:30:56.650476+0000","last_fullsized":"2023-11-08T12:30:56.650476+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650113+0000","last_change":"2023-11-08T12:30:54.836504+0000","last_active":"2023-11-08T12:30:56.650113+0000","last_peered":"2023-11-08T12:30:56.650113+0000","last_clean":"2023-11-08T12:30:56.650113+0000","last_became_active":"2023-11-08T12:30:54.836192+0000","last_became_peered":"2023-11-08T12:30:54.836192+0000","last_unstale":"2023-11-08T12:30:56.650113+0000","last_undegraded":"2023-11-08T12:30:56.650113+0000","last_fullsized":"2023-11-08T12:30:56.650113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:57:06.832813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.310120+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:30:55.310120+0000","last_peered":"2023-11-08T12:30:55.310120+0000","last_clean":"2023-11-08T12:30:55.310120+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:30:55.310120+0000","last_undegraded":"2023-11-08T12:30:55.310120+0000","last_fullsized":"2023-11-08T12:30:55.310120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827114+0000","last_change":"2023-11-08T12:30:55.326991+0000","last_active":"2023-11-08T12:30:55.827114+0000","last_peered":"2023-11-08T12:30:55.827114+0000","last_clean":"2023-11-08T12:30:55.827114+0000","last_became_active":"2023-11-08T12:30:55.326567+0000","last_became_peered":"2023-11-08T12:30:55.326567+0000","last_unstale":"2023-11-08T12:30:55.827114+0000","last_undegraded":"2023-11-08T12:30:55.827114+0000","last_fullsized":"2023-11-08T12:30:55.827114+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:06:29.685417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.650578+0000","last_change":"2023-11-08T12:30:54.833012+0000","last_active":"2023-11-08T12:30:56.650578+0000","last_peered":"2023-11-08T12:30:56.650578+0000","last_clean":"2023-11-08T12:30:56.650578+0000","last_became_active":"2023-11-08T12:30:54.832759+0000","last_became_peered":"2023-11-08T12:30:54.832759+0000","last_unstale":"2023-11-08T12:30:56.650578+0000","last_undegraded":"2023-11-08T12:30:56.650578+0000","last_fullsized":"2023-11-08T12:30:56.650578+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:15:02.872845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.304521+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:30:55.304521+0000","last_peered":"2023-11-08T12:30:55.304521+0000","last_clean":"2023-11-08T12:30:55.304521+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:30:55.304521+0000","last_undegraded":"2023-11-08T12:30:55.304521+0000","last_fullsized":"2023-11-08T12:30:55.304521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.818802+0000","last_change":"2023-11-08T12:30:55.321736+0000","last_active":"2023-11-08T12:30:55.818802+0000","last_peered":"2023-11-08T12:30:55.818802+0000","last_clean":"2023-11-08T12:30:55.818802+0000","last_became_active":"2023-11-08T12:30:55.321525+0000","last_became_peered":"2023-11-08T12:30:55.321525+0000","last_unstale":"2023-11-08T12:30:55.818802+0000","last_undegraded":"2023-11-08T12:30:55.818802+0000","last_fullsized":"2023-11-08T12:30:55.818802+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:26:42.972609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"69'1","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649816+0000","last_change":"2023-11-08T12:30:54.834063+0000","last_active":"2023-11-08T12:30:56.649816+0000","last_peered":"2023-11-08T12:30:56.649816+0000","last_clean":"2023-11-08T12:30:56.649816+0000","last_became_active":"2023-11-08T12:30:54.833800+0000","last_became_peered":"2023-11-08T12:30:54.833800+0000","last_unstale":"2023-11-08T12:30:56.649816+0000","last_undegraded":"2023-11-08T12:30:56.649816+0000","last_fullsized":"2023-11-08T12:30:56.649816+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:59:26.678216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.305122+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:30:55.305122+0000","last_peered":"2023-11-08T12:30:55.305122+0000","last_clean":"2023-11-08T12:30:55.305122+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:30:55.305122+0000","last_undegraded":"2023-11-08T12:30:55.305122+0000","last_fullsized":"2023-11-08T12:30:55.305122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.307869+0000","last_change":"2023-11-08T12:30:55.326437+0000","last_active":"2023-11-08T12:30:56.307869+0000","last_peered":"2023-11-08T12:30:56.307869+0000","last_clean":"2023-11-08T12:30:56.307869+0000","last_became_active":"2023-11-08T12:30:55.326064+0000","last_became_peered":"2023-11-08T12:30:55.326064+0000","last_unstale":"2023-11-08T12:30:56.307869+0000","last_undegraded":"2023-11-08T12:30:56.307869+0000","last_fullsized":"2023-11-08T12:30:56.307869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:27:32.391791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827038+0000","last_change":"2023-11-08T12:30:54.847512+0000","last_active":"2023-11-08T12:30:55.827038+0000","last_peered":"2023-11-08T12:30:55.827038+0000","last_clean":"2023-11-08T12:30:55.827038+0000","last_became_active":"2023-11-08T12:30:54.847274+0000","last_became_peered":"2023-11-08T12:30:54.847274+0000","last_unstale":"2023-11-08T12:30:55.827038+0000","last_undegraded":"2023-11-08T12:30:55.827038+0000","last_fullsized":"2023-11-08T12:30:55.827038+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:44:24.515082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.307946+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:30:55.307946+0000","last_peered":"2023-11-08T12:30:55.307946+0000","last_clean":"2023-11-08T12:30:55.307946+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:30:55.307946+0000","last_undegraded":"2023-11-08T12:30:55.307946+0000","last_fullsized":"2023-11-08T12:30:55.307946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817853+0000","last_change":"2023-11-08T12:30:55.309187+0000","last_active":"2023-11-08T12:30:55.817853+0000","last_peered":"2023-11-08T12:30:55.817853+0000","last_clean":"2023-11-08T12:30:55.817853+0000","last_became_active":"2023-11-08T12:30:55.308893+0000","last_became_peered":"2023-11-08T12:30:55.308893+0000","last_unstale":"2023-11-08T12:30:55.817853+0000","last_undegraded":"2023-11-08T12:30:55.817853+0000","last_fullsized":"2023-11-08T12:30:55.817853+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:19:58.583605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649658+0000","last_change":"2023-11-08T12:30:54.844094+0000","last_active":"2023-11-08T12:30:56.649658+0000","last_peered":"2023-11-08T12:30:56.649658+0000","last_clean":"2023-11-08T12:30:56.649658+0000","last_became_active":"2023-11-08T12:30:54.843807+0000","last_became_peered":"2023-11-08T12:30:54.843807+0000","last_unstale":"2023-11-08T12:30:56.649658+0000","last_undegraded":"2023-11-08T12:30:56.649658+0000","last_fullsized":"2023-11-08T12:30:56.649658+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:16:29.671187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.295616+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:30:55.295616+0000","last_peered":"2023-11-08T12:30:55.295616+0000","last_clean":"2023-11-08T12:30:55.295616+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:30:55.295616+0000","last_undegraded":"2023-11-08T12:30:55.295616+0000","last_fullsized":"2023-11-08T12:30:55.295616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817748+0000","last_change":"2023-11-08T12:30:55.327299+0000","last_active":"2023-11-08T12:30:55.817748+0000","last_peered":"2023-11-08T12:30:55.817748+0000","last_clean":"2023-11-08T12:30:55.817748+0000","last_became_active":"2023-11-08T12:30:55.327048+0000","last_became_peered":"2023-11-08T12:30:55.327048+0000","last_unstale":"2023-11-08T12:30:55.817748+0000","last_undegraded":"2023-11-08T12:30:55.817748+0000","last_fullsized":"2023-11-08T12:30:55.817748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:15:55.705998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.827799+0000","last_change":"2023-11-08T12:30:54.836886+0000","last_active":"2023-11-08T12:30:55.827799+0000","last_peered":"2023-11-08T12:30:55.827799+0000","last_clean":"2023-11-08T12:30:55.827799+0000","last_became_active":"2023-11-08T12:30:54.836409+0000","last_became_peered":"2023-11-08T12:30:54.836409+0000","last_unstale":"2023-11-08T12:30:55.827799+0000","last_undegraded":"2023-11-08T12:30:55.827799+0000","last_fullsized":"2023-11-08T12:30:55.827799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:19:36.880517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.297144+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:30:55.297144+0000","last_peered":"2023-11-08T12:30:55.297144+0000","last_clean":"2023-11-08T12:30:55.297144+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:30:55.297144+0000","last_undegraded":"2023-11-08T12:30:55.297144+0000","last_fullsized":"2023-11-08T12:30:55.297144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817779+0000","last_change":"2023-11-08T12:30:55.326952+0000","last_active":"2023-11-08T12:30:55.817779+0000","last_peered":"2023-11-08T12:30:55.817779+0000","last_clean":"2023-11-08T12:30:55.817779+0000","last_became_active":"2023-11-08T12:30:55.326675+0000","last_became_peered":"2023-11-08T12:30:55.326675+0000","last_unstale":"2023-11-08T12:30:55.817779+0000","last_undegraded":"2023-11-08T12:30:55.817779+0000","last_fullsized":"2023-11-08T12:30:55.817779+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T17:31:28.467115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.830431+0000","last_change":"2023-11-08T12:30:54.837545+0000","last_active":"2023-11-08T12:30:55.830431+0000","last_peered":"2023-11-08T12:30:55.830431+0000","last_clean":"2023-11-08T12:30:55.830431+0000","last_became_active":"2023-11-08T12:30:54.837294+0000","last_became_peered":"2023-11-08T12:30:54.837294+0000","last_unstale":"2023-11-08T12:30:55.830431+0000","last_undegraded":"2023-11-08T12:30:55.830431+0000","last_fullsized":"2023-11-08T12:30:55.830431+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:34:06.023882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.305451+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:30:55.305451+0000","last_peered":"2023-11-08T12:30:55.305451+0000","last_clean":"2023-11-08T12:30:55.305451+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:30:55.305451+0000","last_undegraded":"2023-11-08T12:30:55.305451+0000","last_fullsized":"2023-11-08T12:30:55.305451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.817797+0000","last_change":"2023-11-08T12:30:55.316883+0000","last_active":"2023-11-08T12:30:55.817797+0000","last_peered":"2023-11-08T12:30:55.817797+0000","last_clean":"2023-11-08T12:30:55.817797+0000","last_became_active":"2023-11-08T12:30:55.316621+0000","last_became_peered":"2023-11-08T12:30:55.316621+0000","last_unstale":"2023-11-08T12:30:55.817797+0000","last_undegraded":"2023-11-08T12:30:55.817797+0000","last_fullsized":"2023-11-08T12:30:55.817797+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:54.801393+0000","last_clean_scrub_stamp":"2023-11-08T12:30:54.801393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T20:23:34.883991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"69'2","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-08T12:30:56.649596+0000","last_change":"2023-11-08T12:30:54.843585+0000","last_active":"2023-11-08T12:30:56.649596+0000","last_peered":"2023-11-08T12:30:56.649596+0000","last_clean":"2023-11-08T12:30:56.649596+0000","last_became_active":"2023-11-08T12:30:54.843194+0000","last_became_peered":"2023-11-08T12:30:54.843194+0000","last_unstale":"2023-11-08T12:30:56.649596+0000","last_undegraded":"2023-11-08T12:30:56.649596+0000","last_fullsized":"2023-11-08T12:30:56.649596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:30:53.794820+0000","last_clean_scrub_stamp":"2023-11-08T12:30:53.794820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:21:27.756624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.296161+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:30:55.296161+0000","last_peered":"2023-11-08T12:30:55.296161+0000","last_clean":"2023-11-08T12:30:55.296161+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:30:55.296161+0000","last_undegraded":"2023-11-08T12:30:55.296161+0000","last_fullsized":"2023-11-08T12:30:55.296161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-11-08T12:30:55.305303+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:30:55.305303+0000","last_peered":"2023-11-08T12:30:55.305303+0000","last_clean":"2023-11-08T12:30:55.305303+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:30:55.305303+0000","last_undegraded":"2023-11-08T12:30:55.305303+0000","last_fullsized":"2023-11-08T12:30:55.305303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476780,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9728,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362112,"statfs":{"total":96636764160,"available":96626802688,"internally_reserved":0,"allocated":843776,"data_stored":390494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.375,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.1040000000000001},"min":{"1min":0.71999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5669999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.4339999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.169,"15min":1.157},"min":{"1min":0.77100000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5649999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.119,"15min":1.1120000000000001},"min":{"1min":0.80800000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.512,"5min":1.851,"15min":1.851},"last":0.76300000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.069,"15min":1.0589999999999999},"min":{"1min":0.90800000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.155},{"interface":"front","average":{"1min":1.214,"5min":1.272,"15min":1.27},"min":{"1min":0.92300000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.466,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3360000000000001,"15min":1.341},"min":{"1min":0.89400000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6040000000000001,"5min":5.601,"15min":5.601},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.226,"15min":1.236},"min":{"1min":0.93600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.452,"5min":1.73,"15min":1.73},"last":1.3009999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.29,"15min":1.321},"min":{"1min":0.879,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.613,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.337,"15min":1.3660000000000001},"min":{"1min":0.96499999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6639999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.3460000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2629999999999999,"15min":1.284},"min":{"1min":0.82999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.694,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.397},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.4470000000000001,"15min":1.466},"min":{"1min":1.0880000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.734,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.5840000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.456,"15min":1.482},"min":{"1min":1.0029999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.7649999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.417,"15min":1.4410000000000001},"min":{"1min":0.98999999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7849999999999999,"5min":2.121,"15min":2.121},"last":1.5249999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476780,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9980,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361860,"statfs":{"total":96636764160,"available":96626544640,"internally_reserved":0,"allocated":839680,"data_stored":390472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0089999999999999,"15min":0.999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.056,"5min":1.069,"15min":1.0569999999999999},"min":{"1min":0.61599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4399999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.159,"15min":1.1599999999999999},"min":{"1min":0.81299999999999994,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.639,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.157,"15min":1.1930000000000001},"min":{"1min":0.73799999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.343,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.01}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.2130000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.446,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.2},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.1779999999999999,"15min":1.1899999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4330000000000001,"5min":3.129,"15min":3.129},"last":1.149}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1950000000000001,"15min":1.2150000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8140000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5189999999999999,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.115}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2490000000000001,"15min":1.2989999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5700000000000001,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2190000000000001,"15min":1.22},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.5409999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.4199999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3620000000000001,"15min":1.385},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5780000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.359},{"interface":"front","average":{"1min":1.306,"5min":1.3979999999999999,"15min":1.425},"min":{"1min":1.018,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.524,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.2829999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.3839999999999999,"15min":1.4099999999999999},"min":{"1min":0.94499999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.734,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.4299999999999999,"15min":1.448},"min":{"1min":0.95699999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.867,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4490000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10884,"kb_used_data":1404,"kb_used_omap":0,"kb_used_meta":9472,"kb_avail":94360956,"statfs":{"total":96636764160,"available":96625618944,"internally_reserved":0,"allocated":1437696,"data_stored":981370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9699328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1519999999999999},"min":{"1min":0.67800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4319999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.145,"5min":1.1639999999999999,"15min":1.1719999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.5329999999999999,"5min":1.7,"15min":1.7},"last":1}]},{"osd":1,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.046},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.76000000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.409,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.123,"15min":1.121},"min":{"1min":0.84699999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.47,"5min":1.597,"15min":1.597},"last":1.254},{"interface":"front","average":{"1min":1.24,"5min":1.2090000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.651,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.298}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.198,"15min":1.222},"min":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3979999999999999,"5min":1.984,"15min":1.984},"last":1.121},{"interface":"front","average":{"1min":1.198,"5min":1.2529999999999999,"15min":1.2629999999999999},"min":{"1min":0.79200000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.51,"5min":2.137,"15min":2.137},"last":1.177}]},{"osd":4,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.26,"15min":1.2889999999999999},"min":{"1min":0.70699999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.677,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.224,"15min":1.246},"min":{"1min":0.83699999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.353}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.86899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5760000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.238,"15min":1.264},"min":{"1min":0.69999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6020000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.4219999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:50 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3600000000000001,"15min":1.3660000000000001},"min":{"1min":0.97299999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.79,"5min":1.956,"15min":1.956},"last":1.391},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3859999999999999,"15min":1.415},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.798,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.591}]}]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9724,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362116,"statfs":{"total":96636764160,"available":96626806784,"internally_reserved":0,"allocated":839680,"data_stored":390492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.7629999999999999,"15min":2.0649999999999999},"min":{"1min":0.73299999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.623,"5min":20.099,"15min":20.099},"last":1.097},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.823,"15min":2.141},"min":{"1min":0.85099999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4379999999999999,"5min":21.238,"15min":21.238},"last":0.80100000000000005}]},{"osd":1,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.155,"15min":1.2110000000000001},"min":{"1min":0.71399999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.573,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.391,"15min":1.5369999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5149999999999999,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":0.90000000000000002}]},{"osd":2,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.5569999999999999,"15min":1.7310000000000001},"min":{"1min":0.97599999999999998,"5min":0.745,"15min":0.745},"max":{"1min":1.4770000000000001,"5min":11.843,"15min":11.843},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.597,"15min":1.7749999999999999},"min":{"1min":0.80500000000000005,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8939999999999999,"5min":11.907,"15min":11.907},"last":1.258}]},{"osd":3,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.331,"15min":1.4059999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.556,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.4039999999999999,"15min":1.4930000000000001},"min":{"1min":0.90800000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.7529999999999999,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.169}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2070000000000001,"15min":1.2130000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.869,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2709999999999999,"15min":1.2889999999999999},"min":{"1min":0.75,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.966,"5min":2.073,"15min":2.073},"last":1.216}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.262,"15min":1.3029999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.552,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.367,"15min":1.385},"min":{"1min":1.0449999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.3959999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.637,"15min":1.7889999999999999},"min":{"1min":1.002,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.647,"5min":8.109,"15min":8.109},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.593,"15min":1.675},"min":{"1min":1.2190000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.101,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.4790000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9920,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361920,"statfs":{"total":96636764160,"available":96626606080,"internally_reserved":0,"allocated":843776,"data_stored":390514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.91600000000000004,"15min":0.97799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.96599999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.97799999999999998},"min":{"1min":0.61399999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.165,"5min":1.53,"15min":1.53},"last":0.90200000000000002}]},{"osd":1,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.52900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.075,"5min":1.51,"15min":1.51},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.099},"min":{"1min":0.55700000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.4219999999999999,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.0269999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.143,"15min":1.22},"min":{"1min":0.63600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.393,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.097},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.57899999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.226,"5min":1.972,"15min":1.972},"last":0.80900000000000005}]},{"osd":4,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.2150000000000001,"15min":1.2490000000000001},"min":{"1min":0.72099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.458,"5min":1.837,"15min":1.837},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.3089999999999999,"15min":1.339},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5960000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3680000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2749999999999999,"15min":1.304},"min":{"1min":0.70599999999999996,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.649,"5min":1.897,"15min":1.897},"last":1.155},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4059999999999999,"15min":1.474},"min":{"1min":0.77500000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6759999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.423}]},{"osd":6,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.319,"15min":1.347},"min":{"1min":0.875,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.9079999999999999,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.119},{"interface":"front","average":{"1min":1.292,"5min":1.321,"15min":1.339},"min":{"1min":0.88900000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6679999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.427,"15min":1.4630000000000001},"min":{"1min":0.94399999999999995,"5min":0.875,"15min":0.875},"max":{"1min":1.9890000000000001,"5min":2.194,"15min":2.194},"last":1.399},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.93600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":2.472,"15min":2.472},"last":1.341}]}]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9740,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362100,"statfs":{"total":96636764160,"available":96626790400,"internally_reserved":0,"allocated":856064,"data_stored":392550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95799999999999996,"15min":0.98599999999999999},"min":{"1min":0.499,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.597,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.5259999999999998,"5min":2.5259999999999998,"15min":2.5259999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0029999999999999,"15min":1.0349999999999999},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5329999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1379999999999999},"min":{"1min":0.754,"5min":0.63,"15min":0.63},"max":{"1min":1.5940000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.032,"15min":1.0880000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.4550000000000001,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.627}]},{"osd":4,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2410000000000001,"15min":1.2709999999999999},"min":{"1min":0.878,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3120000000000001,"15min":1.3320000000000001},"min":{"1min":1.0680000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.663,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0600000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.375,"15min":1.411},"min":{"1min":0.88500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":4.8620000000000001,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.4590000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.9970000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.194}]},{"osd":6,"last update":"Wed Nov 8 12:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3400000000000001,"15min":1.3680000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.357,"15min":1.3999999999999999},"min":{"1min":0.95999999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.482,"15min":1.5269999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.956,"5min":3.7240000000000002,"15min":3.7240000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.425,"15min":1.4710000000000001},"min":{"1min":1.087,"5min":0.996,"15min":0.996},"max":{"1min":1.6439999999999999,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.1419999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11004,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":94360836,"statfs":{"total":96636764160,"available":96625496064,"internally_reserved":0,"allocated":1429504,"data_stored":980770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0169999999999999,"15min":1.1140000000000001},"min":{"1min":0.58899999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1679999999999999,"5min":6.54,"15min":6.54},"last":0.63},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.0289999999999999,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1359999999999999,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.93999999999999995}]},{"osd":2,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.97799999999999998,"15min":1.0249999999999999},"min":{"1min":0.60299999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.2130000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.014},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0269999999999999,"15min":1.0609999999999999},"min":{"1min":0.623,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5720000000000001,"5min":3.069,"15min":3.069},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.327,"5min":2.673,"15min":2.673},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.272,"15min":1.3819999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.599,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.085}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.3280000000000001,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5840000000000001,"5min":2.927,"15min":2.927},"last":1.359},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3440000000000001,"15min":1.409},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5589999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.401}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.3480000000000001,"15min":1.4119999999999999},"min":{"1min":0.99399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.4370000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.456,"15min":1.546},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.556,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.2829999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.4930000000000001,"15min":1.583},"min":{"1min":0.95099999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.52,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.4390000000000001,"15min":1.5189999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.6379999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.3180000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.4550000000000001,"15min":1.5269999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.5409999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.478,"15min":1.573},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.528,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.1890000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9668,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362172,"statfs":{"total":96636764160,"available":96626864128,"internally_reserved":0,"allocated":847872,"data_stored":391950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84699999999999998,"15min":0.872},"min":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3620000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.079,"15min":1.1200000000000001},"min":{"1min":0.77000000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2569999999999999,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.91200000000000003,"15min":0.92000000000000004},"min":{"1min":0.60799999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.415,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2829999999999999,"5min":1.837,"15min":1.837},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.073,"15min":1.119},"min":{"1min":0.51600000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.304,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.98699999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.876,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.4990000000000001,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.198,"5min":1.3220000000000001,"15min":1.3740000000000001},"min":{"1min":0.90200000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.3979999999999999,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.3360000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.343,"15min":1.393},"min":{"1min":1.0669999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.5640000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.278,"15min":1.3260000000000001},"min":{"1min":1.008,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.613,"5min":3.052,"15min":3.052},"last":0.92100000000000004}]},{"osd":6,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.327,"15min":1.377},"min":{"1min":1.0740000000000001,"5min":0.753,"15min":0.753},"max":{"1min":1.6719999999999999,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3680000000000001,"15min":1.4139999999999999},"min":{"1min":1.048,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8,"5min":2.254,"15min":2.254},"last":1.0469999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:30:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3620000000000001,"15min":1.4099999999999999},"min":{"1min":1.0820000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5389999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.425,"15min":1.4690000000000001},"min":{"1min":1.0680000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.8959999999999999,"5min":3.5,"15min":3.5},"last":1.2849999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:31:04.877 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-08T12:31:04.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-08T12:31:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.097+0000 7fcd63a5b700 1 Processor -- start 2023-11-08T12:31:05.101 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.097+0000 7fcd63a5b700 1 -- start start 2023-11-08T12:31:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd63a5b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c15d740 0x7fcd5c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd63a5b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcd5c0afbc0 0x7fcd5c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd63a5b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0cad20 con 0x7fcd5c0b0900 2023-11-08T12:31:05.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd63a5b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0b0d80 con 0x7fcd5c0afbc0 2023-11-08T12:31:05.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd63a5b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c0cb000 con 0x7fcd5c15d740 2023-11-08T12:31:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd617f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c15d740 0x7fcd5c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd617f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c15d740 0x7fcd5c15a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:57926/0 (socket says 172.21.15.112:57926) 2023-11-08T12:31:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd617f7700 1 -- 172.21.15.112:0/4162734122 learned_addr learned my addr 172.21.15.112:0/4162734122 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd60ff6700 1 --2- 172.21.15.112:0/4162734122 >> v2:172.21.15.112:3300/0 conn(0x7fcd5c0afbc0 0x7fcd5c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd617f7700 1 -- 172.21.15.112:0/4162734122 >> v2:172.21.15.112:3300/0 conn(0x7fcd5c0afbc0 msgr2=0x7fcd5c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd617f7700 1 --2- 172.21.15.112:0/4162734122 >> v2:172.21.15.112:3300/0 conn(0x7fcd5c0afbc0 0x7fcd5c0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd617f7700 1 -- 172.21.15.112:0/4162734122 >> v1:172.21.15.112:6789/0 conn(0x7fcd5c0b0900 legacy=0x7fcd5c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.101+0000 7fcd617f7700 1 -- 172.21.15.112:0/4162734122 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c159990 con 0x7fcd5c15d740 2023-11-08T12:31:05.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd617f7700 1 --2- 172.21.15.112:0/4162734122 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c15d740 0x7fcd5c15a190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009910 tx=0x7fcd58009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30ffa1b2f9a40c4d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:05.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd53fff700 1 -- 172.21.15.112:0/4162734122 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58005e50 con 0x7fcd5c15d740 2023-11-08T12:31:05.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd53fff700 1 -- 172.21.15.112:0/4162734122 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58006030 con 0x7fcd5c15d740 2023-11-08T12:31:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd53fff700 1 -- 172.21.15.112:0/4162734122 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580063e0 con 0x7fcd5c15d740 2023-11-08T12:31:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 -- 172.21.15.112:0/4162734122 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c15d740 msgr2=0x7fcd5c15a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/4162734122 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c15d740 0x7fcd5c15a190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009910 tx=0x7fcd58009c20 comp rx=0 tx=0).stop 2023-11-08T12:31:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 -- 172.21.15.112:0/4162734122 shutdown_connections 2023-11-08T12:31:05.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/4162734122 >> v2:172.21.15.112:3300/0 conn(0x7fcd5c0afbc0 0x7fcd5c0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/4162734122 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c15d740 0x7fcd5c15a190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 -- 172.21.15.112:0/4162734122 >> 172.21.15.112:0/4162734122 conn(0x7fcd5c0ce7e0 msgr2=0x7fcd5c0cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 -- 172.21.15.112:0/4162734122 shutdown_connections 2023-11-08T12:31:05.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.105+0000 7fcd63a5b700 1 -- 172.21.15.112:0/4162734122 wait complete. 2023-11-08T12:31:05.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.109+0000 7fcd63a5b700 1 Processor -- start 2023-11-08T12:31:05.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.109+0000 7fcd63a5b700 1 -- start start 2023-11-08T12:31:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.109+0000 7fcd63a5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd5c0afbc0 0x7fcd5c1f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.109+0000 7fcd63a5b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c0b0900 0x7fcd5c1f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd63a5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd5c15d740 0x7fcd5c158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd63a5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c1f29d0 con 0x7fcd5c0afbc0 2023-11-08T12:31:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd63a5b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c149d90 con 0x7fcd5c15d740 2023-11-08T12:31:05.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd63a5b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c1f5f00 con 0x7fcd5c0b0900 2023-11-08T12:31:05.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd617f7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd5c0afbc0 0x7fcd5c1f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd617f7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd5c0afbc0 0x7fcd5c1f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:44346/0 (socket says 172.21.15.112:44346) 2023-11-08T12:31:05.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd617f7700 1 -- 172.21.15.112:0/3100209331 learned_addr learned my addr 172.21.15.112:0/3100209331 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd60ff6700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c0b0900 0x7fcd5c1f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd61ff8700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd5c15d740 0x7fcd5c158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd60ff6700 1 -- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd5c15d740 msgr2=0x7fcd5c158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd60ff6700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd5c15d740 0x7fcd5c158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd60ff6700 1 -- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd5c0afbc0 msgr2=0x7fcd5c1f59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd60ff6700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd5c0afbc0 0x7fcd5c1f59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd60ff6700 1 -- 172.21.15.112:0/3100209331 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009520 con 0x7fcd5c0b0900 2023-11-08T12:31:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd617f7700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd5c0afbc0 0x7fcd5c1f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd60ff6700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c0b0900 0x7fcd5c1f1370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e900 tx=0x7fcd4c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd51ffb700 1 -- 172.21.15.112:0/3100209331 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c013680 con 0x7fcd5c0b0900 2023-11-08T12:31:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd51ffb700 1 -- 172.21.15.112:0/3100209331 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c0137e0 con 0x7fcd5c0b0900 2023-11-08T12:31:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd51ffb700 1 -- 172.21.15.112:0/3100209331 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c013b50 con 0x7fcd5c0b0900 2023-11-08T12:31:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c15db10 con 0x7fcd5c0b0900 2023-11-08T12:31:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.113+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c159c70 con 0x7fcd5c0b0900 2023-11-08T12:31:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.117+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c159640 con 0x7fcd5c0b0900 2023-11-08T12:31:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.117+0000 7fcd51ffb700 1 -- 172.21.15.112:0/3100209331 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcd4c019030 con 0x7fcd5c0b0900 2023-11-08T12:31:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.117+0000 7fcd51ffb700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcd40064ee0 0x7fcd40067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.117+0000 7fcd51ffb700 1 -- 172.21.15.112:0/3100209331 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcd4c0820d0 con 0x7fcd5c0b0900 2023-11-08T12:31:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.117+0000 7fcd617f7700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcd40064ee0 0x7fcd40067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.121+0000 7fcd617f7700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcd40064ee0 0x7fcd40067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0b2e30 tx=0x7fcd58008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.125+0000 7fcd51ffb700 1 -- 172.21.15.112:0/3100209331 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcd4c050130 con 0x7fcd5c0b0900 2023-11-08T12:31:05.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.353+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fcd5c0726c0 con 0x7fcd5c0b0900 2023-11-08T12:31:05.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.365+0000 7fcd51ffb700 1 -- 172.21.15.112:0/3100209331 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcd4c013cb0 con 0x7fcd5c0b0900 2023-11-08T12:31:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcd40064ee0 msgr2=0x7fcd40067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcd40064ee0 0x7fcd40067390 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0b2e30 tx=0x7fcd58008070 comp rx=0 tx=0).stop 2023-11-08T12:31:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c0b0900 msgr2=0x7fcd5c1f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c0b0900 0x7fcd5c1f1370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e900 tx=0x7fcd4c00ec10 comp rx=0 tx=0).stop 2023-11-08T12:31:05.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 shutdown_connections 2023-11-08T12:31:05.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcd40064ee0 0x7fcd40067390 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd5c15d740 0x7fcd5c158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd5c0b0900 0x7fcd5c1f1370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 --2- 172.21.15.112:0/3100209331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd5c0afbc0 0x7fcd5c1f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 >> 172.21.15.112:0/3100209331 conn(0x7fcd5c0ce7e0 msgr2=0x7fcd5c152410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:05.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 shutdown_connections 2023-11-08T12:31:05.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.369+0000 7fcd63a5b700 1 -- 172.21.15.112:0/3100209331 wait complete. 2023-11-08T12:31:05.376 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2023-11-08T12:31:05.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:31:05.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.569+0000 7f996e7fc700 1 Processor -- start 2023-11-08T12:31:05.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.569+0000 7f996e7fc700 1 -- start start 2023-11-08T12:31:05.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f996e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f996806ad70 0x7f9968165210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f996e7fc700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996815a850 con 0x7f99680c8d10 2023-11-08T12:31:05.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f996e7fc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680cada0 con 0x7f996815a480 2023-11-08T12:31:05.576 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f996e7fc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680cd0b0 con 0x7f996806ad70 2023-11-08T12:31:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f995ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f99680c8d10 0x7f99680cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43724/0 (socket says 172.21.15.112:43724) 2023-11-08T12:31:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f995ffff700 1 -- 172.21.15.112:0/2232105843 learned_addr learned my addr 172.21.15.112:0/2232105843 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f996cd99700 1 --2- 172.21.15.112:0/2232105843 >> v2:172.21.15.133:3300/0 conn(0x7f996806ad70 0x7f9968165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208637760 0 0) 0x7f996815a850 con 0x7f99680c8d10 2023-11-08T12:31:05.577 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99540035d0 con 0x7f99680c8d10 2023-11-08T12:31:05.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960909830 0 0) 0x7f99680cada0 con 0x7f996815a480 2023-11-08T12:31:05.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f996815a850 con 0x7f996815a480 2023-11-08T12:31:05.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403173245 0 0) 0x7f99540035d0 con 0x7f99680c8d10 2023-11-08T12:31:05.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 >> v2:172.21.15.133:3300/0 conn(0x7f996806ad70 msgr2=0x7f9968165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:05.578 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 --2- 172.21.15.112:0/2232105843 >> v2:172.21.15.133:3300/0 conn(0x7f996806ad70 0x7f9968165210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 >> v1:172.21.15.133:6789/0 conn(0x7f996815a480 legacy=0x7f99680cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680ce060 con 0x7f99680c8d10 2023-11-08T12:31:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f9950001670 con 0x7f99680c8d10 2023-11-08T12:31:05.579 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 >> v1:172.21.15.112:6789/0 conn(0x7f99680c8d10 legacy=0x7f99680cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9954003bb0 0x7f9954003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9954004870 0x7f9954004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.581 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f995400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680cd0b0 con 0x7f9954005220 2023-11-08T12:31:05.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995400c020 con 0x7f9954003bb0 2023-11-08T12:31:05.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.573+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995400c1e0 con 0x7f9954004870 2023-11-08T12:31:05.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f995400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.582 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f995ffff700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9954004870 0x7f9954004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f9967fff700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9954003bb0 0x7f9954003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 -- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9954004870 msgr2=0x7f9954004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9954004870 0x7f9954004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 -- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9954003bb0 msgr2=0x7f9954003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9954003bb0 0x7f9954003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 -- 172.21.15.112:0/2232105843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540035d0 con 0x7f9954005220 2023-11-08T12:31:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 -- 172.21.15.112:0/2232105843 reap_dead start 2023-11-08T12:31:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996cd99700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f995400ba30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9960009fc0 tx=0x7f99540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd5f7d9d3b1a607 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960003a40 con 0x7f9954005220 2023-11-08T12:31:05.584 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996000f040 con 0x7f9954005220 2023-11-08T12:31:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f99677fe700 1 -- 172.21.15.112:0/2232105843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9960003e00 con 0x7f9954005220 2023-11-08T12:31:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996e7fc700 1 -- 172.21.15.112:0/2232105843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 msgr2=0x7f995400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996e7fc700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f995400ba30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9960009fc0 tx=0x7f99540058a0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996e7fc700 1 -- 172.21.15.112:0/2232105843 shutdown_connections 2023-11-08T12:31:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996e7fc700 1 --2- 172.21.15.112:0/2232105843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f995400ba30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996e7fc700 1 -- 172.21.15.112:0/2232105843 >> 172.21.15.112:0/2232105843 conn(0x7f99680cf350 msgr2=0x7f99680b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:05.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996e7fc700 1 -- 172.21.15.112:0/2232105843 shutdown_connections 2023-11-08T12:31:05.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.577+0000 7f996e7fc700 1 -- 172.21.15.112:0/2232105843 wait complete. 2023-11-08T12:31:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.581+0000 7f996e7fc700 1 Processor -- start 2023-11-08T12:31:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.581+0000 7f996e7fc700 1 -- start start 2023-11-08T12:31:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f99680c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99680b3460 0x7f99680b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9968153710 0x7f9968153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968156260 con 0x7f9954005220 2023-11-08T12:31:05.588 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680b3fd0 con 0x7f99680b3460 2023-11-08T12:31:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9968156470 con 0x7f9968153710 2023-11-08T12:31:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f99680c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f99680c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36810/0 (socket says 172.21.15.112:36810) 2023-11-08T12:31:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 -- 172.21.15.112:0/3020683333 learned_addr learned my addr 172.21.15.112:0/3020683333 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:05.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f995ffff700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99680b3460 0x7f99680b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996cd99700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9968153710 0x7f9968153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 -- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9968153710 msgr2=0x7f9968153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9968153710 0x7f9968153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 -- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99680b3460 msgr2=0x7f99680b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99680b3460 0x7f99680b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 -- 172.21.15.112:0/3020683333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680caa30 con 0x7f9954005220 2023-11-08T12:31:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f9967fff700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f99680c7a10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f995800e7b0 tx=0x7f995800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f99657fa700 1 -- 172.21.15.112:0/3020683333 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580052e0 con 0x7f9954005220 2023-11-08T12:31:05.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f99657fa700 1 -- 172.21.15.112:0/3020683333 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958005460 con 0x7f9954005220 2023-11-08T12:31:05.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99680ce300 con 0x7f9954005220 2023-11-08T12:31:05.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f99657fa700 1 -- 172.21.15.112:0/3020683333 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580038e0 con 0x7f9954005220 2023-11-08T12:31:05.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.585+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99680add50 con 0x7f9954005220 2023-11-08T12:31:05.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.589+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99680726c0 con 0x7f9954005220 2023-11-08T12:31:05.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.589+0000 7f99657fa700 1 -- 172.21.15.112:0/3020683333 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f995801b030 con 0x7f9954005220 2023-11-08T12:31:05.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.593+0000 7f99657fa700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9948064f10 0x7f99480673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:05.594 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.593+0000 7f99657fa700 1 -- 172.21.15.112:0/3020683333 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9958081760 con 0x7f9954005220 2023-11-08T12:31:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.593+0000 7f995ffff700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9948064f10 0x7f99480673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:05.595 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.593+0000 7f995ffff700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9948064f10 0x7f99480673c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9950008bf0 tx=0x7f99500048b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:05.599 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.597+0000 7f99657fa700 1 -- 172.21.15.112:0/3020683333 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f995804f6d0 con 0x7f9954005220 2023-11-08T12:31:05.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.801+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99680c9a20 con 0x7f9954005220 2023-11-08T12:31:05.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.801+0000 7f99657fa700 1 -- 172.21.15.112:0/3020683333 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f9958019090 con 0x7f9954005220 2023-11-08T12:31:05.805 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:05.806 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:55.282749+0000","modified":"2023-11-08T12:30:58.314109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2843990803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2843990803},{"type":"v1","addr":"172.21.15.112:6837","nonce":2843990803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T12:31:05.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9948064f10 msgr2=0x7f99480673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9948064f10 0x7f99480673c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9950008bf0 tx=0x7f99500048b0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 msgr2=0x7f99680c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:05.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f99680c7a10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f995800e7b0 tx=0x7f995800eac0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 shutdown_connections 2023-11-08T12:31:05.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9948064f10 0x7f99480673c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9968153710 0x7f9968153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99680b3460 0x7f99680b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 --2- 172.21.15.112:0/3020683333 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9954005220 0x7f99680c7a10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 >> 172.21.15.112:0/3020683333 conn(0x7f99680cf350 msgr2=0x7f99681547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:05.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 shutdown_connections 2023-11-08T12:31:05.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:05.809+0000 7f996e7fc700 1 -- 172.21.15.112:0/3020683333 wait complete. 2023-11-08T12:31:05.813 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 32 2023-11-08T12:31:06.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-08T12:30:55.282749+0000', 'modified': '2023-11-08T12:30:58.314109+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6282': {'gid': 6282, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/2843990803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 2843990803}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 2843990803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-08T12:31:06.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-08T12:31:06.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-08T12:31:06.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.408+0000 7febbbe5b700 1 Processor -- start 2023-11-08T12:31:06.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.408+0000 7febbbe5b700 1 -- start start 2023-11-08T12:31:06.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febbbe5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febb41534a0 0x7febb415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febbbe5b700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febb40b6200 0x7febb4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febbbe5b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb415d080 con 0x7febb4160920 2023-11-08T12:31:06.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febbbe5b700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb4153870 con 0x7febb40b6200 2023-11-08T12:31:06.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febbbe5b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb40b53c0 con 0x7febb41534a0 2023-11-08T12:31:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febba3f8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7febb40b6200 0x7febb4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febb93f6700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7febb4160920 0x7febb40b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43738/0 (socket says 172.21.15.112:43738) 2023-11-08T12:31:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febb93f6700 1 -- 172.21.15.112:0/424901250 learned_addr learned my addr 172.21.15.112:0/424901250 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:06.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febb9bf7700 1 --2- 172.21.15.112:0/424901250 >> v2:172.21.15.133:3300/0 conn(0x7febb41534a0 0x7febb415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febba3f8700 1 -- 172.21.15.112:0/424901250 >> v2:172.21.15.133:3300/0 conn(0x7febb41534a0 msgr2=0x7febb415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febba3f8700 1 --2- 172.21.15.112:0/424901250 >> v2:172.21.15.133:3300/0 conn(0x7febb41534a0 0x7febb415d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febba3f8700 1 -- 172.21.15.112:0/424901250 >> v1:172.21.15.112:6789/0 conn(0x7febb4160920 legacy=0x7febb40b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febba3f8700 1 -- 172.21.15.112:0/424901250 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40b56a0 con 0x7febb40b6200 2023-11-08T12:31:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febba3f8700 1 --2- 172.21.15.112:0/424901250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb4070630 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7febb406ff60 tx=0x7febac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c2fc2c3d6a6ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febb8bf5700 1 -- 172.21.15.112:0/424901250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00e070 con 0x7febb40b6200 2023-11-08T12:31:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febb8bf5700 1 -- 172.21.15.112:0/424901250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac00bbd0 con 0x7febb40b6200 2023-11-08T12:31:06.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.412+0000 7febb8bf5700 1 -- 172.21.15.112:0/424901250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac012430 con 0x7febb40b6200 2023-11-08T12:31:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 -- 172.21.15.112:0/424901250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 msgr2=0x7febb4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 --2- 172.21.15.112:0/424901250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb4070630 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7febb406ff60 tx=0x7febac00b330 comp rx=0 tx=0).stop 2023-11-08T12:31:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 -- 172.21.15.112:0/424901250 shutdown_connections 2023-11-08T12:31:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 --2- 172.21.15.112:0/424901250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb4070630 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 --2- 172.21.15.112:0/424901250 >> v2:172.21.15.133:3300/0 conn(0x7febb41534a0 0x7febb415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 -- 172.21.15.112:0/424901250 >> 172.21.15.112:0/424901250 conn(0x7febb406bfc0 msgr2=0x7febb406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 -- 172.21.15.112:0/424901250 shutdown_connections 2023-11-08T12:31:06.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.416+0000 7febbbe5b700 1 -- 172.21.15.112:0/424901250 wait complete. 2023-11-08T12:31:06.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 Processor -- start 2023-11-08T12:31:06.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 -- start start 2023-11-08T12:31:06.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb413c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febb41534a0 0x7febb415fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb4160920 0x7febb4160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb413cc30 con 0x7febb40b6200 2023-11-08T12:31:06.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb41562c0 con 0x7febb4160920 2023-11-08T12:31:06.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb41565a0 con 0x7febb41534a0 2023-11-08T12:31:06.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb413c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb413c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36828/0 (socket says 172.21.15.112:36828) 2023-11-08T12:31:06.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 -- 172.21.15.112:0/449905089 learned_addr learned my addr 172.21.15.112:0/449905089 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:06.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb93f6700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febb41534a0 0x7febb415fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 -- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febb41534a0 msgr2=0x7febb415fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febba3f8700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb4160920 0x7febb4160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febb41534a0 0x7febb415fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 -- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb4160920 msgr2=0x7febb4160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb4160920 0x7febb4160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 -- 172.21.15.112:0/449905089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac009a70 con 0x7febb40b6200 2023-11-08T12:31:06.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb93f6700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febb41534a0 0x7febb415fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:06.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febba3f8700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb4160920 0x7febb4160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:06.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febb9bf7700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb413c6f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7febb000e760 tx=0x7febb000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febaa7fc700 1 -- 172.21.15.112:0/449905089 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0013610 con 0x7febb40b6200 2023-11-08T12:31:06.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febaa7fc700 1 -- 172.21.15.112:0/449905089 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0013770 con 0x7febb40b6200 2023-11-08T12:31:06.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febaa7fc700 1 -- 172.21.15.112:0/449905089 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0013ae0 con 0x7febb40b6200 2023-11-08T12:31:06.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.420+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb415cd10 con 0x7febb40b6200 2023-11-08T12:31:06.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.424+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb415ca30 con 0x7febb40b6200 2023-11-08T12:31:06.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.424+0000 7febaa7fc700 1 -- 172.21.15.112:0/449905089 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7febb0023070 con 0x7febb40b6200 2023-11-08T12:31:06.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.424+0000 7febaa7fc700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb98064f30 0x7feb980673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.424+0000 7febaa7fc700 1 -- 172.21.15.112:0/449905089 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7febb0081bf0 con 0x7febb40b6200 2023-11-08T12:31:06.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.428+0000 7febb93f6700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb98064f30 0x7feb980673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.428+0000 7febb93f6700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb98064f30 0x7feb980673e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7febb4154d90 tx=0x7feba4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.428+0000 7febbf0e3740 1 Processor -- start 2023-11-08T12:31:06.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 -- start start 2023-11-08T12:31:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5ae0 0x19a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x19a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1740790 0x19a6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1864ae0 con 0x16f5ae0 2023-11-08T12:31:06.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d4bd0 con 0x16f5710 2023-11-08T12:31:06.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x18cded0 con 0x1740790 2023-11-08T12:31:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5ae0 0x19a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5ae0 0x19a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36832/0 (socket says 172.21.15.112:36832) 2023-11-08T12:31:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 -- 172.21.15.112:0/2898881709 learned_addr learned my addr 172.21.15.112:0/2898881709 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febba3f8700 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1740790 0x19a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb93f6700 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x19a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 -- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1740790 msgr2=0x19a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1740790 0x19a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 -- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 msgr2=0x19a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x19a6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 -- 172.21.15.112:0/2898881709 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18f3cc0 con 0x16f5ae0 2023-11-08T12:31:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febba3f8700 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1740790 0x19a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febb9bf7700 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5ae0 0x19a5e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7febb0051ce0 tx=0x7febb0051d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40384a4b5e4b2326 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7feb977fe700 1 -- 172.21.15.112:0/2898881709 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb005b5b0 con 0x16f5ae0 2023-11-08T12:31:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7feb977fe700 1 -- 172.21.15.112:0/2898881709 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb005b710 con 0x16f5ae0 2023-11-08T12:31:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7feb977fe700 1 -- 172.21.15.112:0/2898881709 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb005b880 con 0x16f5ae0 2023-11-08T12:31:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 -- 172.21.15.112:0/2898881709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5ae0 msgr2=0x19a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5ae0 0x19a5e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7febb0051ce0 tx=0x7febb0051d50 comp rx=0 tx=0).stop 2023-11-08T12:31:06.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 -- 172.21.15.112:0/2898881709 shutdown_connections 2023-11-08T12:31:06.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1740790 0x19a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x19a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 --2- 172.21.15.112:0/2898881709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5ae0 0x19a5e00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.432+0000 7febbf0e3740 1 -- 172.21.15.112:0/2898881709 >> 172.21.15.112:0/2898881709 conn(0x16f5eb0 msgr2=0x198e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.436+0000 7febbf0e3740 1 -- 172.21.15.112:0/2898881709 shutdown_connections 2023-11-08T12:31:06.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.436+0000 7febbf0e3740 1 -- 172.21.15.112:0/2898881709 wait complete. 2023-11-08T12:31:06.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.436+0000 7febbf0e3740 1 -- start start 2023-11-08T12:31:06.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.436+0000 7febbf0e3740 1 Processor -- start 2023-11-08T12:31:06.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.436+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x1966d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5ae0 0x198cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1740790 0x1967830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x177ab20 con 0x1740790 2023-11-08T12:31:06.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x198cff0 con 0x16f5710 2023-11-08T12:31:06.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x195d380 con 0x16f5ae0 2023-11-08T12:31:06.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 10 client.0 _ll_register_callbacks cb 0x192a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:06.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1740790 0x1967830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1740790 0x1967830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36848/0 (socket says 172.21.15.112:36848) 2023-11-08T12:31:06.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 -- 172.21.15.112:0/1778456279 learned_addr learned my addr 172.21.15.112:0/1778456279 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:06.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febb9bf7700 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x1966d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febb93f6700 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5ae0 0x198cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 -- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5ae0 msgr2=0x198cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5ae0 0x198cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 -- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 msgr2=0x1966d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x1966d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 -- 172.21.15.112:0/1778456279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb415ca30 con 0x1740790 2023-11-08T12:31:06.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febba3f8700 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1740790 0x1967830 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7febac00b730 tx=0x7febac004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9959a6cf347da2f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7feb94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:06.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7feb94ff9700 1 -- 172.21.15.112:0/1778456279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac012e00 con 0x1740790 2023-11-08T12:31:06.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7feb94ff9700 1 -- 172.21.15.112:0/1778456279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7febac022070 con 0x1740790 2023-11-08T12:31:06.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18c6f50 con 0x1740790 2023-11-08T12:31:06.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7feb94ff9700 1 -- 172.21.15.112:0/1778456279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7febac0098f0 con 0x1740790 2023-11-08T12:31:06.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 10 client.6441 fetch_fsmap learned FSMap version 32 2023-11-08T12:31:06.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x17419e0 con 0x1740790 2023-11-08T12:31:06.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7feb94ff9700 1 -- 172.21.15.112:0/1778456279 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18c6f50 con 0x1740790 2023-11-08T12:31:06.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7feb94ff9700 1 -- 172.21.15.112:0/1778456279 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7febac004040 con 0x1740790 2023-11-08T12:31:06.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 10 client.6441 fetch_fsmap finished waiting for FSMap version 32 2023-11-08T12:31:06.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 10 client.6441 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T12:31:06.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 20 client.6441 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:06.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19a86b0 0x19a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 4 client.6441 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:31:06.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x18c6c70 con 0x19a86b0 2023-11-08T12:31:06.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.440+0000 7febb9bf7700 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19a86b0 0x19a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febb9bf7700 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19a86b0 0x19a8a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d31d5eca0e022d6e server_cookie=8280f2d7b58cca33 in_seq=0 out_seq=0 2023-11-08T12:31:06.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7feb94ff9700 10 client.6441 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:06.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7feb94ff9700 1 -- 172.21.15.112:0/1778456279 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x18c6c70 con 0x19a86b0 2023-11-08T12:31:06.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7feb94ff9700 10 client.6441 handle_command_reply: tid=0 2023-11-08T12:31:06.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 client.6441 shutdown 2023-11-08T12:31:06.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1740790 msgr2=0x1967830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1740790 0x1967830 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7febac00b730 tx=0x7febac004b60 comp rx=0 tx=0).stop 2023-11-08T12:31:06.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 shutdown_connections 2023-11-08T12:31:06.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19a86b0 0x19a8a80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1740790 0x1967830 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5ae0 0x198cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 --2- 172.21.15.112:0/1778456279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5710 0x1966d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7feb94ff9700 0 client.6441 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:06.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 >> 172.21.15.112:0/1778456279 conn(0x16f5eb0 msgr2=0x198e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 shutdown_connections 2023-11-08T12:31:06.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 1 -- 172.21.15.112:0/1778456279 wait complete. 2023-11-08T12:31:06.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.444+0000 7febbf0e3740 20 client.6441 trim_cache size 0 max 16384 2023-11-08T12:31:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 Processor -- start 2023-11-08T12:31:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 -- start start 2023-11-08T12:31:06.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x198b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x198bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x1962e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d0a30 con 0x16f5710 2023-11-08T12:31:06.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18ccd60 con 0x16f5ae0 2023-11-08T12:31:06.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x18c9840 con 0x16f5eb0 2023-11-08T12:31:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febb93f6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x198bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febb93f6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x198bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36858/0 (socket says 172.21.15.112:36858) 2023-11-08T12:31:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.464+0000 7febb93f6700 1 -- 172.21.15.112:0/3155278640 learned_addr learned my addr 172.21.15.112:0/3155278640 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:06.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febb9bf7700 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x198b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febba3f8700 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x1962e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febb93f6700 1 -- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 msgr2=0x198b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febb93f6700 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x198b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febb93f6700 1 -- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 msgr2=0x1962e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febb93f6700 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x1962e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febb93f6700 1 -- 172.21.15.112:0/3155278640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40d0e00 con 0x16f5710 2023-11-08T12:31:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febb93f6700 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x198bef0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feba4005b90 tx=0x7feba4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0beb71d2ed88e76 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7feb97fff700 1 -- 172.21.15.112:0/3155278640 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4005ea0 con 0x16f5710 2023-11-08T12:31:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7feb97fff700 1 -- 172.21.15.112:0/3155278640 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba401a030 con 0x16f5710 2023-11-08T12:31:06.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7feb97fff700 1 -- 172.21.15.112:0/3155278640 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4012410 con 0x16f5710 2023-11-08T12:31:06.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 -- 172.21.15.112:0/3155278640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 msgr2=0x198bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x198bef0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feba4005b90 tx=0x7feba4011000 comp rx=0 tx=0).stop 2023-11-08T12:31:06.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 -- 172.21.15.112:0/3155278640 shutdown_connections 2023-11-08T12:31:06.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x1962e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x198bef0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 --2- 172.21.15.112:0/3155278640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x198b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 -- 172.21.15.112:0/3155278640 >> 172.21.15.112:0/3155278640 conn(0x198cc20 msgr2=0x19a7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 -- 172.21.15.112:0/3155278640 shutdown_connections 2023-11-08T12:31:06.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 -- 172.21.15.112:0/3155278640 wait complete. 2023-11-08T12:31:06.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 -- start start 2023-11-08T12:31:06.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.468+0000 7febbf0e3740 1 Processor -- start 2023-11-08T12:31:06.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x1a118c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x19866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x1986bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x18cb2d0 con 0x16f5710 2023-11-08T12:31:06.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d5e60 con 0x16f5ae0 2023-11-08T12:31:06.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1864ae0 con 0x16f5eb0 2023-11-08T12:31:06.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 10 client.0 _ll_register_callbacks cb 0x187a2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:06.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x1a118c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x1a118c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36862/0 (socket says 172.21.15.112:36862) 2023-11-08T12:31:06.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 -- 172.21.15.112:0/269488353 learned_addr learned my addr 172.21.15.112:0/269488353 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:06.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febba3f8700 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x1986bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb93f6700 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x19866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 -- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 msgr2=0x1986bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x1986bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 -- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 msgr2=0x19866b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x19866b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 -- 172.21.15.112:0/269488353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb415d080 con 0x16f5710 2023-11-08T12:31:06.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb9bf7700 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x1a118c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7febb004feb0 tx=0x7febb0056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc212ac5fa86cfc server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7feb94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:06.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7feb94ff9700 1 -- 172.21.15.112:0/269488353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb005b5b0 con 0x16f5710 2023-11-08T12:31:06.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7feb94ff9700 1 -- 172.21.15.112:0/269488353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7febb0060040 con 0x16f5710 2023-11-08T12:31:06.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febb005b710 con 0x16f5710 2023-11-08T12:31:06.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7feb94ff9700 1 -- 172.21.15.112:0/269488353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7febb0053310 con 0x16f5710 2023-11-08T12:31:06.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 10 client.6447 fetch_fsmap learned FSMap version 32 2023-11-08T12:31:06.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x187aa20 con 0x16f5710 2023-11-08T12:31:06.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7feb94ff9700 1 -- 172.21.15.112:0/269488353 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb005b710 con 0x16f5710 2023-11-08T12:31:06.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7feb94ff9700 1 -- 172.21.15.112:0/269488353 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7febb0052910 con 0x16f5710 2023-11-08T12:31:06.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 10 client.6447 fetch_fsmap finished waiting for FSMap version 32 2023-11-08T12:31:06.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 10 client.6447 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-08T12:31:06.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 20 client.6447 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:06.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x1740790 0x1987130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 4 client.6447 mds_command: new command op to 6282 tid=0[{"prefix": "status"}] 2023-11-08T12:31:06.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1772260 con 0x1740790 2023-11-08T12:31:06.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.472+0000 7febb93f6700 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x1740790 0x1987130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febb93f6700 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x1740790 0x1987130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9ffc70ce702f13 server_cookie=5fa1fa5a87f05800 in_seq=0 out_seq=0 2023-11-08T12:31:06.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7feb94ff9700 10 client.6447 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:06.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7feb94ff9700 1 -- 172.21.15.112:0/269488353 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1772260 con 0x1740790 2023-11-08T12:31:06.490 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7feb94ff9700 10 client.6447 handle_command_reply: tid=0 2023-11-08T12:31:06.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 client.6447 shutdown 2023-11-08T12:31:06.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 msgr2=0x1a118c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x1a118c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7febb004feb0 tx=0x7febb0056000 comp rx=0 tx=0).stop 2023-11-08T12:31:06.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 shutdown_connections 2023-11-08T12:31:06.491 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x1740790 0x1987130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16f5eb0 0x1986bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16f5ae0 0x19866b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7feb94ff9700 0 client.6447 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:06.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 --2- 172.21.15.112:0/269488353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16f5710 0x1a118c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.492 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 >> 172.21.15.112:0/269488353 conn(0x198cc20 msgr2=0x198be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 shutdown_connections 2023-11-08T12:31:06.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 1 -- 172.21.15.112:0/269488353 wait complete. 2023-11-08T12:31:06.493 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbf0e3740 20 client.6447 trim_cache size 0 max 16384 2023-11-08T12:31:06.493 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:31:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "c14663df-4425-4498-9232-3ffa5f578bfa", 2023-11-08T12:31:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2023-11-08T12:31:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6282, 2023-11-08T12:31:06.494 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2023-11-08T12:31:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2023-11-08T12:31:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2023-11-08T12:31:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 11.189875004999999, 2023-11-08T12:31:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 32, 2023-11-08T12:31:06.495 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 70, 2023-11-08T12:31:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 70, 2023-11-08T12:31:06.496 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 17.044325549 2023-11-08T12:31:06.496 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:31:06.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb98064f30 msgr2=0x7feb980673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb98064f30 0x7feb980673e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7febb4154d90 tx=0x7feba4009040 comp rx=0 tx=0).stop 2023-11-08T12:31:06.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 msgr2=0x7febb413c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.497 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb413c6f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7febb000e760 tx=0x7febb000eb20 comp rx=0 tx=0).stop 2023-11-08T12:31:06.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 shutdown_connections 2023-11-08T12:31:06.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7feb98064f30 0x7feb980673e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb4160920 0x7febb4160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febb41534a0 0x7febb415fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.498 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 --2- 172.21.15.112:0/449905089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febb40b6200 0x7febb413c6f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 >> 172.21.15.112:0/449905089 conn(0x7febb406bfc0 msgr2=0x7febb415b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 shutdown_connections 2023-11-08T12:31:06.499 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.476+0000 7febbbe5b700 1 -- 172.21.15.112:0/449905089 wait complete. 2023-11-08T12:31:06.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-08T12:31:06.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.668+0000 7f7725fa8700 1 Processor -- start 2023-11-08T12:31:06.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.668+0000 7f7725fa8700 1 -- start start 2023-11-08T12:31:06.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7725fa8700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f772015c650 0x7f772006b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7725fa8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f772006bed0 0x7f772006c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7725fa8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77200c9d40 con 0x7f77200cd0d0 2023-11-08T12:31:06.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7725fa8700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772006b140 con 0x7f772015c650 2023-11-08T12:31:06.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7725fa8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772006c830 con 0x7f772006bed0 2023-11-08T12:31:06.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f772015c650 0x7f772006b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f772015c650 0x7f772006b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36864/0 (socket says 172.21.15.112:36864) 2023-11-08T12:31:06.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 -- 172.21.15.112:0/1631928594 learned_addr learned my addr 172.21.15.112:0/1631928594 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:06.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f77257a7700 1 --2- 172.21.15.112:0/1631928594 >> v2:172.21.15.133:3300/0 conn(0x7f772006bed0 0x7f772006c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 -- 172.21.15.112:0/1631928594 >> v2:172.21.15.133:3300/0 conn(0x7f772006bed0 msgr2=0x7f772006c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:06.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 --2- 172.21.15.112:0/1631928594 >> v2:172.21.15.133:3300/0 conn(0x7f772006bed0 0x7f772006c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 -- 172.21.15.112:0/1631928594 >> v1:172.21.15.112:6789/0 conn(0x7f77200cd0d0 legacy=0x7f77200b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 -- 172.21.15.112:0/1631928594 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772006b820 con 0x7f772015c650 2023-11-08T12:31:06.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f7724fa6700 1 --2- 172.21.15.112:0/1631928594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772015c650 0x7f772006b2e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f772006fe30 tx=0x7f7710009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ef0a24814af6b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f771f7fe700 1 -- 172.21.15.112:0/1631928594 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000b8a0 con 0x7f772015c650 2023-11-08T12:31:06.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f771f7fe700 1 -- 172.21.15.112:0/1631928594 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771000ba00 con 0x7f772015c650 2023-11-08T12:31:06.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.672+0000 7f771f7fe700 1 -- 172.21.15.112:0/1631928594 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000bd90 con 0x7f772015c650 2023-11-08T12:31:06.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 -- 172.21.15.112:0/1631928594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772015c650 msgr2=0x7f772006b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1631928594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772015c650 0x7f772006b2e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f772006fe30 tx=0x7f7710009bf0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 -- 172.21.15.112:0/1631928594 shutdown_connections 2023-11-08T12:31:06.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1631928594 >> v2:172.21.15.133:3300/0 conn(0x7f772006bed0 0x7f772006c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1631928594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772015c650 0x7f772006b2e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 -- 172.21.15.112:0/1631928594 >> 172.21.15.112:0/1631928594 conn(0x7f77200b0f80 msgr2=0x7f77200ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 -- 172.21.15.112:0/1631928594 shutdown_connections 2023-11-08T12:31:06.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.676+0000 7f7725fa8700 1 -- 172.21.15.112:0/1631928594 wait complete. 2023-11-08T12:31:06.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 Processor -- start 2023-11-08T12:31:06.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 -- start start 2023-11-08T12:31:06.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772006bed0 0x7f77201500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77200cd0d0 0x7f77201f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772015c650 0x7f77201f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772014d3d0 con 0x7f772006bed0 2023-11-08T12:31:06.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77200c5100 con 0x7f77200cd0d0 2023-11-08T12:31:06.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7725fa8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7720150600 con 0x7f772015c650 2023-11-08T12:31:06.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772006bed0 0x7f77201500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772006bed0 0x7f77201500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36874/0 (socket says 172.21.15.112:36874) 2023-11-08T12:31:06.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 -- 172.21.15.112:0/1673792382 learned_addr learned my addr 172.21.15.112:0/1673792382 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:06.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f77257a7700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772015c650 0x7f77201f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f771ffff700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77200cd0d0 0x7f77201f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 -- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772015c650 msgr2=0x7f77201f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772015c650 0x7f77201f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 -- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77200cd0d0 msgr2=0x7f77201f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77200cd0d0 0x7f77201f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.680+0000 7f7724fa6700 1 -- 172.21.15.112:0/1673792382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710009570 con 0x7f772006bed0 2023-11-08T12:31:06.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f7724fa6700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772006bed0 0x7f77201500c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f772006bc30 tx=0x7f7710004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f771d7fa700 1 -- 172.21.15.112:0/1673792382 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77100038c0 con 0x7f772006bed0 2023-11-08T12:31:06.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f771d7fa700 1 -- 172.21.15.112:0/1673792382 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771001f070 con 0x7f772006bed0 2023-11-08T12:31:06.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77200cd5d0 con 0x7f772006bed0 2023-11-08T12:31:06.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f771d7fa700 1 -- 172.21.15.112:0/1673792382 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710003c60 con 0x7f772006bed0 2023-11-08T12:31:06.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77200b1d50 con 0x7f772006bed0 2023-11-08T12:31:06.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77200cd8b0 con 0x7f772006bed0 2023-11-08T12:31:06.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.684+0000 7f771d7fa700 1 -- 172.21.15.112:0/1673792382 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f771000f050 con 0x7f772006bed0 2023-11-08T12:31:06.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.688+0000 7f771d7fa700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f770c064ee0 0x7f770c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:06.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.688+0000 7f771d7fa700 1 -- 172.21.15.112:0/1673792382 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7710021070 con 0x7f772006bed0 2023-11-08T12:31:06.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.688+0000 7f771ffff700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f770c064ee0 0x7f770c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:06.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.688+0000 7f771ffff700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f770c064ee0 0x7f770c067390 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77200ad370 tx=0x7f7714009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:06.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.696+0000 7f771d7fa700 1 -- 172.21.15.112:0/1673792382 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7710051b80 con 0x7f772006bed0 2023-11-08T12:31:06.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.900+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7720073cb0 con 0x7f772006bed0 2023-11-08T12:31:06.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.900+0000 7f771d7fa700 1 -- 172.21.15.112:0/1673792382 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7710015060 con 0x7f772006bed0 2023-11-08T12:31:06.904 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-08T12:31:06.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f770c064ee0 msgr2=0x7f770c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f770c064ee0 0x7f770c067390 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77200ad370 tx=0x7f7714009040 comp rx=0 tx=0).stop 2023-11-08T12:31:06.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772006bed0 msgr2=0x7f77201500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:06.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772006bed0 0x7f77201500c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f772006bc30 tx=0x7f7710004770 comp rx=0 tx=0).stop 2023-11-08T12:31:06.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 shutdown_connections 2023-11-08T12:31:06.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f770c064ee0 0x7f770c067390 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772015c650 0x7f77201f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77200cd0d0 0x7f77201f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 --2- 172.21.15.112:0/1673792382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f772006bed0 0x7f77201500c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:06.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 >> 172.21.15.112:0/1673792382 conn(0x7f77200b0f80 msgr2=0x7f77200ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:06.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 shutdown_connections 2023-11-08T12:31:06.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:06.904+0000 7f7725fa8700 1 -- 172.21.15.112:0/1673792382 wait complete. 2023-11-08T12:31:06.927 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-08T12:31:06.927 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-08T12:31:06.928 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2023-11-08T12:31:06.928 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-08T12:31:06.928 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-08T12:31:06.929 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-08T12:31:06.929 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-08T12:31:06.929 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-08T12:31:06.930 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:31:06.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:06.930 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2023-11-08T12:31:06.948 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-08T12:31:06.949 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-08T12:31:06.949 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2023-11-08T12:31:06.949 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.949 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2023-11-08T12:31:06.949 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.950 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:31:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:31:06.950 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2023-11-08T12:31:06.950 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:31:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2023-11-08T12:31:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2023-11-08T12:31:06.951 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-08T12:31:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:31:06.951 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-08T12:31:06.952 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:31:06.952 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-08T12:31:06.952 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42164sec preferred_lft 42164sec 2023-11-08T12:31:06.952 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2023-11-08T12:31:06.952 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.953 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-08T12:31:06.953 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:61:4e:41:39 brd ff:ff:ff:ff:ff:ff 2023-11-08T12:31:06.953 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-08T12:31:06.953 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.953 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-08T12:31:06.954 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:b3:c1:35:93:6c brd ff:ff:ff:ff:ff:ff 2023-11-08T12:31:06.954 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-08T12:31:06.954 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.954 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::e41f:52ff:fe23:f36d/64 scope link 2023-11-08T12:31:06.954 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.955 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:31:06.955 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2e:62:07:0d:fa:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T12:31:06.955 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2c62:7ff:fe0d:fa29/64 scope link 2023-11-08T12:31:06.955 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.955 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-08T12:31:06.956 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 26:b3:c1:35:93:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T12:31:06.956 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::24b3:c1ff:fe35:936c/64 scope link 2023-11-08T12:31:06.956 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2023-11-08T12:31:06.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:06.958 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-08T12:31:07.039 INFO:teuthology.orchestra.run.smithi112.stdout:1 2023-11-08T12:31:07.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.042 DEBUG:teuthology.orchestra.run.smithi112:> route 2023-11-08T12:31:07.107 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2023-11-08T12:31:07.108 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-08T12:31:07.108 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-08T12:31:07.108 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-08T12:31:07.108 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-08T12:31:07.108 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-08T12:31:07.109 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-08T12:31:07.109 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-08T12:31:07.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.110 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec bash -c ' 2023-11-08T12:31:07.110 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2023-11-08T12:31:07.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-08T12:31:07.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-08T12:31:07.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-08T12:31:07.112 DEBUG:teuthology.orchestra.run.smithi112:> ') 2023-11-08T12:31:07.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.246 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:31:07.265 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T12:31:07.265 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T12:31:07.266 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:31:07.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.267 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2023-11-08T12:31:07.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:31:07.349 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-08T12:31:07.408 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-08T12:31:07.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-08T12:31:07.409 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:31:07.468 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-08T12:31:07.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:31:07.595 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:31:07.596 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:31:07.620 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-08T12:31:07.620 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-08T12:31:07.620 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.112:3300,172.21.15.133:3300,172.21.15.133:3301" 2023-11-08T12:31:07.621 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with new device syntax: 0@c14663df-4425-4498-9232-3ffa5f578bfa.cephfs=/ 2023-11-08T12:31:07.621 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.112:3300/172.21.15.133:3300/172.21.15.133:3301" will pass to kernel 2023-11-08T12:31:07.627 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-08T12:31:07.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-08T12:31:07.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.659 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-08T12:31:07.737 INFO:teuthology.orchestra.run.smithi112.stdout:client6229 2023-11-08T12:31:07.737 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:31:07.738 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:31:07.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.800 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2023-11-08T12:31:07.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:31:07.876 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2023-11-08T12:31:07.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:31:07.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:31:07.942 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-08T12:31:07.942 DEBUG:teuthology.orchestra.run.smithi112:> import os 2023-11-08T12:31:07.943 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2023-11-08T12:31:07.943 DEBUG:teuthology.orchestra.run.smithi112:> 2023-11-08T12:31:07.943 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2023-11-08T12:31:07.944 DEBUG:teuthology.orchestra.run.smithi112:> ' 2023-11-08T12:31:08.080 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627777 2023-11-08T12:31:08.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:31:08.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.460+0000 7ff3a06fa700 1 Processor -- start 2023-11-08T12:31:08.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff3a06fa700 1 -- start start 2023-11-08T12:31:08.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff3a06fa700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3980c8d10 0x7ff3980cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff3a06fa700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39815a850 con 0x7ff398069d60 2023-11-08T12:31:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff3a06fa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980cada0 con 0x7ff39815a480 2023-11-08T12:31:08.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff3a06fa700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3980ce060 con 0x7ff3980c8d10 2023-11-08T12:31:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff39dc95700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3980c8d10 0x7ff3980cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff39dc95700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3980c8d10 0x7ff3980cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36888/0 (socket says 172.21.15.112:36888) 2023-11-08T12:31:08.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff39dc95700 1 -- 172.21.15.112:0/1058388027 learned_addr learned my addr 172.21.15.112:0/1058388027 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff39dc95700 1 -- 172.21.15.112:0/1058388027 >> v1:172.21.15.133:6789/0 conn(0x7ff39815a480 legacy=0x7ff3980cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff39dc95700 1 -- 172.21.15.112:0/1058388027 >> v1:172.21.15.112:6789/0 conn(0x7ff398069d60 legacy=0x7ff39806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff39d494700 1 -- 172.21.15.112:0/1058388027 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685316398 0 0) 0x7ff3980cada0 con 0x7ff39815a480 2023-11-08T12:31:08.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.464+0000 7ff39dc95700 1 -- 172.21.15.112:0/1058388027 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980ce300 con 0x7ff3980c8d10 2023-11-08T12:31:08.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff39dc95700 1 --2- 172.21.15.112:0/1058388027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3980c8d10 0x7ff3980cc9a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff388009910 tx=0x7ff388009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385a7c3417b74022 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:08.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff39d494700 1 -- 172.21.15.112:0/1058388027 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800ba60 con 0x7ff3980c8d10 2023-11-08T12:31:08.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff39d494700 1 -- 172.21.15.112:0/1058388027 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38800bbc0 con 0x7ff3980c8d10 2023-11-08T12:31:08.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff39d494700 1 -- 172.21.15.112:0/1058388027 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388009e60 con 0x7ff3980c8d10 2023-11-08T12:31:08.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff3a06fa700 1 -- 172.21.15.112:0/1058388027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3980c8d10 msgr2=0x7ff3980cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/1058388027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3980c8d10 0x7ff3980cc9a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff388009910 tx=0x7ff388009c20 comp rx=0 tx=0).stop 2023-11-08T12:31:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff3a06fa700 1 -- 172.21.15.112:0/1058388027 shutdown_connections 2023-11-08T12:31:08.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/1058388027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3980c8d10 0x7ff3980cc9a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff3a06fa700 1 -- 172.21.15.112:0/1058388027 >> 172.21.15.112:0/1058388027 conn(0x7ff3980cf350 msgr2=0x7ff3980b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff3a06fa700 1 -- 172.21.15.112:0/1058388027 shutdown_connections 2023-11-08T12:31:08.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.468+0000 7ff3a06fa700 1 -- 172.21.15.112:0/1058388027 wait complete. 2023-11-08T12:31:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 Processor -- start 2023-11-08T12:31:08.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 -- start start 2023-11-08T12:31:08.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398069d60 0x7ff39806d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:08.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3980c8d10 0x7ff3981f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39815a480 0x7ff3980b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39806dba0 con 0x7ff398069d60 2023-11-08T12:31:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39806ca60 con 0x7ff39815a480 2023-11-08T12:31:08.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff3a06fa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39806bca0 con 0x7ff3980c8d10 2023-11-08T12:31:08.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398069d60 0x7ff39806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:08.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398069d60 0x7ff39806d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36890/0 (socket says 172.21.15.112:36890) 2023-11-08T12:31:08.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 -- 172.21.15.112:0/2943499835 learned_addr learned my addr 172.21.15.112:0/2943499835 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:08.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39ec97700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39815a480 0x7ff3980b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:08.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39dc95700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3980c8d10 0x7ff3981f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:08.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 -- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3980c8d10 msgr2=0x7ff3981f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:08.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3980c8d10 0x7ff3981f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:08.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 -- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39815a480 msgr2=0x7ff3980b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:08.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39815a480 0x7ff3980b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:08.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39e496700 1 -- 172.21.15.112:0/2943499835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388009570 con 0x7ff398069d60 2023-11-08T12:31:08.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.472+0000 7ff39dc95700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3980c8d10 0x7ff3981f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:08.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.476+0000 7ff39e496700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398069d60 0x7ff39806d370 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c520 tx=0x7ff39400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:08.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.476+0000 7ff38effd700 1 -- 172.21.15.112:0/2943499835 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940054e0 con 0x7ff398069d60 2023-11-08T12:31:08.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.476+0000 7ff38effd700 1 -- 172.21.15.112:0/2943499835 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3940036a0 con 0x7ff398069d60 2023-11-08T12:31:08.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.476+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3980add50 con 0x7ff398069d60 2023-11-08T12:31:08.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.476+0000 7ff38effd700 1 -- 172.21.15.112:0/2943499835 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394003a10 con 0x7ff398069d60 2023-11-08T12:31:08.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.476+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3980caa30 con 0x7ff398069d60 2023-11-08T12:31:08.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.476+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3980ca6e0 con 0x7ff398069d60 2023-11-08T12:31:08.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.480+0000 7ff38effd700 1 -- 172.21.15.112:0/2943499835 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff394019030 con 0x7ff398069d60 2023-11-08T12:31:08.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.480+0000 7ff38effd700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064ee0 0x7ff37c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:08.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.480+0000 7ff38effd700 1 -- 172.21.15.112:0/2943499835 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff3940812c0 con 0x7ff398069d60 2023-11-08T12:31:08.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.480+0000 7ff39dc95700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064ee0 0x7ff37c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:08.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.480+0000 7ff39dc95700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064ee0 0x7ff37c067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff3980b3930 tx=0x7ff388008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:08.489 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.488+0000 7ff38effd700 1 -- 172.21.15.112:0/2943499835 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff39404a400 con 0x7ff398069d60 2023-11-08T12:31:08.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.688+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3980726c0 con 0x7ff398069d60 2023-11-08T12:31:09.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.688+0000 7ff38effd700 1 -- 172.21.15.112:0/2943499835 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4656 (secure 0 0 0) 0x7ff39404f3d0 con 0x7ff398069d60 2023-11-08T12:31:09.117 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:09.118 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:55.282749+0000","modified":"2023-11-08T12:30:58.314109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2843990803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2843990803},{"type":"v1","addr":"172.21.15.112:6837","nonce":2843990803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T12:31:09.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064ee0 msgr2=0x7ff37c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064ee0 0x7ff37c067390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff3980b3930 tx=0x7ff388008030 comp rx=0 tx=0).stop 2023-11-08T12:31:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398069d60 msgr2=0x7ff39806d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398069d60 0x7ff39806d370 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff39400c520 tx=0x7ff39400c8e0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 shutdown_connections 2023-11-08T12:31:09.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff37c064ee0 0x7ff37c067390 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39815a480 0x7ff3980b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3980c8d10 0x7ff3981f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 --2- 172.21.15.112:0/2943499835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398069d60 0x7ff39806d370 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 >> 172.21.15.112:0/2943499835 conn(0x7ff3980cf350 msgr2=0x7ff3980adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 shutdown_connections 2023-11-08T12:31:09.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:08.692+0000 7ff3a06fa700 1 -- 172.21.15.112:0/2943499835 wait complete. 2023-11-08T12:31:09.124 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 32 2023-11-08T12:31:09.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-08T12:31:09.340 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2023-11-08T12:31:09.341 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-08T12:31:09.342 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-08T12:31:09.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 Processor -- start 2023-11-08T12:31:09.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 -- start start 2023-11-08T12:31:09.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 0x5635cb022420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb021960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 0x5635cb101170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635caf4a240 con 0x5635cb070d40 2023-11-08T12:31:09.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635cb022c10 con 0x5635cb070970 2023-11-08T12:31:09.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3f90d140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635cb0fb630 con 0x5635cb0fe960 2023-11-08T12:31:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb021960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb021960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36902/0 (socket says 172.21.15.112:36902) 2023-11-08T12:31:09.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 -- 172.21.15.112:0/2578617677 learned_addr learned my addr 172.21.15.112:0/2578617677 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3d442700 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 0x5635cb022420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3dc43700 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 0x5635cb101170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 -- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 msgr2=0x5635cb101170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 0x5635cb101170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 -- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 msgr2=0x5635cb022420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 0x5635cb022420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 -- 172.21.15.112:0/2578617677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34005d20 con 0x5635cb070d40 2023-11-08T12:31:09.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3dc43700 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 0x5635cb101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:09.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.408+0000 7f7a3cc41700 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb021960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7a340099d0 tx=0x7f7a34005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2fd22fde631981 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a2f7fe700 1 -- 172.21.15.112:0/2578617677 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400f040 con 0x5635cb070d40 2023-11-08T12:31:09.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a2f7fe700 1 -- 172.21.15.112:0/2578617677 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34008ca0 con 0x5635cb070d40 2023-11-08T12:31:09.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a2f7fe700 1 -- 172.21.15.112:0/2578617677 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34014680 con 0x5635cb070d40 2023-11-08T12:31:09.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- 172.21.15.112:0/2578617677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 msgr2=0x5635cb021960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb021960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7a340099d0 tx=0x7f7a34005a00 comp rx=0 tx=0).stop 2023-11-08T12:31:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- 172.21.15.112:0/2578617677 shutdown_connections 2023-11-08T12:31:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 0x5635cb101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb021960 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/2578617677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 0x5635cb022420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- 172.21.15.112:0/2578617677 >> 172.21.15.112:0/2578617677 conn(0x5635cb028c30 msgr2=0x5635cb0545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- 172.21.15.112:0/2578617677 shutdown_connections 2023-11-08T12:31:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- 172.21.15.112:0/2578617677 wait complete. 2023-11-08T12:31:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 Processor -- start 2023-11-08T12:31:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- start start 2023-11-08T12:31:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 0x5635cb1938d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb0515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 0x5635cb051b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635cb0e6f10 con 0x5635cb070d40 2023-11-08T12:31:09.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635cb0e71b0 con 0x5635cb070970 2023-11-08T12:31:09.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3f90d140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635cb0e7450 con 0x5635cb0fe960 2023-11-08T12:31:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3cc41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb0515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3cc41700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb0515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36912/0 (socket says 172.21.15.112:36912) 2023-11-08T12:31:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.412+0000 7f7a3cc41700 1 -- 172.21.15.112:0/1114916767 learned_addr learned my addr 172.21.15.112:0/1114916767 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3d442700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 0x5635cb1938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3cc41700 1 -- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 msgr2=0x5635cb051b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3cc41700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5635cb0fe960 0x5635cb051b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3cc41700 1 -- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 msgr2=0x5635cb1938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3cc41700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5635cb070970 0x5635cb1938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3cc41700 1 -- 172.21.15.112:0/1114916767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34009600 con 0x5635cb070d40 2023-11-08T12:31:09.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3cc41700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb0515f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7a34000c00 tx=0x7f7a34003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a2e7fc700 1 -- 172.21.15.112:0/1114916767 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400f040 con 0x5635cb070d40 2023-11-08T12:31:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a2e7fc700 1 -- 172.21.15.112:0/1114916767 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a340056c0 con 0x5635cb070d40 2023-11-08T12:31:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5635caf558b0 con 0x5635cb070d40 2023-11-08T12:31:09.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a2e7fc700 1 -- 172.21.15.112:0/1114916767 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34014c60 con 0x5635cb070d40 2023-11-08T12:31:09.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.416+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a30005d20 con 0x5635cb070d40 2023-11-08T12:31:09.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a2e7fc700 1 -- 172.21.15.112:0/1114916767 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7a3401f420 con 0x5635cb070d40 2023-11-08T12:31:09.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a2e7fc700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a20063810 0x7f7a20065cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a2e7fc700 1 -- 172.21.15.112:0/1114916767 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7a34083080 con 0x5635cb070d40 2023-11-08T12:31:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a3d442700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a20063810 0x7f7a20065cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5635cb0e7e30 0x5635cb189370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70) v8 -- 0x5635cb1898b0 con 0x5635cb0e7e30 2023-11-08T12:31:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a3dc43700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5635cb0e7e30 0x5635cb189370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a3d442700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a20063810 0x7f7a20065cc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7a30000c00 tx=0x7f7a3000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.420+0000 7f7a3dc43700 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5635cb0e7e30 0x5635cb189370 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3dc43700 1 -- 172.21.15.112:0/1114916767 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f7a38006040 con 0x5635cb0e7e30 2023-11-08T12:31:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5635cb0e7e30 msgr2=0x5635cb189370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5635cb0e7e30 0x5635cb189370 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a20063810 msgr2=0x7f7a20065cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7a20063810 0x7f7a20065cc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7a30000c00 tx=0x7f7a3000f000 comp rx=0 tx=0).stop 2023-11-08T12:31:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 msgr2=0x5635cb0515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 --2- 172.21.15.112:0/1114916767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635cb070d40 0x5635cb0515f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7a34000c00 tx=0x7f7a34003020 comp rx=0 tx=0).stop 2023-11-08T12:31:09.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3dc43700 1 -- 172.21.15.112:0/1114916767 reap_dead start 2023-11-08T12:31:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 shutdown_connections 2023-11-08T12:31:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 >> 172.21.15.112:0/1114916767 conn(0x5635cb028c30 msgr2=0x5635cb0545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 shutdown_connections 2023-11-08T12:31:09.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.424+0000 7f7a3f90d140 1 -- 172.21.15.112:0/1114916767 wait complete. 2023-11-08T12:31:09.445 INFO:teuthology.orchestra.run.smithi112.stdout:Xfiledir_test 2023-11-08T12:31:09.446 DEBUG:teuthology.orchestra.run.smithi112:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-08T12:31:09.532 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:31:09.532 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 1099511627777, 2023-11-08T12:31:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "ancestors": [ 2023-11-08T12:31:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:31:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "dirino": 1099511627776, 2023-11-08T12:31:09.533 INFO:teuthology.orchestra.run.smithi112.stdout: "dname": "file", 2023-11-08T12:31:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: "version": 2 2023-11-08T12:31:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2023-11-08T12:31:09.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:31:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "dirino": 1, 2023-11-08T12:31:09.535 INFO:teuthology.orchestra.run.smithi112.stdout: "dname": "dir_test", 2023-11-08T12:31:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "version": 4 2023-11-08T12:31:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:31:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2023-11-08T12:31:09.536 INFO:teuthology.orchestra.run.smithi112.stdout: "pool": 11, 2023-11-08T12:31:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: "old_pools": [] 2023-11-08T12:31:09.537 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:31:09.537 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:09.539 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2023-11-08T12:31:09.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 Processor -- start 2023-11-08T12:31:09.654 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 -- start start 2023-11-08T12:31:09.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca61d710 0x5646ca6f7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca650990 0x5646ca66b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.656 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 0x5646ca643b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646ca545240 con 0x5646ca61d710 2023-11-08T12:31:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646ca6df6a0 con 0x5646ca6dbf50 2023-11-08T12:31:09.657 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a62d69140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646ca6db300 con 0x5646ca650990 2023-11-08T12:31:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca61d710 0x5646ca6f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca61d710 0x5646ca6f7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36918/0 (socket says 172.21.15.112:36918) 2023-11-08T12:31:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 -- 172.21.15.112:0/1840247680 learned_addr learned my addr 172.21.15.112:0/1840247680 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6009d700 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca650990 0x5646ca66b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6109f700 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 0x5646ca643b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 -- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca650990 msgr2=0x5646ca66b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca650990 0x5646ca66b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 -- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 msgr2=0x5646ca643b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 0x5646ca643b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 -- 172.21.15.112:0/1840247680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58005d20 con 0x5646ca61d710 2023-11-08T12:31:09.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a6089e700 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca61d710 0x5646ca6f7320 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098e0 tx=0x7f6a50005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5984f947ec01493c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.652+0000 7f6a5f09b700 1 -- 172.21.15.112:0/1840247680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000f040 con 0x5646ca61d710 2023-11-08T12:31:09.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a5f09b700 1 -- 172.21.15.112:0/1840247680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a500089b0 con 0x5646ca61d710 2023-11-08T12:31:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a5f09b700 1 -- 172.21.15.112:0/1840247680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50008d60 con 0x5646ca61d710 2023-11-08T12:31:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- 172.21.15.112:0/1840247680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca61d710 msgr2=0x5646ca6f7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca61d710 0x5646ca6f7320 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098e0 tx=0x7f6a50005a00 comp rx=0 tx=0).stop 2023-11-08T12:31:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- 172.21.15.112:0/1840247680 shutdown_connections 2023-11-08T12:31:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 0x5646ca643b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca650990 0x5646ca66b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 --2- 172.21.15.112:0/1840247680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca61d710 0x5646ca6f7320 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- 172.21.15.112:0/1840247680 >> 172.21.15.112:0/1840247680 conn(0x5646ca623c40 msgr2=0x5646ca64db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- 172.21.15.112:0/1840247680 shutdown_connections 2023-11-08T12:31:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- 172.21.15.112:0/1840247680 wait complete. 2023-11-08T12:31:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 Processor -- start 2023-11-08T12:31:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- start start 2023-11-08T12:31:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca61d710 0x5646ca6f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca650990 0x5646ca646ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 0x5646ca647000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646ca6f8760 con 0x5646ca650990 2023-11-08T12:31:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646ca647640 con 0x5646ca6dbf50 2023-11-08T12:31:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a62d69140 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646ca6478e0 con 0x5646ca61d710 2023-11-08T12:31:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a6009d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca650990 0x5646ca646ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a6009d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca650990 0x5646ca646ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36924/0 (socket says 172.21.15.112:36924) 2023-11-08T12:31:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.656+0000 7f6a6009d700 1 -- 172.21.15.112:0/63247486 learned_addr learned my addr 172.21.15.112:0/63247486 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6089e700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca61d710 0x5646ca6f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6109f700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 0x5646ca647000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.672 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6009d700 1 -- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca61d710 msgr2=0x5646ca6f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6009d700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5646ca61d710 0x5646ca6f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6009d700 1 -- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 msgr2=0x5646ca647000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6009d700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646ca6dbf50 0x5646ca647000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6009d700 1 -- 172.21.15.112:0/63247486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50009510 con 0x5646ca650990 2023-11-08T12:31:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a6009d700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca650990 0x5646ca646ac0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400e480 tx=0x7f6a5400e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a5e099700 1 -- 172.21.15.112:0/63247486 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400ee50 con 0x5646ca650990 2023-11-08T12:31:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a5e099700 1 -- 172.21.15.112:0/63247486 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a540062e0 con 0x5646ca650990 2023-11-08T12:31:09.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a5e099700 1 -- 172.21.15.112:0/63247486 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54004760 con 0x5646ca650990 2023-11-08T12:31:09.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646ca55d390 con 0x5646ca650990 2023-11-08T12:31:09.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.660+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646ca5508b0 con 0x5646ca650990 2023-11-08T12:31:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a5e099700 1 -- 172.21.15.112:0/63247486 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6a540048c0 con 0x5646ca650990 2023-11-08T12:31:09.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a5e099700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6a4c063840 0x7f6a4c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a5e099700 1 -- 172.21.15.112:0/63247486 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6a54080b60 con 0x5646ca650990 2023-11-08T12:31:09.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a62d69140 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5646ca649570 0x5646ca796c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x5646ca7971c0 con 0x5646ca649570 2023-11-08T12:31:09.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a6089e700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6a4c063840 0x7f6a4c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a6109f700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5646ca649570 0x5646ca796c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a6089e700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6a4c063840 0x7f6a4c065cf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6a50005a40 tx=0x7f6a50012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.664+0000 7f6a6109f700 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5646ca649570 0x5646ca796c80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a6109f700 1 -- 172.21.15.112:0/63247486 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v70'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6a58019040 con 0x5646ca649570 2023-11-08T12:31:09.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5646ca649570 msgr2=0x5646ca796c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x5646ca649570 0x5646ca796c80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6a4c063840 msgr2=0x7f6a4c065cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6a4c063840 0x7f6a4c065cf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6a50005a40 tx=0x7f6a50012000 comp rx=0 tx=0).stop 2023-11-08T12:31:09.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca650990 msgr2=0x5646ca646ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 --2- 172.21.15.112:0/63247486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5646ca650990 0x5646ca646ac0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400e480 tx=0x7f6a5400e840 comp rx=0 tx=0).stop 2023-11-08T12:31:09.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a6109f700 1 -- 172.21.15.112:0/63247486 reap_dead start 2023-11-08T12:31:09.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 shutdown_connections 2023-11-08T12:31:09.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 >> 172.21.15.112:0/63247486 conn(0x5646ca623c40 msgr2=0x5646ca66b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 shutdown_connections 2023-11-08T12:31:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.668+0000 7f6a62d69140 1 -- 172.21.15.112:0/63247486 wait complete. 2023-11-08T12:31:09.686 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2023-11-08T12:31:09.869 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.864+0000 7f58abfff700 1 Processor -- start 2023-11-08T12:31:09.870 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58abfff700 1 -- start start 2023-11-08T12:31:09.871 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58abfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58ac069e00 0x7f58ac06a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58abfff700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac06a790 con 0x7f58ac06c630 2023-11-08T12:31:09.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58abfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac15cab0 con 0x7f58ac15c6e0 2023-11-08T12:31:09.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58abfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac0d2800 con 0x7f58ac069e00 2023-11-08T12:31:09.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58ab7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f58ac06c630 0x7f58ac06cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43782/0 (socket says 172.21.15.112:43782) 2023-11-08T12:31:09.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58ab7fe700 1 -- 172.21.15.112:0/4114426396 learned_addr learned my addr 172.21.15.112:0/4114426396 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:09.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4114426396 >> v2:172.21.15.133:3300/0 conn(0x7f58ac069e00 0x7f58ac06a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998188733 0 0) 0x7f58a4001490 con 0x7f58ac06c630 2023-11-08T12:31:09.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58940035d0 con 0x7f58ac06c630 2023-11-08T12:31:09.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 846540356 0 0) 0x7f58940035d0 con 0x7f58ac06c630 2023-11-08T12:31:09.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 >> v2:172.21.15.133:3300/0 conn(0x7f58ac069e00 msgr2=0x7f58ac06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 --2- 172.21.15.112:0/4114426396 >> v2:172.21.15.133:3300/0 conn(0x7f58ac069e00 0x7f58ac06a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 >> v1:172.21.15.133:6789/0 conn(0x7f58ac15c6e0 legacy=0x7f58ac071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0702d0 con 0x7f58ac06c630 2023-11-08T12:31:09.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f58a4001b80 con 0x7f58ac06c630 2023-11-08T12:31:09.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 >> v1:172.21.15.112:6789/0 conn(0x7f58ac06c630 legacy=0x7f58ac06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5894003a20 0x7f5894003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5894004410 0x7f58940048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58940050d0 0x7f589400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0d2800 con 0x7f5894004410 2023-11-08T12:31:09.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589400c020 con 0x7f58940050d0 2023-11-08T12:31:09.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.868+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589400c1e0 con 0x7f5894003a20 2023-11-08T12:31:09.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5894004410 0x7f58940048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aaffd700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5894003a20 0x7f5894003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58940050d0 0x7f589400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aa7fc700 1 -- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5894003a20 msgr2=0x7f5894003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5894003a20 0x7f5894003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aa7fc700 1 -- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58940050d0 msgr2=0x7f589400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58940050d0 0x7f589400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58ab7fe700 1 -- 172.21.15.112:0/4114426396 reap_dead start 2023-11-08T12:31:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aa7fc700 1 -- 172.21.15.112:0/4114426396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940035d0 con 0x7f5894004410 2023-11-08T12:31:09.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aaffd700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5894003a20 0x7f5894003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:09.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5894004410 0x7f58940048d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009b70 tx=0x7f58940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f88f710d405d1f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a000e6c0 con 0x7f5894004410 2023-11-08T12:31:09.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a000e820 con 0x7f5894004410 2023-11-08T12:31:09.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58a9ffb700 1 -- 172.21.15.112:0/4114426396 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a000eb90 con 0x7f5894004410 2023-11-08T12:31:09.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58abfff700 1 -- 172.21.15.112:0/4114426396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5894004410 msgr2=0x7f58940048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58abfff700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5894004410 0x7f58940048d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009b70 tx=0x7f58940058a0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58abfff700 1 -- 172.21.15.112:0/4114426396 shutdown_connections 2023-11-08T12:31:09.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58abfff700 1 --2- 172.21.15.112:0/4114426396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5894004410 0x7f58940048d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58abfff700 1 -- 172.21.15.112:0/4114426396 >> 172.21.15.112:0/4114426396 conn(0x7f58ac0b65b0 msgr2=0x7f58ac071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58abfff700 1 -- 172.21.15.112:0/4114426396 shutdown_connections 2023-11-08T12:31:09.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.872+0000 7f58abfff700 1 -- 172.21.15.112:0/4114426396 wait complete. 2023-11-08T12:31:09.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 Processor -- start 2023-11-08T12:31:09.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 -- start start 2023-11-08T12:31:09.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5894004410 0x7f58ac15e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ac09bf80 0x7f58ac0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac1e5f80 0x7f58ac1e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac15ce30 con 0x7f58ac1e5f80 2023-11-08T12:31:09.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac15cb50 con 0x7f5894004410 2023-11-08T12:31:09.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58abfff700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac15db70 con 0x7f58ac09bf80 2023-11-08T12:31:09.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58ab7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac1e5f80 0x7f58ac1e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58ab7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac1e5f80 0x7f58ac1e63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36952/0 (socket says 172.21.15.112:36952) 2023-11-08T12:31:09.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58ab7fe700 1 -- 172.21.15.112:0/3634915677 learned_addr learned my addr 172.21.15.112:0/3634915677 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ac09bf80 0x7f58ac0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.876+0000 7f58aaffd700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5894004410 0x7f58ac15e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58ab7fe700 1 -- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ac09bf80 msgr2=0x7f58ac0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ac09bf80 0x7f58ac0cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58ab7fe700 1 -- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5894004410 msgr2=0x7f58ac15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5894004410 0x7f58ac15e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58ab7fe700 1 -- 172.21.15.112:0/3634915677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0d2cf0 con 0x7f58ac1e5f80 2023-11-08T12:31:09.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac1e5f80 0x7f58ac1e63f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f58ac06ef00 tx=0x7f58a4001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.888 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58937fe700 1 -- 172.21.15.112:0/3634915677 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40076b0 con 0x7f58ac1e5f80 2023-11-08T12:31:09.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58937fe700 1 -- 172.21.15.112:0/3634915677 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4007810 con 0x7f58ac1e5f80 2023-11-08T12:31:09.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac0d2a10 con 0x7f58ac1e5f80 2023-11-08T12:31:09.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58937fe700 1 -- 172.21.15.112:0/3634915677 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4007bc0 con 0x7f58ac1e5f80 2023-11-08T12:31:09.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.880+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac0d2fd0 con 0x7f58ac1e5f80 2023-11-08T12:31:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.884+0000 7f58937fe700 1 -- 172.21.15.112:0/3634915677 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f58a401e460 con 0x7f58ac1e5f80 2023-11-08T12:31:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.884+0000 7f58937fe700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5898064ee0 0x7f5898067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.884+0000 7f58937fe700 1 -- 172.21.15.112:0/3634915677 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f58a40824d0 con 0x7f58ac1e5f80 2023-11-08T12:31:09.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.884+0000 7f58aaffd700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5898064ee0 0x7f5898067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.884+0000 7f58b48aa740 1 Processor -- start 2023-11-08T12:31:09.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.884+0000 7f58aaffd700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5898064ee0 0x7f5898067390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f58ac04f8c0 tx=0x7f589c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.884+0000 7f58b48aa740 1 -- start start 2023-11-08T12:31:09.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378d10 0x26300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378940 0x2630600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x25e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e7c00 con 0x23c39c0 2023-11-08T12:31:09.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x2557cf0 con 0x2378940 2023-11-08T12:31:09.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x2550ff0 con 0x2378d10 2023-11-08T12:31:09.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x25e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x25e4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36962/0 (socket says 172.21.15.112:36962) 2023-11-08T12:31:09.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 -- 172.21.15.112:0/1508719175 learned_addr learned my addr 172.21.15.112:0/1508719175 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58aaffd700 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378d10 0x26300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378940 0x2630600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 -- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378d10 msgr2=0x26300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378d10 0x26300c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 -- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378940 msgr2=0x2630600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378940 0x2630600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 -- 172.21.15.112:0/1508719175 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2576ec0 con 0x23c39c0 2023-11-08T12:31:09.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378940 0x2630600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:09.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x25e4dd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f58a40505a0 tx=0x7f58a405c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dbba8395f904e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f5890ff9700 1 -- 172.21.15.112:0/1508719175 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4053790 con 0x23c39c0 2023-11-08T12:31:09.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f5890ff9700 1 -- 172.21.15.112:0/1508719175 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4052500 con 0x23c39c0 2023-11-08T12:31:09.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f5890ff9700 1 -- 172.21.15.112:0/1508719175 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a406b380 con 0x23c39c0 2023-11-08T12:31:09.900 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- 172.21.15.112:0/1508719175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 msgr2=0x25e4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x25e4dd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f58a40505a0 tx=0x7f58a405c260 comp rx=0 tx=0).stop 2023-11-08T12:31:09.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- 172.21.15.112:0/1508719175 shutdown_connections 2023-11-08T12:31:09.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x25e4dd0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378940 0x2630600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.901 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 --2- 172.21.15.112:0/1508719175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378d10 0x26300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- 172.21.15.112:0/1508719175 >> 172.21.15.112:0/1508719175 conn(0x23790e0 msgr2=0x2611790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- 172.21.15.112:0/1508719175 shutdown_connections 2023-11-08T12:31:09.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.888+0000 7f58b48aa740 1 -- 172.21.15.112:0/1508719175 wait complete. 2023-11-08T12:31:09.902 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 -- start start 2023-11-08T12:31:09.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 Processor -- start 2023-11-08T12:31:09.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x25f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x25fa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x23fdd50 con 0x2378d10 2023-11-08T12:31:09.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x25fa3f0 con 0x23c39c0 2023-11-08T12:31:09.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x25f57c0 con 0x2378940 2023-11-08T12:31:09.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58b48aa740 10 client.0 _ll_register_callbacks cb 0x25ad8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:09.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58aa7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x25f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58aa7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x25f9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36968/0 (socket says 172.21.15.112:36968) 2023-11-08T12:31:09.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58aa7fc700 1 -- 172.21.15.112:0/2278230522 learned_addr learned my addr 172.21.15.112:0/2278230522 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58aaffd700 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.892+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x25fa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aa7fc700 1 -- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 msgr2=0x25f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aa7fc700 1 -- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 msgr2=0x25fa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x25fa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aa7fc700 1 -- 172.21.15.112:0/2278230522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac0d2fd0 con 0x2378d10 2023-11-08T12:31:09.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x25f9eb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5894005830 tx=0x7f58a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc3579e8653105 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f5889ffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:09.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f5889ffb700 1 -- 172.21.15.112:0/2278230522 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a002b070 con 0x2378d10 2023-11-08T12:31:09.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f5889ffb700 1 -- 172.21.15.112:0/2278230522 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f58a0004250 con 0x2378d10 2023-11-08T12:31:09.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x257ee30 con 0x2378d10 2023-11-08T12:31:09.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f5889ffb700 1 -- 172.21.15.112:0/2278230522 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58a0021050 con 0x2378d10 2023-11-08T12:31:09.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 10 client.6498 fetch_fsmap learned FSMap version 32 2023-11-08T12:31:09.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x23c4c10 con 0x2378d10 2023-11-08T12:31:09.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f5889ffb700 1 -- 172.21.15.112:0/2278230522 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x257ee30 con 0x2378d10 2023-11-08T12:31:09.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f5889ffb700 1 -- 172.21.15.112:0/2278230522 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f58a002e020 con 0x2378d10 2023-11-08T12:31:09.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 10 client.6498 fetch_fsmap finished waiting for FSMap version 32 2023-11-08T12:31:09.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 10 client.6498 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:09.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 20 client.6498 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:09.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2638140 0x2638540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 4 client.6498 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:31:09.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x254a070 con 0x2638140 2023-11-08T12:31:09.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aaffd700 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2638140 0x2638540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f58aaffd700 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2638140 0x2638540 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6f230acb1288e4 server_cookie=28a67dc6f27ddd85 in_seq=0 out_seq=0 2023-11-08T12:31:09.910 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.896+0000 7f5889ffb700 10 client.6498 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:09.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f5889ffb700 1 -- 172.21.15.112:0/2278230522 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x254a070 con 0x2638140 2023-11-08T12:31:09.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f5889ffb700 10 client.6498 handle_command_reply: tid=0 2023-11-08T12:31:09.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 client.6498 shutdown 2023-11-08T12:31:09.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 msgr2=0x25f9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x25f9eb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5894005830 tx=0x7f58a0004770 comp rx=0 tx=0).stop 2023-11-08T12:31:09.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 shutdown_connections 2023-11-08T12:31:09.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2638140 0x2638540 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x25fa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x25f9eb0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2278230522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 >> 172.21.15.112:0/2278230522 conn(0x23790e0 msgr2=0x260e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f5889ffb700 0 client.6498 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 shutdown_connections 2023-11-08T12:31:09.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 1 -- 172.21.15.112:0/2278230522 wait complete. 2023-11-08T12:31:09.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.900+0000 7f58b48aa740 20 client.6498 trim_cache size 0 max 16384 2023-11-08T12:31:09.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 Processor -- start 2023-11-08T12:31:09.922 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 -- start start 2023-11-08T12:31:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378d10 0x25f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x260e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x254fe80 con 0x23c39c0 2023-11-08T12:31:09.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x254e3f0 con 0x2378d10 2023-11-08T12:31:09.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x254c960 con 0x2378940 2023-11-08T12:31:09.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58ab7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x260e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58ab7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x260e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36972/0 (socket says 172.21.15.112:36972) 2023-11-08T12:31:09.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58ab7fe700 1 -- 172.21.15.112:0/2788958900 learned_addr learned my addr 172.21.15.112:0/2788958900 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aaffd700 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378d10 0x25f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aaffd700 1 -- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378d10 msgr2=0x25f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aaffd700 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378d10 0x25f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aaffd700 1 -- 172.21.15.112:0/2788958900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 msgr2=0x260e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aaffd700 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x260e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aaffd700 1 -- 172.21.15.112:0/2788958900 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac15e390 con 0x2378940 2023-11-08T12:31:09.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x260e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:09.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.920+0000 7f58aaffd700 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f3f60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f589c000c00 tx=0x7f589c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf478649e46780c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58917fa700 1 -- 172.21.15.112:0/2788958900 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c02a070 con 0x2378940 2023-11-08T12:31:09.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58917fa700 1 -- 172.21.15.112:0/2788958900 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c02ac20 con 0x2378940 2023-11-08T12:31:09.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58917fa700 1 -- 172.21.15.112:0/2788958900 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c02a1d0 con 0x2378940 2023-11-08T12:31:09.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 msgr2=0x25f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f3f60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f589c000c00 tx=0x7f589c014000 comp rx=0 tx=0).stop 2023-11-08T12:31:09.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- 172.21.15.112:0/2788958900 shutdown_connections 2023-11-08T12:31:09.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x23c39c0 0x260e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2378d10 0x25f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 --2- 172.21.15.112:0/2788958900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x25f3f60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- 172.21.15.112:0/2788958900 >> 172.21.15.112:0/2788958900 conn(0x23790e0 msgr2=0x25eae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- 172.21.15.112:0/2788958900 shutdown_connections 2023-11-08T12:31:09.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- 172.21.15.112:0/2788958900 wait complete. 2023-11-08T12:31:09.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- start start 2023-11-08T12:31:09.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 Processor -- start 2023-11-08T12:31:09.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x268e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x268edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x268f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x2554ff0 con 0x2378d10 2023-11-08T12:31:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x2590b10 con 0x23c39c0 2023-11-08T12:31:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x268d950 con 0x2378940 2023-11-08T12:31:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58b48aa740 10 client.0 _ll_register_callbacks cb 0x251ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58aa7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x268edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58aa7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x268edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36978/0 (socket says 172.21.15.112:36978) 2023-11-08T12:31:09.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58aa7fc700 1 -- 172.21.15.112:0/4201314445 learned_addr learned my addr 172.21.15.112:0/4201314445 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:09.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58aaffd700 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x268e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.924+0000 7f58ab7fe700 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x268f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aa7fc700 1 -- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 msgr2=0x268e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x268e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aa7fc700 1 -- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 msgr2=0x268f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x268f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aa7fc700 1 -- 172.21.15.112:0/4201314445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2576ec0 con 0x2378d10 2023-11-08T12:31:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aa7fc700 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x268edb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f58a0000c00 tx=0x7f58a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbe0c5a2d42a658 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f5889ffb700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f5889ffb700 1 -- 172.21.15.112:0/4201314445 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a002b040 con 0x2378d10 2023-11-08T12:31:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f5889ffb700 1 -- 172.21.15.112:0/4201314445 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f58a0000e40 con 0x2378d10 2023-11-08T12:31:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58a4052500 con 0x2378d10 2023-11-08T12:31:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f5889ffb700 1 -- 172.21.15.112:0/4201314445 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58a0021040 con 0x2378d10 2023-11-08T12:31:09.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 10 client.6504 fetch_fsmap learned FSMap version 32 2023-11-08T12:31:09.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x7f589c003c80 con 0x2378d10 2023-11-08T12:31:09.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f5889ffb700 1 -- 172.21.15.112:0/4201314445 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4052500 con 0x2378d10 2023-11-08T12:31:09.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f5889ffb700 1 -- 172.21.15.112:0/4201314445 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f58a000e1d0 con 0x2378d10 2023-11-08T12:31:09.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 10 client.6504 fetch_fsmap finished waiting for FSMap version 32 2023-11-08T12:31:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 10 client.6504 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 20 client.6504 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x268f830 0x2625b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 4 client.6504 mds_command: new command op to 6282 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2023-11-08T12:31:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x2549d90 con 0x268f830 2023-11-08T12:31:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aaffd700 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x268f830 0x2625b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:09.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f58aaffd700 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x268f830 0x2625b20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff53c98dae78a50 server_cookie=da5231c3ab3d1f17 in_seq=0 out_seq=0 2023-11-08T12:31:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.928+0000 7f5889ffb700 10 client.6504 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f5889ffb700 1 -- 172.21.15.112:0/4201314445 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2549d90 con 0x268f830 2023-11-08T12:31:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f5889ffb700 10 client.6504 handle_command_reply: tid=0 2023-11-08T12:31:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 client.6504 shutdown 2023-11-08T12:31:09.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 msgr2=0x268edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x268edb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f58a0000c00 tx=0x7f58a0014000 comp rx=0 tx=0).stop 2023-11-08T12:31:09.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 shutdown_connections 2023-11-08T12:31:09.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x268f830 0x2625b20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x23c39c0 0x268f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x2378d10 0x268edb0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 --2- 172.21.15.112:0/4201314445 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x2378940 0x268e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f5889ffb700 0 client.6504 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:09.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 >> 172.21.15.112:0/4201314445 conn(0x23790e0 msgr2=0x260bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 shutdown_connections 2023-11-08T12:31:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 1 -- 172.21.15.112:0/4201314445 wait complete. 2023-11-08T12:31:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58b48aa740 20 client.6504 trim_cache size 0 max 16384 2023-11-08T12:31:09.950 INFO:tasks.ceph.mds.a.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f060ecc0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6229=0-4194304@1} caps={6229=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6229 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b2ef065600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-08T12:31:09.950 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:31:09.950 INFO:teuthology.orchestra.run.smithi112.stdout: "return_code": 0, 2023-11-08T12:31:09.950 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_tag": "48a0f08f-b250-495b-8e00-ed2bb12873f1", 2023-11-08T12:31:09.951 INFO:teuthology.orchestra.run.smithi112.stdout: "mode": "asynchronous" 2023-11-08T12:31:09.951 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:31:09.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5898064ee0 msgr2=0x7f5898067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5898064ee0 0x7f5898067390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f58ac04f8c0 tx=0x7f589c009040 comp rx=0 tx=0).stop 2023-11-08T12:31:09.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac1e5f80 msgr2=0x7f58ac1e63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:09.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac1e5f80 0x7f58ac1e63f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f58ac06ef00 tx=0x7f58a4001bb0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 shutdown_connections 2023-11-08T12:31:09.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5898064ee0 0x7f5898067390 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac1e5f80 0x7f58ac1e63f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f58ac09bf80 0x7f58ac0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 --2- 172.21.15.112:0/3634915677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5894004410 0x7f58ac15e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:09.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 >> 172.21.15.112:0/3634915677 conn(0x7f58ac0b65b0 msgr2=0x7f58ac159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:09.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 shutdown_connections 2023-11-08T12:31:09.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:09.932+0000 7f58abfff700 1 -- 172.21.15.112:0/3634915677 wait complete. 2023-11-08T12:31:09.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-08T12:31:10.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.136+0000 7f2ff514f700 1 Processor -- start 2023-11-08T12:31:10.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.136+0000 7f2ff514f700 1 -- start start 2023-11-08T12:31:10.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2ff514f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ff015c640 0x7f2ff00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2ff514f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2ff514f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff006c600 con 0x7f2ff0069e00 2023-11-08T12:31:10.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2ff514f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff006cef0 con 0x7f2ff015c640 2023-11-08T12:31:10.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2ff514f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00722f0 con 0x7f2ff0071aa0 2023-11-08T12:31:10.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2feffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ff015c640 0x7f2ff00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2feffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2ff015c640 0x7f2ff00d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36994/0 (socket says 172.21.15.112:36994) 2023-11-08T12:31:10.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2feffff700 1 -- 172.21.15.112:0/3966267471 learned_addr learned my addr 172.21.15.112:0/3966267471 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/3966267471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2fef7fe700 1 -- 172.21.15.112:0/3966267471 >> v2:172.21.15.112:3300/0 conn(0x7f2ff015c640 msgr2=0x7f2ff00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/3966267471 >> v2:172.21.15.112:3300/0 conn(0x7f2ff015c640 0x7f2ff00d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2fef7fe700 1 -- 172.21.15.112:0/3966267471 >> v1:172.21.15.133:6789/0 conn(0x7f2ff0069e00 legacy=0x7f2ff00d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2fef7fe700 1 -- 172.21.15.112:0/3966267471 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff015ca10 con 0x7f2ff0071aa0 2023-11-08T12:31:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2feffff700 1 --2- 172.21.15.112:0/3966267471 >> v2:172.21.15.112:3300/0 conn(0x7f2ff015c640 0x7f2ff00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.140+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/3966267471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff006d310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009850 tx=0x7f2fe4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f13978dc26f5f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:10.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2feeffd700 1 -- 172.21.15.112:0/3966267471 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4011830 con 0x7f2ff0071aa0 2023-11-08T12:31:10.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2feeffd700 1 -- 172.21.15.112:0/3966267471 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe4011990 con 0x7f2ff0071aa0 2023-11-08T12:31:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2feeffd700 1 -- 172.21.15.112:0/3966267471 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4011d40 con 0x7f2ff0071aa0 2023-11-08T12:31:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 -- 172.21.15.112:0/3966267471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 msgr2=0x7f2ff006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 --2- 172.21.15.112:0/3966267471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff006d310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009850 tx=0x7f2fe4009b60 comp rx=0 tx=0).stop 2023-11-08T12:31:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 -- 172.21.15.112:0/3966267471 shutdown_connections 2023-11-08T12:31:10.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 --2- 172.21.15.112:0/3966267471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff006d310 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 --2- 172.21.15.112:0/3966267471 >> v2:172.21.15.112:3300/0 conn(0x7f2ff015c640 0x7f2ff00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 -- 172.21.15.112:0/3966267471 >> 172.21.15.112:0/3966267471 conn(0x7f2ff00b6520 msgr2=0x7f2ff0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 -- 172.21.15.112:0/3966267471 shutdown_connections 2023-11-08T12:31:10.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.144+0000 7f2ff514f700 1 -- 172.21.15.112:0/3966267471 wait complete. 2023-11-08T12:31:10.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 Processor -- start 2023-11-08T12:31:10.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 -- start start 2023-11-08T12:31:10.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff0069e00 0x7f2ff00cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff01f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ff015c640 0x7f2ff00c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00cc220 con 0x7f2ff015c640 2023-11-08T12:31:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00ce840 con 0x7f2ff0069e00 2023-11-08T12:31:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff514f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff00cea90 con 0x7f2ff0071aa0 2023-11-08T12:31:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ff015c640 0x7f2ff00c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ff015c640 0x7f2ff00c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37004/0 (socket says 172.21.15.112:37004) 2023-11-08T12:31:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 -- 172.21.15.112:0/2822251623 learned_addr learned my addr 172.21.15.112:0/2822251623 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2feffff700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff0069e00 0x7f2ff00cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff01f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 -- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 msgr2=0x7f2ff01f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff01f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 -- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff0069e00 msgr2=0x7f2ff00cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff0069e00 0x7f2ff00cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2ff494e700 1 -- 172.21.15.112:0/2822251623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0009570 con 0x7f2ff015c640 2023-11-08T12:31:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.148+0000 7f2feffff700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff0069e00 0x7f2ff00cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:10.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.152+0000 7f2ff494e700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ff015c640 0x7f2ff00c9a80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800cb50 tx=0x7f2fe800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.152+0000 7f2fecff9700 1 -- 172.21.15.112:0/2822251623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8003c20 con 0x7f2ff015c640 2023-11-08T12:31:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.152+0000 7f2fecff9700 1 -- 172.21.15.112:0/2822251623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8003d80 con 0x7f2ff015c640 2023-11-08T12:31:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.152+0000 7f2fecff9700 1 -- 172.21.15.112:0/2822251623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800ab70 con 0x7f2ff015c640 2023-11-08T12:31:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.152+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe40094b0 con 0x7f2ff015c640 2023-11-08T12:31:10.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.152+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff006c830 con 0x7f2ff015c640 2023-11-08T12:31:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2fecff9700 1 -- 172.21.15.112:0/2822251623 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f2fe8010050 con 0x7f2ff015c640 2023-11-08T12:31:10.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2fecff9700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2fdc064ee0 0x7f2fdc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2fecff9700 1 -- 172.21.15.112:0/2822251623 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fe8081f00 con 0x7f2ff015c640 2023-11-08T12:31:10.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2feffff700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2fdc064ee0 0x7f2fdc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 Processor -- start 2023-11-08T12:31:10.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 -- start start 2023-11-08T12:31:10.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2feffff700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2fdc064ee0 0x7f2fdc067390 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ff015ac40 tx=0x7f2fe0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x219ed20 con 0x202f840 2023-11-08T12:31:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x220ed60 con 0x202fc10 2023-11-08T12:31:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x2208060 con 0x207a8c0 2023-11-08T12:31:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2fef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2fef7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37008/0 (socket says 172.21.15.112:37008) 2023-11-08T12:31:10.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2fef7fe700 1 -- 172.21.15.112:0/2277770995 learned_addr learned my addr 172.21.15.112:0/2277770995 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2ff494e700 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.156+0000 7f2feffff700 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fef7fe700 1 -- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 msgr2=0x22b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fef7fe700 1 -- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 msgr2=0x22af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fef7fe700 1 -- 172.21.15.112:0/2277770995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x222e0a0 con 0x202f840 2023-11-08T12:31:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22afd10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0072430 tx=0x7f2fe4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90aaf20d4b494057 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fd5ffb700 1 -- 172.21.15.112:0/2277770995 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4006c80 con 0x202f840 2023-11-08T12:31:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fd5ffb700 1 -- 172.21.15.112:0/2277770995 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe4011b00 con 0x202f840 2023-11-08T12:31:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2fd5ffb700 1 -- 172.21.15.112:0/2277770995 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4004040 con 0x202f840 2023-11-08T12:31:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 -- 172.21.15.112:0/2277770995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 msgr2=0x22afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22afd10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0072430 tx=0x7f2fe4010000 comp rx=0 tx=0).stop 2023-11-08T12:31:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 -- 172.21.15.112:0/2277770995 shutdown_connections 2023-11-08T12:31:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22afd10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2277770995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 -- 172.21.15.112:0/2277770995 >> 172.21.15.112:0/2277770995 conn(0x202ffe0 msgr2=0x22c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:10.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 -- 172.21.15.112:0/2277770995 shutdown_connections 2023-11-08T12:31:10.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 -- 172.21.15.112:0/2277770995 wait complete. 2023-11-08T12:31:10.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 -- start start 2023-11-08T12:31:10.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.160+0000 7f2ff9637740 1 Processor -- start 2023-11-08T12:31:10.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202f840 0x22ef190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x207a8c0 0x22ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x20b4c50 con 0x207a8c0 2023-11-08T12:31:10.174 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x22a04a0 con 0x202f840 2023-11-08T12:31:10.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x229fa20 con 0x202fc10 2023-11-08T12:31:10.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 10 client.0 _ll_register_callbacks cb 0x22019a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:10.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x207a8c0 0x22ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x207a8c0 0x22ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37020/0 (socket says 172.21.15.112:37020) 2023-11-08T12:31:10.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 -- 172.21.15.112:0/3213092002 learned_addr learned my addr 172.21.15.112:0/3213092002 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:10.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2feffff700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202f840 0x22ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 -- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 msgr2=0x229efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 -- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202f840 msgr2=0x22ef190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202f840 0x22ef190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 -- 172.21.15.112:0/3213092002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff015ca10 con 0x207a8c0 2023-11-08T12:31:10.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:10.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff494e700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x207a8c0 0x22ca130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8053b00 tx=0x7f2fe800acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def43ed7eec6279f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:10.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fceffd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:10.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fceffd700 1 -- 172.21.15.112:0/3213092002 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80533e0 con 0x207a8c0 2023-11-08T12:31:10.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fceffd700 1 -- 172.21.15.112:0/3213092002 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fe805ba20 con 0x207a8c0 2023-11-08T12:31:10.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22010e0 con 0x207a8c0 2023-11-08T12:31:10.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fceffd700 1 -- 172.21.15.112:0/3213092002 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fe8057b80 con 0x207a8c0 2023-11-08T12:31:10.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 10 client.6516 fetch_fsmap learned FSMap version 32 2023-11-08T12:31:10.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x207bb10 con 0x207a8c0 2023-11-08T12:31:10.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fceffd700 1 -- 172.21.15.112:0/3213092002 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22010e0 con 0x207a8c0 2023-11-08T12:31:10.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fceffd700 1 -- 172.21.15.112:0/3213092002 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2fe8057ce0 con 0x207a8c0 2023-11-08T12:31:10.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 10 client.6516 fetch_fsmap finished waiting for FSMap version 32 2023-11-08T12:31:10.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 10 client.6516 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:10.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 20 client.6516 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:10.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x229d6e0 0x229dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 4 client.6516 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:31:10.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2200e00 con 0x229d6e0 2023-11-08T12:31:10.180 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2feffff700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x229d6e0 0x229dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2feffff700 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x229d6e0 0x229dae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fade29b0339238a server_cookie=e4c52d05870c90e3 in_seq=0 out_seq=0 2023-11-08T12:31:10.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.164+0000 7f2fceffd700 10 client.6516 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:10.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2fceffd700 1 -- 172.21.15.112:0/3213092002 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x2200e00 con 0x229d6e0 2023-11-08T12:31:10.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2fceffd700 10 client.6516 handle_command_reply: tid=0 2023-11-08T12:31:10.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 client.6516 shutdown 2023-11-08T12:31:10.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x207a8c0 msgr2=0x22ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x207a8c0 0x22ca130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8053b00 tx=0x7f2fe800acd0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 shutdown_connections 2023-11-08T12:31:10.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x229d6e0 0x229dae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x207a8c0 0x22ca130 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 --2- 172.21.15.112:0/3213092002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202f840 0x22ef190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 >> 172.21.15.112:0/3213092002 conn(0x202ffe0 msgr2=0x22a1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:10.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2fceffd700 0 client.6516 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:10.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 shutdown_connections 2023-11-08T12:31:10.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 1 -- 172.21.15.112:0/3213092002 wait complete. 2023-11-08T12:31:10.184 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.168+0000 7f2ff9637740 20 client.6516 trim_cache size 0 max 16384 2023-11-08T12:31:10.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.184+0000 7f2ff9637740 1 Processor -- start 2023-11-08T12:31:10.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.184+0000 7f2ff9637740 1 -- start start 2023-11-08T12:31:10.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x229b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x207a8c0 0x22b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x220c1d0 con 0x202f840 2023-11-08T12:31:10.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x22ef410 con 0x207a8c0 2023-11-08T12:31:10.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x21d3210 con 0x202fc10 2023-11-08T12:31:10.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x229b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x229b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37030/0 (socket says 172.21.15.112:37030) 2023-11-08T12:31:10.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 -- 172.21.15.112:0/2318025018 learned_addr learned my addr 172.21.15.112:0/2318025018 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:10.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff494e700 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x207a8c0 0x22b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 -- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 msgr2=0x229ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 -- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x207a8c0 msgr2=0x22b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x207a8c0 0x22b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 -- 172.21.15.112:0/2318025018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00b3f50 con 0x202f840 2023-11-08T12:31:10.194 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2feffff700 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x229b510 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0012010 tx=0x7f2fe0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283cb0592fc9314c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:10.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2fd67fc700 1 -- 172.21.15.112:0/2318025018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0028040 con 0x202f840 2023-11-08T12:31:10.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2fd67fc700 1 -- 172.21.15.112:0/2318025018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe0015dd0 con 0x202f840 2023-11-08T12:31:10.195 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2fd67fc700 1 -- 172.21.15.112:0/2318025018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe002a660 con 0x202f840 2023-11-08T12:31:10.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- 172.21.15.112:0/2318025018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 msgr2=0x229b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x229b510 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0012010 tx=0x7f2fe0017000 comp rx=0 tx=0).stop 2023-11-08T12:31:10.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- 172.21.15.112:0/2318025018 shutdown_connections 2023-11-08T12:31:10.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x207a8c0 0x22b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x202fc10 0x229ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.199 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2318025018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x229b510 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- 172.21.15.112:0/2318025018 >> 172.21.15.112:0/2318025018 conn(0x202ffe0 msgr2=0x22c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:10.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- 172.21.15.112:0/2318025018 shutdown_connections 2023-11-08T12:31:10.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.188+0000 7f2ff9637740 1 -- 172.21.15.112:0/2318025018 wait complete. 2023-11-08T12:31:10.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 -- start start 2023-11-08T12:31:10.200 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 Processor -- start 2023-11-08T12:31:10.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22fab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x22fded0 con 0x202f840 2023-11-08T12:31:10.201 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x22fbe60 con 0x202fc10 2023-11-08T12:31:10.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x22f96d0 con 0x207a8c0 2023-11-08T12:31:10.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff9637740 10 client.0 _ll_register_callbacks cb 0x7f2fe40096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:10.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22fa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37034/0 (socket says 172.21.15.112:37034) 2023-11-08T12:31:10.202 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 -- 172.21.15.112:0/2299583585 learned_addr learned my addr 172.21.15.112:0/2299583585 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:10.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff494e700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 -- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 msgr2=0x22fab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.203 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22fab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 -- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 msgr2=0x22fd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22fd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 -- 172.21.15.112:0/2299583585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe0015440 con 0x202f840 2023-11-08T12:31:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2ff494e700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:10.204 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:10.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2feffff700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22fa0b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2fe002c040 tx=0x7f2fe0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6081d87f57533cf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:10.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.192+0000 7f2fceffd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:10.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 1 -- 172.21.15.112:0/2299583585 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0028070 con 0x202f840 2023-11-08T12:31:10.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 1 -- 172.21.15.112:0/2299583585 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fe001b040 con 0x202f840 2023-11-08T12:31:10.205 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2fe4011b00 con 0x202f840 2023-11-08T12:31:10.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 1 -- 172.21.15.112:0/2299583585 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fe002a870 con 0x202f840 2023-11-08T12:31:10.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 10 client.6522 fetch_fsmap learned FSMap version 32 2023-11-08T12:31:10.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x21b4af0 con 0x202f840 2023-11-08T12:31:10.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 1 -- 172.21.15.112:0/2299583585 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe4011b00 con 0x202f840 2023-11-08T12:31:10.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 1 -- 172.21.15.112:0/2299583585 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2fe002a9d0 con 0x202f840 2023-11-08T12:31:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 10 client.6522 fetch_fsmap finished waiting for FSMap version 32 2023-11-08T12:31:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 10 client.6522 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 20 client.6522 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x22fb0c0 0x22fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:10.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 4 client.6522 mds_command: new command op to 6282 tid=0[{"prefix": "scrub status"}] 2023-11-08T12:31:10.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x20ac390 con 0x22fb0c0 2023-11-08T12:31:10.208 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x22fb0c0 0x22fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:10.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fef7fe700 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x22fb0c0 0x22fb4c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fc2bb80943f0196 server_cookie=245057f91c3e8186 in_seq=0 out_seq=0 2023-11-08T12:31:10.209 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 10 client.6522 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:10.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 1 -- 172.21.15.112:0/2299583585 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x20ac390 con 0x22fb0c0 2023-11-08T12:31:10.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 10 client.6522 handle_command_reply: tid=0 2023-11-08T12:31:10.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 client.6522 shutdown 2023-11-08T12:31:10.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 msgr2=0x22fa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.210 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22fa0b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2fe002c040 tx=0x7f2fe0004770 comp rx=0 tx=0).stop 2023-11-08T12:31:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 shutdown_connections 2023-11-08T12:31:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x22fb0c0 0x22fb4c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x207a8c0 0x22fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x202fc10 0x22fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2fceffd700 0 client.6522 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:10.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 --2- 172.21.15.112:0/2299583585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x202f840 0x22fa0b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 >> 172.21.15.112:0/2299583585 conn(0x202ffe0 msgr2=0x229b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:10.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 shutdown_connections 2023-11-08T12:31:10.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 1 -- 172.21.15.112:0/2299583585 wait complete. 2023-11-08T12:31:10.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.196+0000 7f2ff9637740 20 client.6522 trim_cache size 0 max 16384 2023-11-08T12:31:10.213 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:31:10.213 INFO:teuthology.orchestra.run.smithi112.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-08T12:31:10.213 INFO:teuthology.orchestra.run.smithi112.stdout: "scrubs": { 2023-11-08T12:31:10.213 INFO:teuthology.orchestra.run.smithi112.stdout: "48a0f08f-b250-495b-8e00-ed2bb12873f1": { 2023-11-08T12:31:10.214 INFO:teuthology.orchestra.run.smithi112.stdout: "path": "/", 2023-11-08T12:31:10.214 INFO:teuthology.orchestra.run.smithi112.stdout: "tag": "48a0f08f-b250-495b-8e00-ed2bb12873f1", 2023-11-08T12:31:10.214 INFO:teuthology.orchestra.run.smithi112.stdout: "options": "recursive" 2023-11-08T12:31:10.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:31:10.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:31:10.215 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:31:10.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2fdc064ee0 msgr2=0x7f2fdc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2fdc064ee0 0x7f2fdc067390 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ff015ac40 tx=0x7f2fe0008040 comp rx=0 tx=0).stop 2023-11-08T12:31:10.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ff015c640 msgr2=0x7f2ff00c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:10.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ff015c640 0x7f2ff00c9a80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800cb50 tx=0x7f2fe800cf10 comp rx=0 tx=0).stop 2023-11-08T12:31:10.216 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 shutdown_connections 2023-11-08T12:31:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f2fdc064ee0 0x7f2fdc067390 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ff015c640 0x7f2ff00c9a80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff0071aa0 0x7f2ff01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 --2- 172.21.15.112:0/2822251623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff0069e00 0x7f2ff00cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:10.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 >> 172.21.15.112:0/2822251623 conn(0x7f2ff00b6520 msgr2=0x7f2ff00d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:10.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 shutdown_connections 2023-11-08T12:31:10.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:10.200+0000 7f2ff514f700 1 -- 172.21.15.112:0/2822251623 wait complete. 2023-11-08T12:31:10.222 INFO:tasks.cephfs.filesystem:scrub status for tag:48a0f08f-b250-495b-8e00-ed2bb12873f1 - {'path': '/', 'tag': '48a0f08f-b250-495b-8e00-ed2bb12873f1', 'options': 'recursive'} 2023-11-08T12:31:15.859 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-11-08T12:31:15.856+0000 7f2dc63f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-08T12:31:37.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:31:38.007 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:31:40.223 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-08T12:31:40.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.404+0000 7f31b99e8700 1 Processor -- start 2023-11-08T12:31:40.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.404+0000 7f31b99e8700 1 -- start start 2023-11-08T12:31:40.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b99e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31b40ced50 0x7f31b406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b99e8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b4160770 0x7f31b4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b99e8700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b4070a00 con 0x7f31b40705c0 2023-11-08T12:31:40.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b99e8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b40d24d0 con 0x7f31b40ced50 2023-11-08T12:31:40.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b99e8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40d27b0 con 0x7f31b4160770 2023-11-08T12:31:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b89e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31b40ced50 0x7f31b406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b91e7700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f31b40705c0 0x7f31b406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58196/0 (socket says 172.21.15.112:58196) 2023-11-08T12:31:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b91e7700 1 -- 172.21.15.112:0/115214238 learned_addr learned my addr 172.21.15.112:0/115214238 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:40.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b3fff700 1 --2- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b4160770 0x7f31b4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b37fe700 1 -- 172.21.15.112:0/115214238 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316211860 0 0) 0x7f31b4070a00 con 0x7f31b40705c0 2023-11-08T12:31:40.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b37fe700 1 -- 172.21.15.112:0/115214238 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a40035d0 con 0x7f31b40705c0 2023-11-08T12:31:40.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b89e6700 1 -- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b4160770 msgr2=0x7f31b4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b89e6700 1 --2- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b4160770 0x7f31b4070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b89e6700 1 -- 172.21.15.112:0/115214238 >> v1:172.21.15.112:6789/0 conn(0x7f31b40705c0 legacy=0x7f31b406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b89e6700 1 -- 172.21.15.112:0/115214238 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40d08d0 con 0x7f31b40ced50 2023-11-08T12:31:40.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.408+0000 7f31b89e6700 1 --2- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b40ced50 0x7f31b406afc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009850 tx=0x7f31a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4a7ef1d27eac279 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b37fe700 1 -- 172.21.15.112:0/115214238 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011830 con 0x7f31b40ced50 2023-11-08T12:31:40.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b37fe700 1 -- 172.21.15.112:0/115214238 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8011990 con 0x7f31b40ced50 2023-11-08T12:31:40.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b37fe700 1 -- 172.21.15.112:0/115214238 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011d40 con 0x7f31b40ced50 2023-11-08T12:31:40.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 -- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b40ced50 msgr2=0x7f31b406afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 --2- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b40ced50 0x7f31b406afc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009850 tx=0x7f31a8009b60 comp rx=0 tx=0).stop 2023-11-08T12:31:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 -- 172.21.15.112:0/115214238 shutdown_connections 2023-11-08T12:31:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 --2- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b4160770 0x7f31b4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 --2- 172.21.15.112:0/115214238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b40ced50 0x7f31b406afc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 -- 172.21.15.112:0/115214238 >> 172.21.15.112:0/115214238 conn(0x7f31b40b53a0 msgr2=0x7f31b40d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 -- 172.21.15.112:0/115214238 shutdown_connections 2023-11-08T12:31:40.418 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 -- 172.21.15.112:0/115214238 wait complete. 2023-11-08T12:31:40.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 Processor -- start 2023-11-08T12:31:40.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.412+0000 7f31b99e8700 1 -- start start 2023-11-08T12:31:40.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31b40705c0 0x7f31b415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b40ced50 0x7f31b41f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b4160770 0x7f31b41f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b8140 con 0x7f31b40705c0 2023-11-08T12:31:40.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b8420 con 0x7f31b4160770 2023-11-08T12:31:40.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b8700 con 0x7f31b40ced50 2023-11-08T12:31:40.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31b40705c0 0x7f31b415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31b40705c0 0x7f31b415a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51118/0 (socket says 172.21.15.112:51118) 2023-11-08T12:31:40.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 -- 172.21.15.112:0/1963303848 learned_addr learned my addr 172.21.15.112:0/1963303848 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b91e7700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b4160770 0x7f31b41f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b3fff700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b40ced50 0x7f31b41f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 -- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b40ced50 msgr2=0x7f31b41f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b40ced50 0x7f31b41f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 -- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b4160770 msgr2=0x7f31b41f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b4160770 0x7f31b41f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 -- 172.21.15.112:0/1963303848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80094b0 con 0x7f31b40705c0 2023-11-08T12:31:40.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b3fff700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b40ced50 0x7f31b41f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:40.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b91e7700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b4160770 0x7f31b41f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:40.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b89e6700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31b40705c0 0x7f31b415a950 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f31a80090b0 tx=0x7f31a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b17fa700 1 -- 172.21.15.112:0/1963303848 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8004480 con 0x7f31b40705c0 2023-11-08T12:31:40.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b17fa700 1 -- 172.21.15.112:0/1963303848 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a801f070 con 0x7f31b40705c0 2023-11-08T12:31:40.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b17fa700 1 -- 172.21.15.112:0/1963303848 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8003900 con 0x7f31b40705c0 2023-11-08T12:31:40.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40cf120 con 0x7f31b40705c0 2023-11-08T12:31:40.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.416+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40d0bb0 con 0x7f31b40705c0 2023-11-08T12:31:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.420+0000 7f31b17fa700 1 -- 172.21.15.112:0/1963303848 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f31a802a020 con 0x7f31b40705c0 2023-11-08T12:31:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b17fa700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3198064ee0 0x7f3198067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b17fa700 1 -- 172.21.15.112:0/1963303848 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f31a80835f0 con 0x7f31b40705c0 2023-11-08T12:31:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3198064ee0 0x7f3198067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 Processor -- start 2023-11-08T12:31:40.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3198064ee0 0x7f3198067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f31b40d0f90 tx=0x7f31a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 -- start start 2023-11-08T12:31:40.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5cc10 0xddc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5c840 0xddcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xccbd20 con 0xb5c840 2023-11-08T12:31:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3bd60 con 0xba78c0 2023-11-08T12:31:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xd35060 con 0xb5cc10 2023-11-08T12:31:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5c840 0xddcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5c840 0xddcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51124/0 (socket says 172.21.15.112:51124) 2023-11-08T12:31:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 -- 172.21.15.112:0/1951108645 learned_addr learned my addr 172.21.15.112:0/1951108645 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b89e6700 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5cc10 0xddc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b91e7700 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 -- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5cc10 msgr2=0xddc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5cc10 0xddc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 -- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 msgr2=0xddd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.424+0000 7f31b3fff700 1 -- 172.21.15.112:0/1951108645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd5b0a0 con 0xb5c840 2023-11-08T12:31:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31b3fff700 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5c840 0xddcd10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f31a00108f0 tx=0x7f31a0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df2d6af2c0fa6ab server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f319e7fc700 1 -- 172.21.15.112:0/1951108645 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0004230 con 0xb5c840 2023-11-08T12:31:40.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f319e7fc700 1 -- 172.21.15.112:0/1951108645 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a001a070 con 0xb5c840 2023-11-08T12:31:40.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f319e7fc700 1 -- 172.21.15.112:0/1951108645 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0015700 con 0xb5c840 2023-11-08T12:31:40.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 -- 172.21.15.112:0/1951108645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5c840 msgr2=0xddcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5c840 0xddcd10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f31a00108f0 tx=0x7f31a0013000 comp rx=0 tx=0).stop 2023-11-08T12:31:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 -- 172.21.15.112:0/1951108645 shutdown_connections 2023-11-08T12:31:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5c840 0xddcd10 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 --2- 172.21.15.112:0/1951108645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5cc10 0xddc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 -- 172.21.15.112:0/1951108645 >> 172.21.15.112:0/1951108645 conn(0xb5cfe0 msgr2=0xdf5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 -- 172.21.15.112:0/1951108645 shutdown_connections 2023-11-08T12:31:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 -- 172.21.15.112:0/1951108645 wait complete. 2023-11-08T12:31:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 -- start start 2023-11-08T12:31:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.428+0000 7f31bded7740 1 Processor -- start 2023-11-08T12:31:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xdde170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdcd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe1c50 con 0xb5cc10 2023-11-08T12:31:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xdcd7c0 con 0xba78c0 2023-11-08T12:31:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xdcda60 con 0xb5c840 2023-11-08T12:31:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 10 client.0 _ll_register_callbacks cb 0xd2e9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdcd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdcd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51132/0 (socket says 172.21.15.112:51132) 2023-11-08T12:31:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 -- 172.21.15.112:0/114895652 learned_addr learned my addr 172.21.15.112:0/114895652 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b89e6700 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xdde170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b91e7700 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 -- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 msgr2=0xdde170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xdde170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 -- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 msgr2=0xddb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 -- 172.21.15.112:0/114895652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a000e050 con 0xb5cc10 2023-11-08T12:31:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b3fff700 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdcd120 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f31a0024040 tx=0x7f31a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af37cd20341b6c2b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31937fe700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31937fe700 1 -- 172.21.15.112:0/114895652 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0015b80 con 0xb5cc10 2023-11-08T12:31:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31937fe700 1 -- 172.21.15.112:0/114895652 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f31a0015ce0 con 0xb5cc10 2023-11-08T12:31:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd2e0e0 con 0xb5cc10 2023-11-08T12:31:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31937fe700 1 -- 172.21.15.112:0/114895652 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a0015ea0 con 0xb5cc10 2023-11-08T12:31:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 10 client.6534 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0xba8b10 con 0xb5cc10 2023-11-08T12:31:40.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31937fe700 1 -- 172.21.15.112:0/114895652 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd2e0e0 con 0xb5cc10 2023-11-08T12:31:40.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31937fe700 1 -- 172.21.15.112:0/114895652 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f31a00036c0 con 0xb5cc10 2023-11-08T12:31:40.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 10 client.6534 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:40.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 10 client.6534 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:40.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 20 client.6534 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:40.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xdcc5a0 0xe18e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 4 client.6534 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:31:40.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd2de00 con 0xdcc5a0 2023-11-08T12:31:40.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.432+0000 7f31b89e6700 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xdcc5a0 0xe18e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31b89e6700 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xdcc5a0 0xe18e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efcf28b253d4954 server_cookie=425ce8cab9fc34b4 in_seq=0 out_seq=0 2023-11-08T12:31:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31937fe700 10 client.6534 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31937fe700 1 -- 172.21.15.112:0/114895652 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0xd2de00 con 0xdcc5a0 2023-11-08T12:31:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31937fe700 10 client.6534 handle_command_reply: tid=0 2023-11-08T12:31:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 client.6534 shutdown 2023-11-08T12:31:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 msgr2=0xdcd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdcd120 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f31a0024040 tx=0x7f31a0004770 comp rx=0 tx=0).stop 2023-11-08T12:31:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 shutdown_connections 2023-11-08T12:31:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xdcc5a0 0xe18e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xddb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdcd120 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 --2- 172.21.15.112:0/114895652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xdde170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31937fe700 0 client.6534 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 >> 172.21.15.112:0/114895652 conn(0xb5cfe0 msgr2=0xdde760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 shutdown_connections 2023-11-08T12:31:40.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 1 -- 172.21.15.112:0/114895652 wait complete. 2023-11-08T12:31:40.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.436+0000 7f31bded7740 20 client.6534 trim_cache size 0 max 16384 2023-11-08T12:31:40.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 Processor -- start 2023-11-08T12:31:40.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 -- start start 2023-11-08T12:31:40.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb5c840 0xdda2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdda7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xba78c0 0xddad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xd33ef0 con 0xb5cc10 2023-11-08T12:31:40.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xd04ba0 con 0xb5c840 2023-11-08T12:31:40.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xd32870 con 0xba78c0 2023-11-08T12:31:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdda7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdda7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51138/0 (socket says 172.21.15.112:51138) 2023-11-08T12:31:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 -- 172.21.15.112:0/3895940317 learned_addr learned my addr 172.21.15.112:0/3895940317 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b89e6700 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb5c840 0xdda2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b91e7700 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xba78c0 0xddad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 -- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xba78c0 msgr2=0xddad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xba78c0 0xddad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 -- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb5c840 msgr2=0xdda2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb5c840 0xdda2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 -- 172.21.15.112:0/3895940317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40c8a00 con 0xb5cc10 2023-11-08T12:31:40.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b91e7700 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xba78c0 0xddad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:40.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.456+0000 7f31b3fff700 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdda7f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f31a0000c00 tx=0x7f31a002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7e831823a88306 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f319effd700 1 -- 172.21.15.112:0/3895940317 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0010ee0 con 0xb5cc10 2023-11-08T12:31:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f319effd700 1 -- 172.21.15.112:0/3895940317 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00157b0 con 0xb5cc10 2023-11-08T12:31:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f319effd700 1 -- 172.21.15.112:0/3895940317 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003bd0 con 0xb5cc10 2023-11-08T12:31:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 -- 172.21.15.112:0/3895940317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 msgr2=0xdda7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdda7f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f31a0000c00 tx=0x7f31a002c000 comp rx=0 tx=0).stop 2023-11-08T12:31:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 -- 172.21.15.112:0/3895940317 shutdown_connections 2023-11-08T12:31:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xba78c0 0xddad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xdda7f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 --2- 172.21.15.112:0/3895940317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xb5c840 0xdda2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 -- 172.21.15.112:0/3895940317 >> 172.21.15.112:0/3895940317 conn(0xb5cfe0 msgr2=0xe16eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 -- 172.21.15.112:0/3895940317 shutdown_connections 2023-11-08T12:31:40.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 -- 172.21.15.112:0/3895940317 wait complete. 2023-11-08T12:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 -- start start 2023-11-08T12:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.460+0000 7f31bded7740 1 Processor -- start 2023-11-08T12:31:40.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xe28f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xe71c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xe29750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3cff0 con 0xb5cc10 2023-11-08T12:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xe187e0 con 0xba78c0 2023-11-08T12:31:40.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0xdcbdb0 con 0xb5c840 2023-11-08T12:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 10 client.0 _ll_register_callbacks cb 0x7f31a0009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xe71c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xe71c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51142/0 (socket says 172.21.15.112:51142) 2023-11-08T12:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 -- 172.21.15.112:0/2555865533 learned_addr learned my addr 172.21.15.112:0/2555865533 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b91e7700 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xe29750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b89e6700 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xe28f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 -- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 msgr2=0xe28f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xe28f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 -- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 msgr2=0xe29750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xe29750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 -- 172.21.15.112:0/2555865533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xba8b10 con 0xb5cc10 2023-11-08T12:31:40.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b3fff700 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xe71c50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f31a0008010 tx=0x7f31a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a430c162690fc1ef server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31937fe700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:40.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31937fe700 1 -- 172.21.15.112:0/2555865533 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003ae0 con 0xb5cc10 2023-11-08T12:31:40.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31937fe700 1 -- 172.21.15.112:0/2555865533 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f31a0049d80 con 0xb5cc10 2023-11-08T12:31:40.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31a001a070 con 0xb5cc10 2023-11-08T12:31:40.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31937fe700 1 -- 172.21.15.112:0/2555865533 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a0003c40 con 0xb5cc10 2023-11-08T12:31:40.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 10 client.6540 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:40.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0xce1af0 con 0xb5cc10 2023-11-08T12:31:40.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31937fe700 1 -- 172.21.15.112:0/2555865533 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a001a070 con 0xb5cc10 2023-11-08T12:31:40.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31937fe700 1 -- 172.21.15.112:0/2555865533 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f31a0021440 con 0xb5cc10 2023-11-08T12:31:40.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 10 client.6540 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:40.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 10 client.6540 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:40.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 20 client.6540 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:40.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xe72190 0xe29c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 4 client.6540 mds_command: new command op to 6282 tid=0[{"prefix": "scrub status"}] 2023-11-08T12:31:40.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xbd9390 con 0xe72190 2023-11-08T12:31:40.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.464+0000 7f31b89e6700 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xe72190 0xe29c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b89e6700 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xe72190 0xe29c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ad6f1643fa99854 server_cookie=f97f245cae5febf1 in_seq=0 out_seq=0 2023-11-08T12:31:40.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31937fe700 10 client.6540 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31937fe700 1 -- 172.21.15.112:0/2555865533 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xbd9390 con 0xe72190 2023-11-08T12:31:40.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31937fe700 10 client.6540 handle_command_reply: tid=0 2023-11-08T12:31:40.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 client.6540 shutdown 2023-11-08T12:31:40.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 msgr2=0xe71c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xe71c50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f31a0008010 tx=0x7f31a0016000 comp rx=0 tx=0).stop 2023-11-08T12:31:40.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 shutdown_connections 2023-11-08T12:31:40.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0xe72190 0xe29c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xba78c0 0xe29750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xb5cc10 0xe71c50 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 --2- 172.21.15.112:0/2555865533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xb5c840 0xe28f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31937fe700 0 client.6540 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 >> 172.21.15.112:0/2555865533 conn(0xb5cfe0 msgr2=0xddad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 shutdown_connections 2023-11-08T12:31:40.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 1 -- 172.21.15.112:0/2555865533 wait complete. 2023-11-08T12:31:40.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31bded7740 20 client.6540 trim_cache size 0 max 16384 2023-11-08T12:31:40.483 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:31:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "status": "no active scrubs running", 2023-11-08T12:31:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "scrubs": {} 2023-11-08T12:31:40.483 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3198064ee0 msgr2=0x7f3198067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3198064ee0 0x7f3198067390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f31b40d0f90 tx=0x7f31a0008040 comp rx=0 tx=0).stop 2023-11-08T12:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31b40705c0 msgr2=0x7f31b415a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31b40705c0 0x7f31b415a950 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f31a80090b0 tx=0x7f31a8004770 comp rx=0 tx=0).stop 2023-11-08T12:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 shutdown_connections 2023-11-08T12:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3198064ee0 0x7f3198067390 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b4160770 0x7f31b41f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31b40ced50 0x7f31b41f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 --2- 172.21.15.112:0/1963303848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31b40705c0 0x7f31b415a950 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 >> 172.21.15.112:0/1963303848 conn(0x7f31b40b53a0 msgr2=0x7f31b40cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 shutdown_connections 2023-11-08T12:31:40.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.468+0000 7f31b99e8700 1 -- 172.21.15.112:0/1963303848 wait complete. 2023-11-08T12:31:40.494 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-08T12:31:40.495 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 damage ls 2023-11-08T12:31:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.676+0000 7f7951ba0700 1 Processor -- start 2023-11-08T12:31:40.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.676+0000 7f7951ba0700 1 -- start start 2023-11-08T12:31:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7951ba0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f794c0aed60 0x7f794c165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7951ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7951ba0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c06afb0 con 0x7f794c06c2b0 2023-11-08T12:31:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7951ba0700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0ca750 con 0x7f794c0aed60 2023-11-08T12:31:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7951ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c06b290 con 0x7f794c06c680 2023-11-08T12:31:40.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f794c06c2b0 0x7f794c1639d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:54864/0 (socket says 172.21.15.112:54864) 2023-11-08T12:31:40.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794b7fe700 1 -- 172.21.15.112:0/4281082718 learned_addr learned my addr 172.21.15.112:0/4281082718 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:40.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7942ffd700 1 --2- 172.21.15.112:0/4281082718 >> v2:172.21.15.112:3300/0 conn(0x7f794c0aed60 0x7f794c165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794bfff700 1 --2- 172.21.15.112:0/4281082718 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794affd700 1 -- 172.21.15.112:0/4281082718 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335303085 0 0) 0x7f794c06afb0 con 0x7f794c06c2b0 2023-11-08T12:31:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794affd700 1 -- 172.21.15.112:0/4281082718 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79380035d0 con 0x7f794c06c2b0 2023-11-08T12:31:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7942ffd700 1 -- 172.21.15.112:0/4281082718 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 msgr2=0x7f794c0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7942ffd700 1 --2- 172.21.15.112:0/4281082718 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7942ffd700 1 -- 172.21.15.112:0/4281082718 >> v1:172.21.15.133:6789/0 conn(0x7f794c06c2b0 legacy=0x7f794c1639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7942ffd700 1 -- 172.21.15.112:0/4281082718 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0c8f40 con 0x7f794c0aed60 2023-11-08T12:31:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f7942ffd700 1 --2- 172.21.15.112:0/4281082718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c165080 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7934009850 tx=0x7f7934009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574ffed4ac8808bb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794affd700 1 -- 172.21.15.112:0/4281082718 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934011830 con 0x7f794c0aed60 2023-11-08T12:31:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794affd700 1 -- 172.21.15.112:0/4281082718 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934011990 con 0x7f794c0aed60 2023-11-08T12:31:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.680+0000 7f794affd700 1 -- 172.21.15.112:0/4281082718 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934011d40 con 0x7f794c0aed60 2023-11-08T12:31:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 -- 172.21.15.112:0/4281082718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 msgr2=0x7f794c165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 --2- 172.21.15.112:0/4281082718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c165080 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7934009850 tx=0x7f7934009b60 comp rx=0 tx=0).stop 2023-11-08T12:31:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 -- 172.21.15.112:0/4281082718 shutdown_connections 2023-11-08T12:31:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 --2- 172.21.15.112:0/4281082718 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 --2- 172.21.15.112:0/4281082718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c165080 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 -- 172.21.15.112:0/4281082718 >> 172.21.15.112:0/4281082718 conn(0x7f794c0cf580 msgr2=0x7f794c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 -- 172.21.15.112:0/4281082718 shutdown_connections 2023-11-08T12:31:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.684+0000 7f7951ba0700 1 -- 172.21.15.112:0/4281082718 wait complete. 2023-11-08T12:31:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 Processor -- start 2023-11-08T12:31:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 -- start start 2023-11-08T12:31:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f794c06c2b0 0x7f794c0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0b22e0 con 0x7f794c0aed60 2023-11-08T12:31:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0b25c0 con 0x7f794c06c2b0 2023-11-08T12:31:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7951ba0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0b28a0 con 0x7f794c06c680 2023-11-08T12:31:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f794bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f794bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51162/0 (socket says 172.21.15.112:51162) 2023-11-08T12:31:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f794bfff700 1 -- 172.21.15.112:0/453468256 learned_addr learned my addr 172.21.15.112:0/453468256 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f7942ffd700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.688+0000 7f794b7fe700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f794c06c2b0 0x7f794c0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f794bfff700 1 -- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 msgr2=0x7f794c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f794bfff700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f794bfff700 1 -- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f794c06c2b0 msgr2=0x7f794c0b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f794bfff700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f794c06c2b0 0x7f794c0b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f794bfff700 1 -- 172.21.15.112:0/453468256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340094b0 con 0x7f794c0aed60 2023-11-08T12:31:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f794bfff700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c158a00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f794400efc0 tx=0x7f794400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f7948ff9700 1 -- 172.21.15.112:0/453468256 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944009ea0 con 0x7f794c0aed60 2023-11-08T12:31:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f7948ff9700 1 -- 172.21.15.112:0/453468256 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400f040 con 0x7f794c0aed60 2023-11-08T12:31:40.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c0ad800 con 0x7f794c0aed60 2023-11-08T12:31:40.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f7948ff9700 1 -- 172.21.15.112:0/453468256 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400ced0 con 0x7f794c0aed60 2023-11-08T12:31:40.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.692+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c0c9220 con 0x7f794c0aed60 2023-11-08T12:31:40.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.696+0000 7f7948ff9700 1 -- 172.21.15.112:0/453468256 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7944014480 con 0x7f794c0aed60 2023-11-08T12:31:40.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.696+0000 7f7948ff9700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f792c064ee0 0x7f792c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.696+0000 7f7948ff9700 1 -- 172.21.15.112:0/453468256 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f79440829f0 con 0x7f794c0aed60 2023-11-08T12:31:40.713 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.696+0000 7f794b7fe700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f792c064ee0 0x7f792c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.696+0000 7f794b7fe700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f792c064ee0 0x7f792c067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f793c007fd0 tx=0x7f793c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.696+0000 7f7954e2e740 1 Processor -- start 2023-11-08T12:31:40.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.696+0000 7f7954e2e740 1 -- start start 2023-11-08T12:31:40.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649c10 0x18df930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18f9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16948c0 0x18f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x17b8bc0 con 0x1649c10 2023-11-08T12:31:40.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1828cb0 con 0x1649840 2023-11-08T12:31:40.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1821fb0 con 0x16948c0 2023-11-08T12:31:40.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649c10 0x18df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649c10 0x18df930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51166/0 (socket says 172.21.15.112:51166) 2023-11-08T12:31:40.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 -- 172.21.15.112:0/3523955326 learned_addr learned my addr 172.21.15.112:0/3523955326 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794bfff700 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16948c0 0x18f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7942ffd700 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 -- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16948c0 msgr2=0x18f9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16948c0 0x18f9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 -- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 msgr2=0x18f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 -- 172.21.15.112:0/3523955326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18479f0 con 0x1649c10 2023-11-08T12:31:40.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794bfff700 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16948c0 0x18f9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:40.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f794b7fe700 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649c10 0x18df930 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f793c0015b0 tx=0x7f793c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f2114a54d2dcbf server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f79417fa700 1 -- 172.21.15.112:0/3523955326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c001d30 con 0x1649c10 2023-11-08T12:31:40.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f79417fa700 1 -- 172.21.15.112:0/3523955326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c005900 con 0x1649c10 2023-11-08T12:31:40.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f79417fa700 1 -- 172.21.15.112:0/3523955326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c005c70 con 0x1649c10 2023-11-08T12:31:40.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- 172.21.15.112:0/3523955326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649c10 msgr2=0x18df930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649c10 0x18df930 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f793c0015b0 tx=0x7f793c012000 comp rx=0 tx=0).stop 2023-11-08T12:31:40.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- 172.21.15.112:0/3523955326 shutdown_connections 2023-11-08T12:31:40.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x16948c0 0x18f9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3523955326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649c10 0x18df930 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- 172.21.15.112:0/3523955326 >> 172.21.15.112:0/3523955326 conn(0x1649fe0 msgr2=0x18e2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- 172.21.15.112:0/3523955326 shutdown_connections 2023-11-08T12:31:40.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.700+0000 7f7954e2e740 1 -- 172.21.15.112:0/3523955326 wait complete. 2023-11-08T12:31:40.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 -- start start 2023-11-08T12:31:40.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 Processor -- start 2023-11-08T12:31:40.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x16cec50 con 0x16948c0 2023-11-08T12:31:40.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18b9850 con 0x1649840 2023-11-08T12:31:40.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x18dcfe0 con 0x1649c10 2023-11-08T12:31:40.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 10 client.0 _ll_register_callbacks cb 0x187e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:40.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51170/0 (socket says 172.21.15.112:51170) 2023-11-08T12:31:40.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 -- 172.21.15.112:0/2130137807 learned_addr learned my addr 172.21.15.112:0/2130137807 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794b7fe700 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7942ffd700 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 -- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 msgr2=0x18b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 -- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 msgr2=0x18dcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18dcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 -- 172.21.15.112:0/2130137807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79380035d0 con 0x16948c0 2023-11-08T12:31:40.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f794bfff700 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18b8370 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7944009db0 tx=0x7f7944053ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb29217c060e414 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f792a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:40.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f792a7fc700 1 -- 172.21.15.112:0/2130137807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794406bd60 con 0x16948c0 2023-11-08T12:31:40.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f792a7fc700 1 -- 172.21.15.112:0/2130137807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7944058360 con 0x16948c0 2023-11-08T12:31:40.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.704+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x181b030 con 0x16948c0 2023-11-08T12:31:40.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f792a7fc700 1 -- 172.21.15.112:0/2130137807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79440503e0 con 0x16948c0 2023-11-08T12:31:40.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 10 client.6552 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:40.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1695b10 con 0x16948c0 2023-11-08T12:31:40.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f792a7fc700 1 -- 172.21.15.112:0/2130137807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x181b030 con 0x16948c0 2023-11-08T12:31:40.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f792a7fc700 1 -- 172.21.15.112:0/2130137807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7944070d20 con 0x16948c0 2023-11-08T12:31:40.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 10 client.6552 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:40.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 10 client.6552 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:40.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 20 client.6552 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:40.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19108d0 0x1912cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 4 client.6552 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:31:40.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x181ad50 con 0x19108d0 2023-11-08T12:31:40.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f794b7fe700 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19108d0 0x1912cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f794b7fe700 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19108d0 0x1912cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0cf26ecbccf9c20 server_cookie=9826e574e2ab9a6f in_seq=0 out_seq=0 2023-11-08T12:31:40.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f792a7fc700 10 client.6552 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f792a7fc700 1 -- 172.21.15.112:0/2130137807 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x181ad50 con 0x19108d0 2023-11-08T12:31:40.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f792a7fc700 10 client.6552 handle_command_reply: tid=0 2023-11-08T12:31:40.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 client.6552 shutdown 2023-11-08T12:31:40.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 msgr2=0x18b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18b8370 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7944009db0 tx=0x7f7944053ae0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 shutdown_connections 2023-11-08T12:31:40.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x19108d0 0x1912cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18b8370 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 --2- 172.21.15.112:0/2130137807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649840 0x18dcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f792a7fc700 0 client.6552 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 >> 172.21.15.112:0/2130137807 conn(0x1649fe0 msgr2=0x18de650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 shutdown_connections 2023-11-08T12:31:40.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.708+0000 7f7954e2e740 1 -- 172.21.15.112:0/2130137807 wait complete. 2023-11-08T12:31:40.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.712+0000 7f7954e2e740 20 client.6552 trim_cache size 0 max 16384 2023-11-08T12:31:40.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.724+0000 7f7954e2e740 1 Processor -- start 2023-11-08T12:31:40.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.724+0000 7f7954e2e740 1 -- start start 2023-11-08T12:31:40.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649840 0x18b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16948c0 0x18de130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1823c20 con 0x1649840 2023-11-08T12:31:40.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x17b81d0 con 0x16948c0 2023-11-08T12:31:40.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x181f7c0 con 0x1649c10 2023-11-08T12:31:40.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649840 0x18b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649840 0x18b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51180/0 (socket says 172.21.15.112:51180) 2023-11-08T12:31:40.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 -- 172.21.15.112:0/3005579459 learned_addr learned my addr 172.21.15.112:0/3005579459 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794bfff700 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16948c0 0x18de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7942ffd700 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 -- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 msgr2=0x18b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 -- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16948c0 msgr2=0x18de130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16948c0 0x18de130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 -- 172.21.15.112:0/3005579459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c1592a0 con 0x1649840 2023-11-08T12:31:40.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f794b7fe700 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649840 0x18b7df0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f793c000f60 tx=0x7f793c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2d0f073dbc8e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7941ffb700 1 -- 172.21.15.112:0/3005579459 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c032070 con 0x1649840 2023-11-08T12:31:40.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7941ffb700 1 -- 172.21.15.112:0/3005579459 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c006c10 con 0x1649840 2023-11-08T12:31:40.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7941ffb700 1 -- 172.21.15.112:0/3005579459 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c005bf0 con 0x1649840 2023-11-08T12:31:40.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- 172.21.15.112:0/3005579459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649840 msgr2=0x18b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649840 0x18b7df0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f793c000f60 tx=0x7f793c01e000 comp rx=0 tx=0).stop 2023-11-08T12:31:40.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- 172.21.15.112:0/3005579459 shutdown_connections 2023-11-08T12:31:40.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x16948c0 0x18de130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649c10 0x18b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 --2- 172.21.15.112:0/3005579459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1649840 0x18b7df0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- 172.21.15.112:0/3005579459 >> 172.21.15.112:0/3005579459 conn(0x1649fe0 msgr2=0x190f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- 172.21.15.112:0/3005579459 shutdown_connections 2023-11-08T12:31:40.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.728+0000 7f7954e2e740 1 -- 172.21.15.112:0/3005579459 wait complete. 2023-11-08T12:31:40.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 -- start start 2023-11-08T12:31:40.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 Processor -- start 2023-11-08T12:31:40.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649840 0x18de5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649c10 0x18deb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18fe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x17ec790 con 0x16948c0 2023-11-08T12:31:40.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1825fb0 con 0x1649c10 2023-11-08T12:31:40.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1824b10 con 0x1649840 2023-11-08T12:31:40.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 10 client.0 _ll_register_callbacks cb 0x184d660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:40.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51196/0 (socket says 172.21.15.112:51196) 2023-11-08T12:31:40.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 -- 172.21.15.112:0/1979967367 learned_addr learned my addr 172.21.15.112:0/1979967367 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794b7fe700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649840 0x18de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7942ffd700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649c10 0x18deb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 -- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649840 msgr2=0x18de5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649840 0x18de5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 -- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649c10 msgr2=0x18deb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:40.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649c10 0x18deb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 -- 172.21.15.112:0/1979967367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x18479f0 con 0x16948c0 2023-11-08T12:31:40.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7942ffd700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649c10 0x18deb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:40.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f794bfff700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18fe820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7944052940 tx=0x7f7944004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d36b4ef10674bc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f792a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:40.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f792a7fc700 1 -- 172.21.15.112:0/1979967367 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944054a00 con 0x16948c0 2023-11-08T12:31:40.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f792a7fc700 1 -- 172.21.15.112:0/1979967367 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7944058360 con 0x16948c0 2023-11-08T12:31:40.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f793c005900 con 0x16948c0 2023-11-08T12:31:40.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f792a7fc700 1 -- 172.21.15.112:0/1979967367 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f794405c250 con 0x16948c0 2023-11-08T12:31:40.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 10 client.6558 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:40.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x17ceac0 con 0x16948c0 2023-11-08T12:31:40.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f792a7fc700 1 -- 172.21.15.112:0/1979967367 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c005900 con 0x16948c0 2023-11-08T12:31:40.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f792a7fc700 1 -- 172.21.15.112:0/1979967367 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7944070d20 con 0x16948c0 2023-11-08T12:31:40.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 10 client.6558 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:40.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 10 client.6558 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:40.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 20 client.6558 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:40.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18e3d80 0x18fed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 4 client.6558 mds_command: new command op to 6282 tid=0[{"prefix": "damage ls"}] 2023-11-08T12:31:40.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.732+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x16c6390 con 0x18e3d80 2023-11-08T12:31:40.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f794b7fe700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18e3d80 0x18fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f794b7fe700 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18e3d80 0x18fed60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9650d9bdd2cd90a7 server_cookie=90e9ed9b18375ffe in_seq=0 out_seq=0 2023-11-08T12:31:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f792a7fc700 10 client.6558 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f792a7fc700 1 -- 172.21.15.112:0/1979967367 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x16c6390 con 0x18e3d80 2023-11-08T12:31:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f792a7fc700 10 client.6558 handle_command_reply: tid=0 2023-11-08T12:31:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 client.6558 shutdown 2023-11-08T12:31:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 msgr2=0x18fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18fe820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7944052940 tx=0x7f7944004af0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 shutdown_connections 2023-11-08T12:31:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18e3d80 0x18fed60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x16948c0 0x18fe820 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1649c10 0x18deb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 --2- 172.21.15.112:0/1979967367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1649840 0x18de5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f792a7fc700 0 client.6558 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:40.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 >> 172.21.15.112:0/1979967367 conn(0x1649fe0 msgr2=0x18e23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 shutdown_connections 2023-11-08T12:31:40.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 1 -- 172.21.15.112:0/1979967367 wait complete. 2023-11-08T12:31:40.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7954e2e740 20 client.6558 trim_cache size 0 max 16384 2023-11-08T12:31:40.755 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-11-08T12:31:40.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:31:40.756 INFO:teuthology.orchestra.run.smithi112.stdout: "damage_type": "backtrace", 2023-11-08T12:31:40.756 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 2758995627, 2023-11-08T12:31:40.757 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 1099511627777, 2023-11-08T12:31:40.757 INFO:teuthology.orchestra.run.smithi112.stdout: "path": "/dir_test/file" 2023-11-08T12:31:40.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:31:40.757 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-11-08T12:31:40.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f792c064ee0 msgr2=0x7f792c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7951ba0700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f792c064ee0 0x7f792c067390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f793c007fd0 tx=0x7f793c007de0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 msgr2=0x7f794c158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.736+0000 7f7951ba0700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c158a00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f794400efc0 tx=0x7f794400c3a0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 shutdown_connections 2023-11-08T12:31:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f792c064ee0 0x7f792c067390 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f794c0aed60 0x7f794c158a00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f794c06c680 0x7f794c0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 --2- 172.21.15.112:0/453468256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f794c06c2b0 0x7f794c0b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 >> 172.21.15.112:0/453468256 conn(0x7f794c0cf580 msgr2=0x7f794c0c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 shutdown_connections 2023-11-08T12:31:40.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.740+0000 7f7951ba0700 1 -- 172.21.15.112:0/453468256 wait complete. 2023-11-08T12:31:40.765 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-08T12:31:40.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.948+0000 7f6e5d392700 1 Processor -- start 2023-11-08T12:31:40.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.948+0000 7f6e5d392700 1 -- start start 2023-11-08T12:31:40.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e5d392700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6e581533b0 0x7f6e58069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e5d392700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580b21f0 con 0x7f6e5806a130 2023-11-08T12:31:40.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e5d392700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e58153780 con 0x7f6e580b36c0 2023-11-08T12:31:40.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e5d392700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5806d950 con 0x7f6e581533b0 2023-11-08T12:31:40.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e56ffd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6e581533b0 0x7f6e58069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e4e7fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6e5806a130 0x7f6e580b2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58206/0 (socket says 172.21.15.112:58206) 2023-11-08T12:31:40.956 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e4e7fc700 1 -- 172.21.15.112:0/4015987407 learned_addr learned my addr 172.21.15.112:0/4015987407 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e567fc700 1 -- 172.21.15.112:0/4015987407 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136451189 0 0) 0x7f6e580b21f0 con 0x7f6e5806a130 2023-11-08T12:31:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e567fc700 1 -- 172.21.15.112:0/4015987407 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e440035d0 con 0x7f6e5806a130 2023-11-08T12:31:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e56ffd700 1 -- 172.21.15.112:0/4015987407 >> v1:172.21.15.133:6789/0 conn(0x7f6e580b36c0 legacy=0x7f6e5806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e567fc700 1 -- 172.21.15.112:0/4015987407 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847714231 0 0) 0x7f6e58153780 con 0x7f6e580b36c0 2023-11-08T12:31:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e56ffd700 1 -- 172.21.15.112:0/4015987407 >> v1:172.21.15.112:6789/0 conn(0x7f6e5806a130 legacy=0x7f6e580b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e56ffd700 1 -- 172.21.15.112:0/4015987407 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5806d390 con 0x7f6e581533b0 2023-11-08T12:31:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e56ffd700 1 --2- 172.21.15.112:0/4015987407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58069bf0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009850 tx=0x7f6e48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ca4cf425df2c7c server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e567fc700 1 -- 172.21.15.112:0/4015987407 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011830 con 0x7f6e581533b0 2023-11-08T12:31:40.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e567fc700 1 -- 172.21.15.112:0/4015987407 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48011990 con 0x7f6e581533b0 2023-11-08T12:31:40.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.952+0000 7f6e567fc700 1 -- 172.21.15.112:0/4015987407 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011d40 con 0x7f6e581533b0 2023-11-08T12:31:40.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 -- 172.21.15.112:0/4015987407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 msgr2=0x7f6e58069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 --2- 172.21.15.112:0/4015987407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58069bf0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009850 tx=0x7f6e48009b60 comp rx=0 tx=0).stop 2023-11-08T12:31:40.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 -- 172.21.15.112:0/4015987407 shutdown_connections 2023-11-08T12:31:40.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 --2- 172.21.15.112:0/4015987407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58069bf0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 -- 172.21.15.112:0/4015987407 >> 172.21.15.112:0/4015987407 conn(0x7f6e580d2c60 msgr2=0x7f6e580d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:40.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 -- 172.21.15.112:0/4015987407 shutdown_connections 2023-11-08T12:31:40.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 -- 172.21.15.112:0/4015987407 wait complete. 2023-11-08T12:31:40.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 Processor -- start 2023-11-08T12:31:40.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.956+0000 7f6e5d392700 1 -- start start 2023-11-08T12:31:40.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e5806a130 0x7f6e58143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e580b36c0 0x7f6e581f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e581441f0 con 0x7f6e581533b0 2023-11-08T12:31:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58140f10 con 0x7f6e580b36c0 2023-11-08T12:31:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58143200 con 0x7f6e5806a130 2023-11-08T12:31:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51212/0 (socket says 172.21.15.112:51212) 2023-11-08T12:31:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 -- 172.21.15.112:0/1234824041 learned_addr learned my addr 172.21.15.112:0/1234824041 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e56ffd700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e5806a130 0x7f6e58143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e4e7fc700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e580b36c0 0x7f6e581f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 -- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e5806a130 msgr2=0x7f6e58143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e5806a130 0x7f6e58143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 -- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e580b36c0 msgr2=0x7f6e581f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e580b36c0 0x7f6e581f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:40.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 -- 172.21.15.112:0/1234824041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480094b0 con 0x7f6e581533b0 2023-11-08T12:31:40.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e577fe700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58155c40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000cc70 tx=0x7f6e5000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e4ffff700 1 -- 172.21.15.112:0/1234824041 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50003e50 con 0x7f6e581533b0 2023-11-08T12:31:40.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e4ffff700 1 -- 172.21.15.112:0/1234824041 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5000a6f0 con 0x7f6e581533b0 2023-11-08T12:31:40.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580b1e80 con 0x7f6e581533b0 2023-11-08T12:31:40.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e4ffff700 1 -- 172.21.15.112:0/1234824041 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000aaa0 con 0x7f6e581533b0 2023-11-08T12:31:40.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.960+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5806d670 con 0x7f6e581533b0 2023-11-08T12:31:40.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.964+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e580b2d90 con 0x7f6e581533b0 2023-11-08T12:31:40.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.964+0000 7f6e4ffff700 1 -- 172.21.15.112:0/1234824041 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6e50019030 con 0x7f6e581533b0 2023-11-08T12:31:40.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.968+0000 7f6e4ffff700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e38064ee0 0x7f6e38067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:40.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.968+0000 7f6e4ffff700 1 -- 172.21.15.112:0/1234824041 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6e50081950 con 0x7f6e581533b0 2023-11-08T12:31:40.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.968+0000 7f6e56ffd700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e38064ee0 0x7f6e38067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:40.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.968+0000 7f6e56ffd700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e38064ee0 0x7f6e38067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e480090b0 tx=0x7f6e4801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:40.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:40.972+0000 7f6e4ffff700 1 -- 172.21.15.112:0/1234824041 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f6e5004f970 con 0x7f6e581533b0 2023-11-08T12:31:41.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.180+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6e58159720 con 0x7f6e581533b0 2023-11-08T12:31:41.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.184+0000 7f6e4ffff700 1 -- 172.21.15.112:0/1234824041 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f6e50052f90 con 0x7f6e581533b0 2023-11-08T12:31:41.186 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:31:41.186 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-08T12:31:41.189 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e38064ee0 msgr2=0x7f6e38067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e38064ee0 0x7f6e38067390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e480090b0 tx=0x7f6e4801c040 comp rx=0 tx=0).stop 2023-11-08T12:31:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 msgr2=0x7f6e58155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.190 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58155c40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000cc70 tx=0x7f6e5000cf80 comp rx=0 tx=0).stop 2023-11-08T12:31:41.191 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 shutdown_connections 2023-11-08T12:31:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f6e38064ee0 0x7f6e38067390 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e581533b0 0x7f6e58155c40 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e580b36c0 0x7f6e581f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 --2- 172.21.15.112:0/1234824041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e5806a130 0x7f6e58143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 >> 172.21.15.112:0/1234824041 conn(0x7f6e580d2c60 msgr2=0x7f6e5815da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 shutdown_connections 2023-11-08T12:31:41.193 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.188+0000 7f6e5d392700 1 -- 172.21.15.112:0/1234824041 wait complete. 2023-11-08T12:31:41.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive 2023-11-08T12:31:41.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.392+0000 7faec6220700 1 Processor -- start 2023-11-08T12:31:41.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.392+0000 7faec6220700 1 -- start start 2023-11-08T12:31:41.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec6220700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faec015c6e0 0x7faec0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec6220700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec015cab0 con 0x7faec006a510 2023-11-08T12:31:41.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec6220700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec00702d0 con 0x7faec0071fe0 2023-11-08T12:31:41.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec6220700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00d2800 con 0x7faec015c6e0 2023-11-08T12:31:41.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec5a1f700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faec006a510 0x7faec006c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58210/0 (socket says 172.21.15.112:58210) 2023-11-08T12:31:41.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec5a1f700 1 -- 172.21.15.112:0/232975037 learned_addr learned my addr 172.21.15.112:0/232975037 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:31:41.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec521e700 1 --2- 172.21.15.112:0/232975037 >> v2:172.21.15.133:3300/0 conn(0x7faec015c6e0 0x7faec0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faeb7fff700 1 -- 172.21.15.112:0/232975037 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764630628 0 0) 0x7faec015cab0 con 0x7faec006a510 2023-11-08T12:31:41.400 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faeb7fff700 1 -- 172.21.15.112:0/232975037 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeac0035d0 con 0x7faec006a510 2023-11-08T12:31:41.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec521e700 1 -- 172.21.15.112:0/232975037 >> v1:172.21.15.133:6789/0 conn(0x7faec0071fe0 legacy=0x7faec0069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.401 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faeb7fff700 1 -- 172.21.15.112:0/232975037 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1335889117 0 0) 0x7faeac0035d0 con 0x7faec006a510 2023-11-08T12:31:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec521e700 1 -- 172.21.15.112:0/232975037 >> v1:172.21.15.112:6789/0 conn(0x7faec006a510 legacy=0x7faec006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec521e700 1 -- 172.21.15.112:0/232975037 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00d2a10 con 0x7faec015c6e0 2023-11-08T12:31:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faec521e700 1 --2- 172.21.15.112:0/232975037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 0x7faec0071aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faebc009850 tx=0x7faebc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46227547e7fb0d5a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.396+0000 7faeb7fff700 1 -- 172.21.15.112:0/232975037 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb80019f0 con 0x7faec015c6e0 2023-11-08T12:31:41.402 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faeb7fff700 1 -- 172.21.15.112:0/232975037 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc004030 con 0x7faec015c6e0 2023-11-08T12:31:41.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faeb7fff700 1 -- 172.21.15.112:0/232975037 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc0043c0 con 0x7faec015c6e0 2023-11-08T12:31:41.403 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 -- 172.21.15.112:0/232975037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 msgr2=0x7faec0071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 --2- 172.21.15.112:0/232975037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 0x7faec0071aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faebc009850 tx=0x7faebc009b60 comp rx=0 tx=0).stop 2023-11-08T12:31:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 -- 172.21.15.112:0/232975037 shutdown_connections 2023-11-08T12:31:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 --2- 172.21.15.112:0/232975037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 0x7faec0071aa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 -- 172.21.15.112:0/232975037 >> 172.21.15.112:0/232975037 conn(0x7faec00b65b0 msgr2=0x7faec0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.404 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 -- 172.21.15.112:0/232975037 shutdown_connections 2023-11-08T12:31:41.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 -- 172.21.15.112:0/232975037 wait complete. 2023-11-08T12:31:41.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 Processor -- start 2023-11-08T12:31:41.405 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.400+0000 7faec6220700 1 -- start start 2023-11-08T12:31:41.406 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec006a510 0x7faec00c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faec0071fe0 0x7faec01f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 0x7faec01f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00cb3d0 con 0x7faec006a510 2023-11-08T12:31:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00cb6b0 con 0x7faec015c6e0 2023-11-08T12:31:41.407 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec01f2e80 con 0x7faec0071fe0 2023-11-08T12:31:41.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec006a510 0x7faec00c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec006a510 0x7faec00c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51220/0 (socket says 172.21.15.112:51220) 2023-11-08T12:31:41.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 -- 172.21.15.112:0/2262551779 learned_addr learned my addr 172.21.15.112:0/2262551779 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec5a1f700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 0x7faec01f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec4a1d700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faec0071fe0 0x7faec01f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 -- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faec0071fe0 msgr2=0x7faec01f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faec0071fe0 0x7faec01f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.410 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 -- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 msgr2=0x7faec01f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 0x7faec01f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 -- 172.21.15.112:0/2262551779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc0094b0 con 0x7faec006a510 2023-11-08T12:31:41.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec521e700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec006a510 0x7faec00c8920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faec006ecf0 tx=0x7faebc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faeb5ffb700 1 -- 172.21.15.112:0/2262551779 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc003da0 con 0x7faec006a510 2023-11-08T12:31:41.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faeb5ffb700 1 -- 172.21.15.112:0/2262551779 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc01f070 con 0x7faec006a510 2023-11-08T12:31:41.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faeb5ffb700 1 -- 172.21.15.112:0/2262551779 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc011870 con 0x7faec006a510 2023-11-08T12:31:41.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec00d2fd0 con 0x7faec006a510 2023-11-08T12:31:41.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.404+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec00d2cf0 con 0x7faec006a510 2023-11-08T12:31:41.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.408+0000 7faeb5ffb700 1 -- 172.21.15.112:0/2262551779 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faebc02a020 con 0x7faec006a510 2023-11-08T12:31:41.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.412+0000 7faeb5ffb700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faea4064ee0 0x7faea4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.412+0000 7faeb5ffb700 1 -- 172.21.15.112:0/2262551779 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7faebc083660 con 0x7faec006a510 2023-11-08T12:31:41.415 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.412+0000 7faec4a1d700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faea4064ee0 0x7faea4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.412+0000 7faec4a1d700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faea4064ee0 0x7faea4067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faec01f5090 tx=0x7faeb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.416 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.412+0000 7faeca710740 1 Processor -- start 2023-11-08T12:31:41.417 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.412+0000 7faeca710740 1 -- start start 2023-11-08T12:31:41.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x206be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x206c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f23c80 con 0x1db4d80 2023-11-08T12:31:41.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f93d60 con 0x1dffa30 2023-11-08T12:31:41.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f8d060 con 0x1db49b0 2023-11-08T12:31:41.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51234/0 (socket says 172.21.15.112:51234) 2023-11-08T12:31:41.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 -- 172.21.15.112:0/1562242479 learned_addr learned my addr 172.21.15.112:0/1562242479 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec4a1d700 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x206be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec5a1f700 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x206c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 -- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 msgr2=0x206be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.421 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x206be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 -- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 msgr2=0x206c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x206c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 -- 172.21.15.112:0/1562242479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fb24e0 con 0x1db4d80 2023-11-08T12:31:41.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec4a1d700 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x206be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:41.422 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec5a1f700 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x206c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:31:41.423 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faec521e700 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062d70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faebc054ce0 tx=0x7faebc022380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35b26577cfba78d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faea2ffd700 1 -- 172.21.15.112:0/1562242479 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc051960 con 0x1db4d80 2023-11-08T12:31:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faea2ffd700 1 -- 172.21.15.112:0/1562242479 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc051ac0 con 0x1db4d80 2023-11-08T12:31:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faea2ffd700 1 -- 172.21.15.112:0/1562242479 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc054940 con 0x1db4d80 2023-11-08T12:31:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- 172.21.15.112:0/1562242479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 msgr2=0x2062d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062d70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faebc054ce0 tx=0x7faebc022380 comp rx=0 tx=0).stop 2023-11-08T12:31:41.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- 172.21.15.112:0/1562242479 shutdown_connections 2023-11-08T12:31:41.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x206c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x206be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 --2- 172.21.15.112:0/1562242479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062d70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- 172.21.15.112:0/1562242479 >> 172.21.15.112:0/1562242479 conn(0x1db5150 msgr2=0x204d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- 172.21.15.112:0/1562242479 shutdown_connections 2023-11-08T12:31:41.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.416+0000 7faeca710740 1 -- 172.21.15.112:0/1562242479 wait complete. 2023-11-08T12:31:41.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 -- start start 2023-11-08T12:31:41.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 Processor -- start 2023-11-08T12:31:41.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x20229d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e39dc0 con 0x1db4d80 2023-11-08T12:31:41.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x2036f90 con 0x1dffa30 2023-11-08T12:31:41.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x2062aa0 con 0x1db49b0 2023-11-08T12:31:41.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faeca710740 10 client.0 _ll_register_callbacks cb 0x1fe8b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:41.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faec4a1d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faec521e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x20229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faec521e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x20229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:57354/0 (socket says 172.21.15.112:57354) 2023-11-08T12:31:41.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faec521e700 1 -- 172.21.15.112:0/2438487462 learned_addr learned my addr 172.21.15.112:0/2438487462 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.420+0000 7faec5a1f700 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec521e700 1 -- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 msgr2=0x20366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec521e700 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec521e700 1 -- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 msgr2=0x2062560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec521e700 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec521e700 1 -- 172.21.15.112:0/2438487462 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec00d2cf0 con 0x1db49b0 2023-11-08T12:31:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec4a1d700 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec521e700 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x20229d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faebc006ef0 tx=0x7faebc003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5582345a58709b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7fae9bfff700 10 client.0 ms_handle_connect on v2:172.21.15.133:3301/0 2023-11-08T12:31:41.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7fae9bfff700 1 -- 172.21.15.112:0/2438487462 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc051960 con 0x1db49b0 2023-11-08T12:31:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f860e0 con 0x1db49b0 2023-11-08T12:31:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7fae9bfff700 1 -- 172.21.15.112:0/2438487462 <== mon.2 v2:172.21.15.133:3301/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7faebc05ce50 con 0x1db49b0 2023-11-08T12:31:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7fae9bfff700 1 -- 172.21.15.112:0/2438487462 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7faebc05d010 con 0x1db49b0 2023-11-08T12:31:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 10 client.5807 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:41.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1e00c80 con 0x1db49b0 2023-11-08T12:31:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7fae9bfff700 1 -- 172.21.15.112:0/2438487462 <== mon.2 v2:172.21.15.133:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc070020 con 0x1db49b0 2023-11-08T12:31:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7fae9bfff700 1 -- 172.21.15.112:0/2438487462 <== mon.2 v2:172.21.15.133:3301/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7faebc051040 con 0x1db49b0 2023-11-08T12:31:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 10 client.5807 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 10 client.5807 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:41.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 20 client.5807 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2020dc0 0x204baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 4 client.5807 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:31:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f85e00 con 0x2020dc0 2023-11-08T12:31:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec4a1d700 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2020dc0 0x204baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7fae9bfff700 10 client.5807 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.424+0000 7faec4a1d700 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2020dc0 0x204baa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87968571b7cdfdee server_cookie=3bbdcdb265208dad in_seq=0 out_seq=0 2023-11-08T12:31:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7fae9bfff700 1 -- 172.21.15.112:0/2438487462 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1f85e00 con 0x2020dc0 2023-11-08T12:31:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7fae9bfff700 10 client.5807 handle_command_reply: tid=0 2023-11-08T12:31:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 client.5807 shutdown 2023-11-08T12:31:41.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 msgr2=0x20229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x20229d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faebc006ef0 tx=0x7faebc003f90 comp rx=0 tx=0).stop 2023-11-08T12:31:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 shutdown_connections 2023-11-08T12:31:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x2020dc0 0x204baa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7fae9bfff700 0 client.5807 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x2062560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 --2- 172.21.15.112:0/2438487462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db49b0 0x20229d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 >> 172.21.15.112:0/2438487462 conn(0x1db5150 msgr2=0x2047550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 shutdown_connections 2023-11-08T12:31:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 1 -- 172.21.15.112:0/2438487462 wait complete. 2023-11-08T12:31:41.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.428+0000 7faeca710740 20 client.5807 trim_cache size 0 max 16384 2023-11-08T12:31:41.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.448+0000 7faeca710740 1 Processor -- start 2023-11-08T12:31:41.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.448+0000 7faeca710740 1 -- start start 2023-11-08T12:31:41.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1db49b0 0x204db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db4d80 0x207a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faeca710740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dffa30 0x207ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faeca710740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f8fbc0 con 0x1dffa30 2023-11-08T12:31:41.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f550e0 con 0x1db49b0 2023-11-08T12:31:41.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1feb430 con 0x1db4d80 2023-11-08T12:31:41.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec5a1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dffa30 0x207ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec521e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1db49b0 0x204db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec5a1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dffa30 0x207ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51244/0 (socket says 172.21.15.112:51244) 2023-11-08T12:31:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec5a1f700 1 -- 172.21.15.112:0/3993088890 learned_addr learned my addr 172.21.15.112:0/3993088890 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec4a1d700 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db4d80 0x207a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec521e700 1 -- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db4d80 msgr2=0x207a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec521e700 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db4d80 0x207a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec521e700 1 -- 172.21.15.112:0/3993088890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dffa30 msgr2=0x207ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec521e700 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dffa30 0x207ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec521e700 1 -- 172.21.15.112:0/3993088890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00b1960 con 0x1db49b0 2023-11-08T12:31:41.459 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.452+0000 7faec521e700 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1db49b0 0x204db80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faebc000c00 tx=0x7faebc081000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b4bba81646f998 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faea37fe700 1 -- 172.21.15.112:0/3993088890 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc051960 con 0x1db49b0 2023-11-08T12:31:41.460 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faea37fe700 1 -- 172.21.15.112:0/3993088890 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc070040 con 0x1db49b0 2023-11-08T12:31:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faea37fe700 1 -- 172.21.15.112:0/3993088890 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc053450 con 0x1db49b0 2023-11-08T12:31:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 -- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1db49b0 msgr2=0x204db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1db49b0 0x204db80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faebc000c00 tx=0x7faebc081000 comp rx=0 tx=0).stop 2023-11-08T12:31:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 -- 172.21.15.112:0/3993088890 shutdown_connections 2023-11-08T12:31:41.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dffa30 0x207ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1db4d80 0x207a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 --2- 172.21.15.112:0/3993088890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1db49b0 0x204db80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 -- 172.21.15.112:0/3993088890 >> 172.21.15.112:0/3993088890 conn(0x1db5150 msgr2=0x201f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 -- 172.21.15.112:0/3993088890 shutdown_connections 2023-11-08T12:31:41.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 -- 172.21.15.112:0/3993088890 wait complete. 2023-11-08T12:31:41.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 -- start start 2023-11-08T12:31:41.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.456+0000 7faeca710740 1 Processor -- start 2023-11-08T12:31:41.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x206fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x20ca740 0x204bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x204d840 con 0x1db4d80 2023-11-08T12:31:41.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x2070530 con 0x1dffa30 2023-11-08T12:31:41.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x204cf80 con 0x20ca740 2023-11-08T12:31:41.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 10 client.0 _ll_register_callbacks cb 0x1fb3910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:41.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x206fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x206fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51256/0 (socket says 172.21.15.112:51256) 2023-11-08T12:31:41.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 -- 172.21.15.112:0/508985879 learned_addr learned my addr 172.21.15.112:0/508985879 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec4a1d700 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec5a1f700 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x20ca740 0x204bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 -- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x20ca740 msgr2=0x204bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x20ca740 0x204bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 -- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 msgr2=0x20ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 -- 172.21.15.112:0/508985879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec00d2cf0 con 0x1db4d80 2023-11-08T12:31:41.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faec521e700 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x206fff0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faebc051c70 tx=0x7faebc0516c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b3526b9d064351 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7fae9bfff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:41.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7fae9bfff700 1 -- 172.21.15.112:0/508985879 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc05d050 con 0x1db4d80 2023-11-08T12:31:41.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7fae9bfff700 1 -- 172.21.15.112:0/508985879 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7faebc071080 con 0x1db4d80 2023-11-08T12:31:41.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faebc051ac0 con 0x1db4d80 2023-11-08T12:31:41.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7fae9bfff700 1 -- 172.21.15.112:0/508985879 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7faebc054bb0 con 0x1db4d80 2023-11-08T12:31:41.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 10 client.6585 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:41.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1f39bb0 con 0x1db4d80 2023-11-08T12:31:41.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7fae9bfff700 1 -- 172.21.15.112:0/508985879 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc051ac0 con 0x1db4d80 2023-11-08T12:31:41.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7fae9bfff700 1 -- 172.21.15.112:0/508985879 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7faebc06c1c0 con 0x1db4d80 2023-11-08T12:31:41.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 10 client.6585 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:41.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 10 client.6585 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:41.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 20 client.6585 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:41.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.460+0000 7faeca710740 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x204c410 0x204c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 4 client.6585 mds_command: new command op to 6282 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-08T12:31:41.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x1e31500 con 0x204c410 2023-11-08T12:31:41.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faec4a1d700 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x204c410 0x204c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7fae9bfff700 10 client.6585 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faec4a1d700 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x204c410 0x204c810 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b70f241629dabaf8 server_cookie=f28c8b6f87fe27a9 in_seq=0 out_seq=0 2023-11-08T12:31:41.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7fae9bfff700 1 -- 172.21.15.112:0/508985879 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1e31500 con 0x204c410 2023-11-08T12:31:41.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7fae9bfff700 10 client.6585 handle_command_reply: tid=0 2023-11-08T12:31:41.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 client.6585 shutdown 2023-11-08T12:31:41.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 msgr2=0x206fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x206fff0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faebc051c70 tx=0x7faebc0516c0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 shutdown_connections 2023-11-08T12:31:41.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x204c410 0x204c810 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x20ca740 0x204bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dffa30 0x20ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 --2- 172.21.15.112:0/508985879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1db4d80 0x206fff0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7fae9bfff700 0 client.6585 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 >> 172.21.15.112:0/508985879 conn(0x1db5150 msgr2=0x2020150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 shutdown_connections 2023-11-08T12:31:41.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 1 -- 172.21.15.112:0/508985879 wait complete. 2023-11-08T12:31:41.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.464+0000 7faeca710740 20 client.6585 trim_cache size 0 max 16384 2023-11-08T12:31:41.477 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:31:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "return_code": 0, 2023-11-08T12:31:41.477 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_tag": "a712fd66-b632-494a-b1c4-3f95922d9219", 2023-11-08T12:31:41.478 INFO:teuthology.orchestra.run.smithi112.stdout: "mode": "asynchronous" 2023-11-08T12:31:41.478 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:31:41.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faea4064ee0 msgr2=0x7faea4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faea4064ee0 0x7faea4067390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faec01f5090 tx=0x7faeb0009040 comp rx=0 tx=0).stop 2023-11-08T12:31:41.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec006a510 msgr2=0x7faec00c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec006a510 0x7faec00c8920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faec006ecf0 tx=0x7faebc004770 comp rx=0 tx=0).stop 2023-11-08T12:31:41.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 shutdown_connections 2023-11-08T12:31:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faea4064ee0 0x7faea4067390 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faec015c6e0 0x7faec01f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faec0071fe0 0x7faec01f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 --2- 172.21.15.112:0/2262551779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec006a510 0x7faec00c8920 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 >> 172.21.15.112:0/2262551779 conn(0x7faec00b65b0 msgr2=0x7faec0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 shutdown_connections 2023-11-08T12:31:41.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.468+0000 7faec6220700 1 -- 172.21.15.112:0/2262551779 wait complete. 2023-11-08T12:31:41.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-08T12:31:41.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 Processor -- start 2023-11-08T12:31:41.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 -- start start 2023-11-08T12:31:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa04415c640 0x7fa0440d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa044071aa0 0x7fa04406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa044069e00 0x7fa04406a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04406cef0 con 0x7fa044069e00 2023-11-08T12:31:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04406a7c0 con 0x7fa04415c640 2023-11-08T12:31:41.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049b77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04406c600 con 0x7fa044071aa0 2023-11-08T12:31:41.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049376700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa044069e00 0x7fa04406a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa048b75700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa04415c640 0x7fa0440d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049376700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa044069e00 0x7fa04406a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51258/0 (socket says 172.21.15.112:51258) 2023-11-08T12:31:41.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049376700 1 -- 172.21.15.112:0/2189346294 learned_addr learned my addr 172.21.15.112:0/2189346294 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa043fff700 1 --2- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa044071aa0 0x7fa04406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa048b75700 1 -- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa044071aa0 msgr2=0x7fa04406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa048b75700 1 --2- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa044071aa0 0x7fa04406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa048b75700 1 -- 172.21.15.112:0/2189346294 >> v2:172.21.15.112:3300/0 conn(0x7fa044069e00 msgr2=0x7fa04406a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa048b75700 1 --2- 172.21.15.112:0/2189346294 >> v2:172.21.15.112:3300/0 conn(0x7fa044069e00 0x7fa04406a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa048b75700 1 -- 172.21.15.112:0/2189346294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0440722f0 con 0x7fa04415c640 2023-11-08T12:31:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa049376700 1 --2- 172.21.15.112:0/2189346294 >> v2:172.21.15.112:3300/0 conn(0x7fa044069e00 0x7fa04406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.680+0000 7fa043fff700 1 --2- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa044071aa0 0x7fa04406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa048b75700 1 --2- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04415c640 0x7fa0440d31e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa04406e290 tx=0x7fa03800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78deaf336407c39d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa0437fe700 1 -- 172.21.15.112:0/2189346294 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800e070 con 0x7fa04415c640 2023-11-08T12:31:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa0437fe700 1 -- 172.21.15.112:0/2189346294 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800bb20 con 0x7fa04415c640 2023-11-08T12:31:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa0437fe700 1 -- 172.21.15.112:0/2189346294 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038012430 con 0x7fa04415c640 2023-11-08T12:31:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 -- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04415c640 msgr2=0x7fa0440d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 --2- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04415c640 0x7fa0440d31e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa04406e290 tx=0x7fa03800b330 comp rx=0 tx=0).stop 2023-11-08T12:31:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 -- 172.21.15.112:0/2189346294 shutdown_connections 2023-11-08T12:31:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 --2- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa044071aa0 0x7fa04406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 --2- 172.21.15.112:0/2189346294 >> v2:172.21.15.112:3300/0 conn(0x7fa044069e00 0x7fa04406a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 --2- 172.21.15.112:0/2189346294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04415c640 0x7fa0440d31e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 -- 172.21.15.112:0/2189346294 >> 172.21.15.112:0/2189346294 conn(0x7fa0440b6520 msgr2=0x7fa044071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 -- 172.21.15.112:0/2189346294 shutdown_connections 2023-11-08T12:31:41.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.684+0000 7fa049b77700 1 -- 172.21.15.112:0/2189346294 wait complete. 2023-11-08T12:31:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 Processor -- start 2023-11-08T12:31:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 -- start start 2023-11-08T12:31:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa044069e00 0x7fa04409bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa044071aa0 0x7fa0440ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04415c640 0x7fa0440ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440ce560 con 0x7fa044071aa0 2023-11-08T12:31:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440cd950 con 0x7fa044069e00 2023-11-08T12:31:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049b77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440cdc30 con 0x7fa04415c640 2023-11-08T12:31:41.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa043fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa044071aa0 0x7fa0440ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa043fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa044071aa0 0x7fa0440ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51272/0 (socket says 172.21.15.112:51272) 2023-11-08T12:31:41.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa043fff700 1 -- 172.21.15.112:0/683584257 learned_addr learned my addr 172.21.15.112:0/683584257 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa048b75700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa044069e00 0x7fa04409bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.688+0000 7fa049376700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04415c640 0x7fa0440ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa043fff700 1 -- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04415c640 msgr2=0x7fa0440ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa043fff700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04415c640 0x7fa0440ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa043fff700 1 -- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa044069e00 msgr2=0x7fa04409bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa043fff700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa044069e00 0x7fa04409bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa043fff700 1 -- 172.21.15.112:0/683584257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c009570 con 0x7fa044071aa0 2023-11-08T12:31:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa043fff700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa044071aa0 0x7fa0440ce9f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa03000e810 tx=0x7fa03000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa0417fa700 1 -- 172.21.15.112:0/683584257 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030004230 con 0x7fa044071aa0 2023-11-08T12:31:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa0417fa700 1 -- 172.21.15.112:0/683584257 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0300043b0 con 0x7fa044071aa0 2023-11-08T12:31:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa0417fa700 1 -- 172.21.15.112:0/683584257 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300036c0 con 0x7fa044071aa0 2023-11-08T12:31:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa038009a70 con 0x7fa044071aa0 2023-11-08T12:31:41.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.692+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa044072010 con 0x7fa044071aa0 2023-11-08T12:31:41.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.696+0000 7fa0417fa700 1 -- 172.21.15.112:0/683584257 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa030022070 con 0x7fa044071aa0 2023-11-08T12:31:41.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.696+0000 7fa0417fa700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa028064ee0 0x7fa028067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.696+0000 7fa0417fa700 1 -- 172.21.15.112:0/683584257 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa0300819e0 con 0x7fa044071aa0 2023-11-08T12:31:41.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.696+0000 7fa048b75700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa028064ee0 0x7fa028067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.696+0000 7fa048b75700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa028064ee0 0x7fa028067390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b370 tx=0x7fa038011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 Processor -- start 2023-11-08T12:31:41.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 -- start start 2023-11-08T12:31:41.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x116b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x116c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x105ad20 con 0xeebc10 2023-11-08T12:31:41.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x10cad60 con 0xeeb840 2023-11-08T12:31:41.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x10c4060 con 0xf368c0 2023-11-08T12:31:41.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x116b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x116b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51278/0 (socket says 172.21.15.112:51278) 2023-11-08T12:31:41.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 -- 172.21.15.112:0/3490393942 learned_addr learned my addr 172.21.15.112:0/3490393942 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa043fff700 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa049376700 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x116c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 -- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 msgr2=0x116c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x116c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 -- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 msgr2=0x116bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.700+0000 7fa048b75700 1 -- 172.21.15.112:0/3490393942 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10ea0a0 con 0xeebc10 2023-11-08T12:31:41.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa048b75700 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x116b7d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa038000f80 tx=0x7fa038010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad006361352ce22 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa02e7fc700 1 -- 172.21.15.112:0/3490393942 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038033480 con 0xeebc10 2023-11-08T12:31:41.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa02e7fc700 1 -- 172.21.15.112:0/3490393942 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03802c070 con 0xeebc10 2023-11-08T12:31:41.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa02e7fc700 1 -- 172.21.15.112:0/3490393942 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380337e0 con 0xeebc10 2023-11-08T12:31:41.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 -- 172.21.15.112:0/3490393942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 msgr2=0x116b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x116b7d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa038000f80 tx=0x7fa038010000 comp rx=0 tx=0).stop 2023-11-08T12:31:41.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 -- 172.21.15.112:0/3490393942 shutdown_connections 2023-11-08T12:31:41.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x116c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 --2- 172.21.15.112:0/3490393942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x116b7d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 -- 172.21.15.112:0/3490393942 >> 172.21.15.112:0/3490393942 conn(0xeebfe0 msgr2=0x1184b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 -- 172.21.15.112:0/3490393942 shutdown_connections 2023-11-08T12:31:41.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 -- 172.21.15.112:0/3490393942 wait complete. 2023-11-08T12:31:41.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.704+0000 7fa04e060740 1 -- start start 2023-11-08T12:31:41.712 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 1 Processor -- start 2023-11-08T12:31:41.714 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeebc10 0x1158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xf368c0 0x1158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0xf70c50 con 0xf368c0 2023-11-08T12:31:41.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x11a9a80 con 0xeeb840 2023-11-08T12:31:41.715 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x116b020 con 0xeebc10 2023-11-08T12:31:41.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa04e060740 10 client.0 _ll_register_callbacks cb 0x10bd9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:41.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xf368c0 0x1158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xf368c0 0x1158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51286/0 (socket says 172.21.15.112:51286) 2023-11-08T12:31:41.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 -- 172.21.15.112:0/3958381154 learned_addr learned my addr 172.21.15.112:0/3958381154 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.716 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa043fff700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeebc10 0x1158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa048b75700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 -- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeebc10 msgr2=0x1158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeebc10 0x1158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 -- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 msgr2=0x116aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.717 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa049376700 1 -- 172.21.15.112:0/3958381154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa038023070 con 0xf368c0 2023-11-08T12:31:41.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa043fff700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeebc10 0x1158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:41.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.708+0000 7fa048b75700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:31:41.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa049376700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xf368c0 0x1158aa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa03c014970 tx=0x7fa03c014d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21438296295726c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa0237fe700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:41.718 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa0237fe700 1 -- 172.21.15.112:0/3958381154 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c014e50 con 0xf368c0 2023-11-08T12:31:41.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa0237fe700 1 -- 172.21.15.112:0/3958381154 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa03c01a070 con 0xf368c0 2023-11-08T12:31:41.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10bd0e0 con 0xf368c0 2023-11-08T12:31:41.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa0237fe700 1 -- 172.21.15.112:0/3958381154 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa03c012950 con 0xf368c0 2023-11-08T12:31:41.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 10 client.6597 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:41.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0xf37b10 con 0xf368c0 2023-11-08T12:31:41.719 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa0237fe700 1 -- 172.21.15.112:0/3958381154 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10bd0e0 con 0xf368c0 2023-11-08T12:31:41.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa0237fe700 1 -- 172.21.15.112:0/3958381154 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa03c011030 con 0xf368c0 2023-11-08T12:31:41.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 10 client.6597 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:41.721 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 10 client.6597 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:41.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 20 client.6597 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:41.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11ab730 0x11b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 4 client.6597 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:31:41.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10bce00 con 0x11ab730 2023-11-08T12:31:41.722 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa048b75700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11ab730 0x11b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa048b75700 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11ab730 0x11b4fa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf0f7f5e28bf404 server_cookie=cebd47371e2b1f73 in_seq=0 out_seq=0 2023-11-08T12:31:41.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.712+0000 7fa0237fe700 10 client.6597 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa0237fe700 1 -- 172.21.15.112:0/3958381154 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x10bce00 con 0x11ab730 2023-11-08T12:31:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa0237fe700 10 client.6597 handle_command_reply: tid=0 2023-11-08T12:31:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 client.6597 shutdown 2023-11-08T12:31:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xf368c0 msgr2=0x1158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xf368c0 0x1158aa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa03c014970 tx=0x7fa03c014d30 comp rx=0 tx=0).stop 2023-11-08T12:31:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 shutdown_connections 2023-11-08T12:31:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11ab730 0x11b4fa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xf368c0 0x1158aa0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeebc10 0x1158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 --2- 172.21.15.112:0/3958381154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeeb840 0x116aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa0237fe700 0 client.6597 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 >> 172.21.15.112:0/3958381154 conn(0xeebfe0 msgr2=0x115d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 shutdown_connections 2023-11-08T12:31:41.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 1 -- 172.21.15.112:0/3958381154 wait complete. 2023-11-08T12:31:41.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.716+0000 7fa04e060740 20 client.6597 trim_cache size 0 max 16384 2023-11-08T12:31:41.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 Processor -- start 2023-11-08T12:31:41.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 -- start start 2023-11-08T12:31:41.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeeb840 0x1158710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeebc10 0x1180ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x1181020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x10c2ef0 con 0xeeb840 2023-11-08T12:31:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1063510 con 0xeebc10 2023-11-08T12:31:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x106df10 con 0xf368c0 2023-11-08T12:31:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeebc10 0x1180ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa048b75700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeeb840 0x1158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeebc10 0x1180ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:42068/0 (socket says 172.21.15.112:42068) 2023-11-08T12:31:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 -- 172.21.15.112:0/4235055673 learned_addr learned my addr 172.21.15.112:0/4235055673 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa049376700 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x1181020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 -- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 msgr2=0x1181020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x1181020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 -- 172.21.15.112:0/4235055673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeeb840 msgr2=0x1158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeeb840 0x1158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.736+0000 7fa043fff700 1 -- 172.21.15.112:0/4235055673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0440cd680 con 0xeebc10 2023-11-08T12:31:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa043fff700 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeebc10 0x1180ae0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa030053270 tx=0x7fa030059040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdb661532a89b305 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa02effd700 1 -- 172.21.15.112:0/4235055673 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030052a60 con 0xeebc10 2023-11-08T12:31:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa02effd700 1 -- 172.21.15.112:0/4235055673 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa030052bc0 con 0xeebc10 2023-11-08T12:31:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa02effd700 1 -- 172.21.15.112:0/4235055673 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030052d30 con 0xeebc10 2023-11-08T12:31:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeebc10 msgr2=0x1180ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeebc10 0x1180ae0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa030053270 tx=0x7fa030059040 comp rx=0 tx=0).stop 2023-11-08T12:31:41.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- 172.21.15.112:0/4235055673 shutdown_connections 2023-11-08T12:31:41.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xf368c0 0x1181020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xeebc10 0x1180ae0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 --2- 172.21.15.112:0/4235055673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeeb840 0x1158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- 172.21.15.112:0/4235055673 >> 172.21.15.112:0/4235055673 conn(0xeebfe0 msgr2=0x11803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- 172.21.15.112:0/4235055673 shutdown_connections 2023-11-08T12:31:41.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- 172.21.15.112:0/4235055673 wait complete. 2023-11-08T12:31:41.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- start start 2023-11-08T12:31:41.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 Processor -- start 2023-11-08T12:31:41.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeeb840 0x11ffac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x11a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xf368c0 0x11a9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x10c6bc0 con 0xeebc10 2023-11-08T12:31:41.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1099f70 con 0xf368c0 2023-11-08T12:31:41.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.740+0000 7fa04e060740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x10c1460 con 0xeeb840 2023-11-08T12:31:41.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 10 client.0 _ll_register_callbacks cb 0x7fa038003a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:31:41.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x11a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa048b75700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeeb840 0x11ffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa049376700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xf368c0 0x11a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x11a8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51312/0 (socket says 172.21.15.112:51312) 2023-11-08T12:31:41.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 -- 172.21.15.112:0/4293699725 learned_addr learned my addr 172.21.15.112:0/4293699725 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:31:41.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 -- 172.21.15.112:0/4293699725 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeeb840 msgr2=0x11ffac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeeb840 0x11ffac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 -- 172.21.15.112:0/4293699725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xf368c0 msgr2=0x11a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:31:41.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xf368c0 0x11a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 -- 172.21.15.112:0/4293699725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa044072010 con 0xeebc10 2023-11-08T12:31:41.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa049376700 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xf368c0 0x11a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:31:41.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa043fff700 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x11a8f10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa030053270 tx=0x7fa030004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a3ccf0bf3ce01 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:31:41.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa0237fe700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:31:41.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa0237fe700 1 -- 172.21.15.112:0/4293699725 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030052d30 con 0xeebc10 2023-11-08T12:31:41.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa0237fe700 1 -- 172.21.15.112:0/4293699725 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa03007b030 con 0xeebc10 2023-11-08T12:31:41.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa03802c070 con 0xeebc10 2023-11-08T12:31:41.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa0237fe700 1 -- 172.21.15.112:0/4293699725 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa030052a60 con 0xeebc10 2023-11-08T12:31:41.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 10 client.6603 fetch_fsmap learned FSMap version 33 2023-11-08T12:31:41.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1070af0 con 0xeebc10 2023-11-08T12:31:41.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa0237fe700 1 -- 172.21.15.112:0/4293699725 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03802c070 con 0xeebc10 2023-11-08T12:31:41.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa0237fe700 1 -- 172.21.15.112:0/4293699725 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa030064070 con 0xeebc10 2023-11-08T12:31:41.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 10 client.6603 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:31:41.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 10 client.6603 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:31:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 20 client.6603 populate_metadata read hostname 'smithi112' 2023-11-08T12:31:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11adb90 0x11adf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:31:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 4 client.6603 mds_command: new command op to 6282 tid=0[{"prefix": "scrub status"}] 2023-11-08T12:31:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xf68390 con 0x11adb90 2023-11-08T12:31:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.744+0000 7fa048b75700 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11adb90 0x11adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:31:41.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa0237fe700 10 client.6603 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa048b75700 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11adb90 0x11adf90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e0f52ea6800f32 server_cookie=f268510b73a41a9c in_seq=0 out_seq=0 2023-11-08T12:31:41.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa0237fe700 1 -- 172.21.15.112:0/4293699725 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0xf68390 con 0x11adb90 2023-11-08T12:31:41.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa0237fe700 10 client.6603 handle_command_reply: tid=0 2023-11-08T12:31:41.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 client.6603 shutdown 2023-11-08T12:31:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 msgr2=0x11a8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x11a8f10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa030053270 tx=0x7fa030004770 comp rx=0 tx=0).stop 2023-11-08T12:31:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 shutdown_connections 2023-11-08T12:31:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x11adb90 0x11adf90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xf368c0 0x11a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0xeebc10 0x11a8f10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 --2- 172.21.15.112:0/4293699725 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0xeeb840 0x11ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa0237fe700 0 client.6603 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:31:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 >> 172.21.15.112:0/4293699725 conn(0xeebfe0 msgr2=0x1157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 shutdown_connections 2023-11-08T12:31:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 1 -- 172.21.15.112:0/4293699725 wait complete. 2023-11-08T12:31:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa04e060740 20 client.6603 trim_cache size 0 max 16384 2023-11-08T12:31:41.763 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:31:41.763 INFO:teuthology.orchestra.run.smithi112.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-08T12:31:41.764 INFO:teuthology.orchestra.run.smithi112.stdout: "scrubs": { 2023-11-08T12:31:41.764 INFO:teuthology.orchestra.run.smithi112.stdout: "a712fd66-b632-494a-b1c4-3f95922d9219": { 2023-11-08T12:31:41.764 INFO:teuthology.orchestra.run.smithi112.stdout: "path": "/", 2023-11-08T12:31:41.764 INFO:teuthology.orchestra.run.smithi112.stdout: "tag": "a712fd66-b632-494a-b1c4-3f95922d9219", 2023-11-08T12:31:41.764 INFO:teuthology.orchestra.run.smithi112.stdout: "options": "recursive,repair" 2023-11-08T12:31:41.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:31:41.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:31:41.765 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:31:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa028064ee0 msgr2=0x7fa028067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa028064ee0 0x7fa028067390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b370 tx=0x7fa038011000 comp rx=0 tx=0).stop 2023-11-08T12:31:41.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa044071aa0 msgr2=0x7fa0440ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:31:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa044071aa0 0x7fa0440ce9f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa03000e810 tx=0x7fa03000eb20 comp rx=0 tx=0).stop 2023-11-08T12:31:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 shutdown_connections 2023-11-08T12:31:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa028064ee0 0x7fa028067390 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04415c640 0x7fa0440ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa044071aa0 0x7fa0440ce9f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 --2- 172.21.15.112:0/683584257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa044069e00 0x7fa04409bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:31:41.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.748+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 >> 172.21.15.112:0/683584257 conn(0x7fa0440b6520 msgr2=0x7fa0440b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:31:41.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.752+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 shutdown_connections 2023-11-08T12:31:41.768 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:31:41.752+0000 7fa049b77700 1 -- 172.21.15.112:0/683584257 wait complete. 2023-11-08T12:31:41.777 INFO:tasks.cephfs.filesystem:scrub status for tag:a712fd66-b632-494a-b1c4-3f95922d9219 - {'path': '/', 'tag': 'a712fd66-b632-494a-b1c4-3f95922d9219', 'options': 'recursive,repair'} 2023-11-08T12:32:08.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:32:08.088 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:32:11.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-08T12:32:11.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709e300700 1 Processor -- start 2023-11-08T12:32:11.958 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709e300700 1 -- start start 2023-11-08T12:32:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709e300700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f709815c640 0x7f70980d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.959 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709e300700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098071aa0 0x7f709806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709e300700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709806c600 con 0x7f7098069e00 2023-11-08T12:32:11.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709e300700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709806cef0 con 0x7f709815c640 2023-11-08T12:32:11.960 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709e300700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70980722f0 con 0x7f7098071aa0 2023-11-08T12:32:11.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709d2fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f709815c640 0x7f70980d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709d2fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f709815c640 0x7f70980d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:38292/0 (socket says 172.21.15.112:38292) 2023-11-08T12:32:11.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709d2fe700 1 -- 172.21.15.112:0/2867766739 learned_addr learned my addr 172.21.15.112:0/2867766739 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:11.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709cafd700 1 --2- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098071aa0 0x7f709806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709d2fe700 1 -- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098071aa0 msgr2=0x7f709806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:11.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709d2fe700 1 --2- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098071aa0 0x7f709806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709d2fe700 1 -- 172.21.15.112:0/2867766739 >> v1:172.21.15.133:6789/0 conn(0x7f7098069e00 legacy=0x7f70980d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:11.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f709d2fe700 1 -- 172.21.15.112:0/2867766739 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709815ca10 con 0x7f709815c640 2023-11-08T12:32:11.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.955+0000 7f708ffff700 1 -- 172.21.15.112:0/2867766739 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103925429 0 0) 0x7f709806c600 con 0x7f7098069e00 2023-11-08T12:32:11.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709d2fe700 1 --2- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709815c640 0x7f70980d31e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7094009910 tx=0x7f7094009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c934b0081f644ca server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:11.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f708ffff700 1 -- 172.21.15.112:0/2867766739 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094011830 con 0x7f709815c640 2023-11-08T12:32:11.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f708ffff700 1 -- 172.21.15.112:0/2867766739 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094011990 con 0x7f709815c640 2023-11-08T12:32:11.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f708ffff700 1 -- 172.21.15.112:0/2867766739 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094011d40 con 0x7f709815c640 2023-11-08T12:32:11.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 -- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709815c640 msgr2=0x7f70980d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:11.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 --2- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709815c640 0x7f70980d31e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7094009910 tx=0x7f7094009c20 comp rx=0 tx=0).stop 2023-11-08T12:32:11.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 -- 172.21.15.112:0/2867766739 shutdown_connections 2023-11-08T12:32:11.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 --2- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098071aa0 0x7f709806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 --2- 172.21.15.112:0/2867766739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709815c640 0x7f70980d31e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 -- 172.21.15.112:0/2867766739 >> 172.21.15.112:0/2867766739 conn(0x7f70980b6520 msgr2=0x7f7098071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:11.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 -- 172.21.15.112:0/2867766739 shutdown_connections 2023-11-08T12:32:11.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.959+0000 7f709e300700 1 -- 172.21.15.112:0/2867766739 wait complete. 2023-11-08T12:32:11.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 Processor -- start 2023-11-08T12:32:11.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 -- start start 2023-11-08T12:32:11.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098069e00 0x7f70981f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7098071aa0 0x7f70980ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f709815c640 0x7f709815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70981f1a50 con 0x7f709815c640 2023-11-08T12:32:11.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70980cf140 con 0x7f7098071aa0 2023-11-08T12:32:11.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709e300700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70980cf420 con 0x7f7098069e00 2023-11-08T12:32:11.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709daff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f709815c640 0x7f709815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709daff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f709815c640 0x7f709815a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40328/0 (socket says 172.21.15.112:40328) 2023-11-08T12:32:11.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709daff700 1 -- 172.21.15.112:0/1053633259 learned_addr learned my addr 172.21.15.112:0/1053633259 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:11.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709d2fe700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098069e00 0x7f70981f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.963+0000 7f709cafd700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7098071aa0 0x7f70980ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709daff700 1 -- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098069e00 msgr2=0x7f70981f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:11.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709daff700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098069e00 0x7f70981f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709daff700 1 -- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7098071aa0 msgr2=0x7f70980ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:11.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709daff700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7098071aa0 0x7f70980ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709daff700 1 -- 172.21.15.112:0/1053633259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7094009570 con 0x7f709815c640 2023-11-08T12:32:11.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709d2fe700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098069e00 0x7f70981f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:11.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709daff700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f709815c640 0x7f709815a3b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f709000cc10 tx=0x7f709000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:11.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f708dffb700 1 -- 172.21.15.112:0/1053633259 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090003e50 con 0x7f709815c640 2023-11-08T12:32:11.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f708dffb700 1 -- 172.21.15.112:0/1053633259 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709000a650 con 0x7f709815c640 2023-11-08T12:32:11.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f708dffb700 1 -- 172.21.15.112:0/1053633259 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709000aa00 con 0x7f709815c640 2023-11-08T12:32:11.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709806c830 con 0x7f709815c640 2023-11-08T12:32:11.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.967+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7098072010 con 0x7f709815c640 2023-11-08T12:32:11.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.971+0000 7f708dffb700 1 -- 172.21.15.112:0/1053633259 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7090019030 con 0x7f709815c640 2023-11-08T12:32:11.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.971+0000 7f708dffb700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f707c064ee0 0x7f707c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.971+0000 7f708dffb700 1 -- 172.21.15.112:0/1053633259 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f70900818e0 con 0x7f709815c640 2023-11-08T12:32:11.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.971+0000 7f709d2fe700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f707c064ee0 0x7f707c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.971+0000 7f709d2fe700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f707c064ee0 0x7f707c067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7094009860 tx=0x7f7094008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:11.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 Processor -- start 2023-11-08T12:32:11.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 -- start start 2023-11-08T12:32:11.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dfcc10 0x207c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x207cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e478c0 0x207d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6bd20 con 0x1dfc840 2023-11-08T12:32:11.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fdbd60 con 0x1dfcc10 2023-11-08T12:32:11.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fd5060 con 0x1e478c0 2023-11-08T12:32:11.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x207cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x207cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40338/0 (socket says 172.21.15.112:40338) 2023-11-08T12:32:11.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 -- 172.21.15.112:0/4048368570 learned_addr learned my addr 172.21.15.112:0/4048368570 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:11.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709daff700 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e478c0 0x207d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709d2fe700 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dfcc10 0x207c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 -- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e478c0 msgr2=0x207d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:11.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e478c0 0x207d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 -- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dfcc10 msgr2=0x207c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:11.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dfcc10 0x207c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 -- 172.21.15.112:0/4048368570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ffb0a0 con 0x1dfc840 2023-11-08T12:32:11.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f709cafd700 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x207cd10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7088009bd0 tx=0x7f7088009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fd0407ec34ff7b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:11.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f707affd700 1 -- 172.21.15.112:0/4048368570 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088004300 con 0x1dfc840 2023-11-08T12:32:11.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f707affd700 1 -- 172.21.15.112:0/4048368570 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088004460 con 0x1dfc840 2023-11-08T12:32:11.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.975+0000 7f707affd700 1 -- 172.21.15.112:0/4048368570 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880045d0 con 0x1dfc840 2023-11-08T12:32:11.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- 172.21.15.112:0/4048368570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 msgr2=0x207cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:11.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x207cd10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7088009bd0 tx=0x7f7088009ee0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- 172.21.15.112:0/4048368570 shutdown_connections 2023-11-08T12:32:11.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1e478c0 0x207d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x207cd10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 --2- 172.21.15.112:0/4048368570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1dfcc10 0x207c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- 172.21.15.112:0/4048368570 >> 172.21.15.112:0/4048368570 conn(0x1dfcfe0 msgr2=0x2095b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:11.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- 172.21.15.112:0/4048368570 shutdown_connections 2023-11-08T12:32:11.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- 172.21.15.112:0/4048368570 wait complete. 2023-11-08T12:32:11.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- start start 2023-11-08T12:32:11.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 Processor -- start 2023-11-08T12:32:11.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x20bc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x206fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x206c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e81c50 con 0x1dfc840 2023-11-08T12:32:11.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x206b7a0 con 0x1e478c0 2023-11-08T12:32:11.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x206ba40 con 0x1dfcc10 2023-11-08T12:32:11.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f70a27ef740 10 client.0 _ll_register_callbacks cb 0x1fce9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:32:11.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f709d2fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x20bc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f709d2fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x20bc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40350/0 (socket says 172.21.15.112:40350) 2023-11-08T12:32:11.991 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.979+0000 7f709d2fe700 1 -- 172.21.15.112:0/3504332681 learned_addr learned my addr 172.21.15.112:0/3504332681 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:11.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709cafd700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x206fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709daff700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x206c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709d2fe700 1 -- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 msgr2=0x206fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:11.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709d2fe700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x206fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709d2fe700 1 -- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 msgr2=0x206c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:11.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709d2fe700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x206c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:11.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709d2fe700 1 -- 172.21.15.112:0/3504332681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70880097d0 con 0x1dfc840 2023-11-08T12:32:11.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709cafd700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x206fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:11.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709d2fe700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x20bc630 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7094009150 tx=0x7f70940047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b6097359752bc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:11.993 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f7073fff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:32:11.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f7073fff700 1 -- 172.21.15.112:0/3504332681 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709402e070 con 0x1dfc840 2023-11-08T12:32:11.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f7073fff700 1 -- 172.21.15.112:0/3504332681 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f709401a700 con 0x1dfc840 2023-11-08T12:32:11.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1fce0e0 con 0x1dfc840 2023-11-08T12:32:11.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f7073fff700 1 -- 172.21.15.112:0/3504332681 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7094020070 con 0x1dfc840 2023-11-08T12:32:11.994 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 10 client.6612 fetch_fsmap learned FSMap version 33 2023-11-08T12:32:11.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1e48b10 con 0x1dfc840 2023-11-08T12:32:11.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f7073fff700 1 -- 172.21.15.112:0/3504332681 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1fce0e0 con 0x1dfc840 2023-11-08T12:32:11.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f7073fff700 1 -- 172.21.15.112:0/3504332681 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f709401a8c0 con 0x1dfc840 2023-11-08T12:32:11.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 10 client.6612 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:32:11.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 10 client.6612 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:32:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 20 client.6612 populate_metadata read hostname 'smithi112' 2023-11-08T12:32:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x206cc00 0x207b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 4 client.6612 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:32:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1fcde00 con 0x206cc00 2023-11-08T12:32:11.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709cafd700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x206cc00 0x207b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f7073fff700 10 client.6612 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.983+0000 7f709cafd700 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x206cc00 0x207b5e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1cbf41802e1c89 server_cookie=1b3538b11965955f in_seq=0 out_seq=0 2023-11-08T12:32:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f7073fff700 1 -- 172.21.15.112:0/3504332681 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x1fcde00 con 0x206cc00 2023-11-08T12:32:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f7073fff700 10 client.6612 handle_command_reply: tid=0 2023-11-08T12:32:11.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 client.6612 shutdown 2023-11-08T12:32:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 msgr2=0x20bc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x20bc630 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7094009150 tx=0x7f70940047e0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 shutdown_connections 2023-11-08T12:32:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x206cc00 0x207b5e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x206c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f7073fff700 0 client.6612 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x206fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3504332681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x20bc630 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 >> 172.21.15.112:0/3504332681 conn(0x1dfcfe0 msgr2=0x206e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 shutdown_connections 2023-11-08T12:32:12.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 1 -- 172.21.15.112:0/3504332681 wait complete. 2023-11-08T12:32:12.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:11.987+0000 7f70a27ef740 20 client.6612 trim_cache size 0 max 16384 2023-11-08T12:32:12.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 Processor -- start 2023-11-08T12:32:12.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 -- start start 2023-11-08T12:32:12.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x206af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:12.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x20c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:12.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x20913d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:12.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x206cac0 con 0x1dfc840 2023-11-08T12:32:12.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x20965d0 con 0x1e478c0 2023-11-08T12:32:12.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f74510 con 0x1dfcc10 2023-11-08T12:32:12.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x206af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:12.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x206af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40352/0 (socket says 172.21.15.112:40352) 2023-11-08T12:32:12.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 -- 172.21.15.112:0/3040631632 learned_addr learned my addr 172.21.15.112:0/3040631632 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:12.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 -- 172.21.15.112:0/3040631632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 msgr2=0x20c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:12.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 --2- 172.21.15.112:0/3040631632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x20c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 -- 172.21.15.112:0/3040631632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 msgr2=0x20913d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 --2- 172.21.15.112:0/3040631632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x20913d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 -- 172.21.15.112:0/3040631632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980cfca0 con 0x1dfc840 2023-11-08T12:32:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f709d2fe700 1 --2- 172.21.15.112:0/3040631632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x206af00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7094006e50 tx=0x7f709402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1808a76960ea86 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f707b7fe700 1 -- 172.21.15.112:0/3040631632 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709401add0 con 0x1dfc840 2023-11-08T12:32:12.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f707b7fe700 1 -- 172.21.15.112:0/3040631632 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094011b80 con 0x1dfc840 2023-11-08T12:32:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f707b7fe700 1 -- 172.21.15.112:0/3040631632 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709401a940 con 0x1dfc840 2023-11-08T12:32:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 -- 172.21.15.112:0/3040631632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 msgr2=0x206af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3040631632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x206af00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7094006e50 tx=0x7f709402e000 comp rx=0 tx=0).stop 2023-11-08T12:32:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 -- 172.21.15.112:0/3040631632 shutdown_connections 2023-11-08T12:32:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3040631632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x20913d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3040631632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfcc10 0x20c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 --2- 172.21.15.112:0/3040631632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfc840 0x206af00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.007+0000 7f70a27ef740 1 -- 172.21.15.112:0/3040631632 >> 172.21.15.112:0/3040631632 conn(0x1dfcfe0 msgr2=0x2068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:12.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.011+0000 7f70a27ef740 1 -- 172.21.15.112:0/3040631632 shutdown_connections 2023-11-08T12:32:12.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.011+0000 7f70a27ef740 1 -- 172.21.15.112:0/3040631632 wait complete. 2023-11-08T12:32:12.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.011+0000 7f70a27ef740 1 -- start start 2023-11-08T12:32:12.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.011+0000 7f70a27ef740 1 Processor -- start 2023-11-08T12:32:12.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfc840 0x20c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:12.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfcc10 0x20c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:12.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x20ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:12.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6b200 con 0x1dfcc10 2023-11-08T12:32:12.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f9a440 con 0x1e478c0 2023-11-08T12:32:12.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fdcff0 con 0x1dfc840 2023-11-08T12:32:12.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 10 client.0 _ll_register_callbacks cb 0x7f7088009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:32:12.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfcc10 0x20c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:12.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfcc10 0x20c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40364/0 (socket says 172.21.15.112:40364) 2023-11-08T12:32:12.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 -- 172.21.15.112:0/2043005178 learned_addr learned my addr 172.21.15.112:0/2043005178 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:12.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709d2fe700 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfc840 0x20c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:12.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709daff700 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x20ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:12.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 -- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfc840 msgr2=0x20c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:12.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfc840 0x20c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 -- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 msgr2=0x20ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:12.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x20ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 -- 172.21.15.112:0/2043005178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1e48b10 con 0x1dfcc10 2023-11-08T12:32:12.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f709cafd700 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfcc10 0x20c8cc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7088009280 tx=0x7f7088004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbe9d2357855839 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:12.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f7073fff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:32:12.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f7073fff700 1 -- 172.21.15.112:0/2043005178 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088024040 con 0x1dfcc10 2023-11-08T12:32:12.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7088004460 con 0x1dfcc10 2023-11-08T12:32:12.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.015+0000 7f7073fff700 1 -- 172.21.15.112:0/2043005178 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7088011d70 con 0x1dfcc10 2023-11-08T12:32:12.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f7073fff700 1 -- 172.21.15.112:0/2043005178 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7088011870 con 0x1dfcc10 2023-11-08T12:32:12.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 10 client.6618 fetch_fsmap learned FSMap version 33 2023-11-08T12:32:12.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x1f81af0 con 0x1dfcc10 2023-11-08T12:32:12.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f7073fff700 1 -- 172.21.15.112:0/2043005178 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088004460 con 0x1dfcc10 2023-11-08T12:32:12.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f7073fff700 1 -- 172.21.15.112:0/2043005178 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f70880297c0 con 0x1dfcc10 2023-11-08T12:32:12.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 10 client.6618 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:32:12.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 10 client.6618 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:32:12.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 20 client.6618 populate_metadata read hostname 'smithi112' 2023-11-08T12:32:12.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x20922c0 0x20ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:12.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 4 client.6618 mds_command: new command op to 6282 tid=0[{"prefix": "scrub status"}] 2023-11-08T12:32:12.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1e79390 con 0x20922c0 2023-11-08T12:32:12.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f709d2fe700 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x20922c0 0x20ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:12.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f709d2fe700 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x20922c0 0x20ca6c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae690822a988c190 server_cookie=cd1edfdd977e716b in_seq=0 out_seq=0 2023-11-08T12:32:12.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f7073fff700 10 client.6618 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:12.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f7073fff700 1 -- 172.21.15.112:0/2043005178 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1e79390 con 0x20922c0 2023-11-08T12:32:12.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f7073fff700 10 client.6618 handle_command_reply: tid=0 2023-11-08T12:32:12.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 client.6618 shutdown 2023-11-08T12:32:12.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfcc10 msgr2=0x20c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:12.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfcc10 0x20c8cc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7088009280 tx=0x7f7088004770 comp rx=0 tx=0).stop 2023-11-08T12:32:12.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 shutdown_connections 2023-11-08T12:32:12.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x20922c0 0x20ca6c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1e478c0 0x20ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1dfcc10 0x20c8cc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 --2- 172.21.15.112:0/2043005178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1dfc840 0x20c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 >> 172.21.15.112:0/2043005178 conn(0x1dfcfe0 msgr2=0x2068510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:12.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f7073fff700 0 client.6618 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:12.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 shutdown_connections 2023-11-08T12:32:12.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 1 -- 172.21.15.112:0/2043005178 wait complete. 2023-11-08T12:32:12.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.019+0000 7f70a27ef740 20 client.6618 trim_cache size 0 max 16384 2023-11-08T12:32:12.033 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:12.033 INFO:teuthology.orchestra.run.smithi112.stdout: "status": "no active scrubs running", 2023-11-08T12:32:12.033 INFO:teuthology.orchestra.run.smithi112.stdout: "scrubs": {} 2023-11-08T12:32:12.033 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:12.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f707c064ee0 msgr2=0x7f707c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:12.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f707c064ee0 0x7f707c067390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7094009860 tx=0x7f7094008030 comp rx=0 tx=0).stop 2023-11-08T12:32:12.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f709815c640 msgr2=0x7f709815a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:12.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f709815c640 0x7f709815a3b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f709000cc10 tx=0x7f709000cf20 comp rx=0 tx=0).stop 2023-11-08T12:32:12.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 shutdown_connections 2023-11-08T12:32:12.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f707c064ee0 0x7f707c067390 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f709815c640 0x7f709815a3b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7098071aa0 0x7f70980ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 --2- 172.21.15.112:0/1053633259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7098069e00 0x7f70981f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:12.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 >> 172.21.15.112:0/1053633259 conn(0x7f70980b6520 msgr2=0x7f70980b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:12.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 shutdown_connections 2023-11-08T12:32:12.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:12.023+0000 7f709e300700 1 -- 172.21.15.112:0/1053633259 wait complete. 2023-11-08T12:32:12.048 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-08T12:32:22.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 damage ls 2023-11-08T12:32:22.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.243+0000 7f36a55d5700 1 Processor -- start 2023-11-08T12:32:22.247 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.243+0000 7f36a55d5700 1 -- start start 2023-11-08T12:32:22.249 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.243+0000 7f36a55d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36a0070790 0x7f36a0167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.243+0000 7f36a55d5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00adf90 con 0x7f36a015c1a0 2023-11-08T12:32:22.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f36a55d5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00ce370 con 0x7f36a00cdeb0 2023-11-08T12:32:22.250 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f36a55d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a0069bf0 con 0x7f36a0070790 2023-11-08T12:32:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f36a015c1a0 0x7f36a006c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52656/0 (socket says 172.21.15.112:52656) 2023-11-08T12:32:22.251 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369ffff700 1 -- 172.21.15.112:0/1834244572 learned_addr learned my addr 172.21.15.112:0/1834244572 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/1834244572 >> v2:172.21.15.133:3300/0 conn(0x7f36a0070790 0x7f36a0167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369f7fe700 1 -- 172.21.15.112:0/1834244572 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455996031 0 0) 0x7f36a00adf90 con 0x7f36a015c1a0 2023-11-08T12:32:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369f7fe700 1 -- 172.21.15.112:0/1834244572 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f368c0035d0 con 0x7f36a015c1a0 2023-11-08T12:32:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369f7fe700 1 -- 172.21.15.112:0/1834244572 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575676267 0 0) 0x7f36a00ce370 con 0x7f36a00cdeb0 2023-11-08T12:32:22.252 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369f7fe700 1 -- 172.21.15.112:0/1834244572 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a00adf90 con 0x7f36a00cdeb0 2023-11-08T12:32:22.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f36a4dd4700 1 -- 172.21.15.112:0/1834244572 >> v1:172.21.15.133:6789/0 conn(0x7f36a00cdeb0 legacy=0x7f36a0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f36a4dd4700 1 -- 172.21.15.112:0/1834244572 >> v1:172.21.15.112:6789/0 conn(0x7f36a015c1a0 legacy=0x7f36a006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.253 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f36a4dd4700 1 -- 172.21.15.112:0/1834244572 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00cc4a0 con 0x7f36a0070790 2023-11-08T12:32:22.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/1834244572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a0167110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36a00ae180 tx=0x7f369800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18c2fcbeefb32743 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.254 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369f7fe700 1 -- 172.21.15.112:0/1834244572 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698016070 con 0x7f36a0070790 2023-11-08T12:32:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369f7fe700 1 -- 172.21.15.112:0/1834244572 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800bb20 con 0x7f36a0070790 2023-11-08T12:32:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.247+0000 7f369f7fe700 1 -- 172.21.15.112:0/1834244572 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800e070 con 0x7f36a0070790 2023-11-08T12:32:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.251+0000 7f36a55d5700 1 -- 172.21.15.112:0/1834244572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 msgr2=0x7f36a0167110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.251+0000 7f36a55d5700 1 --2- 172.21.15.112:0/1834244572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a0167110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f36a00ae180 tx=0x7f369800b330 comp rx=0 tx=0).stop 2023-11-08T12:32:22.255 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.251+0000 7f36a55d5700 1 -- 172.21.15.112:0/1834244572 shutdown_connections 2023-11-08T12:32:22.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.251+0000 7f36a55d5700 1 --2- 172.21.15.112:0/1834244572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a0167110 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.251+0000 7f36a55d5700 1 -- 172.21.15.112:0/1834244572 >> 172.21.15.112:0/1834244572 conn(0x7f36a00b0f80 msgr2=0x7f36a00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.251+0000 7f36a55d5700 1 -- 172.21.15.112:0/1834244572 shutdown_connections 2023-11-08T12:32:22.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.251+0000 7f36a55d5700 1 -- 172.21.15.112:0/1834244572 wait complete. 2023-11-08T12:32:22.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 Processor -- start 2023-11-08T12:32:22.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 -- start start 2023-11-08T12:32:22.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a00b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36a00cdeb0 0x7f36a0148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a015c1a0 0x7f36a0158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01464a0 con 0x7f36a015c1a0 2023-11-08T12:32:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00c8610 con 0x7f36a0070790 2023-11-08T12:32:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a55d5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00b1ad0 con 0x7f36a00cdeb0 2023-11-08T12:32:22.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a015c1a0 0x7f36a0158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a015c1a0 0x7f36a0158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51698/0 (socket says 172.21.15.112:51698) 2023-11-08T12:32:22.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 -- 172.21.15.112:0/3218846659 learned_addr learned my addr 172.21.15.112:0/3218846659 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:22.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f3697fff700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36a00cdeb0 0x7f36a0148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f369ffff700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a00b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 -- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36a00cdeb0 msgr2=0x7f36a0148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36a00cdeb0 0x7f36a0148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 -- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 msgr2=0x7f36a00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a00b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f36a4dd4700 1 -- 172.21.15.112:0/3218846659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009a70 con 0x7f36a015c1a0 2023-11-08T12:32:22.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.255+0000 7f369ffff700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a00b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:22.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.259+0000 7f3697fff700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36a00cdeb0 0x7f36a0148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:22.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.259+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a015c1a0 0x7f36a0158430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3698014040 tx=0x7f3698004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.259+0000 7f369d7fa700 1 -- 172.21.15.112:0/3218846659 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698016040 con 0x7f36a015c1a0 2023-11-08T12:32:22.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.259+0000 7f369d7fa700 1 -- 172.21.15.112:0/3218846659 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980098f0 con 0x7f36a015c1a0 2023-11-08T12:32:22.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.259+0000 7f369d7fa700 1 -- 172.21.15.112:0/3218846659 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369801b680 con 0x7f36a015c1a0 2023-11-08T12:32:22.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.259+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a015c570 con 0x7f36a015c1a0 2023-11-08T12:32:22.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.259+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a00cc780 con 0x7f36a015c1a0 2023-11-08T12:32:22.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.263+0000 7f369d7fa700 1 -- 172.21.15.112:0/3218846659 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3698023030 con 0x7f36a015c1a0 2023-11-08T12:32:22.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.263+0000 7f369d7fa700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3680064ee0 0x7f3680067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.263+0000 7f369d7fa700 1 -- 172.21.15.112:0/3218846659 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3698083690 con 0x7f36a015c1a0 2023-11-08T12:32:22.268 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.263+0000 7f369ffff700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3680064ee0 0x7f3680067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.263+0000 7f369ffff700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3680064ee0 0x7f3680067390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3690000f60 tx=0x7f3690009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 Processor -- start 2023-11-08T12:32:22.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 -- start start 2023-11-08T12:32:22.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x18b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602840 0x18ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x186e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1771bc0 con 0x1602840 2023-11-08T12:32:22.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x17e1cb0 con 0x1602c10 2023-11-08T12:32:22.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x17dafb0 con 0x164d8c0 2023-11-08T12:32:22.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602840 0x18ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602840 0x18ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51714/0 (socket says 172.21.15.112:51714) 2023-11-08T12:32:22.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 -- 172.21.15.112:0/3149621514 learned_addr learned my addr 172.21.15.112:0/3149621514 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:22.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x186e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f369ffff700 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x18b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 -- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 msgr2=0x186e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x186e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 -- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 msgr2=0x18b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x18b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 -- 172.21.15.112:0/3149621514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18009f0 con 0x1602840 2023-11-08T12:32:22.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x186e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:22.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3697fff700 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602840 0x18ba320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3688001750 tx=0x7f3688001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e42f792a40d4131 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3695ffb700 1 -- 172.21.15.112:0/3149621514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880052e0 con 0x1602840 2023-11-08T12:32:22.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3695ffb700 1 -- 172.21.15.112:0/3149621514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688005440 con 0x1602840 2023-11-08T12:32:22.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.267+0000 7f3695ffb700 1 -- 172.21.15.112:0/3149621514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880038a0 con 0x1602840 2023-11-08T12:32:22.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- 172.21.15.112:0/3149621514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602840 msgr2=0x18ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602840 0x18ba320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3688001750 tx=0x7f3688001a60 comp rx=0 tx=0).stop 2023-11-08T12:32:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- 172.21.15.112:0/3149621514 shutdown_connections 2023-11-08T12:32:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x186e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602840 0x18ba320 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/3149621514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x18b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- 172.21.15.112:0/3149621514 >> 172.21.15.112:0/3149621514 conn(0x1602fe0 msgr2=0x189b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- 172.21.15.112:0/3149621514 shutdown_connections 2023-11-08T12:32:22.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- 172.21.15.112:0/3149621514 wait complete. 2023-11-08T12:32:22.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- start start 2023-11-08T12:32:22.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 Processor -- start 2023-11-08T12:32:22.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x186f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1894300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x186ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1687c50 con 0x164d8c0 2023-11-08T12:32:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1894840 con 0x1602c10 2023-11-08T12:32:22.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x1895fb0 con 0x1602840 2023-11-08T12:32:22.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a9ac7740 10 client.0 _ll_register_callbacks cb 0x1837020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:32:22.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a4dd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x186ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a4dd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x186ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51730/0 (socket says 172.21.15.112:51730) 2023-11-08T12:32:22.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f36a4dd4700 1 -- 172.21.15.112:0/1667832264 learned_addr learned my addr 172.21.15.112:0/1667832264 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:22.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f369ffff700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x186f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.271+0000 7f3697fff700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1894300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a4dd4700 1 -- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 msgr2=0x186f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x186f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a4dd4700 1 -- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 msgr2=0x1894300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1894300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a4dd4700 1 -- 172.21.15.112:0/1667832264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368800f040 con 0x164d8c0 2023-11-08T12:32:22.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f3697fff700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1894300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:22.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x186ddd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f369800d010 tx=0x7f3698003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d707dbb8adb89b89 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f367effd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:32:22.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f367effd700 1 -- 172.21.15.112:0/1667832264 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698054a30 con 0x164d8c0 2023-11-08T12:32:22.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f367effd700 1 -- 172.21.15.112:0/1667832264 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f369807be40 con 0x164d8c0 2023-11-08T12:32:22.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x17d4030 con 0x164d8c0 2023-11-08T12:32:22.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f367effd700 1 -- 172.21.15.112:0/1667832264 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f369805ce80 con 0x164d8c0 2023-11-08T12:32:22.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 10 client.6630 fetch_fsmap learned FSMap version 33 2023-11-08T12:32:22.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x164eb10 con 0x164d8c0 2023-11-08T12:32:22.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f367effd700 1 -- 172.21.15.112:0/1667832264 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x17d4030 con 0x164d8c0 2023-11-08T12:32:22.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f367effd700 1 -- 172.21.15.112:0/1667832264 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f3698051070 con 0x164d8c0 2023-11-08T12:32:22.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 10 client.6630 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:32:22.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 10 client.6630 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:32:22.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 20 client.6630 populate_metadata read hostname 'smithi112' 2023-11-08T12:32:22.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x186e800 0x18c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 4 client.6630 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-08T12:32:22.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17d3d50 con 0x186e800 2023-11-08T12:32:22.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f369ffff700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x186e800 0x18c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f367effd700 10 client.6630 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:22.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.275+0000 7f369ffff700 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x186e800 0x18c2ee0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9ab1a9f9a180bd5 server_cookie=337ef40959941f5e in_seq=0 out_seq=0 2023-11-08T12:32:22.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f367effd700 1 -- 172.21.15.112:0/1667832264 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x17d3d50 con 0x186e800 2023-11-08T12:32:22.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f367effd700 10 client.6630 handle_command_reply: tid=0 2023-11-08T12:32:22.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 client.6630 shutdown 2023-11-08T12:32:22.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 msgr2=0x186ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x186ddd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f369800d010 tx=0x7f3698003f20 comp rx=0 tx=0).stop 2023-11-08T12:32:22.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 shutdown_connections 2023-11-08T12:32:22.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x186e800 0x18c2ee0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x186ddd0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f367effd700 0 client.6630 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:22.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1894300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/1667832264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x186f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 >> 172.21.15.112:0/1667832264 conn(0x1602fe0 msgr2=0x189b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 shutdown_connections 2023-11-08T12:32:22.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 1 -- 172.21.15.112:0/1667832264 wait complete. 2023-11-08T12:32:22.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.279+0000 7f36a9ac7740 20 client.6630 trim_cache size 0 max 16384 2023-11-08T12:32:22.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 Processor -- start 2023-11-08T12:32:22.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 -- start start 2023-11-08T12:32:22.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602840 0x18b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602c10 0x18b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x1910900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x17d87c0 con 0x1602c10 2023-11-08T12:32:22.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x178b300 con 0x1602840 2023-11-08T12:32:22.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.295+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x17a9660 con 0x164d8c0 2023-11-08T12:32:22.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602c10 0x18b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a4dd4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x1910900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602c10 0x18b8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51734/0 (socket says 172.21.15.112:51734) 2023-11-08T12:32:22.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 -- 172.21.15.112:0/2790488293 learned_addr learned my addr 172.21.15.112:0/2790488293 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:22.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f369ffff700 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602840 0x18b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 -- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 msgr2=0x1910900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x1910900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 -- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602840 msgr2=0x18b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602840 0x18b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 -- 172.21.15.112:0/2790488293 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0158cd0 con 0x1602c10 2023-11-08T12:32:22.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x1910900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:22.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f3697fff700 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602c10 0x18b8a80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3688009010 tx=0x7f368800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc8dc279ab98156 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36967fc700 1 -- 172.21.15.112:0/2790488293 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800b040 con 0x1602c10 2023-11-08T12:32:22.306 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36967fc700 1 -- 172.21.15.112:0/2790488293 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688001330 con 0x1602c10 2023-11-08T12:32:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36967fc700 1 -- 172.21.15.112:0/2790488293 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880036a0 con 0x1602c10 2023-11-08T12:32:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2790488293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602c10 msgr2=0x18b8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602c10 0x18b8a80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3688009010 tx=0x7f368800c000 comp rx=0 tx=0).stop 2023-11-08T12:32:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2790488293 shutdown_connections 2023-11-08T12:32:22.307 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x164d8c0 0x1910900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x1602c10 0x18b8a80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2790488293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602840 0x18b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2790488293 >> 172.21.15.112:0/2790488293 conn(0x1602fe0 msgr2=0x189b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2790488293 shutdown_connections 2023-11-08T12:32:22.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.299+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2790488293 wait complete. 2023-11-08T12:32:22.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.303+0000 7f36a9ac7740 1 -- start start 2023-11-08T12:32:22.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.303+0000 7f36a9ac7740 1 Processor -- start 2023-11-08T12:32:22.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x1917050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1917590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x1917ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x1918b10 con 0x164d8c0 2023-11-08T12:32:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1874460 con 0x1602c10 2023-11-08T12:32:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x18739b0 con 0x1602840 2023-11-08T12:32:22.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 10 client.0 _ll_register_callbacks cb 0x1806660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-08T12:32:22.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x1917ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x1917ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51742/0 (socket says 172.21.15.112:51742) 2023-11-08T12:32:22.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 -- 172.21.15.112:0/2534248363 learned_addr learned my addr 172.21.15.112:0/2534248363 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:22.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f369ffff700 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x1917050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f3697fff700 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1917590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 -- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 msgr2=0x1917050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x1917050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 -- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 msgr2=0x1917590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:22.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1917590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 -- 172.21.15.112:0/2534248363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x164eb10 con 0x164d8c0 2023-11-08T12:32:22.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a4dd4700 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x1917ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3698051ca0 tx=0x7f3698058070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d234ac0bb8fcc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f367effd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2023-11-08T12:32:22.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f367effd700 1 -- 172.21.15.112:0/2534248363 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369805ce80 con 0x164d8c0 2023-11-08T12:32:22.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f367effd700 1 -- 172.21.15.112:0/2534248363 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f369807be40 con 0x164d8c0 2023-11-08T12:32:22.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3688005440 con 0x164d8c0 2023-11-08T12:32:22.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f367effd700 1 -- 172.21.15.112:0/2534248363 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36980515c0 con 0x164d8c0 2023-11-08T12:32:22.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 10 client.6636 fetch_fsmap learned FSMap version 33 2023-11-08T12:32:22.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x18009f0 con 0x164d8c0 2023-11-08T12:32:22.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f367effd700 1 -- 172.21.15.112:0/2534248363 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688005440 con 0x164d8c0 2023-11-08T12:32:22.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f367effd700 1 -- 172.21.15.112:0/2534248363 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f36980541e0 con 0x164d8c0 2023-11-08T12:32:22.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 10 client.6636 fetch_fsmap finished waiting for FSMap version 33 2023-11-08T12:32:22.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 10 client.6636 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-11-08T12:32:22.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 20 client.6636 populate_metadata read hostname 'smithi112' 2023-11-08T12:32:22.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.307+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18b8fe0 0x18cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 4 client.6636 mds_command: new command op to 6282 tid=0[{"prefix": "damage ls"}] 2023-11-08T12:32:22.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 --> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x167f390 con 0x18b8fe0 2023-11-08T12:32:22.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f369ffff700 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18b8fe0 0x18cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f367effd700 10 client.6636 ms_handle_connect on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:22.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f369ffff700 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18b8fe0 0x18cf130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b1fcca7dcece71a server_cookie=fcfe86f1e0a4ad99 in_seq=0 out_seq=0 2023-11-08T12:32:22.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f367effd700 1 -- 172.21.15.112:0/2534248363 <== mds.0 v2:172.21.15.112:6836/2843990803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x167f390 con 0x18b8fe0 2023-11-08T12:32:22.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f367effd700 10 client.6636 handle_command_reply: tid=0 2023-11-08T12:32:22.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 client.6636 shutdown 2023-11-08T12:32:22.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 msgr2=0x1917ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x1917ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3698051ca0 tx=0x7f3698058070 comp rx=0 tx=0).stop 2023-11-08T12:32:22.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 shutdown_connections 2023-11-08T12:32:22.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:6836/2843990803,v1:172.21.15.112:6837/2843990803] conn(0x18b8fe0 0x18cf130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x164d8c0 0x1917ad0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1602c10 0x1917590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 --2- 172.21.15.112:0/2534248363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x1602840 0x1917050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 >> 172.21.15.112:0/2534248363 conn(0x1602fe0 msgr2=0x18951f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f367effd700 0 client.6636 ms_handle_reset on v2:172.21.15.112:6836/2843990803 2023-11-08T12:32:22.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 shutdown_connections 2023-11-08T12:32:22.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 1 -- 172.21.15.112:0/2534248363 wait complete. 2023-11-08T12:32:22.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a9ac7740 20 client.6636 trim_cache size 0 max 16384 2023-11-08T12:32:22.325 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2023-11-08T12:32:22.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2023-11-08T12:32:22.325 INFO:teuthology.orchestra.run.smithi112.stdout: "damage_type": "backtrace", 2023-11-08T12:32:22.325 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 2758995627, 2023-11-08T12:32:22.326 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 1099511627777, 2023-11-08T12:32:22.326 INFO:teuthology.orchestra.run.smithi112.stdout: "path": "/dir_test/file" 2023-11-08T12:32:22.326 INFO:teuthology.orchestra.run.smithi112.stdout: } 2023-11-08T12:32:22.326 INFO:teuthology.orchestra.run.smithi112.stdout:] 2023-11-08T12:32:22.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3680064ee0 msgr2=0x7f3680067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a55d5700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3680064ee0 0x7f3680067390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3690000f60 tx=0x7f3690009040 comp rx=0 tx=0).stop 2023-11-08T12:32:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a015c1a0 msgr2=0x7f36a0158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.311+0000 7f36a55d5700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a015c1a0 0x7f36a0158430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3698014040 tx=0x7f3698004af0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 shutdown_connections 2023-11-08T12:32:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3680064ee0 0x7f3680067390 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a015c1a0 0x7f36a0158430 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36a00cdeb0 0x7f36a0148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 --2- 172.21.15.112:0/3218846659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0070790 0x7f36a00b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 >> 172.21.15.112:0/3218846659 conn(0x7f36a00b0f80 msgr2=0x7f36a00afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 shutdown_connections 2023-11-08T12:32:22.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.315+0000 7f36a55d5700 1 -- 172.21.15.112:0/3218846659 wait complete. 2023-11-08T12:32:22.343 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-08T12:32:22.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:32:22.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-08T12:32:22.432 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-08T12:32:22.433 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:32:22.433 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:22.452 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:32:22.453 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:22.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:32:22.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.723+0000 7f9c4f59e700 1 Processor -- start 2023-11-08T12:32:22.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.723+0000 7f9c4f59e700 1 -- start start 2023-11-08T12:32:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c50071aa0 0x7f9c5006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4f59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5006c600 con 0x7f9c50069e00 2023-11-08T12:32:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500722f0 con 0x7f9c5015c640 2023-11-08T12:32:22.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5006cef0 con 0x7f9c50071aa0 2023-11-08T12:32:22.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c47fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c50071aa0 0x7f9c5006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4ed9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9c50069e00 0x7f9c500d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52668/0 (socket says 172.21.15.112:52668) 2023-11-08T12:32:22.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4ed9d700 1 -- 172.21.15.112:0/3637405612 learned_addr learned my addr 172.21.15.112:0/3637405612 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:22.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4e59c700 1 --1- 172.21.15.112:0/3637405612 >> v1:172.21.15.133:6789/0 conn(0x7f9c5015c640 0x7f9c500d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:56814/0 (socket says 172.21.15.112:56814) 2023-11-08T12:32:22.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.727+0000 7f9c4dd9b700 1 -- 172.21.15.112:0/3637405612 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349348408 0 0) 0x7f9c5006c600 con 0x7f9c50069e00 2023-11-08T12:32:22.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4dd9b700 1 -- 172.21.15.112:0/3637405612 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3c0035d0 con 0x7f9c50069e00 2023-11-08T12:32:22.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c47fff700 1 -- 172.21.15.112:0/3637405612 >> v1:172.21.15.133:6789/0 conn(0x7f9c5015c640 legacy=0x7f9c500d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4dd9b700 1 -- 172.21.15.112:0/3637405612 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556961107 0 0) 0x7f9c500722f0 con 0x7f9c5015c640 2023-11-08T12:32:22.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c47fff700 1 -- 172.21.15.112:0/3637405612 >> v1:172.21.15.112:6789/0 conn(0x7f9c50069e00 legacy=0x7f9c500d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c47fff700 1 -- 172.21.15.112:0/3637405612 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5015ca10 con 0x7f9c50071aa0 2023-11-08T12:32:22.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c47fff700 1 --2- 172.21.15.112:0/3637405612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c50071aa0 0x7f9c5006d310 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009850 tx=0x7f9c38009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a33ecff15493234d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4dd9b700 1 -- 172.21.15.112:0/3637405612 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38011830 con 0x7f9c50071aa0 2023-11-08T12:32:22.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4dd9b700 1 -- 172.21.15.112:0/3637405612 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38011990 con 0x7f9c50071aa0 2023-11-08T12:32:22.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4dd9b700 1 -- 172.21.15.112:0/3637405612 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38011d40 con 0x7f9c50071aa0 2023-11-08T12:32:22.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4f59e700 1 -- 172.21.15.112:0/3637405612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c50071aa0 msgr2=0x7f9c5006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/3637405612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c50071aa0 0x7f9c5006d310 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009850 tx=0x7f9c38009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:22.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4f59e700 1 -- 172.21.15.112:0/3637405612 shutdown_connections 2023-11-08T12:32:22.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/3637405612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c50071aa0 0x7f9c5006d310 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4f59e700 1 -- 172.21.15.112:0/3637405612 >> 172.21.15.112:0/3637405612 conn(0x7f9c500b6520 msgr2=0x7f9c50071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4f59e700 1 -- 172.21.15.112:0/3637405612 shutdown_connections 2023-11-08T12:32:22.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.731+0000 7f9c4f59e700 1 -- 172.21.15.112:0/3637405612 wait complete. 2023-11-08T12:32:22.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.735+0000 7f9c4f59e700 1 Processor -- start 2023-11-08T12:32:22.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.735+0000 7f9c4f59e700 1 -- start start 2023-11-08T12:32:22.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c50069e00 0x7f9c500ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50071aa0 0x7f9c501f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c5015c640 0x7f9c500cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500d38f0 con 0x7f9c50071aa0 2023-11-08T12:32:22.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500cd890 con 0x7f9c5015c640 2023-11-08T12:32:22.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500cdb70 con 0x7f9c50069e00 2023-11-08T12:32:22.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50071aa0 0x7f9c501f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50071aa0 0x7f9c501f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51748/0 (socket says 172.21.15.112:51748) 2023-11-08T12:32:22.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 -- 172.21.15.112:0/734478404 learned_addr learned my addr 172.21.15.112:0/734478404 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:22.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4ed9d700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c5015c640 0x7f9c500cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4e59c700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c50069e00 0x7f9c500ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 -- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c50069e00 msgr2=0x7f9c500ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c50069e00 0x7f9c500ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 -- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c5015c640 msgr2=0x7f9c500cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c5015c640 0x7f9c500cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 -- 172.21.15.112:0/734478404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380094b0 con 0x7f9c50071aa0 2023-11-08T12:32:22.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c47fff700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50071aa0 0x7f9c501f18c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9c380090b0 tx=0x7f9c38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c46ffd700 1 -- 172.21.15.112:0/734478404 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3801a8d0 con 0x7f9c50071aa0 2023-11-08T12:32:22.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c46ffd700 1 -- 172.21.15.112:0/734478404 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3801f070 con 0x7f9c50071aa0 2023-11-08T12:32:22.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5006c830 con 0x7f9c50071aa0 2023-11-08T12:32:22.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c46ffd700 1 -- 172.21.15.112:0/734478404 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3801ac70 con 0x7f9c50071aa0 2023-11-08T12:32:22.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.739+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c50072010 con 0x7f9c50071aa0 2023-11-08T12:32:22.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.743+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5006cb10 con 0x7f9c50071aa0 2023-11-08T12:32:22.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.743+0000 7f9c46ffd700 1 -- 172.21.15.112:0/734478404 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f9c3800f050 con 0x7f9c50071aa0 2023-11-08T12:32:22.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.743+0000 7f9c46ffd700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:22.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.743+0000 7f9c46ffd700 1 -- 172.21.15.112:0/734478404 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9c38083130 con 0x7f9c50071aa0 2023-11-08T12:32:22.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.743+0000 7f9c4e59c700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:22.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.747+0000 7f9c4e59c700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c40000f60 tx=0x7f9c40007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:22.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.747+0000 7f9c46ffd700 1 -- 172.21.15.112:0/734478404 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9c380510d0 con 0x7f9c50071aa0 2023-11-08T12:32:22.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.927+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c50073cb0 con 0x7f9c50071aa0 2023-11-08T12:32:22.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.927+0000 7f9c46ffd700 1 -- 172.21.15.112:0/734478404 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18232 (secure 0 0 0) 0x7f9c380546f0 con 0x7f9c50071aa0 2023-11-08T12:32:22.933 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:22.933 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:31:36.967622+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:53.129272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:54.279849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.17","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:32:22.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 msgr2=0x7f9c30067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c40000f60 tx=0x7f9c40007e00 comp rx=0 tx=0).stop 2023-11-08T12:32:22.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50071aa0 msgr2=0x7f9c501f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:22.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50071aa0 0x7f9c501f18c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9c380090b0 tx=0x7f9c38004770 comp rx=0 tx=0).stop 2023-11-08T12:32:22.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 shutdown_connections 2023-11-08T12:32:22.936 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9c30064ee0 0x7f9c30067390 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c5015c640 0x7f9c500cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c50071aa0 0x7f9c501f18c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 --2- 172.21.15.112:0/734478404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9c50069e00 0x7f9c500ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:22.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 >> 172.21.15.112:0/734478404 conn(0x7f9c500b6520 msgr2=0x7f9c500b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:22.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 shutdown_connections 2023-11-08T12:32:22.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:22.931+0000 7f9c4f59e700 1 -- 172.21.15.112:0/734478404 wait complete. 2023-11-08T12:32:22.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:30:53.129272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:30:54.279849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:32:22.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:32:23.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.131+0000 7f486359e700 1 Processor -- start 2023-11-08T12:32:23.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.131+0000 7f486359e700 1 -- start start 2023-11-08T12:32:23.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f485c0e29f0 0x7f485c055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f485c038560 0x7f485c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c007360 con 0x7f485c03b160 2023-11-08T12:32:23.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0e2dc0 con 0x7f485c0e29f0 2023-11-08T12:32:23.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c053f70 con 0x7f485c038560 2023-11-08T12:32:23.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f485c0e29f0 0x7f485c055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f485c0e29f0 0x7f485c055490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51760/0 (socket says 172.21.15.112:51760) 2023-11-08T12:32:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.135+0000 7f486259c700 1 -- 172.21.15.112:0/3669986719 learned_addr learned my addr 172.21.15.112:0/3669986719 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f4861d9b700 1 --2- 172.21.15.112:0/3669986719 >> v2:172.21.15.133:3300/0 conn(0x7f485c038560 0x7f485c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486259c700 1 -- 172.21.15.112:0/3669986719 >> v2:172.21.15.133:3300/0 conn(0x7f485c038560 msgr2=0x7f485c03ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:23.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486259c700 1 --2- 172.21.15.112:0/3669986719 >> v2:172.21.15.133:3300/0 conn(0x7f485c038560 0x7f485c03ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486259c700 1 -- 172.21.15.112:0/3669986719 >> v1:172.21.15.133:6789/0 conn(0x7f485c03b160 legacy=0x7f485c0e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486259c700 1 -- 172.21.15.112:0/3669986719 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c03b5a0 con 0x7f485c0e29f0 2023-11-08T12:32:23.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f4861d9b700 1 --2- 172.21.15.112:0/3669986719 >> v2:172.21.15.133:3300/0 conn(0x7f485c038560 0x7f485c03ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:23.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486259c700 1 --2- 172.21.15.112:0/3669986719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c0e29f0 0x7f485c055490 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f485c03bd90 tx=0x7f4854009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77799f37c5d8864 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486159a700 1 -- 172.21.15.112:0/3669986719 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400b8a0 con 0x7f485c0e29f0 2023-11-08T12:32:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486159a700 1 -- 172.21.15.112:0/3669986719 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400ba00 con 0x7f485c0e29f0 2023-11-08T12:32:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486159a700 1 -- 172.21.15.112:0/3669986719 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400bd90 con 0x7f485c0e29f0 2023-11-08T12:32:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 -- 172.21.15.112:0/3669986719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c0e29f0 msgr2=0x7f485c055490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 --2- 172.21.15.112:0/3669986719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c0e29f0 0x7f485c055490 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f485c03bd90 tx=0x7f4854009bf0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 -- 172.21.15.112:0/3669986719 shutdown_connections 2023-11-08T12:32:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 --2- 172.21.15.112:0/3669986719 >> v2:172.21.15.133:3300/0 conn(0x7f485c038560 0x7f485c03ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 --2- 172.21.15.112:0/3669986719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c0e29f0 0x7f485c055490 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 -- 172.21.15.112:0/3669986719 >> 172.21.15.112:0/3669986719 conn(0x7f485c055c20 msgr2=0x7f485c056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:23.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 -- 172.21.15.112:0/3669986719 shutdown_connections 2023-11-08T12:32:23.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.139+0000 7f486359e700 1 -- 172.21.15.112:0/3669986719 wait complete. 2023-11-08T12:32:23.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.143+0000 7f486359e700 1 Processor -- start 2023-11-08T12:32:23.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.143+0000 7f486359e700 1 -- start start 2023-11-08T12:32:23.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c038560 0x7f485c04e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f485c03b160 0x7f485c03a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485c0e29f0 0x7f485c03a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0d6ee0 con 0x7f485c038560 2023-11-08T12:32:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0e0020 con 0x7f485c0e29f0 2023-11-08T12:32:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0df410 con 0x7f485c03b160 2023-11-08T12:32:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c038560 0x7f485c04e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c038560 0x7f485c04e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51772/0 (socket says 172.21.15.112:51772) 2023-11-08T12:32:23.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 -- 172.21.15.112:0/4187226603 learned_addr learned my addr 172.21.15.112:0/4187226603 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:23.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f4862d9d700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485c0e29f0 0x7f485c03a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f4861d9b700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f485c03b160 0x7f485c03a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 -- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f485c03b160 msgr2=0x7f485c03a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f485c03b160 0x7f485c03a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 -- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485c0e29f0 msgr2=0x7f485c03a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485c0e29f0 0x7f485c03a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 -- 172.21.15.112:0/4187226603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009570 con 0x7f485c038560 2023-11-08T12:32:23.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f4862d9d700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485c0e29f0 0x7f485c03a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:23.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486259c700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c038560 0x7f485c04e900 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4854000c00 tx=0x7f4854004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f4852ffd700 1 -- 172.21.15.112:0/4187226603 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854003ad0 con 0x7f485c038560 2023-11-08T12:32:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f4852ffd700 1 -- 172.21.15.112:0/4187226603 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485401e070 con 0x7f485c038560 2023-11-08T12:32:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f4852ffd700 1 -- 172.21.15.112:0/4187226603 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854003e90 con 0x7f485c038560 2023-11-08T12:32:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c007080 con 0x7f485c038560 2023-11-08T12:32:23.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.147+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c006dc0 con 0x7f485c038560 2023-11-08T12:32:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.151+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c053920 con 0x7f485c038560 2023-11-08T12:32:23.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.151+0000 7f4852ffd700 1 -- 172.21.15.112:0/4187226603 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f485400f050 con 0x7f485c038560 2023-11-08T12:32:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.151+0000 7f4852ffd700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.151+0000 7f4852ffd700 1 -- 172.21.15.112:0/4187226603 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4854020070 con 0x7f485c038560 2023-11-08T12:32:23.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.151+0000 7f4861d9b700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.155+0000 7f4861d9b700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4844064ee0 0x7f4844067390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f485c038930 tx=0x7f4858008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.159+0000 7f4852ffd700 1 -- 172.21.15.112:0/4187226603 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4854051860 con 0x7f485c038560 2023-11-08T12:32:23.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.331+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f485c005570 con 0x7f485c038560 2023-11-08T12:32:23.337 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.331+0000 7f4852ffd700 1 -- 172.21.15.112:0/4187226603 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4854054e80 con 0x7f485c038560 2023-11-08T12:32:23.338 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:32:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4844064ee0 msgr2=0x7f4844067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4844064ee0 0x7f4844067390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f485c038930 tx=0x7f4858008040 comp rx=0 tx=0).stop 2023-11-08T12:32:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c038560 msgr2=0x7f485c04e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c038560 0x7f485c04e900 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4854000c00 tx=0x7f4854004770 comp rx=0 tx=0).stop 2023-11-08T12:32:23.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 shutdown_connections 2023-11-08T12:32:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4844064ee0 0x7f4844067390 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485c0e29f0 0x7f485c03a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f485c03b160 0x7f485c03a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 --2- 172.21.15.112:0/4187226603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f485c038560 0x7f485c04e900 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.341 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 >> 172.21.15.112:0/4187226603 conn(0x7f485c055c20 msgr2=0x7f485c03bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:23.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 shutdown_connections 2023-11-08T12:32:23.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.335+0000 7f486359e700 1 -- 172.21.15.112:0/4187226603 wait complete. 2023-11-08T12:32:23.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:32:23.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.543+0000 7f3d2c9cb700 1 Processor -- start 2023-11-08T12:32:23.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.543+0000 7f3d2c9cb700 1 -- start start 2023-11-08T12:32:23.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.543+0000 7f3d2c9cb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d280b4280 0x7f3d280aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.543+0000 7f3d2c9cb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.543+0000 7f3d2c9cb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2806c040 con 0x7f3d280adb20 2023-11-08T12:32:23.549 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.543+0000 7f3d2c9cb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2815a920 con 0x7f3d280b4280 2023-11-08T12:32:23.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.543+0000 7f3d2c9cb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2815eac0 con 0x7f3d2806ae10 2023-11-08T12:32:23.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d280b4280 0x7f3d280aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280af480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:43616/0 (socket says 172.21.15.112:43616) 2023-11-08T12:32:23.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 -- 172.21.15.112:0/628246353 learned_addr learned my addr 172.21.15.112:0/628246353 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:23.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 -- 172.21.15.112:0/628246353 >> v2:172.21.15.133:3300/0 conn(0x7f3d280b4280 msgr2=0x7f3d280aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:23.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 --2- 172.21.15.112:0/628246353 >> v2:172.21.15.133:3300/0 conn(0x7f3d280b4280 0x7f3d280aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 -- 172.21.15.112:0/628246353 >> v1:172.21.15.133:6789/0 conn(0x7f3d280adb20 legacy=0x7f3d28069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d25d9b700 1 -- 172.21.15.112:0/628246353 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767060034 0 0) 0x7f3d2806c040 con 0x7f3d280adb20 2023-11-08T12:32:23.552 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 -- 172.21.15.112:0/628246353 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2806d4e0 con 0x7f3d2806ae10 2023-11-08T12:32:23.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d26d9d700 1 --2- 172.21.15.112:0/628246353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280af480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009e50 tx=0x7f3d2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32c9101f915f7eff server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d25d9b700 1 -- 172.21.15.112:0/628246353 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000e070 con 0x7f3d2806ae10 2023-11-08T12:32:23.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d25d9b700 1 -- 172.21.15.112:0/628246353 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2000b910 con 0x7f3d2806ae10 2023-11-08T12:32:23.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d25d9b700 1 -- 172.21.15.112:0/628246353 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000bcc0 con 0x7f3d2806ae10 2023-11-08T12:32:23.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/628246353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 msgr2=0x7f3d280af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/628246353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280af480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009e50 tx=0x7f3d2000b330 comp rx=0 tx=0).stop 2023-11-08T12:32:23.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/628246353 shutdown_connections 2023-11-08T12:32:23.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/628246353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280af480 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/628246353 >> v2:172.21.15.133:3300/0 conn(0x7f3d280b4280 0x7f3d280aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/628246353 >> 172.21.15.112:0/628246353 conn(0x7f3d280cf580 msgr2=0x7f3d280cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:23.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/628246353 shutdown_connections 2023-11-08T12:32:23.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.547+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/628246353 wait complete. 2023-11-08T12:32:23.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.551+0000 7f3d2c9cb700 1 Processor -- start 2023-11-08T12:32:23.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.551+0000 7f3d2c9cb700 1 -- start start 2023-11-08T12:32:23.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d280adb20 0x7f3d2815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d280b4280 0x7f3d2815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d280c5a60 con 0x7f3d280adb20 2023-11-08T12:32:23.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d280c5d40 con 0x7f3d280b4280 2023-11-08T12:32:23.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d280c6020 con 0x7f3d2806ae10 2023-11-08T12:32:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d280adb20 0x7f3d2815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d280adb20 0x7f3d2815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51776/0 (socket says 172.21.15.112:51776) 2023-11-08T12:32:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 -- 172.21.15.112:0/3002064189 learned_addr learned my addr 172.21.15.112:0/3002064189 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d26d9d700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d280b4280 0x7f3d2815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2659c700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 -- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 msgr2=0x7f3d280b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 -- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d280b4280 msgr2=0x7f3d2815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d280b4280 0x7f3d2815b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 -- 172.21.15.112:0/3002064189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20009b30 con 0x7f3d280adb20 2023-11-08T12:32:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1ffff700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d280adb20 0x7f3d2815b450 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3d100011e0 tx=0x7f3d1000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1effd700 1 -- 172.21.15.112:0/3002064189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100054e0 con 0x7f3d280adb20 2023-11-08T12:32:23.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1effd700 1 -- 172.21.15.112:0/3002064189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d100036a0 con 0x7f3d280adb20 2023-11-08T12:32:23.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d1effd700 1 -- 172.21.15.112:0/3002064189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10003a50 con 0x7f3d280adb20 2023-11-08T12:32:23.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2815ed60 con 0x7f3d280adb20 2023-11-08T12:32:23.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.555+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d280b4650 con 0x7f3d280adb20 2023-11-08T12:32:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.559+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d280b1350 con 0x7f3d280adb20 2023-11-08T12:32:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.559+0000 7f3d1effd700 1 -- 172.21.15.112:0/3002064189 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3d10019030 con 0x7f3d280adb20 2023-11-08T12:32:23.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.559+0000 7f3d1effd700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d08064ee0 0x7f3d08067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.559+0000 7f3d1effd700 1 -- 172.21.15.112:0/3002064189 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3d100814f0 con 0x7f3d280adb20 2023-11-08T12:32:23.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.559+0000 7f3d2659c700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d08064ee0 0x7f3d08067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.563+0000 7f3d2659c700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d08064ee0 0x7f3d08067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009ae0 tx=0x7f3d18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.567+0000 7f3d1effd700 1 -- 172.21.15.112:0/3002064189 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3d1004f420 con 0x7f3d280adb20 2023-11-08T12:32:23.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.731+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d280726c0 con 0x7f3d280adb20 2023-11-08T12:32:23.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.735+0000 7f3d1effd700 1 -- 172.21.15.112:0/3002064189 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d100170a0 con 0x7f3d280adb20 2023-11-08T12:32:23.738 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:32:23.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d08064ee0 msgr2=0x7f3d08067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d08064ee0 0x7f3d08067390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009ae0 tx=0x7f3d18008040 comp rx=0 tx=0).stop 2023-11-08T12:32:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d280adb20 msgr2=0x7f3d2815b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d280adb20 0x7f3d2815b450 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3d100011e0 tx=0x7f3d1000ca30 comp rx=0 tx=0).stop 2023-11-08T12:32:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 shutdown_connections 2023-11-08T12:32:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3d08064ee0 0x7f3d08067390 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d280b4280 0x7f3d2815b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d280adb20 0x7f3d2815b450 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 --2- 172.21.15.112:0/3002064189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d2806ae10 0x7f3d280b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 >> 172.21.15.112:0/3002064189 conn(0x7f3d280cf580 msgr2=0x7f3d280b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 shutdown_connections 2023-11-08T12:32:23.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.739+0000 7f3d2c9cb700 1 -- 172.21.15.112:0/3002064189 wait complete. 2023-11-08T12:32:23.764 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:32:23.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.931+0000 7faaeac66700 1 Processor -- start 2023-11-08T12:32:23.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.931+0000 7faaeac66700 1 -- start start 2023-11-08T12:32:23.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.931+0000 7faaeac66700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faae40cdc50 0x7faae4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.931+0000 7faaeac66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae406ff10 0x7faae4070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.931+0000 7faaeac66700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae415e560 con 0x7faae415e190 2023-11-08T12:32:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.931+0000 7faaeac66700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae40708d0 con 0x7faae40cdc50 2023-11-08T12:32:23.938 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.931+0000 7faaeac66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae406be80 con 0x7faae406ff10 2023-11-08T12:32:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9c64700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faae415e190 0x7faae4161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52676/0 (socket says 172.21.15.112:52676) 2023-11-08T12:32:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9c64700 1 -- 172.21.15.112:0/1938853653 learned_addr learned my addr 172.21.15.112:0/1938853653 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:23.939 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9463700 1 --2- 172.21.15.112:0/1938853653 >> v2:172.21.15.133:3300/0 conn(0x7faae40cdc50 0x7faae4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faaea465700 1 --2- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae406ff10 0x7faae4070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae8c62700 1 -- 172.21.15.112:0/1938853653 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938162485 0 0) 0x7faad8001490 con 0x7faae415e190 2023-11-08T12:32:23.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae8c62700 1 -- 172.21.15.112:0/1938853653 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad40035d0 con 0x7faae415e190 2023-11-08T12:32:23.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9463700 1 -- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae406ff10 msgr2=0x7faae4070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9463700 1 --2- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae406ff10 0x7faae4070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9463700 1 -- 172.21.15.112:0/1938853653 >> v1:172.21.15.112:6789/0 conn(0x7faae415e190 legacy=0x7faae4161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9463700 1 -- 172.21.15.112:0/1938853653 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40ce0a0 con 0x7faae40cdc50 2023-11-08T12:32:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae9463700 1 --2- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae40cdc50 0x7faae4069bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faad0009850 tx=0x7faad0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67995507e8d75ed3 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae8c62700 1 -- 172.21.15.112:0/1938853653 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0011830 con 0x7faae40cdc50 2023-11-08T12:32:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae8c62700 1 -- 172.21.15.112:0/1938853653 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad0011990 con 0x7faae40cdc50 2023-11-08T12:32:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faae8c62700 1 -- 172.21.15.112:0/1938853653 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0011d40 con 0x7faae40cdc50 2023-11-08T12:32:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faaeac66700 1 -- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae40cdc50 msgr2=0x7faae4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faaeac66700 1 --2- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae40cdc50 0x7faae4069bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faad0009850 tx=0x7faad0009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:23.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faaeac66700 1 -- 172.21.15.112:0/1938853653 shutdown_connections 2023-11-08T12:32:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faaeac66700 1 --2- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae406ff10 0x7faae4070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faaeac66700 1 --2- 172.21.15.112:0/1938853653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae40cdc50 0x7faae4069bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.935+0000 7faaeac66700 1 -- 172.21.15.112:0/1938853653 >> 172.21.15.112:0/1938853653 conn(0x7faae40cf280 msgr2=0x7faae40cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.939+0000 7faaeac66700 1 -- 172.21.15.112:0/1938853653 shutdown_connections 2023-11-08T12:32:23.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.939+0000 7faaeac66700 1 -- 172.21.15.112:0/1938853653 wait complete. 2023-11-08T12:32:23.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.939+0000 7faaeac66700 1 Processor -- start 2023-11-08T12:32:23.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.939+0000 7faaeac66700 1 -- start start 2023-11-08T12:32:23.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae406ff10 0x7faae4147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae40cdc50 0x7faae4162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae415e190 0x7faae4162c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40b31e0 con 0x7faae406ff10 2023-11-08T12:32:23.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae414b4b0 con 0x7faae415e190 2023-11-08T12:32:23.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae414b1d0 con 0x7faae40cdc50 2023-11-08T12:32:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9c64700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae406ff10 0x7faae4147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9c64700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae406ff10 0x7faae4147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51786/0 (socket says 172.21.15.112:51786) 2023-11-08T12:32:23.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9c64700 1 -- 172.21.15.112:0/1782416415 learned_addr learned my addr 172.21.15.112:0/1782416415 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:23.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9463700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae40cdc50 0x7faae4162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaea465700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae415e190 0x7faae4162c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.950 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9463700 1 -- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae415e190 msgr2=0x7faae4162c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9463700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae415e190 0x7faae4162c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9463700 1 -- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae406ff10 msgr2=0x7faae4147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:23.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9463700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae406ff10 0x7faae4147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:23.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9463700 1 -- 172.21.15.112:0/1782416415 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00094b0 con 0x7faae40cdc50 2023-11-08T12:32:23.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae9463700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae40cdc50 0x7faae4162710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faad0016000 tx=0x7faad0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.951 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae27fc700 1 -- 172.21.15.112:0/1782416415 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0004590 con 0x7faae40cdc50 2023-11-08T12:32:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae27fc700 1 -- 172.21.15.112:0/1782416415 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad00036c0 con 0x7faae40cdc50 2023-11-08T12:32:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae40af990 con 0x7faae40cdc50 2023-11-08T12:32:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faae27fc700 1 -- 172.21.15.112:0/1782416415 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0003a70 con 0x7faae40cdc50 2023-11-08T12:32:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.943+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae40ce330 con 0x7faae40cdc50 2023-11-08T12:32:23.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.947+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae40afc70 con 0x7faae40cdc50 2023-11-08T12:32:23.953 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.947+0000 7faae27fc700 1 -- 172.21.15.112:0/1782416415 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7faad002d070 con 0x7faae40cdc50 2023-11-08T12:32:23.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.951+0000 7faae27fc700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faac8064ee0 0x7faac8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:23.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.951+0000 7faae27fc700 1 -- 172.21.15.112:0/1782416415 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7faad0021030 con 0x7faae40cdc50 2023-11-08T12:32:23.954 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.951+0000 7faae9c64700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faac8064ee0 0x7faac8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.951+0000 7faae9c64700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faac8064ee0 0x7faac8067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faad8002230 tx=0x7faad8001ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:23.959+0000 7faae27fc700 1 -- 172.21.15.112:0/1782416415 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7faad0051ba0 con 0x7faae40cdc50 2023-11-08T12:32:24.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.131+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faae4073d20 con 0x7faae40cdc50 2023-11-08T12:32:24.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.131+0000 7faae27fc700 1 -- 172.21.15.112:0/1782416415 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7faad0015020 con 0x7faae40cdc50 2023-11-08T12:32:24.137 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:32:24.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faac8064ee0 msgr2=0x7faac8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faac8064ee0 0x7faac8067390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faad8002230 tx=0x7faad8001ac0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae40cdc50 msgr2=0x7faae4162710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae40cdc50 0x7faae4162710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faad0016000 tx=0x7faad0004770 comp rx=0 tx=0).stop 2023-11-08T12:32:24.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 shutdown_connections 2023-11-08T12:32:24.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7faac8064ee0 0x7faac8067390 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faae415e190 0x7faae4162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faae40cdc50 0x7faae4162710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 --2- 172.21.15.112:0/1782416415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faae406ff10 0x7faae4147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 >> 172.21.15.112:0/1782416415 conn(0x7faae40cf280 msgr2=0x7faae406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:24.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 shutdown_connections 2023-11-08T12:32:24.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.135+0000 7faaeac66700 1 -- 172.21.15.112:0/1782416415 wait complete. 2023-11-08T12:32:24.160 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:32:24.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.343+0000 7fec88d37700 1 Processor -- start 2023-11-08T12:32:24.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.343+0000 7fec88d37700 1 -- start start 2023-11-08T12:32:24.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fec84070a00 0x7fec84069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec840b2130 0x7fec8406a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec840cd360 con 0x7fec8415c700 2023-11-08T12:32:24.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec84160190 con 0x7fec84070a00 2023-11-08T12:32:24.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec84160470 con 0x7fec840b2130 2023-11-08T12:32:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec7bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fec84070a00 0x7fec84069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec8259c700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fec8415c700 0x7fec840702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52690/0 (socket says 172.21.15.112:52690) 2023-11-08T12:32:24.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec8259c700 1 -- 172.21.15.112:0/2902258303 learned_addr learned my addr 172.21.15.112:0/2902258303 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec82d9d700 1 --2- 172.21.15.112:0/2902258303 >> v2:172.21.15.133:3300/0 conn(0x7fec840b2130 0x7fec8406a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec81d9b700 1 -- 172.21.15.112:0/2902258303 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243506820 0 0) 0x7fec840cd360 con 0x7fec8415c700 2023-11-08T12:32:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec81d9b700 1 -- 172.21.15.112:0/2902258303 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec700035d0 con 0x7fec8415c700 2023-11-08T12:32:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec7bfff700 1 -- 172.21.15.112:0/2902258303 >> v2:172.21.15.133:3300/0 conn(0x7fec840b2130 msgr2=0x7fec8406a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:24.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec7bfff700 1 --2- 172.21.15.112:0/2902258303 >> v2:172.21.15.133:3300/0 conn(0x7fec840b2130 0x7fec8406a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec7bfff700 1 -- 172.21.15.112:0/2902258303 >> v1:172.21.15.112:6789/0 conn(0x7fec8415c700 legacy=0x7fec840702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec7bfff700 1 -- 172.21.15.112:0/2902258303 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84160750 con 0x7fec84070a00 2023-11-08T12:32:24.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec7bfff700 1 --2- 172.21.15.112:0/2902258303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec84070a00 0x7fec84069bf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fec8406bfd0 tx=0x7fec6c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f01a4454d90dde server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:24.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec81d9b700 1 -- 172.21.15.112:0/2902258303 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c011830 con 0x7fec84070a00 2023-11-08T12:32:24.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec81d9b700 1 -- 172.21.15.112:0/2902258303 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c011990 con 0x7fec84070a00 2023-11-08T12:32:24.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec81d9b700 1 -- 172.21.15.112:0/2902258303 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c011d20 con 0x7fec84070a00 2023-11-08T12:32:24.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- 172.21.15.112:0/2902258303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec84070a00 msgr2=0x7fec84069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 --2- 172.21.15.112:0/2902258303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec84070a00 0x7fec84069bf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fec8406bfd0 tx=0x7fec6c009b30 comp rx=0 tx=0).stop 2023-11-08T12:32:24.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- 172.21.15.112:0/2902258303 shutdown_connections 2023-11-08T12:32:24.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 --2- 172.21.15.112:0/2902258303 >> v2:172.21.15.133:3300/0 conn(0x7fec840b2130 0x7fec8406a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 --2- 172.21.15.112:0/2902258303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec84070a00 0x7fec84069bf0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- 172.21.15.112:0/2902258303 >> 172.21.15.112:0/2902258303 conn(0x7fec840d2d10 msgr2=0x7fec840d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:24.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- 172.21.15.112:0/2902258303 shutdown_connections 2023-11-08T12:32:24.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.347+0000 7fec88d37700 1 -- 172.21.15.112:0/2902258303 wait complete. 2023-11-08T12:32:24.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.351+0000 7fec88d37700 1 Processor -- start 2023-11-08T12:32:24.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.351+0000 7fec88d37700 1 -- start start 2023-11-08T12:32:24.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.351+0000 7fec88d37700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec84070a00 0x7fec84148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec840b2130 0x7fec841f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec8415c700 0x7fec840b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8415fa10 con 0x7fec840b2130 2023-11-08T12:32:24.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840c68e0 con 0x7fec8415c700 2023-11-08T12:32:24.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec840c6bc0 con 0x7fec84070a00 2023-11-08T12:32:24.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec840b2130 0x7fec841f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec840b2130 0x7fec841f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51798/0 (socket says 172.21.15.112:51798) 2023-11-08T12:32:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 -- 172.21.15.112:0/2381782890 learned_addr learned my addr 172.21.15.112:0/2381782890 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec8259c700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec84070a00 0x7fec84148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 -- 172.21.15.112:0/2381782890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec84070a00 msgr2=0x7fec84148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec84070a00 0x7fec84148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 -- 172.21.15.112:0/2381782890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec8415c700 msgr2=0x7fec840b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec8415c700 0x7fec840b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 -- 172.21.15.112:0/2381782890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0094b0 con 0x7fec840b2130 2023-11-08T12:32:24.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7bfff700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec840b2130 0x7fec841f1400 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0090b0 tx=0x7fec6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:24.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7affd700 1 -- 172.21.15.112:0/2381782890 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c004530 con 0x7fec840b2130 2023-11-08T12:32:24.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7affd700 1 -- 172.21.15.112:0/2381782890 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c01f070 con 0x7fec840b2130 2023-11-08T12:32:24.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8406b530 con 0x7fec840b2130 2023-11-08T12:32:24.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec7affd700 1 -- 172.21.15.112:0/2381782890 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0038e0 con 0x7fec840b2130 2023-11-08T12:32:24.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec84160a30 con 0x7fec840b2130 2023-11-08T12:32:24.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.355+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec840b1be0 con 0x7fec840b2130 2023-11-08T12:32:24.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.359+0000 7fec7affd700 1 -- 172.21.15.112:0/2381782890 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fec6c02a020 con 0x7fec840b2130 2023-11-08T12:32:24.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.359+0000 7fec7affd700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec64064ee0 0x7fec64067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.359+0000 7fec7affd700 1 -- 172.21.15.112:0/2381782890 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fec6c0836e0 con 0x7fec840b2130 2023-11-08T12:32:24.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.359+0000 7fec8259c700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec64064ee0 0x7fec64067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.359+0000 7fec8259c700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec64064ee0 0x7fec64067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fec740011e0 tx=0x7fec74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:24.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.367+0000 7fec7affd700 1 -- 172.21.15.112:0/2381782890 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fec6c051610 con 0x7fec840b2130 2023-11-08T12:32:24.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.535+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec840726c0 con 0x7fec840b2130 2023-11-08T12:32:24.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.535+0000 7fec7affd700 1 -- 172.21.15.112:0/2381782890 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec6c054c30 con 0x7fec840b2130 2023-11-08T12:32:24.541 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:32:24.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec64064ee0 msgr2=0x7fec64067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec64064ee0 0x7fec64067390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fec740011e0 tx=0x7fec74009040 comp rx=0 tx=0).stop 2023-11-08T12:32:24.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec840b2130 msgr2=0x7fec841f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec840b2130 0x7fec841f1400 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0090b0 tx=0x7fec6c004770 comp rx=0 tx=0).stop 2023-11-08T12:32:24.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 shutdown_connections 2023-11-08T12:32:24.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fec64064ee0 0x7fec64067390 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec8415c700 0x7fec840b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec840b2130 0x7fec841f1400 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 --2- 172.21.15.112:0/2381782890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec84070a00 0x7fec84148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 >> 172.21.15.112:0/2381782890 conn(0x7fec840d2d10 msgr2=0x7fec840d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:24.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 shutdown_connections 2023-11-08T12:32:24.548 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.539+0000 7fec88d37700 1 -- 172.21.15.112:0/2381782890 wait complete. 2023-11-08T12:32:24.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-08T12:32:24.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.742+0000 7f94b5e0d700 1 Processor -- start 2023-11-08T12:32:24.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.742+0000 7f94b5e0d700 1 -- start start 2023-11-08T12:32:24.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b5e0d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b5e0d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94b0070790 0x7f94b0164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b5e0d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b00ad6c0 con 0x7f94b00cc860 2023-11-08T12:32:24.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b5e0d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b006b1c0 con 0x7f94b0070790 2023-11-08T12:32:24.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b5e0d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00adc60 con 0x7f94b0160710 2023-11-08T12:32:24.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b560c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f94b0070790 0x7f94b0164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94affff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f94b00cc860 0x7f94b0070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:56844/0 (socket says 172.21.15.112:56844) 2023-11-08T12:32:24.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94affff700 1 -- 172.21.15.112:0/2424361387 learned_addr learned my addr 172.21.15.112:0/2424361387 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:24.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b4e0b700 1 --2- 172.21.15.112:0/2424361387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b560c700 1 -- 172.21.15.112:0/2424361387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 msgr2=0x7f94b00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:24.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b560c700 1 --2- 172.21.15.112:0/2424361387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b00cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b560c700 1 -- 172.21.15.112:0/2424361387 >> v1:172.21.15.133:6789/0 conn(0x7f94b00cc860 legacy=0x7f94b0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b560c700 1 -- 172.21.15.112:0/2424361387 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b006b3d0 con 0x7f94b0070790 2023-11-08T12:32:24.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94af7fe700 1 -- 172.21.15.112:0/2424361387 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637251681 0 0) 0x7f94b00ad6c0 con 0x7f94b00cc860 2023-11-08T12:32:24.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b560c700 1 --2- 172.21.15.112:0/2424361387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b0070790 0x7f94b0164250 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009d90 tx=0x7f94a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee5744fd8d8f078 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:24.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94af7fe700 1 -- 172.21.15.112:0/2424361387 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a800e070 con 0x7f94b0070790 2023-11-08T12:32:24.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94af7fe700 1 -- 172.21.15.112:0/2424361387 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a800bb20 con 0x7f94b0070790 2023-11-08T12:32:24.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94af7fe700 1 -- 172.21.15.112:0/2424361387 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8012430 con 0x7f94b0070790 2023-11-08T12:32:24.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2424361387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b0070790 msgr2=0x7f94b0164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.746+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2424361387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b0070790 0x7f94b0164250 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009d90 tx=0x7f94a800b330 comp rx=0 tx=0).stop 2023-11-08T12:32:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2424361387 shutdown_connections 2023-11-08T12:32:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2424361387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b0070790 0x7f94b0164250 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2424361387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b00cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2424361387 >> 172.21.15.112:0/2424361387 conn(0x7f94b00b0f80 msgr2=0x7f94b00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:24.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2424361387 shutdown_connections 2023-11-08T12:32:24.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2424361387 wait complete. 2023-11-08T12:32:24.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 Processor -- start 2023-11-08T12:32:24.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.750+0000 7f94b5e0d700 1 -- start start 2023-11-08T12:32:24.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b0070790 0x7f94b015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00cc860 0x7f94b00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b01f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01f9db0 con 0x7f94b00cc860 2023-11-08T12:32:24.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00b2030 con 0x7f94b0070790 2023-11-08T12:32:24.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01f9430 con 0x7f94b0160710 2023-11-08T12:32:24.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00cc860 0x7f94b00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00cc860 0x7f94b00b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51822/0 (socket says 172.21.15.112:51822) 2023-11-08T12:32:24.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 -- 172.21.15.112:0/2926715560 learned_addr learned my addr 172.21.15.112:0/2926715560 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:24.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b560c700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b01f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b4e0b700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b0070790 0x7f94b015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 -- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 msgr2=0x7f94b01f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b01f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 -- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b0070790 msgr2=0x7f94b015d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b0070790 0x7f94b015d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 -- 172.21.15.112:0/2926715560 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009a70 con 0x7f94b00cc860 2023-11-08T12:32:24.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94affff700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00cc860 0x7f94b00b1640 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f949800c5b0 tx=0x7f949800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:24.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94ad7fa700 1 -- 172.21.15.112:0/2926715560 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498004ca0 con 0x7f94b00cc860 2023-11-08T12:32:24.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94ad7fa700 1 -- 172.21.15.112:0/2926715560 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9498004e20 con 0x7f94b00cc860 2023-11-08T12:32:24.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94ad7fa700 1 -- 172.21.15.112:0/2926715560 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498007310 con 0x7f94b00cc860 2023-11-08T12:32:24.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b00ad8f0 con 0x7f94b00cc860 2023-11-08T12:32:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.754+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b006b6b0 con 0x7f94b00cc860 2023-11-08T12:32:24.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.758+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b0160ae0 con 0x7f94b00cc860 2023-11-08T12:32:24.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.758+0000 7f94ad7fa700 1 -- 172.21.15.112:0/2926715560 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f949801a020 con 0x7f94b00cc860 2023-11-08T12:32:24.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.758+0000 7f94ad7fa700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9490064ee0 0x7f9490067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:24.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.758+0000 7f94ad7fa700 1 -- 172.21.15.112:0/2926715560 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9498081c00 con 0x7f94b00cc860 2023-11-08T12:32:24.766 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.758+0000 7f94b4e0b700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9490064ee0 0x7f9490067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:24.767 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.762+0000 7f94b4e0b700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9490064ee0 0x7f9490067390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009ae0 tx=0x7f94a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:24.771 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.766+0000 7f94ad7fa700 1 -- 172.21.15.112:0/2926715560 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f9498087020 con 0x7f94b00cc860 2023-11-08T12:32:24.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.950+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94b0073cb0 con 0x7f94b00cc860 2023-11-08T12:32:24.957 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.954+0000 7f94ad7fa700 1 -- 172.21.15.112:0/2926715560 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f949804fc20 con 0x7f94b00cc860 2023-11-08T12:32:24.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.954+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9490064ee0 msgr2=0x7f9490067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.954+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9490064ee0 0x7f9490067390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009ae0 tx=0x7f94a0008040 comp rx=0 tx=0).stop 2023-11-08T12:32:24.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.954+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00cc860 msgr2=0x7f94b00b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:24.961 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.954+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00cc860 0x7f94b00b1640 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f949800c5b0 tx=0x7f949800c970 comp rx=0 tx=0).stop 2023-11-08T12:32:24.962 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 shutdown_connections 2023-11-08T12:32:24.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f9490064ee0 0x7f9490067390 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94b0160710 0x7f94b01f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00cc860 0x7f94b00b1640 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 --2- 172.21.15.112:0/2926715560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94b0070790 0x7f94b015d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:24.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 >> 172.21.15.112:0/2926715560 conn(0x7f94b00b0f80 msgr2=0x7f94b0060740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:24.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 shutdown_connections 2023-11-08T12:32:24.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:24.958+0000 7f94b5e0d700 1 -- 172.21.15.112:0/2926715560 wait complete. 2023-11-08T12:32:24.964 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2023-11-08T12:32:24.984 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-08T12:32:24.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:24.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-08T12:32:25.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:32:25.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:25.051 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-08T12:32:25.074 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:32:25.074 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:25.088 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:32:25.088 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:32:25.089 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:25.134 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:32:25.134 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:32:25.135 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:25.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:32:25.152 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:32:25.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.346+0000 7f5a154ab700 1 Processor -- start 2023-11-08T12:32:25.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a154ab700 1 -- start start 2023-11-08T12:32:25.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a154ab700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a1015c650 0x7f5a1006b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a154ab700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5a100cd0d0 0x7f5a100b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a154ab700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a100c9d40 con 0x7f5a100b1b80 2023-11-08T12:32:25.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a154ab700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1006b140 con 0x7f5a1015c650 2023-11-08T12:32:25.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a154ab700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1006b820 con 0x7f5a100cd0d0 2023-11-08T12:32:25.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a0ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a1015c650 0x7f5a1006b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a14caa700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5a100b1b80 0x7f5a1006bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38942/0 (socket says 172.21.15.112:38942) 2023-11-08T12:32:25.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a14caa700 1 -- 172.21.15.112:0/3793577894 learned_addr learned my addr 172.21.15.112:0/3793577894 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:25.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a0ffff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a1015c650 0x7f5a1006b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37710/0 (socket says 172.21.15.112:37710) 2023-11-08T12:32:25.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a077fe700 1 --2- 172.21.15.112:0/3793577894 >> v2:172.21.15.133:3300/0 conn(0x7f5a100cd0d0 0x7f5a100b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a0ffff700 1 -- 172.21.15.112:0/3793577894 >> v2:172.21.15.133:3300/0 conn(0x7f5a100cd0d0 msgr2=0x7f5a100b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a0ffff700 1 --2- 172.21.15.112:0/3793577894 >> v2:172.21.15.133:3300/0 conn(0x7f5a100cd0d0 0x7f5a100b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a0ffff700 1 -- 172.21.15.112:0/3793577894 >> v1:172.21.15.112:6789/0 conn(0x7f5a100b1b80 legacy=0x7f5a1006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a0ffff700 1 -- 172.21.15.112:0/3793577894 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100cd5d0 con 0x7f5a1015c650 2023-11-08T12:32:25.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.350+0000 7f5a0f7fe700 1 -- 172.21.15.112:0/3793577894 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205895138 0 0) 0x7f5a100c9d40 con 0x7f5a100b1b80 2023-11-08T12:32:25.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a0ffff700 1 --2- 172.21.15.112:0/3793577894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a1015c650 0x7f5a1006b2e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5a100cf4d0 tx=0x7f5a00009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aff8ae011f12f48 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a0f7fe700 1 -- 172.21.15.112:0/3793577894 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00011830 con 0x7f5a1015c650 2023-11-08T12:32:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a0f7fe700 1 -- 172.21.15.112:0/3793577894 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a00011990 con 0x7f5a1015c650 2023-11-08T12:32:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a0f7fe700 1 -- 172.21.15.112:0/3793577894 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00011d40 con 0x7f5a1015c650 2023-11-08T12:32:25.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 -- 172.21.15.112:0/3793577894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a1015c650 msgr2=0x7f5a1006b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 --2- 172.21.15.112:0/3793577894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a1015c650 0x7f5a1006b2e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5a100cf4d0 tx=0x7f5a00009b30 comp rx=0 tx=0).stop 2023-11-08T12:32:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 -- 172.21.15.112:0/3793577894 shutdown_connections 2023-11-08T12:32:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 --2- 172.21.15.112:0/3793577894 >> v2:172.21.15.133:3300/0 conn(0x7f5a100cd0d0 0x7f5a100b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 --2- 172.21.15.112:0/3793577894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a1015c650 0x7f5a1006b2e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 -- 172.21.15.112:0/3793577894 >> 172.21.15.112:0/3793577894 conn(0x7f5a100b0f80 msgr2=0x7f5a100ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:25.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 -- 172.21.15.112:0/3793577894 shutdown_connections 2023-11-08T12:32:25.363 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.354+0000 7f5a154ab700 1 -- 172.21.15.112:0/3793577894 wait complete. 2023-11-08T12:32:25.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 Processor -- start 2023-11-08T12:32:25.364 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 -- start start 2023-11-08T12:32:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a100b1b80 0x7f5a101f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a100cd0d0 0x7f5a100c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a1015c650 0x7f5a101f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a101f8df0 con 0x7f5a100b1b80 2023-11-08T12:32:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a101f9d40 con 0x7f5a100cd0d0 2023-11-08T12:32:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a154ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a101f6330 con 0x7f5a1015c650 2023-11-08T12:32:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a100b1b80 0x7f5a101f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a100b1b80 0x7f5a101f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37714/0 (socket says 172.21.15.112:37714) 2023-11-08T12:32:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 -- 172.21.15.112:0/1290658388 learned_addr learned my addr 172.21.15.112:0/1290658388 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a077fe700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a100cd0d0 0x7f5a100c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a14caa700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a1015c650 0x7f5a101f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 -- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a1015c650 msgr2=0x7f5a101f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a1015c650 0x7f5a101f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 -- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a100cd0d0 msgr2=0x7f5a100c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a100cd0d0 0x7f5a100c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 -- 172.21.15.112:0/1290658388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000094b0 con 0x7f5a100b1b80 2023-11-08T12:32:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a14caa700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a1015c650 0x7f5a101f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0ffff700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a100b1b80 0x7f5a101f9800 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5a00000c00 tx=0x7f5a00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.358+0000 7f5a0d7fa700 1 -- 172.21.15.112:0/1290658388 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0001aac0 con 0x7f5a100b1b80 2023-11-08T12:32:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.362+0000 7f5a0d7fa700 1 -- 172.21.15.112:0/1290658388 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0001f070 con 0x7f5a100b1b80 2023-11-08T12:32:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.362+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a100c99d0 con 0x7f5a100b1b80 2023-11-08T12:32:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.362+0000 7f5a0d7fa700 1 -- 172.21.15.112:0/1290658388 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0001ae80 con 0x7f5a100b1b80 2023-11-08T12:32:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.362+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a100cd8b0 con 0x7f5a100b1b80 2023-11-08T12:32:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.362+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a100c9680 con 0x7f5a100b1b80 2023-11-08T12:32:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.362+0000 7f5a0d7fa700 1 -- 172.21.15.112:0/1290658388 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5a0000f050 con 0x7f5a100b1b80 2023-11-08T12:32:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.366+0000 7f5a0d7fa700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59f0064ee0 0x7f59f0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.366+0000 7f5a0d7fa700 1 -- 172.21.15.112:0/1290658388 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5a00083340 con 0x7f5a100b1b80 2023-11-08T12:32:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.366+0000 7f5a077fe700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59f0064ee0 0x7f59f0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.372 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.366+0000 7f5a077fe700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59f0064ee0 0x7f59f0067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5a100c88b0 tx=0x7f59f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.370+0000 7f5a0d7fa700 1 -- 172.21.15.112:0/1290658388 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5a00051270 con 0x7f5a100b1b80 2023-11-08T12:32:25.585 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.578+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a10073cb0 con 0x7f5a100b1b80 2023-11-08T12:32:25.586 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.582+0000 7f5a0d7fa700 1 -- 172.21.15.112:0/1290658388 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f5a00021090 con 0x7f5a100b1b80 2023-11-08T12:32:25.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:25.587 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:55.282749+0000","modified":"2023-11-08T12:31:15.859255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":8,"addr":"172.21.15.112:6837/2843990803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2843990803},{"type":"v1","addr":"172.21.15.112:6837","nonce":2843990803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T12:32:25.589 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.582+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59f0064ee0 msgr2=0x7f59f0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.582+0000 7f5a154ab700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59f0064ee0 0x7f59f0067390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5a100c88b0 tx=0x7f59f8008040 comp rx=0 tx=0).stop 2023-11-08T12:32:25.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.582+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a100b1b80 msgr2=0x7f5a101f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.590 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.582+0000 7f5a154ab700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a100b1b80 0x7f5a101f9800 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5a00000c00 tx=0x7f5a00004770 comp rx=0 tx=0).stop 2023-11-08T12:32:25.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 shutdown_connections 2023-11-08T12:32:25.591 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f59f0064ee0 0x7f59f0067390 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5a1015c650 0x7f5a101f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a100cd0d0 0x7f5a100c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 --2- 172.21.15.112:0/1290658388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a100b1b80 0x7f5a101f9800 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.592 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 >> 172.21.15.112:0/1290658388 conn(0x7f5a100b0f80 msgr2=0x7f5a100b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:25.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 shutdown_connections 2023-11-08T12:32:25.593 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.586+0000 7f5a154ab700 1 -- 172.21.15.112:0/1290658388 wait complete. 2023-11-08T12:32:25.593 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 33 2023-11-08T12:32:25.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:32:25.792 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.786+0000 7fc0c0592700 1 Processor -- start 2023-11-08T12:32:25.793 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.786+0000 7fc0c0592700 1 -- start start 2023-11-08T12:32:25.794 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0c0592700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0b80c8d10 0x7fc0b80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0c0592700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b815a850 con 0x7fc0b8069d60 2023-11-08T12:32:25.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0c0592700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b80cada0 con 0x7fc0b815a480 2023-11-08T12:32:25.795 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0c0592700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b80ce060 con 0x7fc0b80c8d10 2023-11-08T12:32:25.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0beb2f700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc0b8069d60 0x7fc0b806a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38944/0 (socket says 172.21.15.112:38944) 2023-11-08T12:32:25.796 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0beb2f700 1 -- 172.21.15.112:0/2540054846 learned_addr learned my addr 172.21.15.112:0/2540054846 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:25.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0bdb2d700 1 --2- 172.21.15.112:0/2540054846 >> v2:172.21.15.133:3300/0 conn(0x7fc0b80c8d10 0x7fc0b80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0bd32c700 1 -- 172.21.15.112:0/2540054846 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649021002 0 0) 0x7fc0b815a850 con 0x7fc0b8069d60 2023-11-08T12:32:25.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0bd32c700 1 -- 172.21.15.112:0/2540054846 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a40035d0 con 0x7fc0b8069d60 2023-11-08T12:32:25.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0bdb2d700 1 -- 172.21.15.112:0/2540054846 >> v1:172.21.15.133:6789/0 conn(0x7fc0b815a480 legacy=0x7fc0b80cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.797 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0bdb2d700 1 -- 172.21.15.112:0/2540054846 >> v1:172.21.15.112:6789/0 conn(0x7fc0b8069d60 legacy=0x7fc0b806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.798 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0bdb2d700 1 -- 172.21.15.112:0/2540054846 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80ce300 con 0x7fc0b80c8d10 2023-11-08T12:32:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.790+0000 7fc0bdb2d700 1 --2- 172.21.15.112:0/2540054846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b80c8d10 0x7fc0b80cc9a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009850 tx=0x7fc0a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a930e9c0efc40f87 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0bd32c700 1 -- 172.21.15.112:0/2540054846 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8011830 con 0x7fc0b80c8d10 2023-11-08T12:32:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0bd32c700 1 -- 172.21.15.112:0/2540054846 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8011990 con 0x7fc0b80c8d10 2023-11-08T12:32:25.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0bd32c700 1 -- 172.21.15.112:0/2540054846 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8011d40 con 0x7fc0b80c8d10 2023-11-08T12:32:25.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0c0592700 1 -- 172.21.15.112:0/2540054846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b80c8d10 msgr2=0x7fc0b80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0c0592700 1 --2- 172.21.15.112:0/2540054846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b80c8d10 0x7fc0b80cc9a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009850 tx=0x7fc0a8009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:25.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0c0592700 1 -- 172.21.15.112:0/2540054846 shutdown_connections 2023-11-08T12:32:25.800 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0c0592700 1 --2- 172.21.15.112:0/2540054846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b80c8d10 0x7fc0b80cc9a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0c0592700 1 -- 172.21.15.112:0/2540054846 >> 172.21.15.112:0/2540054846 conn(0x7fc0b80cf350 msgr2=0x7fc0b80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:25.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0c0592700 1 -- 172.21.15.112:0/2540054846 shutdown_connections 2023-11-08T12:32:25.801 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.794+0000 7fc0c0592700 1 -- 172.21.15.112:0/2540054846 wait complete. 2023-11-08T12:32:25.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 Processor -- start 2023-11-08T12:32:25.802 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 -- start start 2023-11-08T12:32:25.803 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8069d60 0x7fc0b815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80c8d10 0x7fc0b81f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0b815a480 0x7fc0b80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f59f0 con 0x7fc0b80c8d10 2023-11-08T12:32:25.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f5650 con 0x7fc0b8069d60 2023-11-08T12:32:25.804 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f25c0 con 0x7fc0b815a480 2023-11-08T12:32:25.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80c8d10 0x7fc0b81f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80c8d10 0x7fc0b81f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37730/0 (socket says 172.21.15.112:37730) 2023-11-08T12:32:25.805 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 -- 172.21.15.112:0/33604371 learned_addr learned my addr 172.21.15.112:0/33604371 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:25.806 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0be32e700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8069d60 0x7fc0b815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0beb2f700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0b815a480 0x7fc0b80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 -- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0b815a480 msgr2=0x7fc0b80af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0b815a480 0x7fc0b80af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 -- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8069d60 msgr2=0x7fc0b815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.807 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8069d60 0x7fc0b815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 -- 172.21.15.112:0/33604371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80094b0 con 0x7fc0b80c8d10 2023-11-08T12:32:25.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0bdb2d700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80c8d10 0x7fc0b81f2080 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8014040 tx=0x7fc0a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:25.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0aeffd700 1 -- 172.21.15.112:0/33604371 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8019ab0 con 0x7fc0b80c8d10 2023-11-08T12:32:25.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0aeffd700 1 -- 172.21.15.112:0/33604371 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a801e070 con 0x7fc0b80c8d10 2023-11-08T12:32:25.808 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0aeffd700 1 -- 172.21.15.112:0/33604371 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8019e50 con 0x7fc0b80c8d10 2023-11-08T12:32:25.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.798+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b80add50 con 0x7fc0b80c8d10 2023-11-08T12:32:25.809 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.802+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b80caa30 con 0x7fc0b80c8d10 2023-11-08T12:32:25.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.802+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b80ca6e0 con 0x7fc0b80c8d10 2023-11-08T12:32:25.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.802+0000 7fc0aeffd700 1 -- 172.21.15.112:0/33604371 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc0a800f050 con 0x7fc0b80c8d10 2023-11-08T12:32:25.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.806+0000 7fc0aeffd700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc09c064ee0 0x7fc09c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:25.810 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.806+0000 7fc0aeffd700 1 -- 172.21.15.112:0/33604371 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc0a80830e0 con 0x7fc0b80c8d10 2023-11-08T12:32:25.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.806+0000 7fc0be32e700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc09c064ee0 0x7fc09c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:25.811 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.806+0000 7fc0be32e700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc09c064ee0 0x7fc09c067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc0b81f6730 tx=0x7fc0b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:25.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.810+0000 7fc0aeffd700 1 -- 172.21.15.112:0/33604371 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc0a8051080 con 0x7fc0b80c8d10 2023-11-08T12:32:25.990 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.986+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0b81f5b30 con 0x7fc0b80c8d10 2023-11-08T12:32:25.992 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.986+0000 7fc0aeffd700 1 -- 172.21.15.112:0/33604371 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18232 (secure 0 0 0) 0x7fc0b81f5b30 con 0x7fc0b80c8d10 2023-11-08T12:32:25.993 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:25.993 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:31:36.967622+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:53.129272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:54.279849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.17","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:32:25.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc09c064ee0 msgr2=0x7fc09c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc09c064ee0 0x7fc09c067390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc0b81f6730 tx=0x7fc0b4009040 comp rx=0 tx=0).stop 2023-11-08T12:32:25.997 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80c8d10 msgr2=0x7fc0b81f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80c8d10 0x7fc0b81f2080 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8014040 tx=0x7fc0a8004770 comp rx=0 tx=0).stop 2023-11-08T12:32:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 shutdown_connections 2023-11-08T12:32:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc09c064ee0 0x7fc09c067390 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc0b815a480 0x7fc0b80af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0b80c8d10 0x7fc0b81f2080 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 --2- 172.21.15.112:0/33604371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0b8069d60 0x7fc0b815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:25.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 >> 172.21.15.112:0/33604371 conn(0x7fc0b80cf350 msgr2=0x7fc0b80ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:25.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 shutdown_connections 2023-11-08T12:32:26.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:25.990+0000 7fc0c0592700 1 -- 172.21.15.112:0/33604371 wait complete. 2023-11-08T12:32:26.023 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-08T12:27:40.786766+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-08T12:27:47.449416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-08T12:30:53.129272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-08T12:30:54.279849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-08T12:32:26.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-08T12:32:26.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd166d700 1 Processor -- start 2023-11-08T12:32:26.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd166d700 1 -- start start 2023-11-08T12:32:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd166d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc0cdc50 0x7f4ccc069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd166d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ccc06ff10 0x7f4ccc070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd166d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ccc15e560 con 0x7f4ccc15e190 2023-11-08T12:32:26.217 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd166d700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ccc0708d0 con 0x7f4ccc06ff10 2023-11-08T12:32:26.218 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd166d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc06be80 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd0e6c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ccc06ff10 0x7f4ccc070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd0e6c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4ccc06ff10 0x7f4ccc070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37738/0 (socket says 172.21.15.112:37738) 2023-11-08T12:32:26.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.210+0000 7f4cd0e6c700 1 -- 172.21.15.112:0/4235305251 learned_addr learned my addr 172.21.15.112:0/4235305251 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:26.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cc3fff700 1 --2- 172.21.15.112:0/4235305251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc0cdc50 0x7f4ccc069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.219 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd0e6c700 1 -- 172.21.15.112:0/4235305251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc0cdc50 msgr2=0x7f4ccc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:26.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd0e6c700 1 --2- 172.21.15.112:0/4235305251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc0cdc50 0x7f4ccc069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd0e6c700 1 -- 172.21.15.112:0/4235305251 >> v1:172.21.15.133:6789/0 conn(0x7f4ccc15e190 legacy=0x7f4ccc161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd0e6c700 1 -- 172.21.15.112:0/4235305251 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc0ce0a0 con 0x7f4ccc06ff10 2023-11-08T12:32:26.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4ccb7fe700 1 -- 172.21.15.112:0/4235305251 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509047274 0 0) 0x7f4cbc001110 con 0x7f4ccc15e190 2023-11-08T12:32:26.220 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd0e6c700 1 --2- 172.21.15.112:0/4235305251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc06ff10 0x7f4ccc070390 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009e50 tx=0x7f4cc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba93dff99a85737 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:26.221 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4ccb7fe700 1 -- 172.21.15.112:0/4235305251 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc400e070 con 0x7f4ccc06ff10 2023-11-08T12:32:26.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4ccb7fe700 1 -- 172.21.15.112:0/4235305251 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc400b910 con 0x7f4ccc06ff10 2023-11-08T12:32:26.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4ccb7fe700 1 -- 172.21.15.112:0/4235305251 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc400bcc0 con 0x7f4ccc06ff10 2023-11-08T12:32:26.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 -- 172.21.15.112:0/4235305251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc06ff10 msgr2=0x7f4ccc070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 --2- 172.21.15.112:0/4235305251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc06ff10 0x7f4ccc070390 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009e50 tx=0x7f4cc400b330 comp rx=0 tx=0).stop 2023-11-08T12:32:26.222 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 -- 172.21.15.112:0/4235305251 shutdown_connections 2023-11-08T12:32:26.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 --2- 172.21.15.112:0/4235305251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc06ff10 0x7f4ccc070390 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 --2- 172.21.15.112:0/4235305251 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc0cdc50 0x7f4ccc069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 -- 172.21.15.112:0/4235305251 >> 172.21.15.112:0/4235305251 conn(0x7f4ccc0cf280 msgr2=0x7f4ccc0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:26.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 -- 172.21.15.112:0/4235305251 shutdown_connections 2023-11-08T12:32:26.223 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.214+0000 7f4cd166d700 1 -- 172.21.15.112:0/4235305251 wait complete. 2023-11-08T12:32:26.227 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 Processor -- start 2023-11-08T12:32:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 -- start start 2023-11-08T12:32:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc06ff10 0x7f4ccc1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc0cdc50 0x7f4ccc14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc15e190 0x7f4ccc15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc162610 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc149e00 con 0x7f4ccc06ff10 2023-11-08T12:32:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cd166d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc14a5b0 con 0x7f4ccc15e190 2023-11-08T12:32:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cc3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc0cdc50 0x7f4ccc14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cc3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc0cdc50 0x7f4ccc14a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37740/0 (socket says 172.21.15.112:37740) 2023-11-08T12:32:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.218+0000 7f4cc3fff700 1 -- 172.21.15.112:0/1474217289 learned_addr learned my addr 172.21.15.112:0/1474217289 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4ccbfff700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc06ff10 0x7f4ccc1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cd0e6c700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc15e190 0x7f4ccc15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc3fff700 1 -- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc15e190 msgr2=0x7f4ccc15aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc3fff700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc15e190 0x7f4ccc15aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc3fff700 1 -- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc06ff10 msgr2=0x7f4ccc1498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc3fff700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc06ff10 0x7f4ccc1498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc3fff700 1 -- 172.21.15.112:0/1474217289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4009b30 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cd0e6c700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc15e190 0x7f4ccc15aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc3fff700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc0cdc50 0x7f4ccc14a070 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400e9d0 tx=0x7f4cb400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc97fa700 1 -- 172.21.15.112:0/1474217289 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4009720 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc97fa700 1 -- 172.21.15.112:0/1474217289 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb400c850 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc0af990 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cc97fa700 1 -- 172.21.15.112:0/1474217289 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400cbc0 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc0ce330 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.222+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc0afc70 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.226+0000 7f4cc97fa700 1 -- 172.21.15.112:0/1474217289 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4cb4019030 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.226+0000 7f4cc97fa700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4cac064f60 0x7f4cac067410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.226+0000 7f4cc97fa700 1 -- 172.21.15.112:0/1474217289 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4cb4081f10 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.226+0000 7f4ccbfff700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4cac064f60 0x7f4cac067410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.234 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.226+0000 7f4ccbfff700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4cac064f60 0x7f4cac067410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000f60 tx=0x7f4cbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:26.237 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.234+0000 7f4cc97fa700 1 -- 172.21.15.112:0/1474217289 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4cb404ffd0 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.402+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ccc162750 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.409 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.402+0000 7f4cc97fa700 1 -- 172.21.15.112:0/1474217289 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ccc162750 con 0x7f4ccc0cdc50 2023-11-08T12:32:26.409 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2023-11-08T12:32:26.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4cac064f60 msgr2=0x7f4cac067410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4cac064f60 0x7f4cac067410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000f60 tx=0x7f4cbc009040 comp rx=0 tx=0).stop 2023-11-08T12:32:26.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc0cdc50 msgr2=0x7f4ccc14a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc0cdc50 0x7f4ccc14a070 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400e9d0 tx=0x7f4cb400ece0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 shutdown_connections 2023-11-08T12:32:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4cac064f60 0x7f4cac067410 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ccc15e190 0x7f4ccc15aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ccc0cdc50 0x7f4ccc14a070 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 --2- 172.21.15.112:0/1474217289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ccc06ff10 0x7f4ccc1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 >> 172.21.15.112:0/1474217289 conn(0x7f4ccc0cf280 msgr2=0x7f4ccc0c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 shutdown_connections 2023-11-08T12:32:26.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.406+0000 7f4cd166d700 1 -- 172.21.15.112:0/1474217289 wait complete. 2023-11-08T12:32:26.436 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-08T12:32:26.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.610+0000 7f84b759e700 1 Processor -- start 2023-11-08T12:32:26.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.610+0000 7f84b759e700 1 -- start start 2023-11-08T12:32:26.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b759e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f84b8070360 0x7f84b8160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b815c520 con 0x7f84b806ff10 2023-11-08T12:32:26.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b759e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b80b4240 con 0x7f84b8070360 2023-11-08T12:32:26.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b806ac00 con 0x7f84b815c150 2023-11-08T12:32:26.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b6d9d700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f84b8070360 0x7f84b8160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b659c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.621 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b5d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f84b806ff10 0x7f84b815fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40396/0 (socket says 172.21.15.112:40396) 2023-11-08T12:32:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b5d9b700 1 -- 172.21.15.112:0/1857245018 learned_addr learned my addr 172.21.15.112:0/1857245018 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b659c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:37208/0 (socket says 172.21.15.112:37208) 2023-11-08T12:32:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b6d9d700 1 -- 172.21.15.112:0/1857245018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 msgr2=0x7f84b80b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b6d9d700 1 --2- 172.21.15.112:0/1857245018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b6d9d700 1 -- 172.21.15.112:0/1857245018 >> v1:172.21.15.133:6789/0 conn(0x7f84b806ff10 legacy=0x7f84b815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b6d9d700 1 -- 172.21.15.112:0/1857245018 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b806cc50 con 0x7f84b8070360 2023-11-08T12:32:26.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b6d9d700 1 --2- 172.21.15.112:0/1857245018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b8160340 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009d90 tx=0x7f84b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a880d4cf22262ade server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:26.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b559a700 1 -- 172.21.15.112:0/1857245018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000e070 con 0x7f84b8070360 2023-11-08T12:32:26.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b559a700 1 -- 172.21.15.112:0/1857245018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000bb20 con 0x7f84b8070360 2023-11-08T12:32:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.614+0000 7f84b559a700 1 -- 172.21.15.112:0/1857245018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0012430 con 0x7f84b8070360 2023-11-08T12:32:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 -- 172.21.15.112:0/1857245018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 msgr2=0x7f84b8160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 --2- 172.21.15.112:0/1857245018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b8160340 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009d90 tx=0x7f84b000b330 comp rx=0 tx=0).stop 2023-11-08T12:32:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 -- 172.21.15.112:0/1857245018 shutdown_connections 2023-11-08T12:32:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 --2- 172.21.15.112:0/1857245018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b8160340 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 --2- 172.21.15.112:0/1857245018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 -- 172.21.15.112:0/1857245018 >> 172.21.15.112:0/1857245018 conn(0x7f84b80d3680 msgr2=0x7f84b80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 -- 172.21.15.112:0/1857245018 shutdown_connections 2023-11-08T12:32:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.618+0000 7f84b759e700 1 -- 172.21.15.112:0/1857245018 wait complete. 2023-11-08T12:32:26.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 Processor -- start 2023-11-08T12:32:26.628 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 -- start start 2023-11-08T12:32:26.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84b806ff10 0x7f84b814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b80cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80cadc0 con 0x7f84b8070360 2023-11-08T12:32:26.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80ce930 con 0x7f84b806ff10 2023-11-08T12:32:26.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.622+0000 7f84b759e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80cdd20 con 0x7f84b815c150 2023-11-08T12:32:26.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b80cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b80cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37754/0 (socket says 172.21.15.112:37754) 2023-11-08T12:32:26.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 -- 172.21.15.112:0/3386441896 learned_addr learned my addr 172.21.15.112:0/3386441896 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:26.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b6d9d700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b659c700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84b806ff10 0x7f84b814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 -- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 msgr2=0x7f84b80cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 -- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84b806ff10 msgr2=0x7f84b814fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84b806ff10 0x7f84b814fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 -- 172.21.15.112:0/3386441896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0009a70 con 0x7f84b8070360 2023-11-08T12:32:26.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b659c700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84b806ff10 0x7f84b814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:26.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b5d9b700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b80cf8b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c730 tx=0x7f84ac00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:26.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84a6ffd700 1 -- 172.21.15.112:0/3386441896 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005de0 con 0x7f84b8070360 2023-11-08T12:32:26.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84a6ffd700 1 -- 172.21.15.112:0/3386441896 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac0070d0 con 0x7f84b8070360 2023-11-08T12:32:26.635 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b80d2730 con 0x7f84b8070360 2023-11-08T12:32:26.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84a6ffd700 1 -- 172.21.15.112:0/3386441896 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac007480 con 0x7f84b8070360 2023-11-08T12:32:26.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b80d2450 con 0x7f84b8070360 2023-11-08T12:32:26.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.626+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b80d05e0 con 0x7f84b8070360 2023-11-08T12:32:26.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.630+0000 7f84a6ffd700 1 -- 172.21.15.112:0/3386441896 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f84ac019030 con 0x7f84b8070360 2023-11-08T12:32:26.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.630+0000 7f84a6ffd700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8498064f10 0x7f84980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:26.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.630+0000 7f84a6ffd700 1 -- 172.21.15.112:0/3386441896 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f84ac081520 con 0x7f84b8070360 2023-11-08T12:32:26.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.630+0000 7f84b659c700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8498064f10 0x7f84980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:26.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.634+0000 7f84b659c700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8498064f10 0x7f84980673c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009ba0 tx=0x7f84a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:26.643 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.638+0000 7f84a6ffd700 1 -- 172.21.15.112:0/3386441896 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f84ac04f3d0 con 0x7f84b8070360 2023-11-08T12:32:26.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.814+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f84b8151a20 con 0x7f84b8070360 2023-11-08T12:32:26.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.814+0000 7f84a6ffd700 1 -- 172.21.15.112:0/3386441896 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84ac0529f0 con 0x7f84b8070360 2023-11-08T12:32:26.819 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 8 2023-11-08T12:32:26.821 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.814+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8498064f10 msgr2=0x7f84980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.814+0000 7f84b759e700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8498064f10 0x7f84980673c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009ba0 tx=0x7f84a8008040 comp rx=0 tx=0).stop 2023-11-08T12:32:26.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 msgr2=0x7f84b80cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:26.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b80cf8b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c730 tx=0x7f84ac00ca40 comp rx=0 tx=0).stop 2023-11-08T12:32:26.822 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 shutdown_connections 2023-11-08T12:32:26.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8498064f10 0x7f84980673c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f84b815c150 0x7f84b80cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84b8070360 0x7f84b80cf8b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 --2- 172.21.15.112:0/3386441896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84b806ff10 0x7f84b814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:26.823 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 >> 172.21.15.112:0/3386441896 conn(0x7f84b80d3680 msgr2=0x7f84b80c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:26.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 shutdown_connections 2023-11-08T12:32:26.824 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:26.818+0000 7f84b759e700 1 -- 172.21.15.112:0/3386441896 wait complete. 2023-11-08T12:32:26.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-08T12:32:27.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.014+0000 7f91d2ab1700 1 Processor -- start 2023-11-08T12:32:27.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d2ab1700 1 -- start start 2023-11-08T12:32:27.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d2ab1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91cc15a3a0 0x7f91cc0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d2ab1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 0x7f91cc0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d2ab1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0cebd0 con 0x7f91cc0cd790 2023-11-08T12:32:27.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d2ab1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc0cdc10 con 0x7f91cc15a3a0 2023-11-08T12:32:27.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d2ab1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0ad630 con 0x7f91cc0cc9e0 2023-11-08T12:32:27.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d22b0700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f91cc0cd790 0x7f91cc0cae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38948/0 (socket says 172.21.15.112:38948) 2023-11-08T12:32:27.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.018+0000 7f91d22b0700 1 -- 172.21.15.112:0/1116888152 learned_addr learned my addr 172.21.15.112:0/1116888152 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:27.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d1aaf700 1 --2- 172.21.15.112:0/1116888152 >> v2:172.21.15.133:3300/0 conn(0x7f91cc15a3a0 0x7f91cc0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d12ae700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 0x7f91cc0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260456974 0 0) 0x7f91cc0cebd0 con 0x7f91cc0cd790 2023-11-08T12:32:27.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b80035d0 con 0x7f91cc0cd790 2023-11-08T12:32:27.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861211525 0 0) 0x7f91b80035d0 con 0x7f91cc0cd790 2023-11-08T12:32:27.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 msgr2=0x7f91cc0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:27.028 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 0x7f91cc0cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 >> v2:172.21.15.133:3300/0 conn(0x7f91cc15a3a0 msgr2=0x7f91cc0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:27.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 --2- 172.21.15.112:0/1116888152 >> v2:172.21.15.133:3300/0 conn(0x7f91cc15a3a0 0x7f91cc0ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0ad910 con 0x7f91cc0cd790 2023-11-08T12:32:27.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f91c40019f0 con 0x7f91cc0cd790 2023-11-08T12:32:27.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 >> v1:172.21.15.112:6789/0 conn(0x7f91cc0cd790 legacy=0x7f91cc0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 0x7f91b8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b8003fa0 0x7f91b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8004db0 0x7f91b8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0cdc10 con 0x7f91b8004db0 2023-11-08T12:32:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0ad630 con 0x7f91b8003fa0 2023-11-08T12:32:27.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b800ba30 con 0x7f91cc0cc9e0 2023-11-08T12:32:27.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d22b0700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8004db0 0x7f91b8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d1aaf700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 0x7f91b8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d12ae700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b8003fa0 0x7f91b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d22b0700 1 -- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 msgr2=0x7f91b8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:27.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d22b0700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91cc0cc9e0 0x7f91b8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d22b0700 1 -- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b8003fa0 msgr2=0x7f91b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:27.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d22b0700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b8003fa0 0x7f91b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d22b0700 1 -- 172.21.15.112:0/1116888152 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80035d0 con 0x7f91b8004db0 2023-11-08T12:32:27.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d22b0700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8004db0 0x7f91b8005220 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f91c400a860 tx=0x7f91b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f15b33a173797d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40072d0 con 0x7f91b8004db0 2023-11-08T12:32:27.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4007450 con 0x7f91b8004db0 2023-11-08T12:32:27.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.022+0000 7f91d0aad700 1 -- 172.21.15.112:0/1116888152 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4007800 con 0x7f91b8004db0 2023-11-08T12:32:27.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.026+0000 7f91d2ab1700 1 -- 172.21.15.112:0/1116888152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8004db0 msgr2=0x7f91b8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.026+0000 7f91d2ab1700 1 --2- 172.21.15.112:0/1116888152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91b8004db0 0x7f91b8005220 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f91c400a860 tx=0x7f91b80058a0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.026+0000 7f91d22b0700 1 -- 172.21.15.112:0/1116888152 reap_dead start 2023-11-08T12:32:27.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.026+0000 7f91d2ab1700 1 -- 172.21.15.112:0/1116888152 shutdown_connections 2023-11-08T12:32:27.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.026+0000 7f91d2ab1700 1 -- 172.21.15.112:0/1116888152 >> 172.21.15.112:0/1116888152 conn(0x7f91cc06a510 msgr2=0x7f91cc099ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:27.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.026+0000 7f91d2ab1700 1 -- 172.21.15.112:0/1116888152 shutdown_connections 2023-11-08T12:32:27.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.026+0000 7f91d2ab1700 1 -- 172.21.15.112:0/1116888152 wait complete. 2023-11-08T12:32:27.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 Processor -- start 2023-11-08T12:32:27.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 -- start start 2023-11-08T12:32:27.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b8004db0 0x7f91cc06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91cc156950 0x7f91cc0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91cc156dc0 0x7f91cc0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc06b030 con 0x7f91cc156dc0 2023-11-08T12:32:27.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc06b310 con 0x7f91cc156950 2023-11-08T12:32:27.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d2ab1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc06b5f0 con 0x7f91b8004db0 2023-11-08T12:32:27.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91cc156dc0 0x7f91cc0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91cc156dc0 0x7f91cc0afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37780/0 (socket says 172.21.15.112:37780) 2023-11-08T12:32:27.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 -- 172.21.15.112:0/841216651 learned_addr learned my addr 172.21.15.112:0/841216651 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:27.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d1aaf700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b8004db0 0x7f91cc06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d12ae700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91cc156950 0x7f91cc0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 -- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b8004db0 msgr2=0x7f91cc06c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b8004db0 0x7f91cc06c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 -- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91cc156950 msgr2=0x7f91cc0b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91cc156950 0x7f91cc0b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.030+0000 7f91d22b0700 1 -- 172.21.15.112:0/841216651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0ce8c0 con 0x7f91cc156dc0 2023-11-08T12:32:27.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91d22b0700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91cc156dc0 0x7f91cc0afa00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f91c4011000 tx=0x7f91c4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91c27fc700 1 -- 172.21.15.112:0/841216651 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4025030 con 0x7f91cc156dc0 2023-11-08T12:32:27.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91c27fc700 1 -- 172.21.15.112:0/841216651 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4012620 con 0x7f91cc156dc0 2023-11-08T12:32:27.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91c27fc700 1 -- 172.21.15.112:0/841216651 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40129d0 con 0x7f91cc156dc0 2023-11-08T12:32:27.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc0adbf0 con 0x7f91cc156dc0 2023-11-08T12:32:27.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc15a770 con 0x7f91cc156dc0 2023-11-08T12:32:27.043 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc073d20 con 0x7f91cc156dc0 2023-11-08T12:32:27.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.034+0000 7f91c27fc700 1 -- 172.21.15.112:0/841216651 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f91c4010070 con 0x7f91cc156dc0 2023-11-08T12:32:27.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.038+0000 7f91c27fc700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91b0064ee0 0x7f91b0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.038+0000 7f91c27fc700 1 -- 172.21.15.112:0/841216651 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f91c4026070 con 0x7f91cc156dc0 2023-11-08T12:32:27.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.038+0000 7f91d1aaf700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91b0064ee0 0x7f91b0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.044 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.038+0000 7f91d1aaf700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91b0064ee0 0x7f91b0067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009cf0 tx=0x7f91c8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.048 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.042+0000 7f91c27fc700 1 -- 172.21.15.112:0/841216651 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f91c4051c90 con 0x7f91cc156dc0 2023-11-08T12:32:27.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.218+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91cc08a990 con 0x7f91cc156dc0 2023-11-08T12:32:27.225 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.218+0000 7f91c27fc700 1 -- 172.21.15.112:0/841216651 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91c40552b0 con 0x7f91cc156dc0 2023-11-08T12:32:27.226 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2023-11-08T12:32:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91b0064ee0 msgr2=0x7f91b0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.230 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91b0064ee0 0x7f91b0067390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009cf0 tx=0x7f91c8009240 comp rx=0 tx=0).stop 2023-11-08T12:32:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91cc156dc0 msgr2=0x7f91cc0afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91cc156dc0 0x7f91cc0afa00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f91c4011000 tx=0x7f91c4001d80 comp rx=0 tx=0).stop 2023-11-08T12:32:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 shutdown_connections 2023-11-08T12:32:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f91b0064ee0 0x7f91b0067390 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.231 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91cc156dc0 0x7f91cc0afa00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91cc156950 0x7f91cc0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 --2- 172.21.15.112:0/841216651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91b8004db0 0x7f91cc06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 >> 172.21.15.112:0/841216651 conn(0x7f91cc06a510 msgr2=0x7f91cc0ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:27.232 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 shutdown_connections 2023-11-08T12:32:27.233 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.226+0000 7f91d2ab1700 1 -- 172.21.15.112:0/841216651 wait complete. 2023-11-08T12:32:27.258 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-08T12:32:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.430+0000 7fa0a6cd1700 1 Processor -- start 2023-11-08T12:32:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.430+0000 7fa0a6cd1700 1 -- start start 2023-11-08T12:32:27.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a6cd1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0a006c2b0 0x7fa0a0165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a6cd1700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0a006c680 0x7fa0a00adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a6cd1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a006afb0 con 0x7fa0a00aed60 2023-11-08T12:32:27.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a6cd1700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a00ca750 con 0x7fa0a006c680 2023-11-08T12:32:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a6cd1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a006b290 con 0x7fa0a006c2b0 2023-11-08T12:32:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a526e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa0a006c680 0x7fa0a00adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa09ffff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa0a00aed60 0x7fa0a01639d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38962/0 (socket says 172.21.15.112:38962) 2023-11-08T12:32:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa09ffff700 1 -- 172.21.15.112:0/3397202418 learned_addr learned my addr 172.21.15.112:0/3397202418 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a4a6d700 1 --2- 172.21.15.112:0/3397202418 >> v2:172.21.15.133:3300/0 conn(0x7fa0a006c2b0 0x7fa0a0165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa09f7fe700 1 -- 172.21.15.112:0/3397202418 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695841374 0 0) 0x7fa0a006afb0 con 0x7fa0a00aed60 2023-11-08T12:32:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa09f7fe700 1 -- 172.21.15.112:0/3397202418 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0880035d0 con 0x7fa0a00aed60 2023-11-08T12:32:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a526e700 1 -- 172.21.15.112:0/3397202418 >> v2:172.21.15.133:3300/0 conn(0x7fa0a006c2b0 msgr2=0x7fa0a0165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a526e700 1 --2- 172.21.15.112:0/3397202418 >> v2:172.21.15.133:3300/0 conn(0x7fa0a006c2b0 0x7fa0a0165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a526e700 1 -- 172.21.15.112:0/3397202418 >> v1:172.21.15.112:6789/0 conn(0x7fa0a00aed60 legacy=0x7fa0a01639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.434+0000 7fa0a526e700 1 -- 172.21.15.112:0/3397202418 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00c8f40 con 0x7fa0a006c680 2023-11-08T12:32:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a526e700 1 --2- 172.21.15.112:0/3397202418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00adfe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa0a006fde0 tx=0x7fa09800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaae4a7a0680b188 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa09f7fe700 1 -- 172.21.15.112:0/3397202418 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09800e070 con 0x7fa0a006c680 2023-11-08T12:32:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa09f7fe700 1 -- 172.21.15.112:0/3397202418 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09800bb20 con 0x7fa0a006c680 2023-11-08T12:32:27.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa09f7fe700 1 -- 172.21.15.112:0/3397202418 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098012430 con 0x7fa0a006c680 2023-11-08T12:32:27.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/3397202418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 msgr2=0x7fa0a00adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/3397202418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00adfe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa0a006fde0 tx=0x7fa09800b330 comp rx=0 tx=0).stop 2023-11-08T12:32:27.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/3397202418 shutdown_connections 2023-11-08T12:32:27.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/3397202418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00adfe0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/3397202418 >> v2:172.21.15.133:3300/0 conn(0x7fa0a006c2b0 0x7fa0a0165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/3397202418 >> 172.21.15.112:0/3397202418 conn(0x7fa0a00cf580 msgr2=0x7fa0a00cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:27.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/3397202418 shutdown_connections 2023-11-08T12:32:27.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.438+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/3397202418 wait complete. 2023-11-08T12:32:27.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 Processor -- start 2023-11-08T12:32:27.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 -- start start 2023-11-08T12:32:27.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a006c2b0 0x7fa0a00c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0a00aed60 0x7fa0a00b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00b1d30 con 0x7fa0a006c680 2023-11-08T12:32:27.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00b2010 con 0x7fa0a006c2b0 2023-11-08T12:32:27.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a6cd1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00b22f0 con 0x7fa0a00aed60 2023-11-08T12:32:27.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa09ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa09ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37808/0 (socket says 172.21.15.112:37808) 2023-11-08T12:32:27.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa09ffff700 1 -- 172.21.15.112:0/1271771308 learned_addr learned my addr 172.21.15.112:0/1271771308 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:27.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a4a6d700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a006c2b0 0x7fa0a00c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.442+0000 7fa0a526e700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0a00aed60 0x7fa0a00b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09ffff700 1 -- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0a00aed60 msgr2=0x7fa0a00b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09ffff700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0a00aed60 0x7fa0a00b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09ffff700 1 -- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a006c2b0 msgr2=0x7fa0a00c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09ffff700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a006c2b0 0x7fa0a00c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09ffff700 1 -- 172.21.15.112:0/1271771308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098009a70 con 0x7fa0a006c680 2023-11-08T12:32:27.453 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09ffff700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00c7e90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa090005930 tx=0x7fa09000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09d7fa700 1 -- 172.21.15.112:0/1271771308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090005d90 con 0x7fa0a006c680 2023-11-08T12:32:27.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09d7fa700 1 -- 172.21.15.112:0/1271771308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900070d0 con 0x7fa0a006c680 2023-11-08T12:32:27.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a00ad800 con 0x7fa0a006c680 2023-11-08T12:32:27.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa09d7fa700 1 -- 172.21.15.112:0/1271771308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090007480 con 0x7fa0a006c680 2023-11-08T12:32:27.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a00c9220 con 0x7fa0a006c680 2023-11-08T12:32:27.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.446+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a01640e0 con 0x7fa0a006c680 2023-11-08T12:32:27.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.450+0000 7fa09d7fa700 1 -- 172.21.15.112:0/1271771308 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa090019030 con 0x7fa0a006c680 2023-11-08T12:32:27.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.450+0000 7fa09d7fa700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa08c064ee0 0x7fa08c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.450+0000 7fa09d7fa700 1 -- 172.21.15.112:0/1271771308 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa090081440 con 0x7fa0a006c680 2023-11-08T12:32:27.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.450+0000 7fa0a4a6d700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa08c064ee0 0x7fa08c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.450+0000 7fa0a4a6d700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa08c064ee0 0x7fa08c067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa094009bf0 tx=0x7fa094009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.454+0000 7fa09d7fa700 1 -- 172.21.15.112:0/1271771308 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa09004f370 con 0x7fa0a006c680 2023-11-08T12:32:27.633 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.626+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0a00726c0 con 0x7fa0a006c680 2023-11-08T12:32:27.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa09d7fa700 1 -- 172.21.15.112:0/1271771308 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa090052990 con 0x7fa0a006c680 2023-11-08T12:32:27.634 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2023-11-08T12:32:27.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa08c064ee0 msgr2=0x7fa08c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.636 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa08c064ee0 0x7fa08c067390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa094009bf0 tx=0x7fa094009240 comp rx=0 tx=0).stop 2023-11-08T12:32:27.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 msgr2=0x7fa0a00c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.637 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00c7e90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa090005930 tx=0x7fa09000c7b0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 shutdown_connections 2023-11-08T12:32:27.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa08c064ee0 0x7fa08c067390 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0a00aed60 0x7fa0a00b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.638 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0a006c680 0x7fa0a00c7e90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 --2- 172.21.15.112:0/1271771308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a006c2b0 0x7fa0a00c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 >> 172.21.15.112:0/1271771308 conn(0x7fa0a00cf580 msgr2=0x7fa0a00cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:27.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 shutdown_connections 2023-11-08T12:32:27.639 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.630+0000 7fa0a6cd1700 1 -- 172.21.15.112:0/1271771308 wait complete. 2023-11-08T12:32:27.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:32:27.832 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.826+0000 7f33f7981700 1 Processor -- start 2023-11-08T12:32:27.833 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.826+0000 7f33f7981700 1 -- start start 2023-11-08T12:32:27.835 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f7981700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f015a480 0x7f33f00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f7981700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33f00c8d10 0x7f33f00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f7981700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f015a850 con 0x7f33f00ccd10 2023-11-08T12:32:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f7981700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00ce060 con 0x7f33f00c8d10 2023-11-08T12:32:27.836 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f7981700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00ce300 con 0x7f33f015a480 2023-11-08T12:32:27.837 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f571d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f015a480 0x7f33f00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f571d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f015a480 0x7f33f00cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:37264/0 (socket says 172.21.15.112:37264) 2023-11-08T12:32:27.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f571d700 1 -- 172.21.15.112:0/2426741037 learned_addr learned my addr 172.21.15.112:0/2426741037 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:27.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f4f1c700 1 --2- 172.21.15.112:0/2426741037 >> v2:172.21.15.133:3300/0 conn(0x7f33f00c8d10 0x7f33f00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f571d700 1 -- 172.21.15.112:0/2426741037 >> v2:172.21.15.133:3300/0 conn(0x7f33f00c8d10 msgr2=0x7f33f00cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:27.838 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.830+0000 7f33f571d700 1 --2- 172.21.15.112:0/2426741037 >> v2:172.21.15.133:3300/0 conn(0x7f33f00c8d10 0x7f33f00cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.834+0000 7f33f571d700 1 -- 172.21.15.112:0/2426741037 >> v1:172.21.15.133:6789/0 conn(0x7f33f00ccd10 legacy=0x7f33f015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.834+0000 7f33f571d700 1 -- 172.21.15.112:0/2426741037 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00cada0 con 0x7f33f015a480 2023-11-08T12:32:27.839 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.834+0000 7f33f4f1c700 1 --2- 172.21.15.112:0/2426741037 >> v2:172.21.15.133:3300/0 conn(0x7f33f00c8d10 0x7f33f00cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:27.840 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.834+0000 7f33f571d700 1 --2- 172.21.15.112:0/2426741037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f015a480 0x7f33f00cc290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009e50 tx=0x7f33ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6570dec8154e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33e7fff700 1 -- 172.21.15.112:0/2426741037 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00e070 con 0x7f33f015a480 2023-11-08T12:32:27.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33e7fff700 1 -- 172.21.15.112:0/2426741037 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00b910 con 0x7f33f015a480 2023-11-08T12:32:27.842 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33e7fff700 1 -- 172.21.15.112:0/2426741037 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00bcc0 con 0x7f33f015a480 2023-11-08T12:32:27.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 -- 172.21.15.112:0/2426741037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f015a480 msgr2=0x7f33f00cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 --2- 172.21.15.112:0/2426741037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f015a480 0x7f33f00cc290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009e50 tx=0x7f33ec00b330 comp rx=0 tx=0).stop 2023-11-08T12:32:27.843 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 -- 172.21.15.112:0/2426741037 shutdown_connections 2023-11-08T12:32:27.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 --2- 172.21.15.112:0/2426741037 >> v2:172.21.15.133:3300/0 conn(0x7f33f00c8d10 0x7f33f00cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 --2- 172.21.15.112:0/2426741037 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f015a480 0x7f33f00cc290 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 -- 172.21.15.112:0/2426741037 >> 172.21.15.112:0/2426741037 conn(0x7f33f00cf350 msgr2=0x7f33f00b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:27.844 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 -- 172.21.15.112:0/2426741037 shutdown_connections 2023-11-08T12:32:27.845 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.838+0000 7f33f7981700 1 -- 172.21.15.112:0/2426741037 wait complete. 2023-11-08T12:32:27.846 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 Processor -- start 2023-11-08T12:32:27.847 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 -- start start 2023-11-08T12:32:27.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f00c8d10 0x7f33f00c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.848 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f00ccd10 0x7f33f00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33f015a480 0x7f33f00b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f006bb00 con 0x7f33f015a480 2023-11-08T12:32:27.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00c7cf0 con 0x7f33f00ccd10 2023-11-08T12:32:27.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f7981700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00c7fd0 con 0x7f33f00c8d10 2023-11-08T12:32:27.849 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f5f1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33f015a480 0x7f33f00b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.850 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f5f1e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33f015a480 0x7f33f00b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37810/0 (socket says 172.21.15.112:37810) 2023-11-08T12:32:27.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f5f1e700 1 -- 172.21.15.112:0/1219383178 learned_addr learned my addr 172.21.15.112:0/1219383178 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:27.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f4f1c700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f00ccd10 0x7f33f00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.842+0000 7f33f571d700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f00c8d10 0x7f33f00c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f5f1e700 1 -- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f00c8d10 msgr2=0x7f33f00c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.851 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f5f1e700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f00c8d10 0x7f33f00c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f5f1e700 1 -- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f00ccd10 msgr2=0x7f33f00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:27.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f5f1e700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f00ccd10 0x7f33f00b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:27.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f5f1e700 1 -- 172.21.15.112:0/1219383178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00094b0 con 0x7f33f015a480 2023-11-08T12:32:27.852 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f5f1e700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33f015a480 0x7f33f00b2a80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e800c430 tx=0x7f33e800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33e5ffb700 1 -- 172.21.15.112:0/1219383178 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80052d0 con 0x7f33f015a480 2023-11-08T12:32:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33e5ffb700 1 -- 172.21.15.112:0/1219383178 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8005430 con 0x7f33f015a480 2023-11-08T12:32:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33e5ffb700 1 -- 172.21.15.112:0/1219383178 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80055a0 con 0x7f33f015a480 2023-11-08T12:32:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec009b30 con 0x7f33f015a480 2023-11-08T12:32:27.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f00add50 con 0x7f33f015a480 2023-11-08T12:32:27.854 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.846+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f00caa30 con 0x7f33f015a480 2023-11-08T12:32:27.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.850+0000 7f33e5ffb700 1 -- 172.21.15.112:0/1219383178 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f33e8019030 con 0x7f33f015a480 2023-11-08T12:32:27.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.850+0000 7f33e5ffb700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f33d4064f30 0x7f33d40673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:27.855 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.850+0000 7f33e5ffb700 1 -- 172.21.15.112:0/1219383178 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f33e80810f0 con 0x7f33f015a480 2023-11-08T12:32:27.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.850+0000 7f33f571d700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f33d4064f30 0x7f33d40673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:27.856 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.850+0000 7f33f571d700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f33d4064f30 0x7f33d40673e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000f80 tx=0x7f33ec009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:27.863 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:27.858+0000 7f33e5ffb700 1 -- 172.21.15.112:0/1219383178 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f33e804f1b0 con 0x7f33f015a480 2023-11-08T12:32:28.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.066+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33f00ca6e0 con 0x7f33f015a480 2023-11-08T12:32:28.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.066+0000 7f33e5ffb700 1 -- 172.21.15.112:0/1219383178 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f33e80527d0 con 0x7f33f015a480 2023-11-08T12:32:28.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:28.077 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:55.282749+0000","modified":"2023-11-08T12:31:15.859255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":8,"addr":"172.21.15.112:6837/2843990803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2843990803},{"type":"v1","addr":"172.21.15.112:6837","nonce":2843990803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T12:32:28.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f33d4064f30 msgr2=0x7f33d40673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f33d4064f30 0x7f33d40673e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000f80 tx=0x7f33ec009000 comp rx=0 tx=0).stop 2023-11-08T12:32:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33f015a480 msgr2=0x7f33f00b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33f015a480 0x7f33f00b2a80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f33e800c430 tx=0x7f33e800c740 comp rx=0 tx=0).stop 2023-11-08T12:32:28.079 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 shutdown_connections 2023-11-08T12:32:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f33d4064f30 0x7f33d40673e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33f015a480 0x7f33f00b2a80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f00ccd10 0x7f33f00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 --2- 172.21.15.112:0/1219383178 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f00c8d10 0x7f33f00c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 >> 172.21.15.112:0/1219383178 conn(0x7f33f00cf350 msgr2=0x7f33f00adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:28.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 shutdown_connections 2023-11-08T12:32:28.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.074+0000 7f33f7981700 1 -- 172.21.15.112:0/1219383178 wait complete. 2023-11-08T12:32:28.081 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 33 2023-11-08T12:32:28.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:32:28.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.266+0000 7ff081876700 1 Processor -- start 2023-11-08T12:32:28.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081876700 1 -- start start 2023-11-08T12:32:28.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081876700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff07c15c1a0 0x7ff07c06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081876700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff07c070790 0x7ff07c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081876700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c0adf90 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081876700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c069bf0 con 0x7ff07c15c1a0 2023-11-08T12:32:28.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081876700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c0ce370 con 0x7ff07c070790 2023-11-08T12:32:28.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff07c15c1a0 0x7ff07c06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff07c15c1a0 0x7ff07c06c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37824/0 (socket says 172.21.15.112:37824) 2023-11-08T12:32:28.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 -- 172.21.15.112:0/336159235 learned_addr learned my addr 172.21.15.112:0/336159235 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:28.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff073fff700 1 --1- 172.21.15.112:0/336159235 >> v1:172.21.15.112:6789/0 conn(0x7ff07c0cdeb0 0x7ff07c070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38968/0 (socket says 172.21.15.112:38968) 2023-11-08T12:32:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081075700 1 --2- 172.21.15.112:0/336159235 >> v2:172.21.15.133:3300/0 conn(0x7ff07c070790 0x7ff07c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 -- 172.21.15.112:0/336159235 >> v2:172.21.15.133:3300/0 conn(0x7ff07c070790 msgr2=0x7ff07c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 --2- 172.21.15.112:0/336159235 >> v2:172.21.15.133:3300/0 conn(0x7ff07c070790 0x7ff07c06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 -- 172.21.15.112:0/336159235 >> v1:172.21.15.112:6789/0 conn(0x7ff07c0cdeb0 legacy=0x7ff07c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 -- 172.21.15.112:0/336159235 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0cc4a0 con 0x7ff07c15c1a0 2023-11-08T12:32:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff081075700 1 --2- 172.21.15.112:0/336159235 >> v2:172.21.15.133:3300/0 conn(0x7ff07c070790 0x7ff07c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.270+0000 7ff080874700 1 --2- 172.21.15.112:0/336159235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c15c1a0 0x7ff07c06c8b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff07c06d4f0 tx=0x7ff078009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c011ba7a9b61ba server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:28.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff0737fe700 1 -- 172.21.15.112:0/336159235 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800b8a0 con 0x7ff07c15c1a0 2023-11-08T12:32:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff0737fe700 1 -- 172.21.15.112:0/336159235 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07800ba00 con 0x7ff07c15c1a0 2023-11-08T12:32:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff0737fe700 1 -- 172.21.15.112:0/336159235 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800bd90 con 0x7ff07c15c1a0 2023-11-08T12:32:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 -- 172.21.15.112:0/336159235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c15c1a0 msgr2=0x7ff07c06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 --2- 172.21.15.112:0/336159235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c15c1a0 0x7ff07c06c8b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff07c06d4f0 tx=0x7ff078009bf0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 -- 172.21.15.112:0/336159235 shutdown_connections 2023-11-08T12:32:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 --2- 172.21.15.112:0/336159235 >> v2:172.21.15.133:3300/0 conn(0x7ff07c070790 0x7ff07c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 --2- 172.21.15.112:0/336159235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c15c1a0 0x7ff07c06c8b0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 -- 172.21.15.112:0/336159235 >> 172.21.15.112:0/336159235 conn(0x7ff07c0b0f80 msgr2=0x7ff07c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 -- 172.21.15.112:0/336159235 shutdown_connections 2023-11-08T12:32:28.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.274+0000 7ff081876700 1 -- 172.21.15.112:0/336159235 wait complete. 2023-11-08T12:32:28.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 Processor -- start 2023-11-08T12:32:28.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 -- start start 2023-11-08T12:32:28.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07c070790 0x7ff07c0c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c0cdeb0 0x7ff07c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c15c1a0 0x7ff07c15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c1591d0 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c158870 con 0x7ff07c15c1a0 2023-11-08T12:32:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081876700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c158b10 con 0x7ff07c070790 2023-11-08T12:32:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c0cdeb0 0x7ff07c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c0cdeb0 0x7ff07c155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37830/0 (socket says 172.21.15.112:37830) 2023-11-08T12:32:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 -- 172.21.15.112:0/2223856983 learned_addr learned my addr 172.21.15.112:0/2223856983 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:28.288 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff080874700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07c070790 0x7ff07c0c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff081075700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c15c1a0 0x7ff07c15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 -- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07c070790 msgr2=0x7ff07c0c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07c070790 0x7ff07c0c18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 -- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c15c1a0 msgr2=0x7ff07c15ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.289 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c15c1a0 0x7ff07c15ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.278+0000 7ff073fff700 1 -- 172.21.15.112:0/2223856983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078009570 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.282+0000 7ff073fff700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c0cdeb0 0x7ff07c155e60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c480 tx=0x7ff06c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.282+0000 7ff0717fa700 1 -- 172.21.15.112:0/2223856983 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c005cd0 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.282+0000 7ff0717fa700 1 -- 172.21.15.112:0/2223856983 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c005e30 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.290 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.282+0000 7ff0717fa700 1 -- 172.21.15.112:0/2223856983 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0072f0 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.282+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c06cdf0 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.291 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.282+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c0cc780 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.282+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c15c570 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.286+0000 7ff0717fa700 1 -- 172.21.15.112:0/2223856983 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff06c019030 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.286+0000 7ff0717fa700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff068064f10 0x7ff0680673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.286+0000 7ff0717fa700 1 -- 172.21.15.112:0/2223856983 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff06c0812d0 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.286+0000 7ff080874700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff068064f10 0x7ff0680673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.286+0000 7ff080874700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff068064f10 0x7ff0680673c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff078014040 tx=0x7ff078008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:28.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.294+0000 7ff0717fa700 1 -- 172.21.15.112:0/2223856983 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff06c04f3b0 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.466+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff07c159310 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.473 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff0717fa700 1 -- 172.21.15.112:0/2223856983 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18232 (secure 0 0 0) 0x7ff06c0529d0 con 0x7ff07c0cdeb0 2023-11-08T12:32:28.474 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:28.474 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:31:36.967622+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:53.129272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:54.279849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.17","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:32:28.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff068064f10 msgr2=0x7ff0680673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff068064f10 0x7ff0680673c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff078014040 tx=0x7ff078008030 comp rx=0 tx=0).stop 2023-11-08T12:32:28.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c0cdeb0 msgr2=0x7ff07c155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c0cdeb0 0x7ff07c155e60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c480 tx=0x7ff06c00c790 comp rx=0 tx=0).stop 2023-11-08T12:32:28.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 shutdown_connections 2023-11-08T12:32:28.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff068064f10 0x7ff0680673c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff07c15c1a0 0x7ff07c15ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff07c0cdeb0 0x7ff07c155e60 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 --2- 172.21.15.112:0/2223856983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff07c070790 0x7ff07c0c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 >> 172.21.15.112:0/2223856983 conn(0x7ff07c0b0f80 msgr2=0x7ff07c15fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 shutdown_connections 2023-11-08T12:32:28.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.470+0000 7ff081876700 1 -- 172.21.15.112:0/2223856983 wait complete. 2023-11-08T12:32:28.500 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T12:32:28.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:32:28.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.682+0000 7f5215b77700 1 Processor -- start 2023-11-08T12:32:28.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.682+0000 7f5215b77700 1 -- start start 2023-11-08T12:32:28.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5215b77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5210160710 0x7f52100cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5215b77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100cc860 0x7f5210070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5215b77700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100ad6c0 con 0x7f52100705c0 2023-11-08T12:32:28.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5215b77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5210070a60 con 0x7f5210160710 2023-11-08T12:32:28.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5215b77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521006b1c0 con 0x7f52100cc860 2023-11-08T12:32:28.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f520ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100cc860 0x7f5210070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5214b75700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5210160710 0x7f52100cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f520ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100cc860 0x7f5210070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:37290/0 (socket says 172.21.15.112:37290) 2023-11-08T12:32:28.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5215376700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f52100705c0 0x7f5210069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40414/0 (socket says 172.21.15.112:40414) 2023-11-08T12:32:28.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5214b75700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5210160710 0x7f52100cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:45460/0 (socket says 172.21.15.112:45460) 2023-11-08T12:32:28.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f520ffff700 1 -- 172.21.15.112:0/1729444684 learned_addr learned my addr 172.21.15.112:0/1729444684 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:28.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5214b75700 1 -- 172.21.15.112:0/1729444684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100cc860 msgr2=0x7f5210070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:28.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5214b75700 1 --2- 172.21.15.112:0/1729444684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100cc860 0x7f5210070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5214b75700 1 -- 172.21.15.112:0/1729444684 >> v1:172.21.15.133:6789/0 conn(0x7f52100705c0 legacy=0x7f5210069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5214b75700 1 -- 172.21.15.112:0/1729444684 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100adc60 con 0x7f5210160710 2023-11-08T12:32:28.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f5214b75700 1 --2- 172.21.15.112:0/1729444684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5210160710 0x7f52100cc320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5204009850 tx=0x7f5204009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f668475a9a3891 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:28.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.686+0000 7f520f7fe700 1 -- 172.21.15.112:0/1729444684 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204011830 con 0x7f5210160710 2023-11-08T12:32:28.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f520f7fe700 1 -- 172.21.15.112:0/1729444684 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204011990 con 0x7f5210160710 2023-11-08T12:32:28.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f520f7fe700 1 -- 172.21.15.112:0/1729444684 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204011d40 con 0x7f5210160710 2023-11-08T12:32:28.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 -- 172.21.15.112:0/1729444684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5210160710 msgr2=0x7f52100cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 --2- 172.21.15.112:0/1729444684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5210160710 0x7f52100cc320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5204009850 tx=0x7f5204009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:28.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 -- 172.21.15.112:0/1729444684 shutdown_connections 2023-11-08T12:32:28.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 --2- 172.21.15.112:0/1729444684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100cc860 0x7f5210070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 --2- 172.21.15.112:0/1729444684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5210160710 0x7f52100cc320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.696 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 -- 172.21.15.112:0/1729444684 >> 172.21.15.112:0/1729444684 conn(0x7f52100b0f80 msgr2=0x7f52100ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:28.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 -- 172.21.15.112:0/1729444684 shutdown_connections 2023-11-08T12:32:28.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 -- 172.21.15.112:0/1729444684 wait complete. 2023-11-08T12:32:28.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 Processor -- start 2023-11-08T12:32:28.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.690+0000 7f5215b77700 1 -- start start 2023-11-08T12:32:28.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100705c0 0x7f52100b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52100cc860 0x7f5210162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5210160710 0x7f52101631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521015f810 con 0x7f5210160710 2023-11-08T12:32:28.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52100b4750 con 0x7f52100cc860 2023-11-08T12:32:28.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52100b4470 con 0x7f52100705c0 2023-11-08T12:32:28.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5210160710 0x7f52101631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5210160710 0x7f52101631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37846/0 (socket says 172.21.15.112:37846) 2023-11-08T12:32:28.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 -- 172.21.15.112:0/2493436353 learned_addr learned my addr 172.21.15.112:0/2493436353 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:28.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f520ffff700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52100cc860 0x7f5210162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.701 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5214b75700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100705c0 0x7f52100b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 -- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100705c0 msgr2=0x7f52100b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100705c0 0x7f52100b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 -- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52100cc860 msgr2=0x7f5210162cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52100cc860 0x7f5210162cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 -- 172.21.15.112:0/2493436353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040094b0 con 0x7f5210160710 2023-11-08T12:32:28.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f520ffff700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52100cc860 0x7f5210162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:28.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215376700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5210160710 0x7f52101631f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f520800cbd0 tx=0x7f520800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:28.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f520d7fa700 1 -- 172.21.15.112:0/2493436353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800aaa0 con 0x7f5210160710 2023-11-08T12:32:28.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f520d7fa700 1 -- 172.21.15.112:0/2493436353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520800ac00 con 0x7f5210160710 2023-11-08T12:32:28.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521006b6b0 con 0x7f5210160710 2023-11-08T12:32:28.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f520d7fa700 1 -- 172.21.15.112:0/2493436353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208007070 con 0x7f5210160710 2023-11-08T12:32:28.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.694+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521006b3d0 con 0x7f5210160710 2023-11-08T12:32:28.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.698+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52100ad8f0 con 0x7f5210160710 2023-11-08T12:32:28.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.698+0000 7f520d7fa700 1 -- 172.21.15.112:0/2493436353 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5208019030 con 0x7f5210160710 2023-11-08T12:32:28.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.702+0000 7f520d7fa700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51f4064ee0 0x7f51f4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:28.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.702+0000 7f520d7fa700 1 -- 172.21.15.112:0/2493436353 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5208081bb0 con 0x7f5210160710 2023-11-08T12:32:28.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.702+0000 7f5214b75700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51f4064ee0 0x7f51f4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:28.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.702+0000 7f5214b75700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51f4064ee0 0x7f51f4067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f52040090b0 tx=0x7f5204008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:28.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.706+0000 7f520d7fa700 1 -- 172.21.15.112:0/2493436353 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f520804a400 con 0x7f5210160710 2023-11-08T12:32:28.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.914+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5210073cb0 con 0x7f5210160710 2023-11-08T12:32:28.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.914+0000 7f520d7fa700 1 -- 172.21.15.112:0/2493436353 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4656 (secure 0 0 0) 0x7f5208017020 con 0x7f5210160710 2023-11-08T12:32:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:28.921 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:55.282749+0000","modified":"2023-11-08T12:31:15.859255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":8,"addr":"172.21.15.112:6837/2843990803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2843990803},{"type":"v1","addr":"172.21.15.112:6837","nonce":2843990803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T12:32:28.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51f4064ee0 msgr2=0x7f51f4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51f4064ee0 0x7f51f4067390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f52040090b0 tx=0x7f5204008030 comp rx=0 tx=0).stop 2023-11-08T12:32:28.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5210160710 msgr2=0x7f52101631f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:28.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5210160710 0x7f52101631f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f520800cbd0 tx=0x7f520800cee0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 shutdown_connections 2023-11-08T12:32:28.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51f4064ee0 0x7f51f4067390 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5210160710 0x7f52101631f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52100cc860 0x7f5210162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 --2- 172.21.15.112:0/2493436353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52100705c0 0x7f52100b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:28.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 >> 172.21.15.112:0/2493436353 conn(0x7f52100b0f80 msgr2=0x7f52100afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:28.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 shutdown_connections 2023-11-08T12:32:28.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:28.918+0000 7f5215b77700 1 -- 172.21.15.112:0/2493436353 wait complete. 2023-11-08T12:32:28.927 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 33 2023-11-08T12:32:28.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:32:29.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2f0b1700 1 Processor -- start 2023-11-08T12:32:29.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2f0b1700 1 -- start start 2023-11-08T12:32:29.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2f0b1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda280ced50 0x7fda2806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2f0b1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda28160770 0x7fda28070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2f0b1700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda28070a00 con 0x7fda280705c0 2023-11-08T12:32:29.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2f0b1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda280d24d0 con 0x7fda28160770 2023-11-08T12:32:29.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2f0b1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280d27b0 con 0x7fda280ced50 2023-11-08T12:32:29.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2e8b0700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fda280705c0 0x7fda2806bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38972/0 (socket says 172.21.15.112:38972) 2023-11-08T12:32:29.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2e8b0700 1 -- 172.21.15.112:0/3296442124 learned_addr learned my addr 172.21.15.112:0/3296442124 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:29.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.118+0000 7fda2d8ae700 1 --2- 172.21.15.112:0/3296442124 >> v2:172.21.15.133:3300/0 conn(0x7fda28160770 0x7fda28070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2e0af700 1 --2- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda280ced50 0x7fda2806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d0ad700 1 -- 172.21.15.112:0/3296442124 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410765152 0 0) 0x7fda28070a00 con 0x7fda280705c0 2023-11-08T12:32:29.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d0ad700 1 -- 172.21.15.112:0/3296442124 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda140035d0 con 0x7fda280705c0 2023-11-08T12:32:29.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d8ae700 1 -- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda280ced50 msgr2=0x7fda2806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:29.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d8ae700 1 --2- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda280ced50 0x7fda2806afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d8ae700 1 -- 172.21.15.112:0/3296442124 >> v1:172.21.15.112:6789/0 conn(0x7fda280705c0 legacy=0x7fda2806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d8ae700 1 -- 172.21.15.112:0/3296442124 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda280d08d0 con 0x7fda28160770 2023-11-08T12:32:29.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d8ae700 1 --2- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda28160770 0x7fda28070080 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fda18009850 tx=0x7fda18009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58cb83afcf63978 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d0ad700 1 -- 172.21.15.112:0/3296442124 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18011830 con 0x7fda28160770 2023-11-08T12:32:29.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d0ad700 1 -- 172.21.15.112:0/3296442124 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18011990 con 0x7fda28160770 2023-11-08T12:32:29.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2d0ad700 1 -- 172.21.15.112:0/3296442124 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18011d40 con 0x7fda28160770 2023-11-08T12:32:29.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 -- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda28160770 msgr2=0x7fda28070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda28160770 0x7fda28070080 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fda18009850 tx=0x7fda18009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:29.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 -- 172.21.15.112:0/3296442124 shutdown_connections 2023-11-08T12:32:29.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda28160770 0x7fda28070080 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/3296442124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda280ced50 0x7fda2806afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 -- 172.21.15.112:0/3296442124 >> 172.21.15.112:0/3296442124 conn(0x7fda280b53a0 msgr2=0x7fda280d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:29.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 -- 172.21.15.112:0/3296442124 shutdown_connections 2023-11-08T12:32:29.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.122+0000 7fda2f0b1700 1 -- 172.21.15.112:0/3296442124 wait complete. 2023-11-08T12:32:29.132 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 Processor -- start 2023-11-08T12:32:29.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 -- start start 2023-11-08T12:32:29.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda280705c0 0x7fda28158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda280ced50 0x7fda280c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda28160770 0x7fda280b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280ca0b0 con 0x7fda280705c0 2023-11-08T12:32:29.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28160470 con 0x7fda280ced50 2023-11-08T12:32:29.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2f0b1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2815cc70 con 0x7fda28160770 2023-11-08T12:32:29.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda280705c0 0x7fda28158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda280705c0 0x7fda28158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37862/0 (socket says 172.21.15.112:37862) 2023-11-08T12:32:29.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 -- 172.21.15.112:0/289987194 learned_addr learned my addr 172.21.15.112:0/289987194 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:29.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 -- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda28160770 msgr2=0x7fda280b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e8b0700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda28160770 0x7fda280b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2d8ae700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda280ced50 0x7fda280c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda28160770 0x7fda280b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 -- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda280ced50 msgr2=0x7fda280c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda280ced50 0x7fda280c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 -- 172.21.15.112:0/289987194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda180094b0 con 0x7fda280705c0 2023-11-08T12:32:29.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e8b0700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda28160770 0x7fda280b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:29.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2d8ae700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda280ced50 0x7fda280c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:29.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.126+0000 7fda2e0af700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda280705c0 0x7fda28158270 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fda2400ea00 tx=0x7fda2400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.130+0000 7fda1effd700 1 -- 172.21.15.112:0/289987194 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24009720 con 0x7fda280705c0 2023-11-08T12:32:29.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.130+0000 7fda1effd700 1 -- 172.21.15.112:0/289987194 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400c850 con 0x7fda280705c0 2023-11-08T12:32:29.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.130+0000 7fda1effd700 1 -- 172.21.15.112:0/289987194 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400cbc0 con 0x7fda280705c0 2023-11-08T12:32:29.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.130+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda280cf120 con 0x7fda280705c0 2023-11-08T12:32:29.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.130+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280d0bb0 con 0x7fda280705c0 2023-11-08T12:32:29.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.130+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda28160bc0 con 0x7fda280705c0 2023-11-08T12:32:29.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.130+0000 7fda1effd700 1 -- 172.21.15.112:0/289987194 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fda24019030 con 0x7fda280705c0 2023-11-08T12:32:29.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.134+0000 7fda1effd700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fda0c064ee0 0x7fda0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.134+0000 7fda1effd700 1 -- 172.21.15.112:0/289987194 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fda24082040 con 0x7fda280705c0 2023-11-08T12:32:29.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.134+0000 7fda2d8ae700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fda0c064ee0 0x7fda0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.134+0000 7fda2d8ae700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fda0c064ee0 0x7fda0c067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fda2815f000 tx=0x7fda18008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.138+0000 7fda1effd700 1 -- 172.21.15.112:0/289987194 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fda24050060 con 0x7fda280705c0 2023-11-08T12:32:29.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.346+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda28073cb0 con 0x7fda280705c0 2023-11-08T12:32:29.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.346+0000 7fda1effd700 1 -- 172.21.15.112:0/289987194 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4656 (secure 0 0 0) 0x7fda24053680 con 0x7fda280705c0 2023-11-08T12:32:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:29.352 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-08T12:30:55.282749+0000","modified":"2023-11-08T12:31:15.859255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":8,"addr":"172.21.15.112:6837/2843990803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2843990803},{"type":"v1","addr":"172.21.15.112:6837","nonce":2843990803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-08T12:32:29.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fda0c064ee0 msgr2=0x7fda0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fda0c064ee0 0x7fda0c067390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fda2815f000 tx=0x7fda18008030 comp rx=0 tx=0).stop 2023-11-08T12:32:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda280705c0 msgr2=0x7fda28158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda280705c0 0x7fda28158270 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fda2400ea00 tx=0x7fda2400edc0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 shutdown_connections 2023-11-08T12:32:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fda0c064ee0 0x7fda0c067390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda28160770 0x7fda280b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda280ced50 0x7fda280c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 --2- 172.21.15.112:0/289987194 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda280705c0 0x7fda28158270 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 >> 172.21.15.112:0/289987194 conn(0x7fda280b53a0 msgr2=0x7fda280cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 shutdown_connections 2023-11-08T12:32:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.350+0000 7fda2f0b1700 1 -- 172.21.15.112:0/289987194 wait complete. 2023-11-08T12:32:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 33 2023-11-08T12:32:29.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:32:29.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.546+0000 7fc4ae51e700 1 Processor -- start 2023-11-08T12:32:29.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.546+0000 7fc4ae51e700 1 -- start start 2023-11-08T12:32:29.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4a8163cb0 0x7fc4a8164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4a80cdfb0 0x7fc4a806cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a8164080 con 0x7fc4a806d2f0 2023-11-08T12:32:29.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a80cc290 con 0x7fc4a8163cb0 2023-11-08T12:32:29.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a806d770 con 0x7fc4a80cdfb0 2023-11-08T12:32:29.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a7fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4a8163cb0 0x7fc4a8164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4acabb700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc4a806d2f0 0x7fc4a806bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38974/0 (socket says 172.21.15.112:38974) 2023-11-08T12:32:29.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4acabb700 1 -- 172.21.15.112:0/1277770101 learned_addr learned my addr 172.21.15.112:0/1277770101 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:29.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc49f7fe700 1 --2- 172.21.15.112:0/1277770101 >> v2:172.21.15.133:3300/0 conn(0x7fc4a80cdfb0 0x7fc4a806cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a7fff700 1 -- 172.21.15.112:0/1277770101 >> v2:172.21.15.133:3300/0 conn(0x7fc4a80cdfb0 msgr2=0x7fc4a806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:29.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a7fff700 1 --2- 172.21.15.112:0/1277770101 >> v2:172.21.15.133:3300/0 conn(0x7fc4a80cdfb0 0x7fc4a806cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a7fff700 1 -- 172.21.15.112:0/1277770101 >> v1:172.21.15.112:6789/0 conn(0x7fc4a806d2f0 legacy=0x7fc4a806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a7fff700 1 -- 172.21.15.112:0/1277770101 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a8069bf0 con 0x7fc4a8163cb0 2023-11-08T12:32:29.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a7fff700 1 --2- 172.21.15.112:0/1277770101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a8163cb0 0x7fc4a8164cb0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806f480 tx=0x7fc498009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6820d25ce7a367 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a77fe700 1 -- 172.21.15.112:0/1277770101 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011830 con 0x7fc4a8163cb0 2023-11-08T12:32:29.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a77fe700 1 -- 172.21.15.112:0/1277770101 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc498011990 con 0x7fc4a8163cb0 2023-11-08T12:32:29.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4a77fe700 1 -- 172.21.15.112:0/1277770101 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498011d40 con 0x7fc4a8163cb0 2023-11-08T12:32:29.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- 172.21.15.112:0/1277770101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a8163cb0 msgr2=0x7fc4a8164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/1277770101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a8163cb0 0x7fc4a8164cb0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806f480 tx=0x7fc498009b30 comp rx=0 tx=0).stop 2023-11-08T12:32:29.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- 172.21.15.112:0/1277770101 shutdown_connections 2023-11-08T12:32:29.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/1277770101 >> v2:172.21.15.133:3300/0 conn(0x7fc4a80cdfb0 0x7fc4a806cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/1277770101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a8163cb0 0x7fc4a8164cb0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- 172.21.15.112:0/1277770101 >> 172.21.15.112:0/1277770101 conn(0x7fc4a80cf350 msgr2=0x7fc4a80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:29.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- 172.21.15.112:0/1277770101 shutdown_connections 2023-11-08T12:32:29.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.550+0000 7fc4ae51e700 1 -- 172.21.15.112:0/1277770101 wait complete. 2023-11-08T12:32:29.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.554+0000 7fc4ae51e700 1 Processor -- start 2023-11-08T12:32:29.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.554+0000 7fc4ae51e700 1 -- start start 2023-11-08T12:32:29.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.554+0000 7fc4ae51e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a806d2f0 0x7fc4a80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.554+0000 7fc4ae51e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a80cdfb0 0x7fc4a80702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4ae51e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4a8163cb0 0x7fc4a80c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4ae51e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80c3790 con 0x7fc4a806d2f0 2023-11-08T12:32:29.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4ae51e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80c3a70 con 0x7fc4a80cdfb0 2023-11-08T12:32:29.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4ae51e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80c3d50 con 0x7fc4a8163cb0 2023-11-08T12:32:29.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a806d2f0 0x7fc4a80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a806d2f0 0x7fc4a80c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37878/0 (socket says 172.21.15.112:37878) 2023-11-08T12:32:29.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 -- 172.21.15.112:0/3415506570 learned_addr learned my addr 172.21.15.112:0/3415506570 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:29.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc49f7fe700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a80cdfb0 0x7fc4a80702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4acabb700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4a8163cb0 0x7fc4a80c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 -- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4a8163cb0 msgr2=0x7fc4a80c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4a8163cb0 0x7fc4a80c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 -- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a80cdfb0 msgr2=0x7fc4a80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.565 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a80cdfb0 0x7fc4a80702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 -- 172.21.15.112:0/3415506570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980094b0 con 0x7fc4a806d2f0 2023-11-08T12:32:29.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4acabb700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4a8163cb0 0x7fc4a80c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:29.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a7fff700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a806d2f0 0x7fc4a80c4b10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806f6f0 tx=0x7fc498004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a57fa700 1 -- 172.21.15.112:0/3415506570 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498004570 con 0x7fc4a806d2f0 2023-11-08T12:32:29.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a57fa700 1 -- 172.21.15.112:0/3415506570 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49801f070 con 0x7fc4a806d2f0 2023-11-08T12:32:29.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4a57fa700 1 -- 172.21.15.112:0/3415506570 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498003900 con 0x7fc4a806d2f0 2023-11-08T12:32:29.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a80cc4a0 con 0x7fc4a806d2f0 2023-11-08T12:32:29.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a81651f0 con 0x7fc4a806d2f0 2023-11-08T12:32:29.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.558+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a80c5050 con 0x7fc4a806d2f0 2023-11-08T12:32:29.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.562+0000 7fc4a57fa700 1 -- 172.21.15.112:0/3415506570 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc49802a020 con 0x7fc4a806d2f0 2023-11-08T12:32:29.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.562+0000 7fc4a57fa700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc488064ee0 0x7fc488067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.562+0000 7fc4a57fa700 1 -- 172.21.15.112:0/3415506570 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc4980837a0 con 0x7fc4a806d2f0 2023-11-08T12:32:29.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.562+0000 7fc49f7fe700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc488064ee0 0x7fc488067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.566+0000 7fc49f7fe700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc488064ee0 0x7fc488067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80b4310 tx=0x7fc490008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.570+0000 7fc4a57fa700 1 -- 172.21.15.112:0/3415506570 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc4980516d0 con 0x7fc4a806d2f0 2023-11-08T12:32:29.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.742+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4a80cc780 con 0x7fc4a806d2f0 2023-11-08T12:32:29.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.746+0000 7fc4a57fa700 1 -- 172.21.15.112:0/3415506570 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18232 (secure 0 0 0) 0x7fc498054cf0 con 0x7fc4a806d2f0 2023-11-08T12:32:29.750 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:29.750 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:31:36.967622+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-08T12:30:53.129272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-08T12:30:54.279849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.17","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:32:29.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc488064ee0 msgr2=0x7fc488067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc488064ee0 0x7fc488067390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80b4310 tx=0x7fc490008040 comp rx=0 tx=0).stop 2023-11-08T12:32:29.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a806d2f0 msgr2=0x7fc4a80c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a806d2f0 0x7fc4a80c4b10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806f6f0 tx=0x7fc498004770 comp rx=0 tx=0).stop 2023-11-08T12:32:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 shutdown_connections 2023-11-08T12:32:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc488064ee0 0x7fc488067390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4a8163cb0 0x7fc4a80c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a80cdfb0 0x7fc4a80702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 --2- 172.21.15.112:0/3415506570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4a806d2f0 0x7fc4a80c4b10 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 >> 172.21.15.112:0/3415506570 conn(0x7fc4a80cf350 msgr2=0x7fc4a806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:29.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 shutdown_connections 2023-11-08T12:32:29.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.750+0000 7fc4ae51e700 1 -- 172.21.15.112:0/3415506570 wait complete. 2023-11-08T12:32:29.776 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-08T12:32:29.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.958+0000 7f3b305d2700 1 Processor -- start 2023-11-08T12:32:29.964 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.958+0000 7f3b305d2700 1 -- start start 2023-11-08T12:32:29.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b305d2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3b281591c0 0x7f3b280ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b305d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b2806c210 0x7f3b280ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b305d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2806b510 con 0x7f3b28159590 2023-11-08T12:32:29.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b305d2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b280b0c00 con 0x7f3b281591c0 2023-11-08T12:32:29.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b305d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280b0ee0 con 0x7f3b2806c210 2023-11-08T12:32:29.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3b281591c0 0x7f3b280ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3b281591c0 0x7f3b280ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37892/0 (socket says 172.21.15.112:37892) 2023-11-08T12:32:29.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 -- 172.21.15.112:0/3604224206 learned_addr learned my addr 172.21.15.112:0/3604224206 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:29.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2eb6f700 1 --2- 172.21.15.112:0/3604224206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b2806c210 0x7f3b280ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 -- 172.21.15.112:0/3604224206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b2806c210 msgr2=0x7f3b280ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:29.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 --2- 172.21.15.112:0/3604224206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b2806c210 0x7f3b280ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 -- 172.21.15.112:0/3604224206 >> v1:172.21.15.133:6789/0 conn(0x7f3b28159590 legacy=0x7f3b2806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 -- 172.21.15.112:0/3604224206 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280ca280 con 0x7f3b281591c0 2023-11-08T12:32:29.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2e36e700 1 --2- 172.21.15.112:0/3604224206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b281591c0 0x7f3b280ca7a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400bbb0 tx=0x7f3b2400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f53b5bc2433c8d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2d36c700 1 -- 172.21.15.112:0/3604224206 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400dd30 con 0x7f3b281591c0 2023-11-08T12:32:29.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2d36c700 1 -- 172.21.15.112:0/3604224206 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400de90 con 0x7f3b281591c0 2023-11-08T12:32:29.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.962+0000 7f3b2d36c700 1 -- 172.21.15.112:0/3604224206 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24010690 con 0x7f3b281591c0 2023-11-08T12:32:29.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 -- 172.21.15.112:0/3604224206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b281591c0 msgr2=0x7f3b280ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 --2- 172.21.15.112:0/3604224206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b281591c0 0x7f3b280ca7a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400bbb0 tx=0x7f3b2400bec0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 -- 172.21.15.112:0/3604224206 shutdown_connections 2023-11-08T12:32:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 --2- 172.21.15.112:0/3604224206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b2806c210 0x7f3b280ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 --2- 172.21.15.112:0/3604224206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b281591c0 0x7f3b280ca7a0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 -- 172.21.15.112:0/3604224206 >> 172.21.15.112:0/3604224206 conn(0x7f3b280cf350 msgr2=0x7f3b280b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:29.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 -- 172.21.15.112:0/3604224206 shutdown_connections 2023-11-08T12:32:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.966+0000 7f3b305d2700 1 -- 172.21.15.112:0/3604224206 wait complete. 2023-11-08T12:32:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 Processor -- start 2023-11-08T12:32:29.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 -- start start 2023-11-08T12:32:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2806c210 0x7f3b280c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b281591c0 0x7f3b280c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b28159590 0x7f3b28069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280c4650 con 0x7f3b28159590 2023-11-08T12:32:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280c3750 con 0x7f3b2806c210 2023-11-08T12:32:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280c39d0 con 0x7f3b281591c0 2023-11-08T12:32:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b28159590 0x7f3b28069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b28159590 0x7f3b28069bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37894/0 (socket says 172.21.15.112:37894) 2023-11-08T12:32:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 -- 172.21.15.112:0/2514599947 learned_addr learned my addr 172.21.15.112:0/2514599947 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2e36e700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2806c210 0x7f3b280c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2db6d700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b281591c0 0x7f3b280c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 -- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b281591c0 msgr2=0x7f3b280c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b281591c0 0x7f3b280c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 -- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2806c210 msgr2=0x7f3b280c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2806c210 0x7f3b280c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 -- 172.21.15.112:0/2514599947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2400b810 con 0x7f3b28159590 2023-11-08T12:32:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b2eb6f700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b28159590 0x7f3b28069bf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000ef90 tx=0x7f3b2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b1effd700 1 -- 172.21.15.112:0/2514599947 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000cd40 con 0x7f3b28159590 2023-11-08T12:32:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b1effd700 1 -- 172.21.15.112:0/2514599947 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2000f040 con 0x7f3b28159590 2023-11-08T12:32:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b280cace0 con 0x7f3b28159590 2023-11-08T12:32:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b1effd700 1 -- 172.21.15.112:0/2514599947 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000cea0 con 0x7f3b28159590 2023-11-08T12:32:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.970+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b280cd920 con 0x7f3b28159590 2023-11-08T12:32:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.974+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b280cae70 con 0x7f3b28159590 2023-11-08T12:32:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.974+0000 7f3b1effd700 1 -- 172.21.15.112:0/2514599947 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3b200146c0 con 0x7f3b28159590 2023-11-08T12:32:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.978+0000 7f3b1effd700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b0c064ee0 0x7f3b0c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.978+0000 7f3b1effd700 1 -- 172.21.15.112:0/2514599947 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f3b20082e80 con 0x7f3b28159590 2023-11-08T12:32:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.978+0000 7f3b2e36e700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b0c064ee0 0x7f3b0c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.978+0000 7f3b2e36e700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b0c064ee0 0x7f3b0c067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400bfd0 tx=0x7f3b2401b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:29.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:29.982+0000 7f3b1effd700 1 -- 172.21.15.112:0/2514599947 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f3b20050db0 con 0x7f3b28159590 2023-11-08T12:32:30.198 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.194+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3b280c4790 con 0x7f3b28159590 2023-11-08T12:32:30.883 INFO:tasks.ceph.mon.a.smithi112.stderr:2023-11-08T12:32:30.878+0000 7f2dc63f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-08T12:32:30.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.894+0000 7f3b1effd700 1 -- 172.21.15.112:0/2514599947 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3b280c4790 con 0x7f3b28159590 2023-11-08T12:32:30.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b0c064ee0 msgr2=0x7f3b0c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:30.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b0c064ee0 0x7f3b0c067390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400bfd0 tx=0x7f3b2401b040 comp rx=0 tx=0).stop 2023-11-08T12:32:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b28159590 msgr2=0x7f3b28069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b28159590 0x7f3b28069bf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000ef90 tx=0x7f3b2000c3a0 comp rx=0 tx=0).stop 2023-11-08T12:32:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 shutdown_connections 2023-11-08T12:32:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3b0c064ee0 0x7f3b0c067390 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:30.904 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b28159590 0x7f3b28069bf0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:30.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b281591c0 0x7f3b280c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:30.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 --2- 172.21.15.112:0/2514599947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2806c210 0x7f3b280c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:30.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 >> 172.21.15.112:0/2514599947 conn(0x7f3b280cf350 msgr2=0x7f3b280c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:30.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 shutdown_connections 2023-11-08T12:32:30.905 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:30.898+0000 7f3b305d2700 1 -- 172.21.15.112:0/2514599947 wait complete. 2023-11-08T12:32:30.906 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-08T12:32:30.915 INFO:tasks.ceph.mds.a.smithi112.stderr: -7302> 2023-11-08T12:31:00.089+0000 7f06124c7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-08T12:32:30.919 INFO:tasks.ceph.mds.a.smithi112.stderr: -4754> 2023-11-08T12:31:09.932+0000 7f060ecc0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6229=0-4194304@1} caps={6229=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6229 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b2ef065600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-08T12:32:30.925 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-08T12:32:30.974 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2023-11-08T12:32:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.094+0000 7fcbd359e700 1 Processor -- start 2023-11-08T12:32:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd359e700 1 -- start start 2023-11-08T12:32:31.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbd40b43a0 0x7fcbd415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:31.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b1640 0x7fcbd4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:31.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd415a550 con 0x7fcbd40c9040 2023-11-08T12:32:31.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd406b0a0 con 0x7fcbd40b43a0 2023-11-08T12:32:31.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40caac0 con 0x7fcbd40b1640 2023-11-08T12:32:31.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbd40b43a0 0x7fcbd415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:31.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbcbfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b1640 0x7fcbd4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:31.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbd40b43a0 0x7fcbd415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:45510/0 (socket says 172.21.15.112:45510) 2023-11-08T12:32:31.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd259c700 1 -- 172.21.15.112:0/4172637999 learned_addr learned my addr 172.21.15.112:0/4172637999 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:31.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd259c700 1 -- 172.21.15.112:0/4172637999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b1640 msgr2=0x7fcbd4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:31.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd259c700 1 --2- 172.21.15.112:0/4172637999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b1640 0x7fcbd4070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd259c700 1 -- 172.21.15.112:0/4172637999 >> v1:172.21.15.133:6789/0 conn(0x7fcbd40c9040 legacy=0x7fcbd4069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:31.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.098+0000 7fcbd259c700 1 -- 172.21.15.112:0/4172637999 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40cada0 con 0x7fcbd40b43a0 2023-11-08T12:32:31.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd259c700 1 --2- 172.21.15.112:0/4172637999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b43a0 0x7fcbd415e5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009910 tx=0x7fcbc4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831c6ccef1e77138 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:31.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd1d9b700 1 -- 172.21.15.112:0/4172637999 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4011830 con 0x7fcbd40b43a0 2023-11-08T12:32:31.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd1d9b700 1 -- 172.21.15.112:0/4172637999 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4011990 con 0x7fcbd40b43a0 2023-11-08T12:32:31.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd1d9b700 1 -- 172.21.15.112:0/4172637999 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4011d40 con 0x7fcbd40b43a0 2023-11-08T12:32:31.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 -- 172.21.15.112:0/4172637999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b43a0 msgr2=0x7fcbd415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:31.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 --2- 172.21.15.112:0/4172637999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b43a0 0x7fcbd415e5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009910 tx=0x7fcbc4009c20 comp rx=0 tx=0).stop 2023-11-08T12:32:31.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 -- 172.21.15.112:0/4172637999 shutdown_connections 2023-11-08T12:32:31.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 --2- 172.21.15.112:0/4172637999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b1640 0x7fcbd4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 --2- 172.21.15.112:0/4172637999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b43a0 0x7fcbd415e5d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 -- 172.21.15.112:0/4172637999 >> 172.21.15.112:0/4172637999 conn(0x7fcbd40b0f80 msgr2=0x7fcbd40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:31.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 -- 172.21.15.112:0/4172637999 shutdown_connections 2023-11-08T12:32:31.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.102+0000 7fcbd359e700 1 -- 172.21.15.112:0/4172637999 wait complete. 2023-11-08T12:32:31.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.106+0000 7fcbd359e700 1 Processor -- start 2023-11-08T12:32:31.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.106+0000 7fcbd359e700 1 -- start start 2023-11-08T12:32:31.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd40b1640 0x7fcbd414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:31.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b43a0 0x7fcbd415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:31.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40c9040 0x7fcbd40b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:31.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40c7c10 con 0x7fcbd40b1640 2023-11-08T12:32:31.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd415acc0 con 0x7fcbd40c9040 2023-11-08T12:32:31.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd414ee00 con 0x7fcbd40b43a0 2023-11-08T12:32:31.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd40b1640 0x7fcbd414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:31.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd40b1640 0x7fcbd414e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37922/0 (socket says 172.21.15.112:37922) 2023-11-08T12:32:31.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 -- 172.21.15.112:0/227016693 learned_addr learned my addr 172.21.15.112:0/227016693 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:31.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd2d9d700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40c9040 0x7fcbd40b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:31.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbcbfff700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b43a0 0x7fcbd415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:31.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 -- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b43a0 msgr2=0x7fcbd415b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b43a0 0x7fcbd415b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 -- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40c9040 msgr2=0x7fcbd40b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40c9040 0x7fcbd40b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 -- 172.21.15.112:0/227016693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009570 con 0x7fcbd40b1640 2023-11-08T12:32:31.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd2d9d700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40c9040 0x7fcbd40b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd259c700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd40b1640 0x7fcbd414e8c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4000c00 tx=0x7fcbc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbcaffd700 1 -- 172.21.15.112:0/227016693 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4004510 con 0x7fcbd40b1640 2023-11-08T12:32:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbcaffd700 1 -- 172.21.15.112:0/227016693 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc40036c0 con 0x7fcbd40b1640 2023-11-08T12:32:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd406b5d0 con 0x7fcbd40b1640 2023-11-08T12:32:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbcaffd700 1 -- 172.21.15.112:0/227016693 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4003a70 con 0x7fcbd40b1640 2023-11-08T12:32:31.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.110+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd406b2f0 con 0x7fcbd40b1640 2023-11-08T12:32:31.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.114+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd415eb10 con 0x7fcbd40b1640 2023-11-08T12:32:31.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.114+0000 7fcbcaffd700 1 -- 172.21.15.112:0/227016693 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcbc402d070 con 0x7fcbd40b1640 2023-11-08T12:32:31.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.118+0000 7fcbcaffd700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcbb4064ee0 0x7fcbb4067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:31.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.118+0000 7fcbcaffd700 1 -- 172.21.15.112:0/227016693 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fcbc4021030 con 0x7fcbd40b1640 2023-11-08T12:32:31.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.118+0000 7fcbcbfff700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcbb4064ee0 0x7fcbb4067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:31.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.118+0000 7fcbcbfff700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcbb4064ee0 0x7fcbb4067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcbd415d910 tx=0x7fcbbc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:31.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.122+0000 7fcbcaffd700 1 -- 172.21.15.112:0/227016693 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcbc4051590 con 0x7fcbd40b1640 2023-11-08T12:32:31.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.330+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcbd4073cb0 con 0x7fcbd40b1640 2023-11-08T12:32:31.903 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.898+0000 7fcbcaffd700 1 -- 172.21.15.112:0/227016693 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcbc40150a0 con 0x7fcbd40b1640 2023-11-08T12:32:31.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcbb4064ee0 msgr2=0x7fcbb4067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:31.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcbb4064ee0 0x7fcbb4067390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcbd415d910 tx=0x7fcbbc009240 comp rx=0 tx=0).stop 2023-11-08T12:32:31.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd40b1640 msgr2=0x7fcbd414e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:31.906 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd40b1640 0x7fcbd414e8c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4000c00 tx=0x7fcbc4004770 comp rx=0 tx=0).stop 2023-11-08T12:32:31.907 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 shutdown_connections 2023-11-08T12:32:31.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcbb4064ee0 0x7fcbb4067390 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40c9040 0x7fcbd40b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbd40b43a0 0x7fcbd415b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 --2- 172.21.15.112:0/227016693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd40b1640 0x7fcbd414e8c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:31.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 >> 172.21.15.112:0/227016693 conn(0x7fcbd40b0f80 msgr2=0x7fcbd40ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:31.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 shutdown_connections 2023-11-08T12:32:31.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:31.902+0000 7fcbd359e700 1 -- 172.21.15.112:0/227016693 wait complete. 2023-11-08T12:32:31.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-08T12:32:32.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.154+0000 7f4c4e95d700 1 Processor -- start 2023-11-08T12:32:32.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.154+0000 7f4c4e95d700 1 -- start start 2023-11-08T12:32:32.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.158+0000 7f4c4e95d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c48069e00 0x7f4c4806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:32.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.158+0000 7f4c4e95d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4806a790 con 0x7f4c4806c630 2023-11-08T12:32:32.164 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.158+0000 7f4c4e95d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4815cab0 con 0x7f4c4815c6e0 2023-11-08T12:32:32.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.158+0000 7f4c4e95d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c480d2800 con 0x7f4c48069e00 2023-11-08T12:32:32.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.158+0000 7f4c4d95b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4c4815c6e0 0x7f4c48071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40468/0 (socket says 172.21.15.112:40468) 2023-11-08T12:32:32.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.158+0000 7f4c4d95b700 1 -- 172.21.15.112:0/2387979279 learned_addr learned my addr 172.21.15.112:0/2387979279 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:32.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.158+0000 7f4c4d15a700 1 --2- 172.21.15.112:0/2387979279 >> v2:172.21.15.133:3300/0 conn(0x7f4c48069e00 0x7f4c4806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:32.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4c959700 1 -- 172.21.15.112:0/2387979279 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076442966 0 0) 0x7f4c4815cab0 con 0x7f4c4815c6e0 2023-11-08T12:32:32.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4c959700 1 -- 172.21.15.112:0/2387979279 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c340035d0 con 0x7f4c4815c6e0 2023-11-08T12:32:32.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4d15a700 1 -- 172.21.15.112:0/2387979279 >> v1:172.21.15.133:6789/0 conn(0x7f4c4815c6e0 legacy=0x7f4c48071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:32.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4d15a700 1 -- 172.21.15.112:0/2387979279 >> v1:172.21.15.112:6789/0 conn(0x7f4c4806c630 legacy=0x7f4c4806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:32.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4d15a700 1 -- 172.21.15.112:0/2387979279 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480702d0 con 0x7f4c48069e00 2023-11-08T12:32:32.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4d15a700 1 --2- 172.21.15.112:0/2387979279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c48069e00 0x7f4c4806a250 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009850 tx=0x7f4c38009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bec31126f630524 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:32.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4c959700 1 -- 172.21.15.112:0/2387979279 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38011830 con 0x7f4c48069e00 2023-11-08T12:32:32.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4c959700 1 -- 172.21.15.112:0/2387979279 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c38011990 con 0x7f4c48069e00 2023-11-08T12:32:32.170 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4c959700 1 -- 172.21.15.112:0/2387979279 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38011d40 con 0x7f4c48069e00 2023-11-08T12:32:32.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2387979279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c48069e00 msgr2=0x7f4c4806a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:32.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2387979279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c48069e00 0x7f4c4806a250 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009850 tx=0x7f4c38009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:32.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2387979279 shutdown_connections 2023-11-08T12:32:32.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2387979279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c48069e00 0x7f4c4806a250 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.171 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2387979279 >> 172.21.15.112:0/2387979279 conn(0x7f4c480b65b0 msgr2=0x7f4c48071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:32.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2387979279 shutdown_connections 2023-11-08T12:32:32.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.162+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2387979279 wait complete. 2023-11-08T12:32:32.172 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.166+0000 7f4c4e95d700 1 Processor -- start 2023-11-08T12:32:32.173 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.166+0000 7f4c4e95d700 1 -- start start 2023-11-08T12:32:32.175 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e95d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c48069e00 0x7f4c48159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:32.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e95d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4806c630 0x7f4c4808fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:32.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e95d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c4815c6e0 0x7f4c481587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:32.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e95d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c481e6830 con 0x7f4c48069e00 2023-11-08T12:32:32.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e95d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c481e6cc0 con 0x7f4c4806c630 2023-11-08T12:32:32.176 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e95d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c481e5c20 con 0x7f4c4815c6e0 2023-11-08T12:32:32.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c48069e00 0x7f4c48159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:32.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c48069e00 0x7f4c48159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37930/0 (socket says 172.21.15.112:37930) 2023-11-08T12:32:32.177 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 -- 172.21.15.112:0/2083544934 learned_addr learned my addr 172.21.15.112:0/2083544934 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:32.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e15c700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c4815c6e0 0x7f4c481587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:32.178 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d15a700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4806c630 0x7f4c4808fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:32.179 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 -- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c4815c6e0 msgr2=0x7f4c481587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:32.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c4815c6e0 0x7f4c481587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.181 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 -- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4806c630 msgr2=0x7f4c4808fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:32.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4806c630 0x7f4c4808fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 -- 172.21.15.112:0/2083544934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380094b0 con 0x7f4c48069e00 2023-11-08T12:32:32.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4e15c700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c4815c6e0 0x7f4c481587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:32.182 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.170+0000 7f4c4d95b700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c48069e00 0x7f4c48159630 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c4d0 tx=0x7f4c4400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:32.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.174+0000 7f4c3e7fc700 1 -- 172.21.15.112:0/2083544934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44005d90 con 0x7f4c48069e00 2023-11-08T12:32:32.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.174+0000 7f4c3e7fc700 1 -- 172.21.15.112:0/2083544934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c440070d0 con 0x7f4c48069e00 2023-11-08T12:32:32.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.174+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c480d2cf0 con 0x7f4c48069e00 2023-11-08T12:32:32.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.174+0000 7f4c3e7fc700 1 -- 172.21.15.112:0/2083544934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44007480 con 0x7f4c48069e00 2023-11-08T12:32:32.183 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.174+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c480d2a10 con 0x7f4c48069e00 2023-11-08T12:32:32.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.174+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c480d2fd0 con 0x7f4c48069e00 2023-11-08T12:32:32.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.178+0000 7f4c3e7fc700 1 -- 172.21.15.112:0/2083544934 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4c44019030 con 0x7f4c48069e00 2023-11-08T12:32:32.185 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.178+0000 7f4c3e7fc700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4c2c064ee0 0x7f4c2c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:32.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.178+0000 7f4c3e7fc700 1 -- 172.21.15.112:0/2083544934 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f4c440814d0 con 0x7f4c48069e00 2023-11-08T12:32:32.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.178+0000 7f4c4d15a700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4c2c064ee0 0x7f4c2c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:32.186 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.182+0000 7f4c4d15a700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4c2c064ee0 0x7f4c2c067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4c380090b0 tx=0x7f4c38008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:32.192 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.186+0000 7f4c3e7fc700 1 -- 172.21.15.112:0/2083544934 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4c4404f3b0 con 0x7f4c48069e00 2023-11-08T12:32:32.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.354+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c48073cb0 con 0x7f4c48069e00 2023-11-08T12:32:32.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.906+0000 7f4c3e7fc700 1 -- 172.21.15.112:0/2083544934 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4c440529d0 con 0x7f4c48069e00 2023-11-08T12:32:32.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4c2c064ee0 msgr2=0x7f4c2c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:32.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4c2c064ee0 0x7f4c2c067390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4c380090b0 tx=0x7f4c38008030 comp rx=0 tx=0).stop 2023-11-08T12:32:32.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c48069e00 msgr2=0x7f4c48159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:32.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c48069e00 0x7f4c48159630 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c4d0 tx=0x7f4c4400c7e0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 shutdown_connections 2023-11-08T12:32:32.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4c2c064ee0 0x7f4c2c067390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c4815c6e0 0x7f4c481587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4806c630 0x7f4c4808fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 --2- 172.21.15.112:0/2083544934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c48069e00 0x7f4c48159630 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:32.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.910+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 >> 172.21.15.112:0/2083544934 conn(0x7f4c480b65b0 msgr2=0x7f4c480b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:32.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.914+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 shutdown_connections 2023-11-08T12:32:32.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:32.914+0000 7f4c4e95d700 1 -- 172.21.15.112:0/2083544934 wait complete. 2023-11-08T12:32:32.921 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2023-11-08T12:32:32.940 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-08T12:32:33.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.126+0000 7f777dcc3700 1 Processor -- start 2023-11-08T12:32:33.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.126+0000 7f777dcc3700 1 -- start start 2023-11-08T12:32:33.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f777dcc3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f777806b1c0 0x7f7778142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:33.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f777dcc3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777806b8d0 con 0x7f7778142650 2023-11-08T12:32:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f777dcc3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777806bb70 con 0x7f77780b6110 2023-11-08T12:32:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f777dcc3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777806b5f0 con 0x7f777806b1c0 2023-11-08T12:32:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77777fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7778142650 0x7f77780b5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38992/0 (socket says 172.21.15.112:38992) 2023-11-08T12:32:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77777fe700 1 -- 172.21.15.112:0/1115749697 learned_addr learned my addr 172.21.15.112:0/1115749697 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f7777fff700 1 --2- 172.21.15.112:0/1115749697 >> v2:172.21.15.112:3300/0 conn(0x7f777806b1c0 0x7f7778142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338713123 0 0) 0x7f777806b8d0 con 0x7f7778142650 2023-11-08T12:32:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77600035d0 con 0x7f7778142650 2023-11-08T12:32:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951856168 0 0) 0x7f777806bb70 con 0x7f77780b6110 2023-11-08T12:32:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f777806b8d0 con 0x7f77780b6110 2023-11-08T12:32:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f7777fff700 1 -- 172.21.15.112:0/1115749697 >> v1:172.21.15.133:6789/0 conn(0x7f77780b6110 legacy=0x7f777806aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2262044212 0 0) 0x7f77600035d0 con 0x7f7778142650 2023-11-08T12:32:33.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f7777fff700 1 -- 172.21.15.112:0/1115749697 >> v1:172.21.15.112:6789/0 conn(0x7f7778142650 legacy=0x7f77780b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:33.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f7777fff700 1 -- 172.21.15.112:0/1115749697 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777806be50 con 0x7f777806b1c0 2023-11-08T12:32:33.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f7777fff700 1 --2- 172.21.15.112:0/1115749697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f777806b1c0 0x7f7778142fa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7770009d90 tx=0x7f777000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a993376b59ecc2b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000e070 con 0x7f777806b1c0 2023-11-08T12:32:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7770003a40 con 0x7f777806b1c0 2023-11-08T12:32:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.130+0000 7f77767fc700 1 -- 172.21.15.112:0/1115749697 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768001670 con 0x7f777806b1c0 2023-11-08T12:32:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- 172.21.15.112:0/1115749697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f777806b1c0 msgr2=0x7f7778142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 --2- 172.21.15.112:0/1115749697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f777806b1c0 0x7f7778142fa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7770009d90 tx=0x7f777000b330 comp rx=0 tx=0).stop 2023-11-08T12:32:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- 172.21.15.112:0/1115749697 shutdown_connections 2023-11-08T12:32:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 --2- 172.21.15.112:0/1115749697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f777806b1c0 0x7f7778142fa0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- 172.21.15.112:0/1115749697 >> 172.21.15.112:0/1115749697 conn(0x7f77780b5390 msgr2=0x7f77780d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- 172.21.15.112:0/1115749697 shutdown_connections 2023-11-08T12:32:33.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- 172.21.15.112:0/1115749697 wait complete. 2023-11-08T12:32:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 Processor -- start 2023-11-08T12:32:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- start start 2023-11-08T12:32:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f777806b1c0 0x7f77781605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77780b6110 0x7f77781f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7778142650 0x7f7778140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777815f320 con 0x7f77780b6110 2023-11-08T12:32:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777815f530 con 0x7f7778142650 2023-11-08T12:32:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.134+0000 7f777dcc3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777815f810 con 0x7f777806b1c0 2023-11-08T12:32:33.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77780b6110 0x7f77781f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:33.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77780b6110 0x7f77781f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37946/0 (socket says 172.21.15.112:37946) 2023-11-08T12:32:33.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 -- 172.21.15.112:0/3131991 learned_addr learned my addr 172.21.15.112:0/3131991 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:33.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f77777fe700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f777806b1c0 0x7f77781605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:33.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7777fff700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7778142650 0x7f7778140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:33.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 -- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f777806b1c0 msgr2=0x7f77781605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:33.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f777806b1c0 0x7f77781605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 -- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7778142650 msgr2=0x7f7778140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:33.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7778142650 0x7f7778140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 -- 172.21.15.112:0/3131991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770009a70 con 0x7f77780b6110 2023-11-08T12:32:33.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f7776ffd700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77780b6110 0x7f77781f56e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c500 tx=0x7f776c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:33.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f775ffff700 1 -- 172.21.15.112:0/3131991 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0052d0 con 0x7f77780b6110 2023-11-08T12:32:33.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f775ffff700 1 -- 172.21.15.112:0/3131991 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c005450 con 0x7f77780b6110 2023-11-08T12:32:33.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f775ffff700 1 -- 172.21.15.112:0/3131991 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0038e0 con 0x7f77780b6110 2023-11-08T12:32:33.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777806c410 con 0x7f77780b6110 2023-11-08T12:32:33.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777806c130 con 0x7f77780b6110 2023-11-08T12:32:33.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.138+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778142a20 con 0x7f77780b6110 2023-11-08T12:32:33.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.142+0000 7f775ffff700 1 -- 172.21.15.112:0/3131991 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f776c019030 con 0x7f77780b6110 2023-11-08T12:32:33.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.142+0000 7f775ffff700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7764064ee0 0x7f7764067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:33.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.142+0000 7f775ffff700 1 -- 172.21.15.112:0/3131991 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6088+0+0 (secure 0 0 0) 0x7f776c0813a0 con 0x7f77780b6110 2023-11-08T12:32:33.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.142+0000 7f77777fe700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7764064ee0 0x7f7764067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:33.151 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.146+0000 7f77777fe700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7764064ee0 0x7f7764067390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7768007fd0 tx=0x7f7768007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:33.152 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.146+0000 7f775ffff700 1 -- 172.21.15.112:0/3131991 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f776c04f490 con 0x7f77780b6110 2023-11-08T12:32:33.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.326+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77780b6f40 con 0x7f77780b6110 2023-11-08T12:32:33.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.914+0000 7f775ffff700 1 -- 172.21.15.112:0/3131991 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f776c052ab0 con 0x7f77780b6110 2023-11-08T12:32:33.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.918+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7764064ee0 msgr2=0x7f7764067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:33.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.918+0000 7f777dcc3700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7764064ee0 0x7f7764067390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7768007fd0 tx=0x7f7768007a80 comp rx=0 tx=0).stop 2023-11-08T12:32:33.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.918+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77780b6110 msgr2=0x7f77781f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:33.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.918+0000 7f777dcc3700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77780b6110 0x7f77781f56e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c500 tx=0x7f776c00c8c0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 shutdown_connections 2023-11-08T12:32:33.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7764064ee0 0x7f7764067390 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7778142650 0x7f7778140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77780b6110 0x7f77781f56e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 --2- 172.21.15.112:0/3131991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f777806b1c0 0x7f77781605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:33.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 >> 172.21.15.112:0/3131991 conn(0x7f77780b5390 msgr2=0x7f77780b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:33.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 shutdown_connections 2023-11-08T12:32:33.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:33.922+0000 7f777dcc3700 1 -- 172.21.15.112:0/3131991 wait complete. 2023-11-08T12:32:33.931 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2023-11-08T12:32:33.952 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-08T12:32:34.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.114+0000 7f5004e76700 1 Processor -- start 2023-11-08T12:32:34.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.114+0000 7f5004e76700 1 -- start start 2023-11-08T12:32:34.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.114+0000 7f5004e76700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50000b43a0 0x7f500015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5000070790 0x7f500006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500015a550 con 0x7f50000b1640 2023-11-08T12:32:34.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500006b0a0 con 0x7f50000b43a0 2023-11-08T12:32:34.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000caac0 con 0x7f5000070790 2023-11-08T12:32:34.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50000b43a0 0x7f500015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50000b43a0 0x7f500015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37958/0 (socket says 172.21.15.112:37958) 2023-11-08T12:32:34.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 -- 172.21.15.112:0/4108577157 learned_addr learned my addr 172.21.15.112:0/4108577157 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:34.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4ffffff700 1 --2- 172.21.15.112:0/4108577157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5000070790 0x7f500006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 -- 172.21.15.112:0/4108577157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5000070790 msgr2=0x7f500006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:34.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 --2- 172.21.15.112:0/4108577157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5000070790 0x7f500006bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 -- 172.21.15.112:0/4108577157 >> v1:172.21.15.112:6789/0 conn(0x7f50000b1640 legacy=0x7f5000070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:34.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 -- 172.21.15.112:0/4108577157 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000cada0 con 0x7f50000b43a0 2023-11-08T12:32:34.126 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4fff7fe700 1 --2- 172.21.15.112:0/4108577157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b43a0 0x7f500015e5d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009910 tx=0x7f4ff0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70a2e9cdecf3d73 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:34.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4ffe7fc700 1 -- 172.21.15.112:0/4108577157 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0004230 con 0x7f50000b43a0 2023-11-08T12:32:34.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4ffe7fc700 1 -- 172.21.15.112:0/4108577157 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0004390 con 0x7f50000b43a0 2023-11-08T12:32:34.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f4ffe7fc700 1 -- 172.21.15.112:0/4108577157 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0009e60 con 0x7f50000b43a0 2023-11-08T12:32:34.127 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- 172.21.15.112:0/4108577157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b43a0 msgr2=0x7f500015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 --2- 172.21.15.112:0/4108577157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b43a0 0x7f500015e5d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009910 tx=0x7f4ff0009c20 comp rx=0 tx=0).stop 2023-11-08T12:32:34.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- 172.21.15.112:0/4108577157 shutdown_connections 2023-11-08T12:32:34.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 --2- 172.21.15.112:0/4108577157 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5000070790 0x7f500006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 --2- 172.21.15.112:0/4108577157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b43a0 0x7f500015e5d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.128 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- 172.21.15.112:0/4108577157 >> 172.21.15.112:0/4108577157 conn(0x7f50000b0f80 msgr2=0x7f50000ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:34.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- 172.21.15.112:0/4108577157 shutdown_connections 2023-11-08T12:32:34.129 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.118+0000 7f5004e76700 1 -- 172.21.15.112:0/4108577157 wait complete. 2023-11-08T12:32:34.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.122+0000 7f5004e76700 1 Processor -- start 2023-11-08T12:32:34.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.122+0000 7f5004e76700 1 -- start start 2023-11-08T12:32:34.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000070790 0x7f500015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.130 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b1640 0x7f50000c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b43a0 0x7f500006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500015c420 con 0x7f50000b1640 2023-11-08T12:32:34.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c2aa0 con 0x7f5000070790 2023-11-08T12:32:34.131 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c5550 con 0x7f50000b43a0 2023-11-08T12:32:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b1640 0x7f50000c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b1640 0x7f50000c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37970/0 (socket says 172.21.15.112:37970) 2023-11-08T12:32:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 -- 172.21.15.112:0/930496170 learned_addr learned my addr 172.21.15.112:0/930496170 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4fff7fe700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000070790 0x7f500015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffffff700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b43a0 0x7f500006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 -- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b43a0 msgr2=0x7f500006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b43a0 0x7f500006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 -- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000070790 msgr2=0x7f500015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000070790 0x7f500015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 -- 172.21.15.112:0/930496170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0009570 con 0x7f50000b1640 2023-11-08T12:32:34.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffffff700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b43a0 0x7f500006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:34.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4ffeffd700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b1640 0x7f50000c8130 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c4e0 tx=0x7f4ff400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:34.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4fe7fff700 1 -- 172.21.15.112:0/930496170 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011790 con 0x7f50000b1640 2023-11-08T12:32:34.135 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4fe7fff700 1 -- 172.21.15.112:0/930496170 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4011910 con 0x7f50000b1640 2023-11-08T12:32:34.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500006b5d0 con 0x7f50000b1640 2023-11-08T12:32:34.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f4fe7fff700 1 -- 172.21.15.112:0/930496170 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011cc0 con 0x7f50000b1640 2023-11-08T12:32:34.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.126+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500006b2f0 con 0x7f50000b1640 2023-11-08T12:32:34.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.130+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500015eb10 con 0x7f50000b1640 2023-11-08T12:32:34.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.130+0000 7f4fe7fff700 1 -- 172.21.15.112:0/930496170 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f4ff4010050 con 0x7f50000b1640 2023-11-08T12:32:34.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.130+0000 7f4fe7fff700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4fec064f10 0x7f4fec0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.130+0000 7f4fe7fff700 1 -- 172.21.15.112:0/930496170 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4ff4081910 con 0x7f50000b1640 2023-11-08T12:32:34.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.134+0000 7f4fff7fe700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4fec064f10 0x7f4fec0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.134+0000 7f4fff7fe700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4fec064f10 0x7f4fec0673c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009910 tx=0x7f4ff0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:34.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.138+0000 7f4fe7fff700 1 -- 172.21.15.112:0/930496170 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f4ff404fc70 con 0x7f50000b1640 2023-11-08T12:32:34.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.310+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5000073cb0 con 0x7f50000b1640 2023-11-08T12:32:34.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.318+0000 7f4fe7fff700 1 -- 172.21.15.112:0/930496170 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ff4053290 con 0x7f50000b1640 2023-11-08T12:32:34.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4fec064f10 msgr2=0x7f4fec0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4fec064f10 0x7f4fec0673c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009910 tx=0x7f4ff0008030 comp rx=0 tx=0).stop 2023-11-08T12:32:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b1640 msgr2=0x7f50000c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b1640 0x7f50000c8130 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c4e0 tx=0x7f4ff400c7f0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 shutdown_connections 2023-11-08T12:32:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f4fec064f10 0x7f4fec0673c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f50000b43a0 0x7f500006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50000b1640 0x7f50000c8130 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 --2- 172.21.15.112:0/930496170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5000070790 0x7f500015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 >> 172.21.15.112:0/930496170 conn(0x7f50000b0f80 msgr2=0x7f50000ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 shutdown_connections 2023-11-08T12:32:34.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.322+0000 7f5004e76700 1 -- 172.21.15.112:0/930496170 wait complete. 2023-11-08T12:32:34.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-08T12:32:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.522+0000 7f5bbe616700 1 Processor -- start 2023-11-08T12:32:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.522+0000 7f5bbe616700 1 -- start start 2023-11-08T12:32:34.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.522+0000 7f5bbe616700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bb815a480 0x7f5bb80cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.522+0000 7f5bbe616700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80c8d10 0x7f5bb80cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.529 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.522+0000 7f5bbe616700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb815a850 con 0x7f5bb80ccd10 2023-11-08T12:32:34.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.522+0000 7f5bbe616700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb80ce060 con 0x7f5bb815a480 2023-11-08T12:32:34.530 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.522+0000 7f5bbe616700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80ce300 con 0x7f5bb80c8d10 2023-11-08T12:32:34.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bb815a480 0x7f5bb80cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bb815a480 0x7f5bb80cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:45572/0 (socket says 172.21.15.112:45572) 2023-11-08T12:32:34.531 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5baffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80c8d10 0x7f5bb80cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 -- 172.21.15.112:0/2224918815 learned_addr learned my addr 172.21.15.112:0/2224918815 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:34.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bbcbb3700 1 --1- 172.21.15.112:0/2224918815 >> v1:172.21.15.133:6789/0 conn(0x7f5bb80ccd10 0x7f5bb815dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:40472/0 (socket says 172.21.15.112:40472) 2023-11-08T12:32:34.532 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 -- 172.21.15.112:0/2224918815 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80c8d10 msgr2=0x7f5bb80cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:34.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 --2- 172.21.15.112:0/2224918815 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80c8d10 0x7f5bb80cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 -- 172.21.15.112:0/2224918815 >> v1:172.21.15.133:6789/0 conn(0x7f5bb80ccd10 legacy=0x7f5bb815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.533 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 -- 172.21.15.112:0/2224918815 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80cada0 con 0x7f5bb815a480 2023-11-08T12:32:34.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb7fff700 1 --2- 172.21.15.112:0/2224918815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb815a480 0x7f5bb80cc290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009910 tx=0x7f5ba8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23cc03703ebbf664 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:34.534 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb77fe700 1 -- 172.21.15.112:0/2224918815 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8011830 con 0x7f5bb815a480 2023-11-08T12:32:34.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb77fe700 1 -- 172.21.15.112:0/2224918815 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba8011990 con 0x7f5bb815a480 2023-11-08T12:32:34.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.526+0000 7f5bb77fe700 1 -- 172.21.15.112:0/2224918815 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8011d40 con 0x7f5bb815a480 2023-11-08T12:32:34.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 -- 172.21.15.112:0/2224918815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb815a480 msgr2=0x7f5bb80cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.535 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 --2- 172.21.15.112:0/2224918815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb815a480 0x7f5bb80cc290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009910 tx=0x7f5ba8009c20 comp rx=0 tx=0).stop 2023-11-08T12:32:34.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 -- 172.21.15.112:0/2224918815 shutdown_connections 2023-11-08T12:32:34.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 --2- 172.21.15.112:0/2224918815 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80c8d10 0x7f5bb80cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 --2- 172.21.15.112:0/2224918815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb815a480 0x7f5bb80cc290 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 -- 172.21.15.112:0/2224918815 >> 172.21.15.112:0/2224918815 conn(0x7f5bb80cf350 msgr2=0x7f5bb80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:34.536 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 -- 172.21.15.112:0/2224918815 shutdown_connections 2023-11-08T12:32:34.537 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 -- 172.21.15.112:0/2224918815 wait complete. 2023-11-08T12:32:34.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 Processor -- start 2023-11-08T12:32:34.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.530+0000 7f5bbe616700 1 -- start start 2023-11-08T12:32:34.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb80c8d10 0x7f5bb815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80ccd10 0x7f5bb814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb815a480 0x7f5bb80cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8157e20 con 0x7f5bb815a480 2023-11-08T12:32:34.540 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8157810 con 0x7f5bb80c8d10 2023-11-08T12:32:34.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb815b8f0 con 0x7f5bb80ccd10 2023-11-08T12:32:34.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb815a480 0x7f5bb80cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bb7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb80c8d10 0x7f5bb815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb815a480 0x7f5bb80cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37984/0 (socket says 172.21.15.112:37984) 2023-11-08T12:32:34.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 -- 172.21.15.112:0/1142965099 learned_addr learned my addr 172.21.15.112:0/1142965099 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:34.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5baffff700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80ccd10 0x7f5bb814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 -- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80ccd10 msgr2=0x7f5bb814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80ccd10 0x7f5bb814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 -- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb80c8d10 msgr2=0x7f5bb815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb80c8d10 0x7f5bb815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 -- 172.21.15.112:0/1142965099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8009570 con 0x7f5bb815a480 2023-11-08T12:32:34.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bb7fff700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb80c8d10 0x7f5bb815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:34.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbcbb3700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb815a480 0x7f5bb80cd190 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000cbc0 tx=0x7f5bb000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:34.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bb57fa700 1 -- 172.21.15.112:0/1142965099 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000a9e0 con 0x7f5bb815a480 2023-11-08T12:32:34.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bb57fa700 1 -- 172.21.15.112:0/1142965099 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb000ab40 con 0x7f5bb815a480 2023-11-08T12:32:34.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80add50 con 0x7f5bb815a480 2023-11-08T12:32:34.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bb57fa700 1 -- 172.21.15.112:0/1142965099 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0007070 con 0x7f5bb815a480 2023-11-08T12:32:34.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.534+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80caa30 con 0x7f5bb815a480 2023-11-08T12:32:34.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.538+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb80ca6e0 con 0x7f5bb815a480 2023-11-08T12:32:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.538+0000 7f5bb57fa700 1 -- 172.21.15.112:0/1142965099 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f5bb0019030 con 0x7f5bb815a480 2023-11-08T12:32:34.546 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.538+0000 7f5bb57fa700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5b98064f10 0x7f5b980673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:34.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.538+0000 7f5bb57fa700 1 -- 172.21.15.112:0/1142965099 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f5bb0081810 con 0x7f5bb815a480 2023-11-08T12:32:34.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.538+0000 7f5bb7fff700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5b98064f10 0x7f5b980673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:34.547 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.542+0000 7f5bb7fff700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5b98064f10 0x7f5b980673c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009860 tx=0x7f5ba8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:34.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.546+0000 7f5bb57fa700 1 -- 172.21.15.112:0/1142965099 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f5bb004a400 con 0x7f5bb815a480 2023-11-08T12:32:34.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.778+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f5bb80726c0 con 0x7f5bb815a480 2023-11-08T12:32:34.937 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.930+0000 7f5bb57fa700 1 -- 172.21.15.112:0/1142965099 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v246) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5bb0017020 con 0x7f5bb815a480 2023-11-08T12:32:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5b98064f10 msgr2=0x7f5b980673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.941 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5b98064f10 0x7f5b980673c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009860 tx=0x7f5ba8008030 comp rx=0 tx=0).stop 2023-11-08T12:32:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb815a480 msgr2=0x7f5bb80cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb815a480 0x7f5bb80cd190 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000cbc0 tx=0x7f5bb000ced0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 shutdown_connections 2023-11-08T12:32:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f5b98064f10 0x7f5b980673c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.942 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bb815a480 0x7f5bb80cd190 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5bb80ccd10 0x7f5bb814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 --2- 172.21.15.112:0/1142965099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bb80c8d10 0x7f5bb815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:34.943 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 >> 172.21.15.112:0/1142965099 conn(0x7f5bb80cf350 msgr2=0x7f5bb806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 shutdown_connections 2023-11-08T12:32:34.944 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:34.934+0000 7f5bbe616700 1 -- 172.21.15.112:0/1142965099 wait complete. 2023-11-08T12:32:34.960 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... FAIL 2023-11-08T12:32:34.961 INFO:tasks.cephfs_test_runner: 2023-11-08T12:32:34.961 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-08T12:32:34.962 INFO:tasks.cephfs_test_runner:FAIL: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T12:32:34.962 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-08T12:32:34.962 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-08T12:32:34.963 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-08T12:32:34.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa/tasks/cephfs/test_forward_scrub.py", line 521, in test_health_status_after_backtrace_repair 2023-11-08T12:32:34.963 INFO:tasks.cephfs_test_runner: self.assertEqual(len(damage), 0) 2023-11-08T12:32:34.964 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-11-08T12:32:34.964 INFO:tasks.cephfs_test_runner: 2023-11-08T12:32:34.964 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-08T12:32:34.964 INFO:tasks.cephfs_test_runner:Ran 3 tests in 225.534s 2023-11-08T12:32:34.965 INFO:tasks.cephfs_test_runner: 2023-11-08T12:32:34.965 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-11-08T12:32:34.965 INFO:tasks.cephfs_test_runner: 2023-11-08T12:32:34.966 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-08T12:32:34.966 INFO:tasks.cephfs_test_runner:FAIL: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T12:32:34.966 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-08T12:32:34.966 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-08T12:32:34.967 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-08T12:32:34.967 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa/tasks/cephfs/test_forward_scrub.py", line 521, in test_health_status_after_backtrace_repair 2023-11-08T12:32:34.967 INFO:tasks.cephfs_test_runner: self.assertEqual(len(damage), 0) 2023-11-08T12:32:34.967 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-11-08T12:32:34.968 INFO:tasks.cephfs_test_runner: 2023-11-08T12:32:34.968 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T12:32:35.079 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d60efb6c32284fe89e7244a5d815b395 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_aa63d47e911f728a17b611e016a29a682d602ec3/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-08T12:32:35.081 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-08T12:32:35.093 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-08T12:32:35.114 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-08T12:32:35.115 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:32:35.115 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:35.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:32:35.144 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2023-11-08T12:32:35.144 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:35.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9418 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-08T12:32:35.208 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:32:35.208 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:35.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:32:35.228 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-11-08T12:32:35.228 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-08T12:32:35.290 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352268k,nr_inodes=4088067,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9281 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-08T12:32:35.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.291 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:32:35.311 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-08T12:32:35.311 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-08T12:32:35.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-08T12:32:35.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-08T12:32:35.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.473 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-11-08T12:32:35.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.678 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2023-11-08T12:32:35.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.697 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2023-11-08T12:32:35.781 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2023-11-08T12:32:35.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:32:35.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.785 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-11-08T12:32:35.804 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-08T12:32:35.805 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-08T12:32:35.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.806 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-08T12:32:35.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-08T12:32:35.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:35.989 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-11-08T12:32:36.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:36.163 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-11-08T12:32:36.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-08T12:32:36.182 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-11-08T12:32:36.265 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-11-08T12:32:36.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:32:36.268 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-08T12:32:36.298 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-08T12:32:36.298 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:32:36.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a17d2700 1 Processor -- start 2023-11-08T12:32:36.463 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a17d2700 1 -- start start 2023-11-08T12:32:36.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a17d2700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f819c15c1a0 0x7f819c06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a17d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f819c070790 0x7f819c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a17d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0adf90 con 0x7f819c0cdeb0 2023-11-08T12:32:36.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a17d2700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c069bf0 con 0x7f819c15c1a0 2023-11-08T12:32:36.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a17d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c0ce370 con 0x7f819c070790 2023-11-08T12:32:36.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f819bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f819c15c1a0 0x7f819c06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f819bfff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f819c15c1a0 0x7f819c06c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51832/0 (socket says 172.21.15.112:51832) 2023-11-08T12:32:36.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f819bfff700 1 -- 172.21.15.112:0/3681394546 learned_addr learned my addr 172.21.15.112:0/3681394546 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:36.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a0fd1700 1 --2- 172.21.15.112:0/3681394546 >> v2:172.21.15.133:3300/0 conn(0x7f819c070790 0x7f819c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f819bfff700 1 -- 172.21.15.112:0/3681394546 >> v2:172.21.15.133:3300/0 conn(0x7f819c070790 msgr2=0x7f819c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:36.468 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f819bfff700 1 --2- 172.21.15.112:0/3681394546 >> v2:172.21.15.133:3300/0 conn(0x7f819c070790 0x7f819c06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f819bfff700 1 -- 172.21.15.112:0/3681394546 >> v1:172.21.15.133:6789/0 conn(0x7f819c0cdeb0 legacy=0x7f819c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:36.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f819bfff700 1 -- 172.21.15.112:0/3681394546 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0cc4a0 con 0x7f819c15c1a0 2023-11-08T12:32:36.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.458+0000 7f81a0fd1700 1 --2- 172.21.15.112:0/3681394546 >> v2:172.21.15.133:3300/0 conn(0x7f819c070790 0x7f819c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:36.469 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f819bfff700 1 --2- 172.21.15.112:0/3681394546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c06c8b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f819c06d4f0 tx=0x7f818c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0d85696730eecb server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:36.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f819affd700 1 -- 172.21.15.112:0/3681394546 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c004230 con 0x7f819c15c1a0 2023-11-08T12:32:36.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f819affd700 1 -- 172.21.15.112:0/3681394546 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c004390 con 0x7f819c15c1a0 2023-11-08T12:32:36.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f819affd700 1 -- 172.21.15.112:0/3681394546 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0036c0 con 0x7f819c15c1a0 2023-11-08T12:32:36.470 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 -- 172.21.15.112:0/3681394546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 msgr2=0x7f819c06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 --2- 172.21.15.112:0/3681394546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c06c8b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f819c06d4f0 tx=0x7f818c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 -- 172.21.15.112:0/3681394546 shutdown_connections 2023-11-08T12:32:36.471 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 --2- 172.21.15.112:0/3681394546 >> v2:172.21.15.133:3300/0 conn(0x7f819c070790 0x7f819c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 --2- 172.21.15.112:0/3681394546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c06c8b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 -- 172.21.15.112:0/3681394546 >> 172.21.15.112:0/3681394546 conn(0x7f819c0b0f80 msgr2=0x7f819c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:36.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 -- 172.21.15.112:0/3681394546 shutdown_connections 2023-11-08T12:32:36.472 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.462+0000 7f81a17d2700 1 -- 172.21.15.112:0/3681394546 wait complete. 2023-11-08T12:32:36.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 Processor -- start 2023-11-08T12:32:36.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 -- start start 2023-11-08T12:32:36.475 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f819c070790 0x7f819c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f819c0cdeb0 0x7f819c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c15dd40 con 0x7f819c15c1a0 2023-11-08T12:32:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c155800 con 0x7f819c0cdeb0 2023-11-08T12:32:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a17d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0c1bf0 con 0x7f819c070790 2023-11-08T12:32:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c0b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51836/0 (socket says 172.21.15.112:51836) 2023-11-08T12:32:36.477 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 -- 172.21.15.112:0/4273716243 learned_addr learned my addr 172.21.15.112:0/4273716243 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f819bfff700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f819c070790 0x7f819c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f819b7fe700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f819c0cdeb0 0x7f819c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.478 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 -- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f819c070790 msgr2=0x7f819c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f819c070790 0x7f819c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 -- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f819c0cdeb0 msgr2=0x7f819c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f819c0cdeb0 0x7f819c0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.466+0000 7f81a0fd1700 1 -- 172.21.15.112:0/4273716243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c009570 con 0x7f819c15c1a0 2023-11-08T12:32:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.470+0000 7f81a0fd1700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c0b2100 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f819400ce80 tx=0x7f819400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.470+0000 7f8198ff9700 1 -- 172.21.15.112:0/4273716243 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819400ad40 con 0x7f819c15c1a0 2023-11-08T12:32:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.470+0000 7f8198ff9700 1 -- 172.21.15.112:0/4273716243 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194015440 con 0x7f819c15c1a0 2023-11-08T12:32:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.470+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c06cdf0 con 0x7f819c15c1a0 2023-11-08T12:32:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.470+0000 7f8198ff9700 1 -- 172.21.15.112:0/4273716243 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819400aea0 con 0x7f819c15c1a0 2023-11-08T12:32:36.481 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.470+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c0cc780 con 0x7f819c15c1a0 2023-11-08T12:32:36.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.470+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c15c570 con 0x7f819c15c1a0 2023-11-08T12:32:36.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.474+0000 7f8198ff9700 1 -- 172.21.15.112:0/4273716243 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f819401c030 con 0x7f819c15c1a0 2023-11-08T12:32:36.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.474+0000 7f8198ff9700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8188064f10 0x7f81880673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.474+0000 7f8198ff9700 1 -- 172.21.15.112:0/4273716243 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8194081fa0 con 0x7f819c15c1a0 2023-11-08T12:32:36.483 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.474+0000 7f819bfff700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8188064f10 0x7f81880673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.474+0000 7f819bfff700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8188064f10 0x7f81880673c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f819c06d4f0 tx=0x7f818c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:36.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.482+0000 7f8198ff9700 1 -- 172.21.15.112:0/4273716243 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f81940502a0 con 0x7f819c15c1a0 2023-11-08T12:32:36.655 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.650+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f819c073200 con 0x7f8188064f10 2023-11-08T12:32:36.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.658+0000 7f8198ff9700 1 -- 172.21.15.112:0/4273716243 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70317 (secure 0 0 0) 0x7f819c073200 con 0x7f8188064f10 2023-11-08T12:32:36.663 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:36.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.658+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8188064f10 msgr2=0x7f81880673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.658+0000 7f81a17d2700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8188064f10 0x7f81880673c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f819c06d4f0 tx=0x7f818c008030 comp rx=0 tx=0).stop 2023-11-08T12:32:36.665 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.658+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 msgr2=0x7f819c0b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.658+0000 7f81a17d2700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c0b2100 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f819400ce80 tx=0x7f819400ceb0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.658+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 shutdown_connections 2023-11-08T12:32:36.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.658+0000 7f81a17d2700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f8188064f10 0x7f81880673c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.662+0000 7f81a17d2700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f819c15c1a0 0x7f819c0b2100 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.662+0000 7f81a17d2700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f819c0cdeb0 0x7f819c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.662+0000 7f81a17d2700 1 --2- 172.21.15.112:0/4273716243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f819c070790 0x7f819c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.662+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 >> 172.21.15.112:0/4273716243 conn(0x7f819c0b0f80 msgr2=0x7f819c06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.662+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 shutdown_connections 2023-11-08T12:32:36.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.662+0000 7f81a17d2700 1 -- 172.21.15.112:0/4273716243 wait complete. 2023-11-08T12:32:36.670 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:32:36.687 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2023-11-08T12:32:34.812033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":89916,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":81856,"kb_avail":754884804,"statfs":{"total":773094113280,"available":773002039296,"internally_reserved":0,"allocated":8187904,"data_stored":4456430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83820544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12286,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-8,"num_read_kb":-7,"num_write":-75,"num_write_kb":-38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002364"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:32:11.842626+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:32:11.842626+0000","last_peered":"2023-11-08T12:32:11.842626+0000","last_clean":"2023-11-08T12:32:11.842626+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:32:11.842626+0000","last_undegraded":"2023-11-08T12:32:11.842626+0000","last_fullsized":"2023-11-08T12:32:11.842626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:31:38.158432+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:31:38.158432+0000","last_peered":"2023-11-08T12:31:38.158432+0000","last_clean":"2023-11-08T12:31:38.158432+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:31:38.158432+0000","last_undegraded":"2023-11-08T12:31:38.158432+0000","last_fullsized":"2023-11-08T12:31:38.158432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:31:36.982281+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:31:36.982281+0000","last_peered":"2023-11-08T12:31:36.982281+0000","last_clean":"2023-11-08T12:31:36.982281+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:31:36.982281+0000","last_undegraded":"2023-11-08T12:31:36.982281+0000","last_fullsized":"2023-11-08T12:31:36.982281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:31:38.158494+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:31:38.158494+0000","last_peered":"2023-11-08T12:31:38.158494+0000","last_clean":"2023-11-08T12:31:38.158494+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:31:38.158494+0000","last_undegraded":"2023-11-08T12:31:38.158494+0000","last_fullsized":"2023-11-08T12:31:38.158494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:32:00.839682+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:32:00.839682+0000","last_peered":"2023-11-08T12:32:00.839682+0000","last_clean":"2023-11-08T12:32:00.839682+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:32:00.839682+0000","last_undegraded":"2023-11-08T12:32:00.839682+0000","last_fullsized":"2023-11-08T12:32:00.839682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:31:36.979972+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:31:36.979972+0000","last_peered":"2023-11-08T12:31:36.979972+0000","last_clean":"2023-11-08T12:31:36.979972+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:31:36.979972+0000","last_undegraded":"2023-11-08T12:31:36.979972+0000","last_fullsized":"2023-11-08T12:31:36.979972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:31:36.981649+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:31:36.981649+0000","last_peered":"2023-11-08T12:31:36.981649+0000","last_clean":"2023-11-08T12:31:36.981649+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:31:36.981649+0000","last_undegraded":"2023-11-08T12:31:36.981649+0000","last_fullsized":"2023-11-08T12:31:36.981649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:32:00.839717+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:32:00.839717+0000","last_peered":"2023-11-08T12:32:00.839717+0000","last_clean":"2023-11-08T12:32:00.839717+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:32:00.839717+0000","last_undegraded":"2023-11-08T12:32:00.839717+0000","last_fullsized":"2023-11-08T12:32:00.839717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":205,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:31:36.981694+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:31:36.981694+0000","last_peered":"2023-11-08T12:31:36.981694+0000","last_clean":"2023-11-08T12:31:36.981694+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:31:36.981694+0000","last_undegraded":"2023-11-08T12:31:36.981694+0000","last_fullsized":"2023-11-08T12:31:36.981694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476798,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9816,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362024,"statfs":{"total":96636764160,"available":96626712576,"internally_reserved":0,"allocated":868352,"data_stored":403906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.64700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.508,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.107},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.161,"15min":1.1140000000000001},"min":{"1min":0.72199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5509999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.69899999999999995}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.175,"15min":1.159},"min":{"1min":0.80300000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5289999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.1379999999999999,"15min":1.1180000000000001},"min":{"1min":0.76300000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5269999999999999,"5min":1.851,"15min":1.851},"last":0.90100000000000002}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.093,"15min":1.0669999999999999},"min":{"1min":0.77100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.266,"15min":1.268},"min":{"1min":0.86099999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.3859999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":1.004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.601,"5min":5.601,"15min":5.601},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5349999999999999,"5min":1.73,"15min":1.73},"last":0.86799999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2669999999999999,"15min":1.3129999999999999},"min":{"1min":0.87,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6579999999999999,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.298},{"interface":"front","average":{"1min":1.296,"5min":1.3200000000000001,"15min":1.3600000000000001},"min":{"1min":1.016,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6619999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0800000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2549999999999999,"15min":1.2809999999999999},"min":{"1min":0.82799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9039999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.377,"5min":1.427,"15min":1.4590000000000001},"min":{"1min":0.94499999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.857,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.345}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.429,"15min":1.4730000000000001},"min":{"1min":0.93000000000000005,"5min":0.752,"15min":0.752},"max":{"1min":1.633,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3899999999999999,"15min":1.4319999999999999},"min":{"1min":0.94099999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8200000000000001,"5min":2.121,"15min":2.121},"last":1.1519999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476798,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10080,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361760,"statfs":{"total":96636764160,"available":96626442240,"internally_reserved":0,"allocated":876544,"data_stored":410754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.01,"15min":0.999},"min":{"1min":0.66200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0820000000000001,"15min":1.0620000000000001},"min":{"1min":0.70599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.589,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1259999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.165,"15min":1.1619999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1459999999999999,"15min":1.1890000000000001},"min":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.542,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.4099999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2,"15min":1.2150000000000001},"min":{"1min":0.83699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7230000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1659999999999999,"15min":1.1859999999999999},"min":{"1min":0.72299999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.129,"15min":3.129},"last":1.514}]},{"osd":3,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.196,"15min":1.216},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2709999999999999,"15min":1.3089999999999999},"min":{"1min":0.91000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.548,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.5940000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.196,"15min":1.2809999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2150000000000001,"15min":1.2190000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6919999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.6299999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.347,"15min":1.3799999999999999},"min":{"1min":0.73999999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6459999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.294},{"interface":"front","average":{"1min":1.272,"5min":1.3640000000000001,"15min":1.4139999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7969999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.768}]},{"osd":7,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3700000000000001,"15min":1.405},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7849999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.405,"15min":1.4399999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.837,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.907}]}]},{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15132,"kb_used_data":1428,"kb_used_omap":0,"kb_used_meta":13696,"kb_avail":94356708,"statfs":{"total":96636764160,"available":96621268992,"internally_reserved":0,"allocated":1462272,"data_stored":994782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14024704},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4770000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.165},{"interface":"front","average":{"1min":1.095,"5min":1.147,"15min":1.167},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.482,"5min":1.7,"15min":1.7},"last":1.3779999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.03,"15min":1.044},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.585,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.121,"15min":1.121},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.24},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3149999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.415,"5min":1.984,"15min":1.984},"last":1.345},{"interface":"front","average":{"1min":1.222,"5min":1.244,"15min":1.26},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5860000000000001,"5min":2.137,"15min":2.137},"last":1.5209999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.218,"15min":1.2749999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.4770000000000001,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1950000000000001,"15min":1.2370000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6719999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2649999999999999,"15min":1.2789999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7430000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.222,"15min":1.258},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.347,"15min":1.361},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":1.956,"15min":1.956},"last":1.476},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.4099999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.786,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.111}]}]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9824,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362016,"statfs":{"total":96636764160,"available":96626704384,"internally_reserved":0,"allocated":876544,"data_stored":410774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.5680000000000001,"15min":2},"min":{"1min":1.0149999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6160000000000001,"5min":20.099,"15min":20.099},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.6000000000000001,"15min":2.0670000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5469999999999999,"5min":21.238,"15min":21.238},"last":0.71599999999999997}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.139,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.512,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2949999999999999,"15min":1.5049999999999999},"min":{"1min":0.74399999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4470000000000001,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.0660000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.45,"15min":1.6950000000000001},"min":{"1min":1.091,"5min":0.745,"15min":0.745},"max":{"1min":1.6519999999999999,"5min":11.843,"15min":11.843},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4830000000000001,"15min":1.7370000000000001},"min":{"1min":0.79300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.754,"5min":11.907,"15min":11.907},"last":0.752}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.274,"15min":1.387},"min":{"1min":0.98299999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.5249999999999999,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.4770000000000001},"min":{"1min":0.84599999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.8500000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.2310000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.21,"15min":1.214},"min":{"1min":0.85399999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.6519999999999999,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.264,"15min":1.286},"min":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.571,"5min":2.073,"15min":2.073},"last":1.3520000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.242,"15min":1.296},"min":{"1min":0.71799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.631,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.157},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3660000000000001,"15min":1.3839999999999999},"min":{"1min":1.097,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.661,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.96699999999999997}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.5329999999999999,"15min":1.754},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6799999999999999,"5min":8.109,"15min":8.109},"last":1.214},{"interface":"front","average":{"1min":1.45,"5min":1.5389999999999999,"15min":1.657},"min":{"1min":1.2150000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.1240000000000001,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.177}]}]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10072,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361768,"statfs":{"total":96636764160,"available":96626450432,"internally_reserved":0,"allocated":868352,"data_stored":403926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88600000000000001,"15min":0.96799999999999997},"min":{"1min":0.60499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.113,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.622},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93300000000000005,"15min":0.97599999999999998},"min":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.349,"5min":1.53,"15min":1.53},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.155,"5min":1.51,"15min":1.51},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.004,"15min":1.0900000000000001},"min":{"1min":0.64100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.502,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.877}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0980000000000001,"15min":1.2050000000000001},"min":{"1min":0.61199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.365,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.294,"5min":1.972,"15min":1.972},"last":1.361}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1859999999999999,"15min":1.24},"min":{"1min":0.80500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.359,"5min":1.837,"15min":1.837},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.2829999999999999,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6799999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.222}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.244,"15min":1.294},"min":{"1min":0.84999999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.46,"5min":1.897,"15min":1.897},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.359,"15min":1.4590000000000001},"min":{"1min":0.89700000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.599,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.649}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2829999999999999,"15min":1.335},"min":{"1min":0.86599999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.653,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.835},{"interface":"front","average":{"1min":1.222,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.94899999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4390000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.776}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.389,"15min":1.45},"min":{"1min":0.98999999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.7210000000000001,"5min":2.194,"15min":2.194},"last":1.915},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.419,"15min":1.488},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.512,"5min":2.472,"15min":2.472},"last":1.6200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9900,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361940,"statfs":{"total":96636764160,"available":96626626560,"internally_reserved":0,"allocated":888832,"data_stored":415918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.95999999999999996,"15min":0.98699999999999999},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":5.0190000000000001,"5min":5.0190000000000001,"15min":5.0190000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98499999999999999,"15min":1.0289999999999999},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.26,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0960000000000001,"15min":1.1299999999999999},"min":{"1min":0.68999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0960000000000001,"15min":1.1180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.546,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":1.0800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.85499999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.242,"15min":1.272},"min":{"1min":0.88400000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":1.415},{"interface":"front","average":{"1min":1.23,"5min":1.2889999999999999,"15min":1.3240000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.573,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.234}]},{"osd":5,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3620000000000001,"15min":1.4059999999999999},"min":{"1min":0.97299999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.8730000000000002,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":1.121},{"interface":"front","average":{"1min":1.224,"5min":1.345,"15min":1.4410000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7190000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.325}]},{"osd":6,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3380000000000001,"15min":1.3680000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.161},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.3660000000000001,"15min":1.403},"min":{"1min":1.077,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":1.391}]},{"osd":7,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.476,"15min":1.5249999999999999},"min":{"1min":1.0349999999999999,"5min":0.874,"15min":0.874},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":1.532},{"interface":"front","average":{"1min":1.27,"5min":1.3799999999999999,"15min":1.456},"min":{"1min":1.0600000000000001,"5min":0.996,"15min":0.996},"max":{"1min":1.5680000000000001,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.284}]}]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15200,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":13760,"kb_avail":94356640,"statfs":{"total":96636764160,"available":96621199360,"internally_reserved":0,"allocated":1466368,"data_stored":1001052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14090240},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":1.0940000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4099999999999999,"5min":6.54,"15min":6.54},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98799999999999999,"15min":1.1120000000000001},"min":{"1min":0.66100000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.339,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.60899999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.014},"min":{"1min":0.63900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.3700000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.629},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0229999999999999,"15min":1.0589999999999999},"min":{"1min":0.66700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":3.069,"15min":3.069},"last":0.66900000000000004}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.0840000000000001},"min":{"1min":0.60399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.4530000000000001,"5min":2.673,"15min":2.673},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2090000000000001,"15min":1.361},"min":{"1min":0.72099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4870000000000001,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":1.034,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.7290000000000001,"5min":2.927,"15min":2.927},"last":1.095},{"interface":"front","average":{"1min":1.365,"5min":1.3280000000000001,"15min":1.4039999999999999},"min":{"1min":0.97799999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6339999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":0.95199999999999996}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3109999999999999,"15min":1.399},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.802,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.401,"15min":1.5269999999999999},"min":{"1min":1.0860000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.5169999999999999,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.93500000000000005}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4419999999999999,"15min":1.5660000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.615,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.034},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":1.0469999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.597,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.0800000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4239999999999999,"15min":1.5169999999999999},"min":{"1min":1.2649999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.6779999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.4350000000000001,"15min":1.5589999999999999},"min":{"1min":1.115,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.875,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.82799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9892,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361948,"statfs":{"total":96636764160,"available":96626634752,"internally_reserved":0,"allocated":880640,"data_stored":415318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.341,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84799999999999998,"15min":0.872},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.03}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.089,"15min":1.123},"min":{"1min":0.77900000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.534,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.4750000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94099999999999995,"15min":0.96699999999999997},"min":{"1min":0.58599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1779999999999999,"5min":1.837,"15min":1.837},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.0700000000000001,"15min":1.1180000000000001},"min":{"1min":0.79600000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.708,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.298}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.83399999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.619,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.284,"5min":1.2989999999999999,"15min":1.367},"min":{"1min":0.92100000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.167}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.323,"15min":1.3859999999999999},"min":{"1min":1.0089999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.7909999999999999,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.262,"15min":1.3200000000000001},"min":{"1min":0.92100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.524,"5min":3.052,"15min":3.052},"last":1.274}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.3740000000000001},"min":{"1min":0.96699999999999997,"5min":0.753,"15min":0.753},"max":{"1min":2.0110000000000001,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.115},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.353,"15min":1.409},"min":{"1min":1.0469999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8620000000000001,"5min":2.254,"15min":2.254},"last":1.3640000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":1.0149999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.752,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":1.1970000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.948,"5min":3.5,"15min":3.5},"last":1.246}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:32:36.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:32:36.874 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 Processor -- start 2023-11-08T12:32:36.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 -- start start 2023-11-08T12:32:36.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa53015c1a0 0x7fa53006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5300cdeb0 0x7fa530070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5300705c0 0x7fa53015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa530069bf0 con 0x7fa5300cdeb0 2023-11-08T12:32:36.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa530070a20 con 0x7fa53015c1a0 2023-11-08T12:32:36.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa534f84700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300adf90 con 0x7fa5300705c0 2023-11-08T12:32:36.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52effd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5300cdeb0 0x7fa530070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5300705c0 0x7fa53015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.880 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52ffff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5300705c0 0x7fa53015fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:56348/0 (socket says 172.21.15.112:56348) 2023-11-08T12:32:36.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52ffff700 1 -- 172.21.15.112:0/1052008217 learned_addr learned my addr 172.21.15.112:0/1052008217 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:36.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52f7fe700 1 --2- 172.21.15.112:0/1052008217 >> v2:172.21.15.133:3300/0 conn(0x7fa53015c1a0 0x7fa53006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52effd700 1 -- 172.21.15.112:0/1052008217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5300705c0 msgr2=0x7fa53015fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:36.881 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52effd700 1 --2- 172.21.15.112:0/1052008217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5300705c0 0x7fa53015fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52effd700 1 -- 172.21.15.112:0/1052008217 >> v2:172.21.15.133:3300/0 conn(0x7fa53015c1a0 msgr2=0x7fa53006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:36.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52effd700 1 --2- 172.21.15.112:0/1052008217 >> v2:172.21.15.133:3300/0 conn(0x7fa53015c1a0 0x7fa53006c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.882 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52effd700 1 -- 172.21.15.112:0/1052008217 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5300ce370 con 0x7fa5300cdeb0 2023-11-08T12:32:36.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52ffff700 1 --2- 172.21.15.112:0/1052008217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5300705c0 0x7fa53015fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:36.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.870+0000 7fa52f7fe700 1 --2- 172.21.15.112:0/1052008217 >> v2:172.21.15.133:3300/0 conn(0x7fa53015c1a0 0x7fa53006c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:36.883 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa52effd700 1 --2- 172.21.15.112:0/1052008217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa530070080 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa530070ef0 tx=0x7fa524009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c8ee95ac2cd12d server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:36.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa52e7fc700 1 -- 172.21.15.112:0/1052008217 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524011830 con 0x7fa5300cdeb0 2023-11-08T12:32:36.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa52e7fc700 1 -- 172.21.15.112:0/1052008217 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa524011990 con 0x7fa5300cdeb0 2023-11-08T12:32:36.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa52e7fc700 1 -- 172.21.15.112:0/1052008217 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524011d20 con 0x7fa5300cdeb0 2023-11-08T12:32:36.884 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 -- 172.21.15.112:0/1052008217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 msgr2=0x7fa530070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 --2- 172.21.15.112:0/1052008217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa530070080 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa530070ef0 tx=0x7fa524009b30 comp rx=0 tx=0).stop 2023-11-08T12:32:36.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 -- 172.21.15.112:0/1052008217 shutdown_connections 2023-11-08T12:32:36.885 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 --2- 172.21.15.112:0/1052008217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5300705c0 0x7fa53015fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 --2- 172.21.15.112:0/1052008217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa530070080 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.886 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 --2- 172.21.15.112:0/1052008217 >> v2:172.21.15.133:3300/0 conn(0x7fa53015c1a0 0x7fa53006c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 -- 172.21.15.112:0/1052008217 >> 172.21.15.112:0/1052008217 conn(0x7fa5300b0f80 msgr2=0x7fa5300ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:36.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 -- 172.21.15.112:0/1052008217 shutdown_connections 2023-11-08T12:32:36.887 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.874+0000 7fa534f84700 1 -- 172.21.15.112:0/1052008217 wait complete. 2023-11-08T12:32:36.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 Processor -- start 2023-11-08T12:32:36.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 -- start start 2023-11-08T12:32:36.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5300705c0 0x7fa53014cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa5300b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa53015c1a0 0x7fa5300b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53015e080 con 0x7fa5300cdeb0 2023-11-08T12:32:36.891 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53015dbf0 con 0x7fa5300705c0 2023-11-08T12:32:36.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa534f84700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53015d020 con 0x7fa53015c1a0 2023-11-08T12:32:36.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa52effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa5300b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa52effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa5300b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51860/0 (socket says 172.21.15.112:51860) 2023-11-08T12:32:36.892 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.878+0000 7fa52effd700 1 -- 172.21.15.112:0/433908124 learned_addr learned my addr 172.21.15.112:0/433908124 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52f7fe700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5300705c0 0x7fa53014cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52ffff700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa53015c1a0 0x7fa5300b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52effd700 1 -- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa53015c1a0 msgr2=0x7fa5300b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52effd700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa53015c1a0 0x7fa5300b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52effd700 1 -- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5300705c0 msgr2=0x7fa53014cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:36.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52effd700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5300705c0 0x7fa53014cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52effd700 1 -- 172.21.15.112:0/433908124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009b30 con 0x7fa5300cdeb0 2023-11-08T12:32:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52f7fe700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5300705c0 0x7fa53014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:36.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa52effd700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa5300b34b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa5240090b0 tx=0x7fa524004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa517fff700 1 -- 172.21.15.112:0/433908124 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524004400 con 0x7fa5300cdeb0 2023-11-08T12:32:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa517fff700 1 -- 172.21.15.112:0/433908124 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52401f070 con 0x7fa5300cdeb0 2023-11-08T12:32:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5240094b0 con 0x7fa5300cdeb0 2023-11-08T12:32:36.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa517fff700 1 -- 172.21.15.112:0/433908124 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5240036c0 con 0x7fa5300cdeb0 2023-11-08T12:32:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5300cc780 con 0x7fa5300cdeb0 2023-11-08T12:32:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.882+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5300cc4a0 con 0x7fa5300cdeb0 2023-11-08T12:32:36.897 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.886+0000 7fa517fff700 1 -- 172.21.15.112:0/433908124 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fa52402a020 con 0x7fa5300cdeb0 2023-11-08T12:32:36.898 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.886+0000 7fa517fff700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa51c064ee0 0x7fa51c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:36.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.886+0000 7fa517fff700 1 -- 172.21.15.112:0/433908124 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa5240831f0 con 0x7fa5300cdeb0 2023-11-08T12:32:36.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.886+0000 7fa52f7fe700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa51c064ee0 0x7fa51c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:36.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.886+0000 7fa52f7fe700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa51c064ee0 0x7fa51c067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa520009a10 tx=0x7fa520008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:36.899 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:36.890+0000 7fa517fff700 1 -- 172.21.15.112:0/433908124 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fa524051480 con 0x7fa5300cdeb0 2023-11-08T12:32:37.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.058+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa53006cdf0 con 0x7fa51c064ee0 2023-11-08T12:32:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.062+0000 7fa517fff700 1 -- 172.21.15.112:0/433908124 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70492 (secure 0 0 0) 0x7fa53006cdf0 con 0x7fa51c064ee0 2023-11-08T12:32:37.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:37.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa51c064ee0 msgr2=0x7fa51c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa51c064ee0 0x7fa51c067390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa520009a10 tx=0x7fa520008040 comp rx=0 tx=0).stop 2023-11-08T12:32:37.073 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 msgr2=0x7fa5300b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa5300b34b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa5240090b0 tx=0x7fa524004770 comp rx=0 tx=0).stop 2023-11-08T12:32:37.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 shutdown_connections 2023-11-08T12:32:37.074 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fa51c064ee0 0x7fa51c067390 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa53015c1a0 0x7fa5300b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5300cdeb0 0x7fa5300b34b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 --2- 172.21.15.112:0/433908124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5300705c0 0x7fa53014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 >> 172.21.15.112:0/433908124 conn(0x7fa5300b0f80 msgr2=0x7fa5300caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 shutdown_connections 2023-11-08T12:32:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.066+0000 7fa534f84700 1 -- 172.21.15.112:0/433908124 wait complete. 2023-11-08T12:32:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:32:37.095 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2023-11-08T12:32:36.812499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90440,"kb_used_data":8136,"kb_used_omap":0,"kb_used_meta":82240,"kb_avail":754884280,"statfs":{"total":773094113280,"available":773001502720,"internally_reserved":0,"allocated":8331264,"data_stored":4525340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":84213760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12286,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-8,"num_read_kb":-7,"num_write":-75,"num_write_kb":-38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.606558"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:32:11.842626+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:32:11.842626+0000","last_peered":"2023-11-08T12:32:11.842626+0000","last_clean":"2023-11-08T12:32:11.842626+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:32:11.842626+0000","last_undegraded":"2023-11-08T12:32:11.842626+0000","last_fullsized":"2023-11-08T12:32:11.842626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-08T12:32:30.841830+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:32:30.841830+0000","last_peered":"2023-11-08T12:32:30.841830+0000","last_clean":"2023-11-08T12:32:30.841830+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:32:30.841830+0000","last_undegraded":"2023-11-08T12:32:30.841830+0000","last_fullsized":"2023-11-08T12:32:30.841830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.912189+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:32:32.912189+0000","last_peered":"2023-11-08T12:32:32.912189+0000","last_clean":"2023-11-08T12:32:32.912189+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:32:32.912189+0000","last_undegraded":"2023-11-08T12:32:32.912189+0000","last_fullsized":"2023-11-08T12:32:32.912189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-08T12:32:30.841600+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:32:30.841600+0000","last_peered":"2023-11-08T12:32:30.841600+0000","last_clean":"2023-11-08T12:32:30.841600+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:32:30.841600+0000","last_undegraded":"2023-11-08T12:32:30.841600+0000","last_fullsized":"2023-11-08T12:32:30.841600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:33.430557+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:32:33.430557+0000","last_peered":"2023-11-08T12:32:33.430557+0000","last_clean":"2023-11-08T12:32:33.430557+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:32:33.430557+0000","last_undegraded":"2023-11-08T12:32:33.430557+0000","last_fullsized":"2023-11-08T12:32:33.430557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-08T12:32:30.209562+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:32:30.209562+0000","last_peered":"2023-11-08T12:32:30.209562+0000","last_clean":"2023-11-08T12:32:30.209562+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:32:30.209562+0000","last_undegraded":"2023-11-08T12:32:30.209562+0000","last_fullsized":"2023-11-08T12:32:30.209562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.911196+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:32:32.911196+0000","last_peered":"2023-11-08T12:32:32.911196+0000","last_clean":"2023-11-08T12:32:32.911196+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:32:32.911196+0000","last_undegraded":"2023-11-08T12:32:32.911196+0000","last_fullsized":"2023-11-08T12:32:32.911196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:33.431153+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:32:33.431153+0000","last_peered":"2023-11-08T12:32:33.431153+0000","last_clean":"2023-11-08T12:32:33.431153+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:32:33.431153+0000","last_undegraded":"2023-11-08T12:32:33.431153+0000","last_fullsized":"2023-11-08T12:32:33.431153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.911319+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:32:32.911319+0000","last_peered":"2023-11-08T12:32:32.911319+0000","last_clean":"2023-11-08T12:32:32.911319+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:32:32.911319+0000","last_undegraded":"2023-11-08T12:32:32.911319+0000","last_fullsized":"2023-11-08T12:32:32.911319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476798,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9816,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362024,"statfs":{"total":96636764160,"available":96626712576,"internally_reserved":0,"allocated":868352,"data_stored":403906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.64700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.508,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.107},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.161,"15min":1.1140000000000001},"min":{"1min":0.72199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5509999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.69899999999999995}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.175,"15min":1.159},"min":{"1min":0.80300000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5289999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.1379999999999999,"15min":1.1180000000000001},"min":{"1min":0.76300000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5269999999999999,"5min":1.851,"15min":1.851},"last":0.90100000000000002}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.093,"15min":1.0669999999999999},"min":{"1min":0.77100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.266,"15min":1.268},"min":{"1min":0.86099999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.3859999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":1.004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.601,"5min":5.601,"15min":5.601},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5349999999999999,"5min":1.73,"15min":1.73},"last":0.86799999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2669999999999999,"15min":1.3129999999999999},"min":{"1min":0.87,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6579999999999999,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.298},{"interface":"front","average":{"1min":1.296,"5min":1.3200000000000001,"15min":1.3600000000000001},"min":{"1min":1.016,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6619999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0800000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2549999999999999,"15min":1.2809999999999999},"min":{"1min":0.82799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9039999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.377,"5min":1.427,"15min":1.4590000000000001},"min":{"1min":0.94499999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.857,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.345}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.429,"15min":1.4730000000000001},"min":{"1min":0.93000000000000005,"5min":0.752,"15min":0.752},"max":{"1min":1.633,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3899999999999999,"15min":1.4319999999999999},"min":{"1min":0.94099999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8200000000000001,"5min":2.121,"15min":2.121},"last":1.1519999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476798,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10080,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361760,"statfs":{"total":96636764160,"available":96626442240,"internally_reserved":0,"allocated":876544,"data_stored":410754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.01,"15min":0.999},"min":{"1min":0.66200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0820000000000001,"15min":1.0620000000000001},"min":{"1min":0.70599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.589,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1259999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.165,"15min":1.1619999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1459999999999999,"15min":1.1890000000000001},"min":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.542,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.4099999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2,"15min":1.2150000000000001},"min":{"1min":0.83699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7230000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1659999999999999,"15min":1.1859999999999999},"min":{"1min":0.72299999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.129,"15min":3.129},"last":1.514}]},{"osd":3,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.196,"15min":1.216},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2709999999999999,"15min":1.3089999999999999},"min":{"1min":0.91000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.548,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.5940000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.196,"15min":1.2809999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2150000000000001,"15min":1.2190000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6919999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.6299999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.347,"15min":1.3799999999999999},"min":{"1min":0.73999999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6459999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.294},{"interface":"front","average":{"1min":1.272,"5min":1.3640000000000001,"15min":1.4139999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7969999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.768}]},{"osd":7,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3700000000000001,"15min":1.405},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7849999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.405,"15min":1.4399999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.837,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.907}]}]},{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4770000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.147,"15min":1.167},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.482,"5min":1.7,"15min":1.7},"last":1.1160000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.03,"15min":1.044},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.585,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.84799999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.121,"15min":1.121},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.002}]},{"osd":3,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.415,"5min":1.984,"15min":1.984},"last":1.079},{"interface":"front","average":{"1min":1.222,"5min":1.244,"15min":1.26},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5860000000000001,"5min":2.137,"15min":2.137},"last":1.1950000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.218,"15min":1.2749999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.4770000000000001,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.401},{"interface":"front","average":{"1min":1.113,"5min":1.1950000000000001,"15min":1.2370000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6719999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.5009999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2649999999999999,"15min":1.2789999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7430000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.222,"15min":1.258},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.347,"15min":1.361},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":1.956,"15min":1.956},"last":1.29},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.4099999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.786,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.2609999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9916,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361924,"statfs":{"total":96636764160,"available":96626610176,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.5680000000000001,"15min":2},"min":{"1min":1.0149999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6160000000000001,"5min":20.099,"15min":20.099},"last":1.016},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.6000000000000001,"15min":2.0670000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5469999999999999,"5min":21.238,"15min":21.238},"last":1.218}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.139,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.512,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2949999999999999,"15min":1.5049999999999999},"min":{"1min":0.74399999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4470000000000001,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.1919999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.45,"15min":1.6950000000000001},"min":{"1min":1.091,"5min":0.745,"15min":0.745},"max":{"1min":1.6519999999999999,"5min":11.843,"15min":11.843},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4830000000000001,"15min":1.7370000000000001},"min":{"1min":0.79300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.754,"5min":11.907,"15min":11.907},"last":1.073}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.274,"15min":1.387},"min":{"1min":0.98299999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.5249999999999999,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.4770000000000001},"min":{"1min":0.84599999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.8500000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.1299999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.21,"15min":1.214},"min":{"1min":0.85399999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.6519999999999999,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.264,"15min":1.286},"min":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.571,"5min":2.073,"15min":2.073},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.242,"15min":1.296},"min":{"1min":0.71799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.631,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3660000000000001,"15min":1.3839999999999999},"min":{"1min":1.097,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.661,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.96699999999999997}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.5329999999999999,"15min":1.754},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6799999999999999,"5min":8.109,"15min":8.109},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.45,"5min":1.5389999999999999,"15min":1.657},"min":{"1min":1.2150000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.1240000000000001,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.91300000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361668,"statfs":{"total":96636764160,"available":96626348032,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88600000000000001,"15min":0.96799999999999997},"min":{"1min":0.60499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.113,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93300000000000005,"15min":0.97599999999999998},"min":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.349,"5min":1.53,"15min":1.53},"last":1.341}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.155,"5min":1.51,"15min":1.51},"last":0.745},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.004,"15min":1.0900000000000001},"min":{"1min":0.64100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.502,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.5509999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0980000000000001,"15min":1.2050000000000001},"min":{"1min":0.61199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.365,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.206},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.294,"5min":1.972,"15min":1.972},"last":1.089}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1859999999999999,"15min":1.24},"min":{"1min":0.80500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.359,"5min":1.837,"15min":1.837},"last":1.46},{"interface":"front","average":{"1min":1.228,"5min":1.2829999999999999,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6799999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.6819999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.244,"15min":1.294},"min":{"1min":0.84999999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.46,"5min":1.897,"15min":1.897},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.359,"15min":1.4590000000000001},"min":{"1min":0.89700000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.599,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.74}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2829999999999999,"15min":1.335},"min":{"1min":0.86599999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.653,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.595},{"interface":"front","average":{"1min":1.222,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.94899999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4390000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.397}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.389,"15min":1.45},"min":{"1min":0.98999999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.7210000000000001,"5min":2.194,"15min":2.194},"last":1.762},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.419,"15min":1.488},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.512,"5min":2.472,"15min":2.472},"last":1.3129999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9964,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361876,"statfs":{"total":96636764160,"available":96626561024,"internally_reserved":0,"allocated":888832,"data_stored":417476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.95999999999999996,"15min":0.98699999999999999},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":5.0190000000000001,"5min":5.0190000000000001,"15min":5.0190000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98499999999999999,"15min":1.0289999999999999},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.26,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.753},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0960000000000001,"15min":1.1299999999999999},"min":{"1min":0.68999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0960000000000001,"15min":1.1180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.546,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":1.0800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.57999999999999996}]},{"osd":4,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.242,"15min":1.272},"min":{"1min":0.88400000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.23,"5min":1.2889999999999999,"15min":1.3240000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.573,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.77800000000000002}]},{"osd":5,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3620000000000001,"15min":1.4059999999999999},"min":{"1min":0.97299999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.8730000000000002,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.345,"15min":1.4410000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7190000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3380000000000001,"15min":1.3680000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.3660000000000001,"15min":1.403},"min":{"1min":1.077,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.476,"15min":1.5249999999999999},"min":{"1min":1.0349999999999999,"5min":0.874,"15min":0.874},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.3799999999999999,"15min":1.456},"min":{"1min":1.0600000000000001,"5min":0.996,"15min":0.996},"max":{"1min":1.5680000000000001,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":0.81599999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509503,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":1.0940000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4099999999999999,"5min":6.54,"15min":6.54},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98799999999999999,"15min":1.1120000000000001},"min":{"1min":0.66100000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.339,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.58099999999999996}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.014},"min":{"1min":0.63900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.3700000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0229999999999999,"15min":1.0589999999999999},"min":{"1min":0.66700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":3.069,"15min":3.069},"last":0.74099999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.0840000000000001},"min":{"1min":0.60399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.4530000000000001,"5min":2.673,"15min":2.673},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2090000000000001,"15min":1.361},"min":{"1min":0.72099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4870000000000001,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":0.78400000000000003}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":1.034,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.7290000000000001,"5min":2.927,"15min":2.927},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.3280000000000001,"15min":1.4039999999999999},"min":{"1min":0.97799999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6339999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":0.83199999999999996}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3109999999999999,"15min":1.399},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.802,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.401,"15min":1.5269999999999999},"min":{"1min":1.0860000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.5169999999999999,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.94899999999999995}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4419999999999999,"15min":1.5660000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.615,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":1.0469999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.597,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.032}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4239999999999999,"15min":1.5169999999999999},"min":{"1min":1.2649999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.6779999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.407,"5min":1.4350000000000001,"15min":1.5589999999999999},"min":{"1min":1.115,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.875,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.70199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542206,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9900,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361940,"statfs":{"total":96636764160,"available":96626626560,"internally_reserved":0,"allocated":888832,"data_stored":417476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.341,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84799999999999998,"15min":0.872},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.089,"15min":1.123},"min":{"1min":0.77900000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.534,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.4750000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94099999999999995,"15min":0.96699999999999997},"min":{"1min":0.58599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1779999999999999,"5min":1.837,"15min":1.837},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.0700000000000001,"15min":1.1180000000000001},"min":{"1min":0.79600000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.708,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.98299999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.83399999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.619,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.446},{"interface":"front","average":{"1min":1.284,"5min":1.2989999999999999,"15min":1.367},"min":{"1min":0.92100000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.1160000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.323,"15min":1.3859999999999999},"min":{"1min":1.0089999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.7909999999999999,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.262,"15min":1.3200000000000001},"min":{"1min":0.92100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.524,"5min":3.052,"15min":3.052},"last":1.3480000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.3740000000000001},"min":{"1min":0.96699999999999997,"5min":0.753,"15min":0.753},"max":{"1min":2.0110000000000001,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.159},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.353,"15min":1.409},"min":{"1min":1.0469999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8620000000000001,"5min":2.254,"15min":2.254},"last":1.077}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":1.0149999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.752,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.226},{"interface":"front","average":{"1min":1.468,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":1.1970000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.948,"5min":3.5,"15min":3.5},"last":1.2909999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:32:37.098 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-08T12:32:37.099 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:32:37.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.270+0000 7fc91194f700 1 Processor -- start 2023-11-08T12:32:37.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc91194f700 1 -- start start 2023-11-08T12:32:37.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc91194f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc90c15a480 0x7fc90c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc91194f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0c8d10 0x7fc90c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc91194f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c15a850 con 0x7fc90c0ccd10 2023-11-08T12:32:37.280 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc91194f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c0ce060 con 0x7fc90c15a480 2023-11-08T12:32:37.281 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc91194f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0ce300 con 0x7fc90c0c8d10 2023-11-08T12:32:37.282 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc90affd700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc90c15a480 0x7fc90c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc903fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0c8d10 0x7fc90c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc903fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0c8d10 0x7fc90c0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.112:56364/0 (socket says 172.21.15.112:56364) 2023-11-08T12:32:37.283 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc903fff700 1 -- 172.21.15.112:0/2135923714 learned_addr learned my addr 172.21.15.112:0/2135923714 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:37.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc903fff700 1 -- 172.21.15.112:0/2135923714 >> v2:172.21.15.112:3300/0 conn(0x7fc90c15a480 msgr2=0x7fc90c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:37.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc903fff700 1 --2- 172.21.15.112:0/2135923714 >> v2:172.21.15.112:3300/0 conn(0x7fc90c15a480 0x7fc90c0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.284 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc903fff700 1 -- 172.21.15.112:0/2135923714 >> v1:172.21.15.133:6789/0 conn(0x7fc90c0ccd10 legacy=0x7fc90c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.274+0000 7fc903fff700 1 -- 172.21.15.112:0/2135923714 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0cada0 con 0x7fc90c0c8d10 2023-11-08T12:32:37.285 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc903fff700 1 --2- 172.21.15.112:0/2135923714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0c8d10 0x7fc90c0cc7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009910 tx=0x7fc8f4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce29c4a4f7ec019 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:37.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc90a7fc700 1 -- 172.21.15.112:0/2135923714 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4011830 con 0x7fc90c0c8d10 2023-11-08T12:32:37.286 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc90a7fc700 1 -- 172.21.15.112:0/2135923714 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f4011990 con 0x7fc90c0c8d10 2023-11-08T12:32:37.287 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc90a7fc700 1 -- 172.21.15.112:0/2135923714 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4011d40 con 0x7fc90c0c8d10 2023-11-08T12:32:37.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 -- 172.21.15.112:0/2135923714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0c8d10 msgr2=0x7fc90c0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.292 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 --2- 172.21.15.112:0/2135923714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0c8d10 0x7fc90c0cc7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009910 tx=0x7fc8f4009c20 comp rx=0 tx=0).stop 2023-11-08T12:32:37.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 -- 172.21.15.112:0/2135923714 shutdown_connections 2023-11-08T12:32:37.293 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 --2- 172.21.15.112:0/2135923714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0c8d10 0x7fc90c0cc7d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 --2- 172.21.15.112:0/2135923714 >> v2:172.21.15.112:3300/0 conn(0x7fc90c15a480 0x7fc90c0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.294 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 -- 172.21.15.112:0/2135923714 >> 172.21.15.112:0/2135923714 conn(0x7fc90c0cf350 msgr2=0x7fc90c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:37.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 -- 172.21.15.112:0/2135923714 shutdown_connections 2023-11-08T12:32:37.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.278+0000 7fc91194f700 1 -- 172.21.15.112:0/2135923714 wait complete. 2023-11-08T12:32:37.295 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 Processor -- start 2023-11-08T12:32:37.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 -- start start 2023-11-08T12:32:37.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc90c0c8d10 0x7fc90c1f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.296 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0ccd10 0x7fc90c0c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc90c15a480 0x7fc90c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c1f3ab0 con 0x7fc90c15a480 2023-11-08T12:32:37.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c1f1130 con 0x7fc90c0c8d10 2023-11-08T12:32:37.297 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc91194f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c158720 con 0x7fc90c0ccd10 2023-11-08T12:32:37.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc90b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc90c15a480 0x7fc90c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc90b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc90c15a480 0x7fc90c0c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51878/0 (socket says 172.21.15.112:51878) 2023-11-08T12:32:37.298 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc90b7fe700 1 -- 172.21.15.112:0/1506566232 learned_addr learned my addr 172.21.15.112:0/1506566232 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:37.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc90affd700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc90c0c8d10 0x7fc90c1f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.282+0000 7fc903fff700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0ccd10 0x7fc90c0c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.299 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc90b7fe700 1 -- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0ccd10 msgr2=0x7fc90c0c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc90b7fe700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0ccd10 0x7fc90c0c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc90b7fe700 1 -- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc90c0c8d10 msgr2=0x7fc90c1f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc90b7fe700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc90c0c8d10 0x7fc90c1f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.300 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc90b7fe700 1 -- 172.21.15.112:0/1506566232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4009570 con 0x7fc90c15a480 2023-11-08T12:32:37.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc903fff700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0ccd10 0x7fc90c0c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:37.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc90b7fe700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc90c15a480 0x7fc90c0c7ea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc90400cb50 tx=0x7fc90400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:37.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc908ff9700 1 -- 172.21.15.112:0/1506566232 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904003c20 con 0x7fc90c15a480 2023-11-08T12:32:37.301 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc908ff9700 1 -- 172.21.15.112:0/1506566232 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904003d80 con 0x7fc90c15a480 2023-11-08T12:32:37.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc908ff9700 1 -- 172.21.15.112:0/1506566232 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400aac0 con 0x7fc90c15a480 2023-11-08T12:32:37.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c0add50 con 0x7fc90c15a480 2023-11-08T12:32:37.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c0caa30 con 0x7fc90c15a480 2023-11-08T12:32:37.302 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.286+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90c0ca6e0 con 0x7fc90c15a480 2023-11-08T12:32:37.303 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.290+0000 7fc908ff9700 1 -- 172.21.15.112:0/1506566232 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fc904010050 con 0x7fc90c15a480 2023-11-08T12:32:37.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.290+0000 7fc908ff9700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc8ec064ee0 0x7fc8ec067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.304 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.290+0000 7fc908ff9700 1 -- 172.21.15.112:0/1506566232 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc904081bc0 con 0x7fc90c15a480 2023-11-08T12:32:37.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.290+0000 7fc90affd700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc8ec064ee0 0x7fc8ec067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.290+0000 7fc90affd700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc8ec064ee0 0x7fc8ec067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc90c155b70 tx=0x7fc8fc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:37.305 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.298+0000 7fc908ff9700 1 -- 172.21.15.112:0/1506566232 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fc90404fe50 con 0x7fc90c15a480 2023-11-08T12:32:37.474 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.470+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc90c0726c0 con 0x7fc8ec064ee0 2023-11-08T12:32:37.481 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:37.482 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.474+0000 7fc908ff9700 1 -- 172.21.15.112:0/1506566232 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70492 (secure 0 0 0) 0x7fc90c0726c0 con 0x7fc8ec064ee0 2023-11-08T12:32:37.484 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc8ec064ee0 msgr2=0x7fc8ec067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc8ec064ee0 0x7fc8ec067390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc90c155b70 tx=0x7fc8fc009240 comp rx=0 tx=0).stop 2023-11-08T12:32:37.485 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc90c15a480 msgr2=0x7fc90c0c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc90c15a480 0x7fc90c0c7ea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc90400cb50 tx=0x7fc90400ce60 comp rx=0 tx=0).stop 2023-11-08T12:32:37.486 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 shutdown_connections 2023-11-08T12:32:37.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fc8ec064ee0 0x7fc8ec067390 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc90c15a480 0x7fc90c0c7ea0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.487 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc90c0ccd10 0x7fc90c0c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 --2- 172.21.15.112:0/1506566232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc90c0c8d10 0x7fc90c1f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 >> 172.21.15.112:0/1506566232 conn(0x7fc90c0cf350 msgr2=0x7fc90c0b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:37.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 shutdown_connections 2023-11-08T12:32:37.488 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.478+0000 7fc91194f700 1 -- 172.21.15.112:0/1506566232 wait complete. 2023-11-08T12:32:37.489 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:32:37.508 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2023-11-08T12:32:36.812499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90440,"kb_used_data":8136,"kb_used_omap":0,"kb_used_meta":82240,"kb_avail":754884280,"statfs":{"total":773094113280,"available":773001502720,"internally_reserved":0,"allocated":8331264,"data_stored":4525340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":84213760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12286,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-8,"num_read_kb":-7,"num_write":-75,"num_write_kb":-38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.606558"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-08T12:32:11.842626+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:32:11.842626+0000","last_peered":"2023-11-08T12:32:11.842626+0000","last_clean":"2023-11-08T12:32:11.842626+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:32:11.842626+0000","last_undegraded":"2023-11-08T12:32:11.842626+0000","last_fullsized":"2023-11-08T12:32:11.842626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-08T12:32:30.841830+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:32:30.841830+0000","last_peered":"2023-11-08T12:32:30.841830+0000","last_clean":"2023-11-08T12:32:30.841830+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:32:30.841830+0000","last_undegraded":"2023-11-08T12:32:30.841830+0000","last_fullsized":"2023-11-08T12:32:30.841830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.912189+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:32:32.912189+0000","last_peered":"2023-11-08T12:32:32.912189+0000","last_clean":"2023-11-08T12:32:32.912189+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:32:32.912189+0000","last_undegraded":"2023-11-08T12:32:32.912189+0000","last_fullsized":"2023-11-08T12:32:32.912189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-08T12:32:30.841600+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:32:30.841600+0000","last_peered":"2023-11-08T12:32:30.841600+0000","last_clean":"2023-11-08T12:32:30.841600+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:32:30.841600+0000","last_undegraded":"2023-11-08T12:32:30.841600+0000","last_fullsized":"2023-11-08T12:32:30.841600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:01:20.742838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:33.430557+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:32:33.430557+0000","last_peered":"2023-11-08T12:32:33.430557+0000","last_clean":"2023-11-08T12:32:33.430557+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:32:33.430557+0000","last_undegraded":"2023-11-08T12:32:33.430557+0000","last_fullsized":"2023-11-08T12:32:33.430557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-08T12:32:30.209562+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:32:30.209562+0000","last_peered":"2023-11-08T12:32:30.209562+0000","last_clean":"2023-11-08T12:32:30.209562+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:32:30.209562+0000","last_undegraded":"2023-11-08T12:32:30.209562+0000","last_fullsized":"2023-11-08T12:32:30.209562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.911196+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:32:32.911196+0000","last_peered":"2023-11-08T12:32:32.911196+0000","last_clean":"2023-11-08T12:32:32.911196+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:32:32.911196+0000","last_undegraded":"2023-11-08T12:32:32.911196+0000","last_fullsized":"2023-11-08T12:32:32.911196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:33.431153+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:32:33.431153+0000","last_peered":"2023-11-08T12:32:33.431153+0000","last_clean":"2023-11-08T12:32:33.431153+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:32:33.431153+0000","last_undegraded":"2023-11-08T12:32:33.431153+0000","last_fullsized":"2023-11-08T12:32:33.431153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.911319+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:32:32.911319+0000","last_peered":"2023-11-08T12:32:32.911319+0000","last_clean":"2023-11-08T12:32:32.911319+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:32:32.911319+0000","last_undegraded":"2023-11-08T12:32:32.911319+0000","last_fullsized":"2023-11-08T12:32:32.911319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476798,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9816,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94362024,"statfs":{"total":96636764160,"available":96626712576,"internally_reserved":0,"allocated":868352,"data_stored":403906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.64700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.508,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.107},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.161,"15min":1.1140000000000001},"min":{"1min":0.72199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5509999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.69899999999999995}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.175,"15min":1.159},"min":{"1min":0.80300000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5289999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.1379999999999999,"15min":1.1180000000000001},"min":{"1min":0.76300000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5269999999999999,"5min":1.851,"15min":1.851},"last":0.90100000000000002}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.093,"15min":1.0669999999999999},"min":{"1min":0.77100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.266,"15min":1.268},"min":{"1min":0.86099999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.3859999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":1.004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.601,"5min":5.601,"15min":5.601},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5349999999999999,"5min":1.73,"15min":1.73},"last":0.86799999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2669999999999999,"15min":1.3129999999999999},"min":{"1min":0.87,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6579999999999999,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.298},{"interface":"front","average":{"1min":1.296,"5min":1.3200000000000001,"15min":1.3600000000000001},"min":{"1min":1.016,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6619999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0800000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2549999999999999,"15min":1.2809999999999999},"min":{"1min":0.82799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9039999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.377,"5min":1.427,"15min":1.4590000000000001},"min":{"1min":0.94499999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.857,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.345}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.429,"15min":1.4730000000000001},"min":{"1min":0.93000000000000005,"5min":0.752,"15min":0.752},"max":{"1min":1.633,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3899999999999999,"15min":1.4319999999999999},"min":{"1min":0.94099999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8200000000000001,"5min":2.121,"15min":2.121},"last":1.1519999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476798,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10080,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361760,"statfs":{"total":96636764160,"available":96626442240,"internally_reserved":0,"allocated":876544,"data_stored":410754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.01,"15min":0.999},"min":{"1min":0.66200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0820000000000001,"15min":1.0620000000000001},"min":{"1min":0.70599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.589,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.1259999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.165,"15min":1.1619999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1459999999999999,"15min":1.1890000000000001},"min":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.542,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.4099999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2,"15min":1.2150000000000001},"min":{"1min":0.83699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7230000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.7190000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1659999999999999,"15min":1.1859999999999999},"min":{"1min":0.72299999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.129,"15min":3.129},"last":1.514}]},{"osd":3,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.196,"15min":1.216},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2709999999999999,"15min":1.3089999999999999},"min":{"1min":0.91000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.548,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.5940000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.196,"15min":1.2809999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2150000000000001,"15min":1.2190000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6919999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.6299999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.347,"15min":1.3799999999999999},"min":{"1min":0.73999999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6459999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.294},{"interface":"front","average":{"1min":1.272,"5min":1.3640000000000001,"15min":1.4139999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7969999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.768}]},{"osd":7,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3700000000000001,"15min":1.405},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7849999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.405,"15min":1.4399999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.837,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.907}]}]},{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4770000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.147,"15min":1.167},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.482,"5min":1.7,"15min":1.7},"last":1.1160000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.03,"15min":1.044},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.091,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.585,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.84799999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.121,"15min":1.121},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.002}]},{"osd":3,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.415,"5min":1.984,"15min":1.984},"last":1.079},{"interface":"front","average":{"1min":1.222,"5min":1.244,"15min":1.26},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5860000000000001,"5min":2.137,"15min":2.137},"last":1.1950000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.218,"15min":1.2749999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.4770000000000001,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.401},{"interface":"front","average":{"1min":1.113,"5min":1.1950000000000001,"15min":1.2370000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6719999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.5009999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2649999999999999,"15min":1.2789999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7430000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.222,"15min":1.258},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.347,"15min":1.361},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":1.956,"15min":1.956},"last":1.29},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.4099999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.786,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.2609999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9916,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361924,"statfs":{"total":96636764160,"available":96626610176,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.5680000000000001,"15min":2},"min":{"1min":1.0149999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6160000000000001,"5min":20.099,"15min":20.099},"last":1.016},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.6000000000000001,"15min":2.0670000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5469999999999999,"5min":21.238,"15min":21.238},"last":1.218}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.139,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.512,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2949999999999999,"15min":1.5049999999999999},"min":{"1min":0.74399999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4470000000000001,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.1919999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.45,"15min":1.6950000000000001},"min":{"1min":1.091,"5min":0.745,"15min":0.745},"max":{"1min":1.6519999999999999,"5min":11.843,"15min":11.843},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4830000000000001,"15min":1.7370000000000001},"min":{"1min":0.79300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.754,"5min":11.907,"15min":11.907},"last":1.073}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.274,"15min":1.387},"min":{"1min":0.98299999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.5249999999999999,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.4770000000000001},"min":{"1min":0.84599999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.8500000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.1299999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.21,"15min":1.214},"min":{"1min":0.85399999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.6519999999999999,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.264,"15min":1.286},"min":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.571,"5min":2.073,"15min":2.073},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.242,"15min":1.296},"min":{"1min":0.71799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.631,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3660000000000001,"15min":1.3839999999999999},"min":{"1min":1.097,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.661,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.96699999999999997}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.5329999999999999,"15min":1.754},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6799999999999999,"5min":8.109,"15min":8.109},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.45,"5min":1.5389999999999999,"15min":1.657},"min":{"1min":1.2150000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.1240000000000001,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.91300000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361668,"statfs":{"total":96636764160,"available":96626348032,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88600000000000001,"15min":0.96799999999999997},"min":{"1min":0.60499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.113,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93300000000000005,"15min":0.97599999999999998},"min":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.349,"5min":1.53,"15min":1.53},"last":1.341}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.155,"5min":1.51,"15min":1.51},"last":0.745},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.004,"15min":1.0900000000000001},"min":{"1min":0.64100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.502,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.5509999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0980000000000001,"15min":1.2050000000000001},"min":{"1min":0.61199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.365,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.206},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.294,"5min":1.972,"15min":1.972},"last":1.089}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1859999999999999,"15min":1.24},"min":{"1min":0.80500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.359,"5min":1.837,"15min":1.837},"last":1.46},{"interface":"front","average":{"1min":1.228,"5min":1.2829999999999999,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6799999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.6819999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.244,"15min":1.294},"min":{"1min":0.84999999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.46,"5min":1.897,"15min":1.897},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.359,"15min":1.4590000000000001},"min":{"1min":0.89700000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.599,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.74}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2829999999999999,"15min":1.335},"min":{"1min":0.86599999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.653,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.595},{"interface":"front","average":{"1min":1.222,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.94899999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4390000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.397}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.389,"15min":1.45},"min":{"1min":0.98999999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.7210000000000001,"5min":2.194,"15min":2.194},"last":1.762},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.419,"15min":1.488},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.512,"5min":2.472,"15min":2.472},"last":1.3129999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9964,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361876,"statfs":{"total":96636764160,"available":96626561024,"internally_reserved":0,"allocated":888832,"data_stored":417476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.95999999999999996,"15min":0.98699999999999999},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":5.0190000000000001,"5min":5.0190000000000001,"15min":5.0190000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98499999999999999,"15min":1.0289999999999999},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.26,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.753},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0960000000000001,"15min":1.1299999999999999},"min":{"1min":0.68999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0960000000000001,"15min":1.1180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.546,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":1.0800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.57999999999999996}]},{"osd":4,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.242,"15min":1.272},"min":{"1min":0.88400000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.23,"5min":1.2889999999999999,"15min":1.3240000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.573,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.77800000000000002}]},{"osd":5,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3620000000000001,"15min":1.4059999999999999},"min":{"1min":0.97299999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.8730000000000002,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.345,"15min":1.4410000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7190000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3380000000000001,"15min":1.3680000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.3660000000000001,"15min":1.403},"min":{"1min":1.077,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.476,"15min":1.5249999999999999},"min":{"1min":1.0349999999999999,"5min":0.874,"15min":0.874},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.3799999999999999,"15min":1.456},"min":{"1min":1.0600000000000001,"5min":0.996,"15min":0.996},"max":{"1min":1.5680000000000001,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":0.81599999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509503,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":1.0940000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4099999999999999,"5min":6.54,"15min":6.54},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98799999999999999,"15min":1.1120000000000001},"min":{"1min":0.66100000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.339,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.58099999999999996}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.014},"min":{"1min":0.63900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.3700000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0229999999999999,"15min":1.0589999999999999},"min":{"1min":0.66700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":3.069,"15min":3.069},"last":0.74099999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.0840000000000001},"min":{"1min":0.60399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.4530000000000001,"5min":2.673,"15min":2.673},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2090000000000001,"15min":1.361},"min":{"1min":0.72099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4870000000000001,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":0.78400000000000003}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":1.034,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.7290000000000001,"5min":2.927,"15min":2.927},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.3280000000000001,"15min":1.4039999999999999},"min":{"1min":0.97799999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6339999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":0.83199999999999996}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3109999999999999,"15min":1.399},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.802,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.401,"15min":1.5269999999999999},"min":{"1min":1.0860000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.5169999999999999,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":0.94899999999999995}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4419999999999999,"15min":1.5660000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.615,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":1.0469999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.597,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.032}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4239999999999999,"15min":1.5169999999999999},"min":{"1min":1.2649999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.6779999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.407,"5min":1.4350000000000001,"15min":1.5589999999999999},"min":{"1min":1.115,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.875,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.70199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542206,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9900,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361940,"statfs":{"total":96636764160,"available":96626626560,"internally_reserved":0,"allocated":888832,"data_stored":417476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.341,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84799999999999998,"15min":0.872},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.089,"15min":1.123},"min":{"1min":0.77900000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.534,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.4750000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94099999999999995,"15min":0.96699999999999997},"min":{"1min":0.58599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1779999999999999,"5min":1.837,"15min":1.837},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.0700000000000001,"15min":1.1180000000000001},"min":{"1min":0.79600000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.708,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.98299999999999998}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.83399999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.619,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.446},{"interface":"front","average":{"1min":1.284,"5min":1.2989999999999999,"15min":1.367},"min":{"1min":0.92100000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.1160000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.323,"15min":1.3859999999999999},"min":{"1min":1.0089999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.7909999999999999,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.262,"15min":1.3200000000000001},"min":{"1min":0.92100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.524,"5min":3.052,"15min":3.052},"last":1.3480000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.3740000000000001},"min":{"1min":0.96699999999999997,"5min":0.753,"15min":0.753},"max":{"1min":2.0110000000000001,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.159},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.353,"15min":1.409},"min":{"1min":1.0469999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8620000000000001,"5min":2.254,"15min":2.254},"last":1.077}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":1.0149999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.752,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.226},{"interface":"front","average":{"1min":1.468,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":1.1970000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.948,"5min":3.5,"15min":3.5},"last":1.2909999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:32:37.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T12:32:37.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.682+0000 7fb64359e700 1 Processor -- start 2023-11-08T12:32:37.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.682+0000 7fb64359e700 1 -- start start 2023-11-08T12:32:37.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644070080 0x7fb6440704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb644164250 0x7fb6441646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440ad6c0 con 0x7fb644160710 2023-11-08T12:32:37.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64406b1c0 con 0x7fb644164250 2023-11-08T12:32:37.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440adc60 con 0x7fb644070080 2023-11-08T12:32:37.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb642d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb644164250 0x7fb6441646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb644160710 0x7fb6440cc320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:37522/0 (socket says 172.21.15.112:37522) 2023-11-08T12:32:37.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64259c700 1 -- 172.21.15.112:0/123801631 learned_addr learned my addr 172.21.15.112:0/123801631 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:37.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb642d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb644164250 0x7fb6441646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:37534/0 (socket says 172.21.15.112:37534) 2023-11-08T12:32:37.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb641d9b700 1 --2- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644070080 0x7fb6440704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64159a700 1 -- 172.21.15.112:0/123801631 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214648833 0 0) 0x7fb6440ad6c0 con 0x7fb644160710 2023-11-08T12:32:37.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64159a700 1 -- 172.21.15.112:0/123801631 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb62c0035d0 con 0x7fb644160710 2023-11-08T12:32:37.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb642d9d700 1 -- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644070080 msgr2=0x7fb6440704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:37.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb642d9d700 1 --2- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644070080 0x7fb6440704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb642d9d700 1 -- 172.21.15.112:0/123801631 >> v1:172.21.15.133:6789/0 conn(0x7fb644160710 legacy=0x7fb6440cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb642d9d700 1 -- 172.21.15.112:0/123801631 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440709f0 con 0x7fb644164250 2023-11-08T12:32:37.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb642d9d700 1 --2- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644164250 0x7fb6441646d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12c8060548e6e302 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:37.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.686+0000 7fb64159a700 1 -- 172.21.15.112:0/123801631 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00e070 con 0x7fb644164250 2023-11-08T12:32:37.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64159a700 1 -- 172.21.15.112:0/123801631 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00bb20 con 0x7fb644164250 2023-11-08T12:32:37.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64159a700 1 -- 172.21.15.112:0/123801631 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c012430 con 0x7fb644164250 2023-11-08T12:32:37.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 -- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644164250 msgr2=0x7fb6441646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 --2- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644164250 0x7fb6441646d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c00b330 comp rx=0 tx=0).stop 2023-11-08T12:32:37.698 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 -- 172.21.15.112:0/123801631 shutdown_connections 2023-11-08T12:32:37.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 --2- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644164250 0x7fb6441646d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 --2- 172.21.15.112:0/123801631 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644070080 0x7fb6440704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 -- 172.21.15.112:0/123801631 >> 172.21.15.112:0/123801631 conn(0x7fb6440b0f80 msgr2=0x7fb6440ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:37.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 -- 172.21.15.112:0/123801631 shutdown_connections 2023-11-08T12:32:37.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 -- 172.21.15.112:0/123801631 wait complete. 2023-11-08T12:32:37.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 Processor -- start 2023-11-08T12:32:37.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.690+0000 7fb64359e700 1 -- start start 2023-11-08T12:32:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644070080 0x7fb644158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644160710 0x7fb6440b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb644164250 0x7fb6440adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644159240 con 0x7fb644164250 2023-11-08T12:32:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441f6310 con 0x7fb644070080 2023-11-08T12:32:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441f65f0 con 0x7fb644160710 2023-11-08T12:32:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb644164250 0x7fb6440adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb644164250 0x7fb6440adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51886/0 (socket says 172.21.15.112:51886) 2023-11-08T12:32:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 -- 172.21.15.112:0/3273667661 learned_addr learned my addr 172.21.15.112:0/3273667661 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64259c700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644070080 0x7fb644158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb641d9b700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644160710 0x7fb6440b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 -- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644160710 msgr2=0x7fb6440b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644160710 0x7fb6440b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 -- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644070080 msgr2=0x7fb644158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644070080 0x7fb644158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 -- 172.21.15.112:0/3273667661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c009a70 con 0x7fb644164250 2023-11-08T12:32:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb642d9d700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb644164250 0x7fb6440adf40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb63c014040 tx=0x7fb63c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb632ffd700 1 -- 172.21.15.112:0/3273667661 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c004800 con 0x7fb644164250 2023-11-08T12:32:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb632ffd700 1 -- 172.21.15.112:0/3273667661 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c020070 con 0x7fb644164250 2023-11-08T12:32:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64406b3d0 con 0x7fb644164250 2023-11-08T12:32:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb632ffd700 1 -- 172.21.15.112:0/3273667661 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0276c0 con 0x7fb644164250 2023-11-08T12:32:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.694+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440cca30 con 0x7fb644164250 2023-11-08T12:32:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.698+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64406b6b0 con 0x7fb644164250 2023-11-08T12:32:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.698+0000 7fb632ffd700 1 -- 172.21.15.112:0/3273667661 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb63c02e070 con 0x7fb644164250 2023-11-08T12:32:37.709 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.698+0000 7fb632ffd700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb624064ee0 0x7fb624067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.698+0000 7fb632ffd700 1 -- 172.21.15.112:0/3273667661 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb63c022070 con 0x7fb644164250 2023-11-08T12:32:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.698+0000 7fb64259c700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb624064ee0 0x7fb624067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.702+0000 7fb64259c700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb624064ee0 0x7fb624067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb634007fd0 tx=0x7fb634007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.706+0000 7fb632ffd700 1 -- 172.21.15.112:0/3273667661 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb63c051b50 con 0x7fb644164250 2023-11-08T12:32:37.889 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.882+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb644073cb0 con 0x7fb644164250 2023-11-08T12:32:37.890 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb632ffd700 1 -- 172.21.15.112:0/3273667661 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+14556 (secure 0 0 0) 0x7fb63c02c090 con 0x7fb644164250 2023-11-08T12:32:37.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:37.891 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":75,"fsid":"c14663df-4425-4498-9232-3ffa5f578bfa","created":"2023-11-08T12:27:27.949127+0000","modified":"2023-11-08T12:32:33.907984+0000","last_up_change":"2023-11-08T12:27:41.284190+0000","last_in_change":"2023-11-08T12:27:31.152866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-08T12:27:40.786766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T12:27:47.449416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b5f1ca-d17d-4619-be08-333a7272a603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6801","nonce":35551},{"type":"v1","addr":"172.21.15.112:6802","nonce":35551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":35551},{"type":"v1","addr":"172.21.15.112:6806","nonce":35551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":35551},{"type":"v1","addr":"172.21.15.112:6814","nonce":35551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":35551},{"type":"v1","addr":"172.21.15.112:6810","nonce":35551}]},"public_addr":"172.21.15.112:6802/35551","cluster_addr":"172.21.15.112:6806/35551","heartbeat_back_addr":"172.21.15.112:6814/35551","heartbeat_front_addr":"172.21.15.112:6810/35551","state":["exists","up"]},{"osd":1,"uuid":"ee741323-f98d-4f9f-9926-ca25115004a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":35553},{"type":"v1","addr":"172.21.15.112:6803","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6805","nonce":35553},{"type":"v1","addr":"172.21.15.112:6807","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6813","nonce":35553},{"type":"v1","addr":"172.21.15.112:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6809","nonce":35553},{"type":"v1","addr":"172.21.15.112:6811","nonce":35553}]},"public_addr":"172.21.15.112:6803/35553","cluster_addr":"172.21.15.112:6807/35553","heartbeat_back_addr":"172.21.15.112:6815/35553","heartbeat_front_addr":"172.21.15.112:6811/35553","state":["exists","up"]},{"osd":2,"uuid":"1c8b2a89-48f7-4390-81b1-c7940a234908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":35550},{"type":"v1","addr":"172.21.15.112:6817","nonce":35550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":35550},{"type":"v1","addr":"172.21.15.112:6819","nonce":35550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":35550},{"type":"v1","addr":"172.21.15.112:6823","nonce":35550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":35550},{"type":"v1","addr":"172.21.15.112:6821","nonce":35550}]},"public_addr":"172.21.15.112:6817/35550","cluster_addr":"172.21.15.112:6819/35550","heartbeat_back_addr":"172.21.15.112:6823/35550","heartbeat_front_addr":"172.21.15.112:6821/35550","state":["exists","up"]},{"osd":3,"uuid":"74b2e634-466f-43dc-a722-fea68bd0285a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":35552},{"type":"v1","addr":"172.21.15.112:6825","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":35552},{"type":"v1","addr":"172.21.15.112:6827","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":35552},{"type":"v1","addr":"172.21.15.112:6831","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":35552},{"type":"v1","addr":"172.21.15.112:6829","nonce":35552}]},"public_addr":"172.21.15.112:6825/35552","cluster_addr":"172.21.15.112:6827/35552","heartbeat_back_addr":"172.21.15.112:6831/35552","heartbeat_front_addr":"172.21.15.112:6829/35552","state":["exists","up"]},{"osd":4,"uuid":"7e052dbc-e322-44e4-b028-2dd0ebe88f84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":35801},{"type":"v1","addr":"172.21.15.133:6804","nonce":35801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":35801},{"type":"v1","addr":"172.21.15.133:6808","nonce":35801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":35801},{"type":"v1","addr":"172.21.15.133:6815","nonce":35801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":35801},{"type":"v1","addr":"172.21.15.133:6812","nonce":35801}]},"public_addr":"172.21.15.133:6804/35801","cluster_addr":"172.21.15.133:6808/35801","heartbeat_back_addr":"172.21.15.133:6815/35801","heartbeat_front_addr":"172.21.15.133:6812/35801","state":["exists","up"]},{"osd":5,"uuid":"d2a144b3-6132-4240-8160-483ff40c62e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":35800},{"type":"v1","addr":"172.21.15.133:6801","nonce":35800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6803","nonce":35800},{"type":"v1","addr":"172.21.15.133:6805","nonce":35800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6811","nonce":35800},{"type":"v1","addr":"172.21.15.133:6813","nonce":35800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6807","nonce":35800},{"type":"v1","addr":"172.21.15.133:6809","nonce":35800}]},"public_addr":"172.21.15.133:6801/35800","cluster_addr":"172.21.15.133:6805/35800","heartbeat_back_addr":"172.21.15.133:6813/35800","heartbeat_front_addr":"172.21.15.133:6809/35800","state":["exists","up"]},{"osd":6,"uuid":"ed1c99ab-1da7-49c1-9263-31bf27cc2909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":35802},{"type":"v1","addr":"172.21.15.133:6817","nonce":35802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":35802},{"type":"v1","addr":"172.21.15.133:6819","nonce":35802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":35802},{"type":"v1","addr":"172.21.15.133:6823","nonce":35802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":35802},{"type":"v1","addr":"172.21.15.133:6821","nonce":35802}]},"public_addr":"172.21.15.133:6817/35802","cluster_addr":"172.21.15.133:6819/35802","heartbeat_back_addr":"172.21.15.133:6823/35802","heartbeat_front_addr":"172.21.15.133:6821/35802","state":["exists","up"]},{"osd":7,"uuid":"038526bd-caad-4bb8-b409-9afc4704c9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":35803},{"type":"v1","addr":"172.21.15.133:6825","nonce":35803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":35803},{"type":"v1","addr":"172.21.15.133:6827","nonce":35803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":35803},{"type":"v1","addr":"172.21.15.133:6831","nonce":35803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":35803},{"type":"v1","addr":"172.21.15.133:6829","nonce":35803}]},"public_addr":"172.21.15.133:6825/35803","cluster_addr":"172.21.15.133:6827/35803","heartbeat_back_addr":"172.21.15.133:6831/35803","heartbeat_front_addr":"172.21.15.133:6829/35803","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.899123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.901229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.568157+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.912891+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.907217+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.247643+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:37.189633+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T12:27:36.925277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2843990803":"2023-11-09T12:32:30.199103+0000","172.21.15.112:6836/2843990803":"2023-11-09T12:32:30.199103+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T12:32:37.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb624064ee0 msgr2=0x7fb624067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.893 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb624064ee0 0x7fb624067390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb634007fd0 tx=0x7fb634007de0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb644164250 msgr2=0x7fb6440adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:37.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb644164250 0x7fb6440adf40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb63c014040 tx=0x7fb63c004af0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 shutdown_connections 2023-11-08T12:32:37.894 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb624064ee0 0x7fb624067390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb644164250 0x7fb6440adf40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb644160710 0x7fb6440b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.895 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 --2- 172.21.15.112:0/3273667661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb644070080 0x7fb644158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:37.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 >> 172.21.15.112:0/3273667661 conn(0x7fb6440b0f80 msgr2=0x7fb64415aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:37.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.886+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 shutdown_connections 2023-11-08T12:32:37.896 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:37.890+0000 7fb64359e700 1 -- 172.21.15.112:0/3273667661 wait complete. 2023-11-08T12:32:38.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:32:38.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:32:38.914 INFO:tasks.ceph:Scrubbing osd.0 2023-11-08T12:32:38.915 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f79318ee700 1 Processor -- start 2023-11-08T12:32:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f79318ee700 1 -- start start 2023-11-08T12:32:39.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f79318ee700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f79318ee700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c06c2a0 con 0x7f792c06d210 2023-11-08T12:32:39.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f79318ee700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c15a630 con 0x7f792c159e10 2023-11-08T12:32:39.104 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f79318ee700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c06b320 con 0x7f792c15a1e0 2023-11-08T12:32:39.105 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f792a7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f792b7fe700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f792c06d210 0x7f792c0cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51736/0 (socket says 172.21.15.112:51736) 2023-11-08T12:32:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.098+0000 7f792b7fe700 1 -- 172.21.15.112:0/3406568325 learned_addr learned my addr 172.21.15.112:0/3406568325 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:39.106 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f792a7fc700 1 -- 172.21.15.112:0/3406568325 >> v1:172.21.15.133:6789/0 conn(0x7f792c159e10 legacy=0x7f792c06a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f792a7fc700 1 -- 172.21.15.112:0/3406568325 >> v1:172.21.15.112:6789/0 conn(0x7f792c06d210 legacy=0x7f792c0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f792a7fc700 1 -- 172.21.15.112:0/3406568325 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c06d690 con 0x7f792c15a1e0 2023-11-08T12:32:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f7929ffb700 1 -- 172.21.15.112:0/3406568325 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033343363 0 0) 0x7f792c06c2a0 con 0x7f792c06d210 2023-11-08T12:32:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f792a7fc700 1 --2- 172.21.15.112:0/3406568325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c06ccd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7920009880 tx=0x7f7920009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c8149fae6534d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f7929ffb700 1 -- 172.21.15.112:0/3406568325 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920011830 con 0x7f792c15a1e0 2023-11-08T12:32:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f7929ffb700 1 -- 172.21.15.112:0/3406568325 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7920011990 con 0x7f792c15a1e0 2023-11-08T12:32:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f7929ffb700 1 -- 172.21.15.112:0/3406568325 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920011d20 con 0x7f792c15a1e0 2023-11-08T12:32:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f79318ee700 1 -- 172.21.15.112:0/3406568325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 msgr2=0x7f792c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f79318ee700 1 --2- 172.21.15.112:0/3406568325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c06ccd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7920009880 tx=0x7f7920009b90 comp rx=0 tx=0).stop 2023-11-08T12:32:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f79318ee700 1 -- 172.21.15.112:0/3406568325 shutdown_connections 2023-11-08T12:32:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f79318ee700 1 --2- 172.21.15.112:0/3406568325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c06ccd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f79318ee700 1 -- 172.21.15.112:0/3406568325 >> 172.21.15.112:0/3406568325 conn(0x7f792c0ce5b0 msgr2=0x7f792c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f79318ee700 1 -- 172.21.15.112:0/3406568325 shutdown_connections 2023-11-08T12:32:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.102+0000 7f79318ee700 1 -- 172.21.15.112:0/3406568325 wait complete. 2023-11-08T12:32:39.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 Processor -- start 2023-11-08T12:32:39.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 -- start start 2023-11-08T12:32:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f792c06d210 0x7f792c1f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f792c159e10 0x7f792c0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c0c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c6330 con 0x7f792c159e10 2023-11-08T12:32:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c5720 con 0x7f792c06d210 2023-11-08T12:32:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.106+0000 7f79318ee700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c5a00 con 0x7f792c15a1e0 2023-11-08T12:32:39.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f792c159e10 0x7f792c0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f792c159e10 0x7f792c0c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51900/0 (socket says 172.21.15.112:51900) 2023-11-08T12:32:39.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 -- 172.21.15.112:0/504586594 learned_addr learned my addr 172.21.15.112:0/504586594 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:39.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792affd700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f792c06d210 0x7f792c1f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792b7fe700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c0c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 -- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 msgr2=0x7f792c0c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c0c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 -- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f792c06d210 msgr2=0x7f792c1f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f792c06d210 0x7f792c1f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.118 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 -- 172.21.15.112:0/504586594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200094b0 con 0x7f792c159e10 2023-11-08T12:32:39.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792affd700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f792c06d210 0x7f792c1f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:39.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792b7fe700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f792c15a1e0 0x7f792c0c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:39.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f792a7fc700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f792c159e10 0x7f792c0c48f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7920014040 tx=0x7f7920004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.119 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000bc10 con 0x7f792c159e10 2023-11-08T12:32:39.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792001e070 con 0x7f792c159e10 2023-11-08T12:32:39.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c06ad60 con 0x7f792c159e10 2023-11-08T12:32:39.120 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792001a420 con 0x7f792c159e10 2023-11-08T12:32:39.121 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c15df90 con 0x7f792c159e10 2023-11-08T12:32:39.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.110+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f792c06b040 con 0x7f792c159e10 2023-11-08T12:32:39.122 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f792000f050 con 0x7f792c159e10 2023-11-08T12:32:39.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f7913fff700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7918064ee0 0x7f7918067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7920082f70 con 0x7f792c159e10 2023-11-08T12:32:39.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f7913fff700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f791806b7f0 0x7f791806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.123 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 --> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f791806e2f0 con 0x7f791806b7f0 2023-11-08T12:32:39.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79200855c0 con 0x7f792c159e10 2023-11-08T12:32:39.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f792affd700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7918064ee0 0x7f7918067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.124 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f792b7fe700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f791806b7f0 0x7f791806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.114+0000 7f792affd700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7918064ee0 0x7f7918067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f791c000fb0 tx=0x7f791c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.118+0000 7f792b7fe700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f791806b7f0 0x7f791806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.125 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.118+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== osd.0 v2:172.21.15.112:6801/35551 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f791806e2f0 con 0x7f791806b7f0 2023-11-08T12:32:39.138 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 --> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f792c0c64e0 con 0x7f791806b7f0 2023-11-08T12:32:39.139 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f7913fff700 1 -- 172.21.15.112:0/504586594 <== osd.0 v2:172.21.15.112:6801/35551 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f792c0c64e0 con 0x7f791806b7f0 2023-11-08T12:32:39.140 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:39.140 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:39.140 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:39.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f791806b7f0 msgr2=0x7f791806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6801/35551,v1:172.21.15.112:6802/35551] conn(0x7f791806b7f0 0x7f791806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7918064ee0 msgr2=0x7f7918067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7918064ee0 0x7f7918067390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f791c000fb0 tx=0x7f791c009040 comp rx=0 tx=0).stop 2023-11-08T12:32:39.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f792c159e10 msgr2=0x7f792c0c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 --2- 172.21.15.112:0/504586594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f792c159e10 0x7f792c0c48f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7920014040 tx=0x7f7920004770 comp rx=0 tx=0).stop 2023-11-08T12:32:39.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f792b7fe700 1 -- 172.21.15.112:0/504586594 reap_dead start 2023-11-08T12:32:39.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 shutdown_connections 2023-11-08T12:32:39.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 >> 172.21.15.112:0/504586594 conn(0x7f792c0ce5b0 msgr2=0x7f792c0c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:39.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 shutdown_connections 2023-11-08T12:32:39.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.134+0000 7f79318ee700 1 -- 172.21.15.112:0/504586594 wait complete. 2023-11-08T12:32:39.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-08T12:32:39.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.334+0000 7f7feb59e700 1 Processor -- start 2023-11-08T12:32:39.340 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.334+0000 7f7feb59e700 1 -- start start 2023-11-08T12:32:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7feb59e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fec0b43a0 0x7f7fec15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7feb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec070790 0x7f7fec06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7feb59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fec15a550 con 0x7f7fec0b1640 2023-11-08T12:32:39.342 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7feb59e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec06b0a0 con 0x7f7fec0b43a0 2023-11-08T12:32:39.343 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7feb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec0caac0 con 0x7f7fec070790 2023-11-08T12:32:39.344 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fea59c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fec0b43a0 0x7f7fec15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fe9d9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7fec0b1640 0x7f7fec070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51738/0 (socket says 172.21.15.112:51738) 2023-11-08T12:32:39.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fe9d9b700 1 -- 172.21.15.112:0/1098155021 learned_addr learned my addr 172.21.15.112:0/1098155021 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:39.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fead9d700 1 --2- 172.21.15.112:0/1098155021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec070790 0x7f7fec06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.345 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fe959a700 1 -- 172.21.15.112:0/1098155021 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004438277 0 0) 0x7f7fe0001110 con 0x7f7fec0b1640 2023-11-08T12:32:39.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fe959a700 1 -- 172.21.15.112:0/1098155021 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd40035d0 con 0x7f7fec0b1640 2023-11-08T12:32:39.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fead9d700 1 -- 172.21.15.112:0/1098155021 >> v2:172.21.15.112:3300/0 conn(0x7f7fec0b43a0 msgr2=0x7f7fec15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:39.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fead9d700 1 --2- 172.21.15.112:0/1098155021 >> v2:172.21.15.112:3300/0 conn(0x7f7fec0b43a0 0x7f7fec15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fead9d700 1 -- 172.21.15.112:0/1098155021 >> v1:172.21.15.112:6789/0 conn(0x7f7fec0b1640 legacy=0x7f7fec070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fead9d700 1 -- 172.21.15.112:0/1098155021 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec0cada0 con 0x7f7fec070790 2023-11-08T12:32:39.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fead9d700 1 --2- 172.21.15.112:0/1098155021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec070790 0x7f7fec06bfd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb17e8a470f8cddd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fe959a700 1 -- 172.21.15.112:0/1098155021 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400e070 con 0x7f7fec070790 2023-11-08T12:32:39.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fe959a700 1 -- 172.21.15.112:0/1098155021 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400bb20 con 0x7f7fec070790 2023-11-08T12:32:39.348 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.338+0000 7f7fe959a700 1 -- 172.21.15.112:0/1098155021 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4012430 con 0x7f7fec070790 2023-11-08T12:32:39.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 -- 172.21.15.112:0/1098155021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec070790 msgr2=0x7f7fec06bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1098155021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec070790 0x7f7fec06bfd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).stop 2023-11-08T12:32:39.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 -- 172.21.15.112:0/1098155021 shutdown_connections 2023-11-08T12:32:39.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1098155021 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec070790 0x7f7fec06bfd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1098155021 >> v2:172.21.15.112:3300/0 conn(0x7f7fec0b43a0 0x7f7fec15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 -- 172.21.15.112:0/1098155021 >> 172.21.15.112:0/1098155021 conn(0x7f7fec0b0f80 msgr2=0x7f7fec0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:39.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 -- 172.21.15.112:0/1098155021 shutdown_connections 2023-11-08T12:32:39.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 -- 172.21.15.112:0/1098155021 wait complete. 2023-11-08T12:32:39.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.342+0000 7f7feb59e700 1 Processor -- start 2023-11-08T12:32:39.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7feb59e700 1 -- start start 2023-11-08T12:32:39.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7feb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fec070790 0x7f7fec15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7feb59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fec0b1640 0x7f7fec0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.354 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7feb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec0b43a0 0x7f7fec0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7feb59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec15d1a0 con 0x7f7fec0b1640 2023-11-08T12:32:39.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7feb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec1467f0 con 0x7f7fec070790 2023-11-08T12:32:39.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7feb59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec146ad0 con 0x7f7fec0b43a0 2023-11-08T12:32:39.355 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fec0b1640 0x7f7fec0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fec0b1640 0x7f7fec0c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51904/0 (socket says 172.21.15.112:51904) 2023-11-08T12:32:39.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 -- 172.21.15.112:0/1947220628 learned_addr learned my addr 172.21.15.112:0/1947220628 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:39.356 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fea59c700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fec070790 0x7f7fec15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fead9d700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec0b43a0 0x7f7fec0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 -- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec0b43a0 msgr2=0x7f7fec0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec0b43a0 0x7f7fec0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.357 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 -- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fec070790 msgr2=0x7f7fec15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fec070790 0x7f7fec15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 -- 172.21.15.112:0/1947220628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009a70 con 0x7f7fec0b1640 2023-11-08T12:32:39.358 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.346+0000 7f7fe9d9b700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fec0b1640 0x7f7fec0c6e70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0001270 tx=0x7f7fe000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.350+0000 7f7fdaffd700 1 -- 172.21.15.112:0/1947220628 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0005d90 con 0x7f7fec0b1640 2023-11-08T12:32:39.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.350+0000 7f7fdaffd700 1 -- 172.21.15.112:0/1947220628 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe00070d0 con 0x7f7fec0b1640 2023-11-08T12:32:39.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.350+0000 7f7fdaffd700 1 -- 172.21.15.112:0/1947220628 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0007480 con 0x7f7fec0b1640 2023-11-08T12:32:39.359 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.350+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec06b5d0 con 0x7f7fec0b1640 2023-11-08T12:32:39.360 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.350+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec06b2f0 con 0x7f7fec0b1640 2023-11-08T12:32:39.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.350+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec15eb10 con 0x7f7fec0b1640 2023-11-08T12:32:39.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.350+0000 7f7fdaffd700 1 -- 172.21.15.112:0/1947220628 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7fe0019030 con 0x7f7fec0b1640 2023-11-08T12:32:39.361 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.354+0000 7f7fdaffd700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7fcc064ee0 0x7f7fcc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.354+0000 7f7fdaffd700 1 -- 172.21.15.112:0/1947220628 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7fe0080f20 con 0x7f7fec0b1640 2023-11-08T12:32:39.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.354+0000 7f7fea59c700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7fcc064ee0 0x7f7fcc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.362 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.354+0000 7f7fea59c700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7fcc064ee0 0x7f7fcc067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009b50 tx=0x7f7fdc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.366 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.362+0000 7f7fdaffd700 1 -- 172.21.15.112:0/1947220628 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f7fe004f1b0 con 0x7f7fec0b1640 2023-11-08T12:32:39.538 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fec15a550 con 0x7f7fcc064ee0 2023-11-08T12:32:39.539 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7fdaffd700 1 -- 172.21.15.112:0/1947220628 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7fec15a550 con 0x7f7fcc064ee0 2023-11-08T12:32:39.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7fcc064ee0 msgr2=0x7f7fcc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.541 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7fcc064ee0 0x7f7fcc067390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009b50 tx=0x7f7fdc009240 comp rx=0 tx=0).stop 2023-11-08T12:32:39.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fec0b1640 msgr2=0x7f7fec0c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fec0b1640 0x7f7fec0c6e70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0001270 tx=0x7f7fe000c9e0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 shutdown_connections 2023-11-08T12:32:39.542 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7fcc064ee0 0x7f7fcc067390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fec0b43a0 0x7f7fec0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fec0b1640 0x7f7fec0c6e70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.543 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 --2- 172.21.15.112:0/1947220628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fec070790 0x7f7fec15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.534+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 >> 172.21.15.112:0/1947220628 conn(0x7f7fec0b0f80 msgr2=0x7f7fec0ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:39.544 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.538+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 shutdown_connections 2023-11-08T12:32:39.545 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.538+0000 7f7feb59e700 1 -- 172.21.15.112:0/1947220628 wait complete. 2023-11-08T12:32:39.545 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2023-11-08T12:32:39.561 INFO:tasks.ceph:Scrubbing osd.1 2023-11-08T12:32:39.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:39.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.730+0000 7f09a359e700 1 Processor -- start 2023-11-08T12:32:39.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.730+0000 7f09a359e700 1 -- start start 2023-11-08T12:32:39.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a359e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09a415c310 0x7f09a4069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a406ad80 0x7f09a406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a40cd2f0 con 0x7f09a406a1e0 2023-11-08T12:32:39.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a359e700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a40cd5d0 con 0x7f09a415c310 2023-11-08T12:32:39.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40cd8b0 con 0x7f09a406ad80 2023-11-08T12:32:39.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09a415c310 0x7f09a4069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09a415c310 0x7f09a4069ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51920/0 (socket says 172.21.15.112:51920) 2023-11-08T12:32:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 -- 172.21.15.112:0/2582529215 learned_addr learned my addr 172.21.15.112:0/2582529215 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a2d9d700 1 --2- 172.21.15.112:0/2582529215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a406ad80 0x7f09a406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 -- 172.21.15.112:0/2582529215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a406ad80 msgr2=0x7f09a406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:39.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 --2- 172.21.15.112:0/2582529215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a406ad80 0x7f09a406c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 -- 172.21.15.112:0/2582529215 >> v1:172.21.15.112:6789/0 conn(0x7f09a406a1e0 legacy=0x7f09a406a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 -- 172.21.15.112:0/2582529215 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a406bb10 con 0x7f09a415c310 2023-11-08T12:32:39.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a1d9b700 1 -- 172.21.15.112:0/2582529215 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203823056 0 0) 0x7f09a40cd2f0 con 0x7f09a406a1e0 2023-11-08T12:32:39.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a259c700 1 --2- 172.21.15.112:0/2582529215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a415c310 0x7f09a4069ca0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0994009930 tx=0x7f0994009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14187ddb577c0a37 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.734+0000 7f09a1d9b700 1 -- 172.21.15.112:0/2582529215 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011830 con 0x7f09a415c310 2023-11-08T12:32:39.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a1d9b700 1 -- 172.21.15.112:0/2582529215 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994011990 con 0x7f09a415c310 2023-11-08T12:32:39.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a1d9b700 1 -- 172.21.15.112:0/2582529215 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011d40 con 0x7f09a415c310 2023-11-08T12:32:39.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 -- 172.21.15.112:0/2582529215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a415c310 msgr2=0x7f09a4069ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 --2- 172.21.15.112:0/2582529215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a415c310 0x7f09a4069ca0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0994009930 tx=0x7f0994009c40 comp rx=0 tx=0).stop 2023-11-08T12:32:39.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 -- 172.21.15.112:0/2582529215 shutdown_connections 2023-11-08T12:32:39.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 --2- 172.21.15.112:0/2582529215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a406ad80 0x7f09a406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 --2- 172.21.15.112:0/2582529215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a415c310 0x7f09a4069ca0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 -- 172.21.15.112:0/2582529215 >> 172.21.15.112:0/2582529215 conn(0x7f09a40ce5b0 msgr2=0x7f09a40ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:39.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 -- 172.21.15.112:0/2582529215 shutdown_connections 2023-11-08T12:32:39.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 -- 172.21.15.112:0/2582529215 wait complete. 2023-11-08T12:32:39.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 Processor -- start 2023-11-08T12:32:39.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.738+0000 7f09a359e700 1 -- start start 2023-11-08T12:32:39.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a406a1e0 0x7f09a415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a406ad80 0x7f09a40caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a415c310 0x7f09a41e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40c5680 con 0x7f09a406ad80 2023-11-08T12:32:39.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40c61c0 con 0x7f09a406a1e0 2023-11-08T12:32:39.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40c5890 con 0x7f09a415c310 2023-11-08T12:32:39.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a406ad80 0x7f09a40caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a406ad80 0x7f09a40caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51924/0 (socket says 172.21.15.112:51924) 2023-11-08T12:32:39.753 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 -- 172.21.15.112:0/143775317 learned_addr learned my addr 172.21.15.112:0/143775317 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:39.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a2d9d700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a415c310 0x7f09a41e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a259c700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a406a1e0 0x7f09a415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.754 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 -- 172.21.15.112:0/143775317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a415c310 msgr2=0x7f09a41e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f09a415c310 0x7f09a41e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 -- 172.21.15.112:0/143775317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a406a1e0 msgr2=0x7f09a415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a406a1e0 0x7f09a415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 -- 172.21.15.112:0/143775317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994009510 con 0x7f09a406ad80 2023-11-08T12:32:39.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a259c700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a406a1e0 0x7f09a415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:39.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f0999d9b700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a406ad80 0x7f09a40caeb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f098c0011e0 tx=0x7f098c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.756 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0054e0 con 0x7f09a406ad80 2023-11-08T12:32:39.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0036a0 con 0x7f09a406ad80 2023-11-08T12:32:39.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a415c6e0 con 0x7f09a406ad80 2023-11-08T12:32:39.757 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c003a50 con 0x7f09a406ad80 2023-11-08T12:32:39.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.742+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a406bdf0 con 0x7f09a406ad80 2023-11-08T12:32:39.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.746+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09a40ccf50 con 0x7f09a406ad80 2023-11-08T12:32:39.758 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.746+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f098c019030 con 0x7f09a406ad80 2023-11-08T12:32:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f099b7fe700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0984064f10 0x7f09840673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f098c081130 con 0x7f09a406ad80 2023-11-08T12:32:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f099b7fe700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f098406b820 0x7f098406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 --> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f098406e320 con 0x7f098406b820 2023-11-08T12:32:39.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f098c083710 con 0x7f09a406ad80 2023-11-08T12:32:39.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f09a259c700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0984064f10 0x7f09840673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.761 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f09a2d9d700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f098406b820 0x7f098406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:39.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f09a259c700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0984064f10 0x7f09840673c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0994014040 tx=0x7f0994008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f09a2d9d700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f098406b820 0x7f098406dc50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:39.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.750+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== osd.1 v2:172.21.15.112:6800/35553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f098406e320 con 0x7f098406b820 2023-11-08T12:32:39.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.770+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 --> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f09a406e260 con 0x7f098406b820 2023-11-08T12:32:39.776 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.770+0000 7f099b7fe700 1 -- 172.21.15.112:0/143775317 <== osd.1 v2:172.21.15.112:6800/35553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f09a406e260 con 0x7f098406b820 2023-11-08T12:32:39.777 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:39.778 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:39.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.770+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f098406b820 msgr2=0x7f098406dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.770+0000 7f09a359e700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6800/35553,v1:172.21.15.112:6803/35553] conn(0x7f098406b820 0x7f098406dc50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:39.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0984064f10 msgr2=0x7f09840673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f0984064f10 0x7f09840673c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0994014040 tx=0x7f0994008030 comp rx=0 tx=0).stop 2023-11-08T12:32:39.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a406ad80 msgr2=0x7f09a40caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:39.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 --2- 172.21.15.112:0/143775317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a406ad80 0x7f09a40caeb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f098c0011e0 tx=0x7f098c00ca30 comp rx=0 tx=0).stop 2023-11-08T12:32:39.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a2d9d700 1 -- 172.21.15.112:0/143775317 reap_dead start 2023-11-08T12:32:39.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 shutdown_connections 2023-11-08T12:32:39.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 >> 172.21.15.112:0/143775317 conn(0x7f09a40ce5b0 msgr2=0x7f09a40ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:39.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 shutdown_connections 2023-11-08T12:32:39.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.774+0000 7f09a359e700 1 -- 172.21.15.112:0/143775317 wait complete. 2023-11-08T12:32:39.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-08T12:32:39.995 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.990+0000 7fb911d69700 1 Processor -- start 2023-11-08T12:32:39.996 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.990+0000 7fb911d69700 1 -- start start 2023-11-08T12:32:39.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb911d69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c0b6200 0x7fb90c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:39.998 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb911d69700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c15d080 con 0x7fb90c15d510 2023-11-08T12:32:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb911d69700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c153870 con 0x7fb90c1534a0 2023-11-08T12:32:39.999 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb911d69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c15d970 con 0x7fb90c0b6200 2023-11-08T12:32:40.000 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90affd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb90c15d510 0x7fb90c0b5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51760/0 (socket says 172.21.15.112:51760) 2023-11-08T12:32:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90affd700 1 -- 172.21.15.112:0/2795248054 learned_addr learned my addr 172.21.15.112:0/2795248054 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90bfff700 1 --2- 172.21.15.112:0/2795248054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c0b6200 0x7fb90c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90a7fc700 1 -- 172.21.15.112:0/2795248054 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080054298 0 0) 0x7fb90c15d080 con 0x7fb90c15d510 2023-11-08T12:32:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90a7fc700 1 -- 172.21.15.112:0/2795248054 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f40035d0 con 0x7fb90c15d510 2023-11-08T12:32:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90bfff700 1 -- 172.21.15.112:0/2795248054 >> v1:172.21.15.133:6789/0 conn(0x7fb90c1534a0 legacy=0x7fb90c160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90bfff700 1 -- 172.21.15.112:0/2795248054 >> v1:172.21.15.112:6789/0 conn(0x7fb90c15d510 legacy=0x7fb90c0b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90bfff700 1 -- 172.21.15.112:0/2795248054 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0b53c0 con 0x7fb90c0b6200 2023-11-08T12:32:40.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90bfff700 1 --2- 172.21.15.112:0/2795248054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c0b6200 0x7fb90c070630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb904009dc0 tx=0x7fb90400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17a7761d881201a server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.003 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90a7fc700 1 -- 172.21.15.112:0/2795248054 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90400e070 con 0x7fb90c0b6200 2023-11-08T12:32:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90a7fc700 1 -- 172.21.15.112:0/2795248054 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90400bb20 con 0x7fb90c0b6200 2023-11-08T12:32:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.994+0000 7fb90a7fc700 1 -- 172.21.15.112:0/2795248054 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904012430 con 0x7fb90c0b6200 2023-11-08T12:32:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.998+0000 7fb911d69700 1 -- 172.21.15.112:0/2795248054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c0b6200 msgr2=0x7fb90c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.998+0000 7fb911d69700 1 --2- 172.21.15.112:0/2795248054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c0b6200 0x7fb90c070630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb904009dc0 tx=0x7fb90400b330 comp rx=0 tx=0).stop 2023-11-08T12:32:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.998+0000 7fb911d69700 1 -- 172.21.15.112:0/2795248054 shutdown_connections 2023-11-08T12:32:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.998+0000 7fb911d69700 1 --2- 172.21.15.112:0/2795248054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c0b6200 0x7fb90c070630 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.998+0000 7fb911d69700 1 -- 172.21.15.112:0/2795248054 >> 172.21.15.112:0/2795248054 conn(0x7fb90c06bfc0 msgr2=0x7fb90c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.998+0000 7fb911d69700 1 -- 172.21.15.112:0/2795248054 shutdown_connections 2023-11-08T12:32:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:39.998+0000 7fb911d69700 1 -- 172.21.15.112:0/2795248054 wait complete. 2023-11-08T12:32:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 Processor -- start 2023-11-08T12:32:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 -- start start 2023-11-08T12:32:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb90c0b6200 0x7fb90c1f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb90c1534a0 0x7fb90c1480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c15d510 0x7fb90c148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.010 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c15f3c0 con 0x7fb90c0b6200 2023-11-08T12:32:40.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c1460e0 con 0x7fb90c1534a0 2023-11-08T12:32:40.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb911d69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c1463c0 con 0x7fb90c15d510 2023-11-08T12:32:40.011 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb90b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb90c0b6200 0x7fb90c1f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb90b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb90c0b6200 0x7fb90c1f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51936/0 (socket says 172.21.15.112:51936) 2023-11-08T12:32:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb90b7fe700 1 -- 172.21.15.112:0/2475148190 learned_addr learned my addr 172.21.15.112:0/2475148190 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb90bfff700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c15d510 0x7fb90c148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.002+0000 7fb90affd700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb90c1534a0 0x7fb90c1480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb90b7fe700 1 -- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c15d510 msgr2=0x7fb90c148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb90b7fe700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c15d510 0x7fb90c148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb90b7fe700 1 -- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb90c1534a0 msgr2=0x7fb90c1480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb90b7fe700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb90c1534a0 0x7fb90c1480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.014 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb90b7fe700 1 -- 172.21.15.112:0/2475148190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904009a70 con 0x7fb90c0b6200 2023-11-08T12:32:40.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb90b7fe700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb90c0b6200 0x7fb90c1f5630 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00c500 tx=0x7fb8fc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb8f3fff700 1 -- 172.21.15.112:0/2475148190 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc0052d0 con 0x7fb90c0b6200 2023-11-08T12:32:40.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c15ca30 con 0x7fb90c0b6200 2023-11-08T12:32:40.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb8f3fff700 1 -- 172.21.15.112:0/2475148190 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc005430 con 0x7fb90c0b6200 2023-11-08T12:32:40.016 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c0b56a0 con 0x7fb90c0b6200 2023-11-08T12:32:40.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb8f3fff700 1 -- 172.21.15.112:0/2475148190 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc0055a0 con 0x7fb90c0b6200 2023-11-08T12:32:40.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.006+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c15cd10 con 0x7fb90c0b6200 2023-11-08T12:32:40.017 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.010+0000 7fb8f3fff700 1 -- 172.21.15.112:0/2475148190 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fb8fc019030 con 0x7fb90c0b6200 2023-11-08T12:32:40.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.014+0000 7fb8f3fff700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb8f8064ee0 0x7fb8f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.014+0000 7fb8f3fff700 1 -- 172.21.15.112:0/2475148190 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb8fc080ea0 con 0x7fb90c0b6200 2023-11-08T12:32:40.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.014+0000 7fb90affd700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb8f8064ee0 0x7fb8f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.014+0000 7fb90affd700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb8f8064ee0 0x7fb8f8067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb90c08b2a0 tx=0x7fb900007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.018+0000 7fb8f3fff700 1 -- 172.21.15.112:0/2475148190 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fb8fc04a400 con 0x7fb90c0b6200 2023-11-08T12:32:40.206 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.202+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb90c146250 con 0x7fb8f8064ee0 2023-11-08T12:32:40.207 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.202+0000 7fb8f3fff700 1 -- 172.21.15.112:0/2475148190 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb90c146250 con 0x7fb8f8064ee0 2023-11-08T12:32:40.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb8f8064ee0 msgr2=0x7fb8f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb8f8064ee0 0x7fb8f8067390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb90c08b2a0 tx=0x7fb900007de0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.211 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb90c0b6200 msgr2=0x7fb90c1f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.212 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb90c0b6200 0x7fb90c1f5630 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00c500 tx=0x7fb8fc00c810 comp rx=0 tx=0).stop 2023-11-08T12:32:40.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 shutdown_connections 2023-11-08T12:32:40.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fb8f8064ee0 0x7fb8f8067390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb90c15d510 0x7fb90c148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.213 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb90c1534a0 0x7fb90c1480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 --2- 172.21.15.112:0/2475148190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb90c0b6200 0x7fb90c1f5630 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 >> 172.21.15.112:0/2475148190 conn(0x7fb90c06bfc0 msgr2=0x7fb90c152700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:40.214 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 shutdown_connections 2023-11-08T12:32:40.215 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.206+0000 7fb911d69700 1 -- 172.21.15.112:0/2475148190 wait complete. 2023-11-08T12:32:40.215 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2023-11-08T12:32:40.233 INFO:tasks.ceph:Scrubbing osd.2 2023-11-08T12:32:40.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:40.419 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.414+0000 7f383c071700 1 Processor -- start 2023-11-08T12:32:40.420 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.414+0000 7f383c071700 1 -- start start 2023-11-08T12:32:40.424 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383c071700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38340cec30 0x7f383406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383c071700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3834145fb0 0x7f38340cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383c071700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38341601d0 con 0x7f38340cd9d0 2023-11-08T12:32:40.425 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383c071700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383415cb90 con 0x7f3834145fb0 2023-11-08T12:32:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383c071700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3834160420 con 0x7f38340cec30 2023-11-08T12:32:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3834145fb0 0x7f38340cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3834145fb0 0x7f38340cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51950/0 (socket says 172.21.15.112:51950) 2023-11-08T12:32:40.426 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f3839e0d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f38340cd9d0 0x7f38340ce520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51764/0 (socket says 172.21.15.112:51764) 2023-11-08T12:32:40.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 -- 172.21.15.112:0/3650369046 learned_addr learned my addr 172.21.15.112:0/3650369046 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:40.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383960c700 1 --2- 172.21.15.112:0/3650369046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38340cec30 0x7f383406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.427 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 -- 172.21.15.112:0/3650369046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38340cec30 msgr2=0x7f383406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:40.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 --2- 172.21.15.112:0/3650369046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38340cec30 0x7f383406a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 -- 172.21.15.112:0/3650369046 >> v1:172.21.15.112:6789/0 conn(0x7f38340cd9d0 legacy=0x7f38340ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.428 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 -- 172.21.15.112:0/3650369046 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834160700 con 0x7f3834145fb0 2023-11-08T12:32:40.429 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f3838e0b700 1 -- 172.21.15.112:0/3650369046 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849267552 0 0) 0x7f38341601d0 con 0x7f38340cd9d0 2023-11-08T12:32:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f383a60e700 1 --2- 172.21.15.112:0/3650369046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3834145fb0 0x7f38340cb1a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f382c009e50 tx=0x7f382c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce10134dca8c72f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.430 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f3838e0b700 1 -- 172.21.15.112:0/3650369046 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c00e070 con 0x7f3834145fb0 2023-11-08T12:32:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f3838e0b700 1 -- 172.21.15.112:0/3650369046 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c00b9c0 con 0x7f3834145fb0 2023-11-08T12:32:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.418+0000 7f3838e0b700 1 -- 172.21.15.112:0/3650369046 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c00bd70 con 0x7f3834145fb0 2023-11-08T12:32:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 -- 172.21.15.112:0/3650369046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3834145fb0 msgr2=0x7f38340cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 --2- 172.21.15.112:0/3650369046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3834145fb0 0x7f38340cb1a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f382c009e50 tx=0x7f382c00b330 comp rx=0 tx=0).stop 2023-11-08T12:32:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 -- 172.21.15.112:0/3650369046 shutdown_connections 2023-11-08T12:32:40.432 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 --2- 172.21.15.112:0/3650369046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3834145fb0 0x7f38340cb1a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 --2- 172.21.15.112:0/3650369046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38340cec30 0x7f383406a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 -- 172.21.15.112:0/3650369046 >> 172.21.15.112:0/3650369046 conn(0x7f383406f1e0 msgr2=0x7f3834069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:40.433 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 -- 172.21.15.112:0/3650369046 shutdown_connections 2023-11-08T12:32:40.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.422+0000 7f383c071700 1 -- 172.21.15.112:0/3650369046 wait complete. 2023-11-08T12:32:40.434 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 Processor -- start 2023-11-08T12:32:40.435 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 -- start start 2023-11-08T12:32:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38340cd9d0 0x7f38340b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38340cec30 0x7f383415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3834145fb0 0x7f383415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.437 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38340b2270 con 0x7f38340cd9d0 2023-11-08T12:32:40.438 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38340b2550 con 0x7f38340cec30 2023-11-08T12:32:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383c071700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38340b2830 con 0x7f3834145fb0 2023-11-08T12:32:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38340cd9d0 0x7f38340b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.439 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38340cd9d0 0x7f38340b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51964/0 (socket says 172.21.15.112:51964) 2023-11-08T12:32:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 -- 172.21.15.112:0/2386251147 learned_addr learned my addr 172.21.15.112:0/2386251147 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:40.440 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383960c700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38340cec30 0x7f383415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.441 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f383a60e700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3834145fb0 0x7f383415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 -- 172.21.15.112:0/2386251147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3834145fb0 msgr2=0x7f383415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3834145fb0 0x7f383415c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.442 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 -- 172.21.15.112:0/2386251147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38340cec30 msgr2=0x7f383415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38340cec30 0x7f383415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 -- 172.21.15.112:0/2386251147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c009b30 con 0x7f38340cd9d0 2023-11-08T12:32:40.443 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f3839e0d700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38340cd9d0 0x7f38340b5100 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f383000c4e0 tx=0x7f383000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.426+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830004ca0 con 0x7f38340cd9d0 2023-11-08T12:32:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.430+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830004e20 con 0x7f38340cd9d0 2023-11-08T12:32:40.444 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.430+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834160cc0 con 0x7f38340cd9d0 2023-11-08T12:32:40.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.430+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830007310 con 0x7f38340cd9d0 2023-11-08T12:32:40.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.430+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38341609e0 con 0x7f38340cd9d0 2023-11-08T12:32:40.445 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.430+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3834160fa0 con 0x7f38340cd9d0 2023-11-08T12:32:40.446 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.430+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f383001a020 con 0x7f38340cd9d0 2023-11-08T12:32:40.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f382a7fc700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3818064ee0 0x7f3818067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.447 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3830081800 con 0x7f38340cd9d0 2023-11-08T12:32:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f383960c700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3818064ee0 0x7f3818067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f382a7fc700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7f381806b7f0 0x7f381806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 --> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f381806e2f0 con 0x7f381806b7f0 2023-11-08T12:32:40.448 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3830083de0 con 0x7f38340cd9d0 2023-11-08T12:32:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f383a60e700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7f381806b7f0 0x7f381806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f383960c700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3818064ee0 0x7f3818067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f38340af870 tx=0x7f3824008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.449 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.434+0000 7f383a60e700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7f381806b7f0 0x7f381806dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.450 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.438+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== osd.2 v2:172.21.15.112:6816/35550 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f381806e2f0 con 0x7f381806b7f0 2023-11-08T12:32:40.461 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.454+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 --> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f38340726c0 con 0x7f381806b7f0 2023-11-08T12:32:40.462 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f382a7fc700 1 -- 172.21.15.112:0/2386251147 <== osd.2 v2:172.21.15.112:6816/35550 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f38340726c0 con 0x7f381806b7f0 2023-11-08T12:32:40.462 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:40.463 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:40.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7f381806b7f0 msgr2=0x7f381806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.464 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6816/35550,v1:172.21.15.112:6817/35550] conn(0x7f381806b7f0 0x7f381806dc20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3818064ee0 msgr2=0x7f3818067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3818064ee0 0x7f3818067390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f38340af870 tx=0x7f3824008040 comp rx=0 tx=0).stop 2023-11-08T12:32:40.465 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38340cd9d0 msgr2=0x7f38340b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 --2- 172.21.15.112:0/2386251147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38340cd9d0 0x7f38340b5100 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f383000c4e0 tx=0x7f383000c7f0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383a60e700 1 -- 172.21.15.112:0/2386251147 reap_dead start 2023-11-08T12:32:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 shutdown_connections 2023-11-08T12:32:40.466 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 >> 172.21.15.112:0/2386251147 conn(0x7f383406f1e0 msgr2=0x7f38340cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 shutdown_connections 2023-11-08T12:32:40.467 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.458+0000 7f383c071700 1 -- 172.21.15.112:0/2386251147 wait complete. 2023-11-08T12:32:40.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-08T12:32:40.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.666+0000 7fbb7f59e700 1 Processor -- start 2023-11-08T12:32:40.671 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.666+0000 7fbb7f59e700 1 -- start start 2023-11-08T12:32:40.673 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb800cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7f59e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb800ad6c0 con 0x7fbb800cc860 2023-11-08T12:32:40.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb800adc60 con 0x7fbb80070790 2023-11-08T12:32:40.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8006b1c0 con 0x7fbb80160710 2023-11-08T12:32:40.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7dd9b700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbb800cc860 0x7fbb80070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51766/0 (socket says 172.21.15.112:51766) 2023-11-08T12:32:40.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7dd9b700 1 -- 172.21.15.112:0/1568638643 learned_addr learned my addr 172.21.15.112:0/1568638643 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:40.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7e59c700 1 --2- 172.21.15.112:0/1568638643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb800cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7d59a700 1 -- 172.21.15.112:0/1568638643 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408668084 0 0) 0x7fbb800ad6c0 con 0x7fbb800cc860 2023-11-08T12:32:40.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7d59a700 1 -- 172.21.15.112:0/1568638643 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb680035d0 con 0x7fbb800cc860 2023-11-08T12:32:40.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7e59c700 1 -- 172.21.15.112:0/1568638643 >> v1:172.21.15.133:6789/0 conn(0x7fbb80070790 legacy=0x7fbb80164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7d59a700 1 -- 172.21.15.112:0/1568638643 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187344430 0 0) 0x7fbb800adc60 con 0x7fbb80070790 2023-11-08T12:32:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7e59c700 1 -- 172.21.15.112:0/1568638643 >> v1:172.21.15.112:6789/0 conn(0x7fbb800cc860 legacy=0x7fbb80070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7e59c700 1 -- 172.21.15.112:0/1568638643 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8006b3d0 con 0x7fbb80160710 2023-11-08T12:32:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.670+0000 7fbb7e59c700 1 --2- 172.21.15.112:0/1568638643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb800cc320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009880 tx=0x7fbb70009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=216d1e5e001586c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7d59a700 1 -- 172.21.15.112:0/1568638643 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70011830 con 0x7fbb80160710 2023-11-08T12:32:40.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7d59a700 1 -- 172.21.15.112:0/1568638643 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70011990 con 0x7fbb80160710 2023-11-08T12:32:40.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7d59a700 1 -- 172.21.15.112:0/1568638643 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70011d20 con 0x7fbb80160710 2023-11-08T12:32:40.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7f59e700 1 -- 172.21.15.112:0/1568638643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 msgr2=0x7fbb800cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/1568638643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb800cc320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009880 tx=0x7fbb70009b90 comp rx=0 tx=0).stop 2023-11-08T12:32:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7f59e700 1 -- 172.21.15.112:0/1568638643 shutdown_connections 2023-11-08T12:32:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/1568638643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb800cc320 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7f59e700 1 -- 172.21.15.112:0/1568638643 >> 172.21.15.112:0/1568638643 conn(0x7fbb800b0f80 msgr2=0x7fbb800ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7f59e700 1 -- 172.21.15.112:0/1568638643 shutdown_connections 2023-11-08T12:32:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.674+0000 7fbb7f59e700 1 -- 172.21.15.112:0/1568638643 wait complete. 2023-11-08T12:32:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 Processor -- start 2023-11-08T12:32:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 -- start start 2023-11-08T12:32:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb80070790 0x7fbb801520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb800cc860 0x7fbb80153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb801541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb80152600 con 0x7fbb80070790 2023-11-08T12:32:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb801555e0 con 0x7fbb800cc860 2023-11-08T12:32:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7f59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb80154700 con 0x7fbb80160710 2023-11-08T12:32:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb80070790 0x7fbb801520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb80070790 0x7fbb801520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51978/0 (socket says 172.21.15.112:51978) 2023-11-08T12:32:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 -- 172.21.15.112:0/905500519 learned_addr learned my addr 172.21.15.112:0/905500519 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7dd9b700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb800cc860 0x7fbb80153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7ed9d700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb801541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 -- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 msgr2=0x7fbb801541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb801541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 -- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb800cc860 msgr2=0x7fbb80153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb800cc860 0x7fbb80153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.690 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.678+0000 7fbb7e59c700 1 -- 172.21.15.112:0/905500519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb700094b0 con 0x7fbb80070790 2023-11-08T12:32:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.682+0000 7fbb7e59c700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb80070790 0x7fbb801520c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbb70013040 tx=0x7fbb70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.682+0000 7fbb6effd700 1 -- 172.21.15.112:0/905500519 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70019950 con 0x7fbb80070790 2023-11-08T12:32:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.682+0000 7fbb6effd700 1 -- 172.21.15.112:0/905500519 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7001e070 con 0x7fbb80070790 2023-11-08T12:32:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.682+0000 7fbb6effd700 1 -- 172.21.15.112:0/905500519 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70019d10 con 0x7fbb80070790 2023-11-08T12:32:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.682+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800ad8f0 con 0x7fbb80070790 2023-11-08T12:32:40.692 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.682+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8006b6b0 con 0x7fbb80070790 2023-11-08T12:32:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.682+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb80160ae0 con 0x7fbb80070790 2023-11-08T12:32:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.686+0000 7fbb6effd700 1 -- 172.21.15.112:0/905500519 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fbb7000f050 con 0x7fbb80070790 2023-11-08T12:32:40.693 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.686+0000 7fbb6effd700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb60064f10 0x7fbb600673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.686+0000 7fbb6effd700 1 -- 172.21.15.112:0/905500519 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbb70082c00 con 0x7fbb80070790 2023-11-08T12:32:40.694 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.686+0000 7fbb7dd9b700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb60064f10 0x7fbb600673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:40.695 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.686+0000 7fbb7dd9b700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb60064f10 0x7fbb600673c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbb8015f650 tx=0x7fbb74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:40.697 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.690+0000 7fbb6effd700 1 -- 172.21.15.112:0/905500519 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fbb70050f60 con 0x7fbb80070790 2023-11-08T12:32:40.872 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.866+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb80155720 con 0x7fbb60064f10 2023-11-08T12:32:40.873 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.866+0000 7fbb6effd700 1 -- 172.21.15.112:0/905500519 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbb7400f690 con 0x7fbb60064f10 2023-11-08T12:32:40.875 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb60064f10 msgr2=0x7fbb600673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb60064f10 0x7fbb600673c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbb8015f650 tx=0x7fbb74009040 comp rx=0 tx=0).stop 2023-11-08T12:32:40.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb80070790 msgr2=0x7fbb801520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:40.876 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb80070790 0x7fbb801520c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbb70013040 tx=0x7fbb70004770 comp rx=0 tx=0).stop 2023-11-08T12:32:40.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 shutdown_connections 2023-11-08T12:32:40.877 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fbb60064f10 0x7fbb600673c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb80160710 0x7fbb801541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb800cc860 0x7fbb80153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.878 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 --2- 172.21.15.112:0/905500519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb80070790 0x7fbb801520c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:40.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 >> 172.21.15.112:0/905500519 conn(0x7fbb800b0f80 msgr2=0x7fbb800cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:40.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 shutdown_connections 2023-11-08T12:32:40.879 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:40.870+0000 7fbb7f59e700 1 -- 172.21.15.112:0/905500519 wait complete. 2023-11-08T12:32:40.880 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2023-11-08T12:32:40.900 INFO:tasks.ceph:Scrubbing osd.3 2023-11-08T12:32:40.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:41.075 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.070+0000 7f3e70f07700 1 Processor -- start 2023-11-08T12:32:41.076 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.070+0000 7f3e70f07700 1 -- start start 2023-11-08T12:32:41.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.070+0000 7f3e70f07700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3e6c15c6e0 0x7f3e6c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.077 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.070+0000 7f3e70f07700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e6c071fe0 0x7f3e6c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.070+0000 7f3e70f07700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c15cab0 con 0x7f3e6c06a340 2023-11-08T12:32:41.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.070+0000 7f3e70f07700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c0d2800 con 0x7f3e6c15c6e0 2023-11-08T12:32:41.078 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.070+0000 7f3e70f07700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c06a7c0 con 0x7f3e6c071fe0 2023-11-08T12:32:41.080 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3e6c15c6e0 0x7f3e6c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3e6c15c6e0 0x7f3e6c071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51984/0 (socket says 172.21.15.112:51984) 2023-11-08T12:32:41.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 -- 172.21.15.112:0/2715433706 learned_addr learned my addr 172.21.15.112:0/2715433706 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:41.081 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6affd700 1 --2- 172.21.15.112:0/2715433706 >> v2:172.21.15.133:3300/0 conn(0x7f3e6c071fe0 0x7f3e6c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 -- 172.21.15.112:0/2715433706 >> v2:172.21.15.133:3300/0 conn(0x7f3e6c071fe0 msgr2=0x7f3e6c069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:41.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 --2- 172.21.15.112:0/2715433706 >> v2:172.21.15.133:3300/0 conn(0x7f3e6c071fe0 0x7f3e6c069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.082 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 -- 172.21.15.112:0/2715433706 >> v1:172.21.15.133:6789/0 conn(0x7f3e6c06a340 legacy=0x7f3e6c0b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 -- 172.21.15.112:0/2715433706 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0702d0 con 0x7f3e6c15c6e0 2023-11-08T12:32:41.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6b7fe700 1 --2- 172.21.15.112:0/2715433706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c15c6e0 0x7f3e6c071aa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c06f9b0 tx=0x7f3e5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cda1b92f32890bd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.083 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6a7fc700 1 -- 172.21.15.112:0/2715433706 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c011830 con 0x7f3e6c15c6e0 2023-11-08T12:32:41.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6a7fc700 1 -- 172.21.15.112:0/2715433706 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c011990 con 0x7f3e6c15c6e0 2023-11-08T12:32:41.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e6a7fc700 1 -- 172.21.15.112:0/2715433706 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c011d20 con 0x7f3e6c15c6e0 2023-11-08T12:32:41.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 -- 172.21.15.112:0/2715433706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c15c6e0 msgr2=0x7f3e6c071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.084 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 --2- 172.21.15.112:0/2715433706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c15c6e0 0x7f3e6c071aa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c06f9b0 tx=0x7f3e5c009bf0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 -- 172.21.15.112:0/2715433706 shutdown_connections 2023-11-08T12:32:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 --2- 172.21.15.112:0/2715433706 >> v2:172.21.15.133:3300/0 conn(0x7f3e6c071fe0 0x7f3e6c069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.085 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 --2- 172.21.15.112:0/2715433706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c15c6e0 0x7f3e6c071aa0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 -- 172.21.15.112:0/2715433706 >> 172.21.15.112:0/2715433706 conn(0x7f3e6c0b65b0 msgr2=0x7f3e6c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 -- 172.21.15.112:0/2715433706 shutdown_connections 2023-11-08T12:32:41.086 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.074+0000 7f3e70f07700 1 -- 172.21.15.112:0/2715433706 wait complete. 2023-11-08T12:32:41.088 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 Processor -- start 2023-11-08T12:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 -- start start 2023-11-08T12:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e6c06a340 0x7f3e6c0c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c071fe0 0x7f3e6c09bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.089 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e6c15c6e0 0x7f3e6c1f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0b3170 con 0x7f3e6c071fe0 2023-11-08T12:32:41.090 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0c7550 con 0x7f3e6c15c6e0 2023-11-08T12:32:41.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e70f07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0c6940 con 0x7f3e6c06a340 2023-11-08T12:32:41.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.078+0000 7f3e6affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c071fe0 0x7f3e6c09bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c071fe0 0x7f3e6c09bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52000/0 (socket says 172.21.15.112:52000) 2023-11-08T12:32:41.091 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 -- 172.21.15.112:0/2120217701 learned_addr learned my addr 172.21.15.112:0/2120217701 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:41.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6b7fe700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e6c06a340 0x7f3e6c0c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6bfff700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e6c15c6e0 0x7f3e6c1f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.092 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 -- 172.21.15.112:0/2120217701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e6c06a340 msgr2=0x7f3e6c0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e6c06a340 0x7f3e6c0c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 -- 172.21.15.112:0/2120217701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e6c15c6e0 msgr2=0x7f3e6c1f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e6c15c6e0 0x7f3e6c1f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.093 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 -- 172.21.15.112:0/2120217701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c009570 con 0x7f3e6c071fe0 2023-11-08T12:32:41.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e6affd700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c071fe0 0x7f3e6c09bb80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000e9d0 tx=0x7f3e6000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.094 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60009720 con 0x7f3e6c071fe0 2023-11-08T12:32:41.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6000ee70 con 0x7f3e6c071fe0 2023-11-08T12:32:41.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000ca50 con 0x7f3e6c071fe0 2023-11-08T12:32:41.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c0d2cf0 con 0x7f3e6c071fe0 2023-11-08T12:32:41.095 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c0d2a10 con 0x7f3e6c071fe0 2023-11-08T12:32:41.096 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.082+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e6c0d2fd0 con 0x7f3e6c071fe0 2023-11-08T12:32:41.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f3e60019030 con 0x7f3e6c071fe0 2023-11-08T12:32:41.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e53fff700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3e58064f10 0x7f3e580673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.097 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3e60081b70 con 0x7f3e6c071fe0 2023-11-08T12:32:41.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e6b7fe700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3e58064f10 0x7f3e580673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e53fff700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7f3e5806b820 0x7f3e5806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.098 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 --> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e5806e320 con 0x7f3e5806b820 2023-11-08T12:32:41.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e60086240 con 0x7f3e6c071fe0 2023-11-08T12:32:41.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e6bfff700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7f3e5806b820 0x7f3e5806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.099 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e6b7fe700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3e58064f10 0x7f3e580673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c000c00 tx=0x7f3e5c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.086+0000 7f3e6bfff700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7f3e5806b820 0x7f3e5806dc50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.100 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.090+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== osd.3 v2:172.21.15.112:6824/35552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3e5806e320 con 0x7f3e5806b820 2023-11-08T12:32:41.110 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 --> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3e6c073cb0 con 0x7f3e5806b820 2023-11-08T12:32:41.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e53fff700 1 -- 172.21.15.112:0/2120217701 <== osd.3 v2:172.21.15.112:6824/35552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3e6c073cb0 con 0x7f3e5806b820 2023-11-08T12:32:41.112 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:41.112 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:41.112 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:41.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7f3e5806b820 msgr2=0x7f3e5806dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6824/35552,v1:172.21.15.112:6825/35552] conn(0x7f3e5806b820 0x7f3e5806dc50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3e58064f10 msgr2=0x7f3e580673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f3e58064f10 0x7f3e580673c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c000c00 tx=0x7f3e5c008030 comp rx=0 tx=0).stop 2023-11-08T12:32:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c071fe0 msgr2=0x7f3e6c09bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 --2- 172.21.15.112:0/2120217701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e6c071fe0 0x7f3e6c09bb80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000e9d0 tx=0x7f3e6000ece0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e6bfff700 1 -- 172.21.15.112:0/2120217701 reap_dead start 2023-11-08T12:32:41.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 shutdown_connections 2023-11-08T12:32:41.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 >> 172.21.15.112:0/2120217701 conn(0x7f3e6c0b65b0 msgr2=0x7f3e6c0b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:41.116 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 shutdown_connections 2023-11-08T12:32:41.117 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.106+0000 7f3e70f07700 1 -- 172.21.15.112:0/2120217701 wait complete. 2023-11-08T12:32:41.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-08T12:32:41.308 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.302+0000 7f49e9190700 1 Processor -- start 2023-11-08T12:32:41.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.302+0000 7f49e9190700 1 -- start start 2023-11-08T12:32:41.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e9190700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e9190700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49e40c9040 0x7f49e40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e9190700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e415a550 con 0x7f49e40b43a0 2023-11-08T12:32:41.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e9190700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e406b0a0 con 0x7f49e40c9040 2023-11-08T12:32:41.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e9190700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40caac0 con 0x7f49e40b1640 2023-11-08T12:32:41.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e3fff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f49e40b43a0 0x7f49e415e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51776/0 (socket says 172.21.15.112:51776) 2023-11-08T12:32:41.312 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e3fff700 1 -- 172.21.15.112:0/2055459349 learned_addr learned my addr 172.21.15.112:0/2055459349 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:41.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e37fe700 1 --2- 172.21.15.112:0/2055459349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e898f700 1 --2- 172.21.15.112:0/2055459349 >> v2:172.21.15.133:3300/0 conn(0x7f49e40c9040 0x7f49e40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e2ffd700 1 -- 172.21.15.112:0/2055459349 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660226935 0 0) 0x7f49d4001110 con 0x7f49e40b43a0 2023-11-08T12:32:41.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e2ffd700 1 -- 172.21.15.112:0/2055459349 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49cc0035d0 con 0x7f49e40b43a0 2023-11-08T12:32:41.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e37fe700 1 -- 172.21.15.112:0/2055459349 >> v2:172.21.15.133:3300/0 conn(0x7f49e40c9040 msgr2=0x7f49e40705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:41.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e37fe700 1 --2- 172.21.15.112:0/2055459349 >> v2:172.21.15.133:3300/0 conn(0x7f49e40c9040 0x7f49e40705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e37fe700 1 -- 172.21.15.112:0/2055459349 >> v1:172.21.15.112:6789/0 conn(0x7f49e40b43a0 legacy=0x7f49e415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e37fe700 1 -- 172.21.15.112:0/2055459349 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40cada0 con 0x7f49e40b1640 2023-11-08T12:32:41.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e37fe700 1 --2- 172.21.15.112:0/2055459349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e4070080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009850 tx=0x7f49d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a04e15284b68472f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.306+0000 7f49e2ffd700 1 -- 172.21.15.112:0/2055459349 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8011830 con 0x7f49e40b1640 2023-11-08T12:32:41.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e2ffd700 1 -- 172.21.15.112:0/2055459349 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8011990 con 0x7f49e40b1640 2023-11-08T12:32:41.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e2ffd700 1 -- 172.21.15.112:0/2055459349 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8011d00 con 0x7f49e40b1640 2023-11-08T12:32:41.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 -- 172.21.15.112:0/2055459349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 msgr2=0x7f49e4070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 --2- 172.21.15.112:0/2055459349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e4070080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009850 tx=0x7f49d8009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:41.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 -- 172.21.15.112:0/2055459349 shutdown_connections 2023-11-08T12:32:41.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 --2- 172.21.15.112:0/2055459349 >> v2:172.21.15.133:3300/0 conn(0x7f49e40c9040 0x7f49e40705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 --2- 172.21.15.112:0/2055459349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e4070080 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 -- 172.21.15.112:0/2055459349 >> 172.21.15.112:0/2055459349 conn(0x7f49e40b0f80 msgr2=0x7f49e40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:41.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 -- 172.21.15.112:0/2055459349 shutdown_connections 2023-11-08T12:32:41.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.310+0000 7f49e9190700 1 -- 172.21.15.112:0/2055459349 wait complete. 2023-11-08T12:32:41.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 Processor -- start 2023-11-08T12:32:41.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 -- start start 2023-11-08T12:32:41.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e40c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49e40b43a0 0x7f49e4156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e40c9040 0x7f49e4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4155450 con 0x7f49e40b43a0 2023-11-08T12:32:41.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40c2bb0 con 0x7f49e40c9040 2023-11-08T12:32:41.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.314+0000 7f49e9190700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40c2e70 con 0x7f49e40b1640 2023-11-08T12:32:41.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49e40b43a0 0x7f49e4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49e40b43a0 0x7f49e4156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52016/0 (socket says 172.21.15.112:52016) 2023-11-08T12:32:41.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 -- 172.21.15.112:0/2895408623 learned_addr learned my addr 172.21.15.112:0/2895408623 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:41.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e898f700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e40c9040 0x7f49e4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e3fff700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e40c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 -- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 msgr2=0x7f49e40c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e40c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 -- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e40c9040 msgr2=0x7f49e4156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e40c9040 0x7f49e4156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 -- 172.21.15.112:0/2895408623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80094b0 con 0x7f49e40b43a0 2023-11-08T12:32:41.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e898f700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e40c9040 0x7f49e4156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:41.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e37fe700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49e40b43a0 0x7f49e4156670 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009ba0 tx=0x7f49d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e0ff9700 1 -- 172.21.15.112:0/2895408623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8004590 con 0x7f49e40b43a0 2023-11-08T12:32:41.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e0ff9700 1 -- 172.21.15.112:0/2895408623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d801e070 con 0x7f49e40b43a0 2023-11-08T12:32:41.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e406b5d0 con 0x7f49e40b43a0 2023-11-08T12:32:41.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e0ff9700 1 -- 172.21.15.112:0/2895408623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8003900 con 0x7f49e40b43a0 2023-11-08T12:32:41.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e406b2f0 con 0x7f49e40b43a0 2023-11-08T12:32:41.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.318+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e40ca7b0 con 0x7f49e40b43a0 2023-11-08T12:32:41.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.322+0000 7f49e0ff9700 1 -- 172.21.15.112:0/2895408623 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f49d800f050 con 0x7f49e40b43a0 2023-11-08T12:32:41.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.322+0000 7f49e0ff9700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f49d0064ee0 0x7f49d0067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.322+0000 7f49e0ff9700 1 -- 172.21.15.112:0/2895408623 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f49d8082b70 con 0x7f49e40b43a0 2023-11-08T12:32:41.333 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.322+0000 7f49e3fff700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f49d0064ee0 0x7f49d0067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.326+0000 7f49e3fff700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f49d0064ee0 0x7f49d0067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005930 tx=0x7f49d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.334 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.330+0000 7f49e0ff9700 1 -- 172.21.15.112:0/2895408623 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f49d8050e00 con 0x7f49e40b43a0 2023-11-08T12:32:41.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.498+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f49e4073cb0 con 0x7f49d0064ee0 2023-11-08T12:32:41.505 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e0ff9700 1 -- 172.21.15.112:0/2895408623 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49e4073cb0 con 0x7f49d0064ee0 2023-11-08T12:32:41.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f49d0064ee0 msgr2=0x7f49d0067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.509 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f49d0064ee0 0x7f49d0067390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005930 tx=0x7f49d4009040 comp rx=0 tx=0).stop 2023-11-08T12:32:41.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49e40b43a0 msgr2=0x7f49e4156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49e40b43a0 0x7f49e4156670 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009ba0 tx=0x7f49d8004770 comp rx=0 tx=0).stop 2023-11-08T12:32:41.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 shutdown_connections 2023-11-08T12:32:41.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f49d0064ee0 0x7f49d0067390 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e40c9040 0x7f49e4156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49e40b43a0 0x7f49e4156670 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.511 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 --2- 172.21.15.112:0/2895408623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49e40b1640 0x7f49e40c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 >> 172.21.15.112:0/2895408623 conn(0x7f49e40b0f80 msgr2=0x7f49e406c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:41.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 shutdown_connections 2023-11-08T12:32:41.512 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.502+0000 7f49e9190700 1 -- 172.21.15.112:0/2895408623 wait complete. 2023-11-08T12:32:41.513 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 3 to deep-scrub 2023-11-08T12:32:41.531 INFO:tasks.ceph:Scrubbing osd.4 2023-11-08T12:32:41.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:41.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.714+0000 7f89b4ed5700 1 Processor -- start 2023-11-08T12:32:41.720 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.714+0000 7f89b4ed5700 1 -- start start 2023-11-08T12:32:41.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89b4ed5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89b4ed5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89b0071fe0 0x7f89b0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.723 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89b4ed5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b006a790 con 0x7f89b006a340 2023-11-08T12:32:41.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89b4ed5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b00d2800 con 0x7f89b0071fe0 2023-11-08T12:32:41.724 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89b4ed5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b015cab0 con 0x7f89b015c6e0 2023-11-08T12:32:41.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89aeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89b0071fe0 0x7f89b0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.725 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89aeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89b0071fe0 0x7f89b0069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:37618/0 (socket says 172.21.15.112:37618) 2023-11-08T12:32:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89aeffd700 1 -- 172.21.15.112:0/2326315982 learned_addr learned my addr 172.21.15.112:0/2326315982 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.726 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89aeffd700 1 -- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 msgr2=0x7f89b0071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89aeffd700 1 --2- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b0071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89aeffd700 1 -- 172.21.15.112:0/2326315982 >> v1:172.21.15.133:6789/0 conn(0x7f89b006a340 legacy=0x7f89b00b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89aeffd700 1 -- 172.21.15.112:0/2326315982 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00702d0 con 0x7f89b0071fe0 2023-11-08T12:32:41.727 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89af7fe700 1 --2- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b0071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:41.728 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.718+0000 7f89ae7fc700 1 -- 172.21.15.112:0/2326315982 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177429627 0 0) 0x7f89a8001490 con 0x7f89b006a340 2023-11-08T12:32:41.729 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89aeffd700 1 --2- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 0x7f89b0069e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009910 tx=0x7f89a4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1bfa86fb4d55c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89ae7fc700 1 -- 172.21.15.112:0/2326315982 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4011830 con 0x7f89b0071fe0 2023-11-08T12:32:41.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89ae7fc700 1 -- 172.21.15.112:0/2326315982 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4011990 con 0x7f89b0071fe0 2023-11-08T12:32:41.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89ae7fc700 1 -- 172.21.15.112:0/2326315982 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4011d40 con 0x7f89b0071fe0 2023-11-08T12:32:41.730 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 -- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 msgr2=0x7f89b0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 --2- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 0x7f89b0069e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009910 tx=0x7f89a4009c20 comp rx=0 tx=0).stop 2023-11-08T12:32:41.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 -- 172.21.15.112:0/2326315982 shutdown_connections 2023-11-08T12:32:41.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 --2- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 0x7f89b0069e00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 --2- 172.21.15.112:0/2326315982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b0071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 -- 172.21.15.112:0/2326315982 >> 172.21.15.112:0/2326315982 conn(0x7f89b00b65b0 msgr2=0x7f89b0071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:41.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 -- 172.21.15.112:0/2326315982 shutdown_connections 2023-11-08T12:32:41.732 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.722+0000 7f89b4ed5700 1 -- 172.21.15.112:0/2326315982 wait complete. 2023-11-08T12:32:41.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 Processor -- start 2023-11-08T12:32:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 -- start start 2023-11-08T12:32:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89b006a340 0x7f89b00b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 0x7f89b00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b00b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00c6140 con 0x7f89b006a340 2023-11-08T12:32:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00b4e70 con 0x7f89b0071fe0 2023-11-08T12:32:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89b4ed5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00c5120 con 0x7f89b015c6e0 2023-11-08T12:32:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89b006a340 0x7f89b00b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89b006a340 0x7f89b00b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52032/0 (socket says 172.21.15.112:52032) 2023-11-08T12:32:41.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 -- 172.21.15.112:0/1707048869 learned_addr learned my addr 172.21.15.112:0/1707048869 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:41.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89affff700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b00b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89aeffd700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 0x7f89b00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 -- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 msgr2=0x7f89b00b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b00b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 -- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 msgr2=0x7f89b00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 0x7f89b00c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 -- 172.21.15.112:0/1707048869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00094b0 con 0x7f89b006a340 2023-11-08T12:32:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89aeffd700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b0071fe0 0x7f89b00c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89affff700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89b015c6e0 0x7f89b00b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.726+0000 7f89af7fe700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89b006a340 0x7f89b00b2b50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f89a000ebe0 tx=0x7f89a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.730+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000c8b0 con 0x7f89b006a340 2023-11-08T12:32:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.730+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000ca10 con 0x7f89b006a340 2023-11-08T12:32:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.730+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4009570 con 0x7f89b006a340 2023-11-08T12:32:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.730+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000cda0 con 0x7f89b006a340 2023-11-08T12:32:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.730+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b00d2cf0 con 0x7f89b006a340 2023-11-08T12:32:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.730+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89b00d2a10 con 0x7f89b006a340 2023-11-08T12:32:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.730+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f89a0019030 con 0x7f89b006a340 2023-11-08T12:32:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f8997fff700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f899c064f10 0x7f899c0673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f89a0081db0 con 0x7f89b006a340 2023-11-08T12:32:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f89aeffd700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f899c064f10 0x7f899c0673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f8997fff700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7f899c06b820 0x7f899c06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 --> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f899c06e320 con 0x7f899c06b820 2023-11-08T12:32:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89a0084390 con 0x7f89b006a340 2023-11-08T12:32:41.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f89aeffd700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f899c064f10 0x7f899c0673c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f89b006c3a0 tx=0x7f89a4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f89affff700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7f899c06b820 0x7f899c06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.734+0000 7f89affff700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7f899c06b820 0x7f899c06dc50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.738+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== osd.4 v2:172.21.15.133:6802/35801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f899c06e320 con 0x7f899c06b820 2023-11-08T12:32:41.759 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 --> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f89b00d2fd0 con 0x7f899c06b820 2023-11-08T12:32:41.760 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f8997fff700 1 -- 172.21.15.112:0/1707048869 <== osd.4 v2:172.21.15.133:6802/35801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f89b00d2fd0 con 0x7f899c06b820 2023-11-08T12:32:41.761 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:41.761 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:41.761 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:41.762 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7f899c06b820 msgr2=0x7f899c06dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.133:6802/35801,v1:172.21.15.133:6804/35801] conn(0x7f899c06b820 0x7f899c06dc50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f899c064f10 msgr2=0x7f899c0673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f899c064f10 0x7f899c0673c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f89b006c3a0 tx=0x7f89a4008030 comp rx=0 tx=0).stop 2023-11-08T12:32:41.763 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89b006a340 msgr2=0x7f89b00b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 --2- 172.21.15.112:0/1707048869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89b006a340 0x7f89b00b2b50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f89a000ebe0 tx=0x7f89a0009e30 comp rx=0 tx=0).stop 2023-11-08T12:32:41.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89affff700 1 -- 172.21.15.112:0/1707048869 reap_dead start 2023-11-08T12:32:41.764 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 shutdown_connections 2023-11-08T12:32:41.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.754+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 >> 172.21.15.112:0/1707048869 conn(0x7f89b00b65b0 msgr2=0x7f89b00d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:41.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.758+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 shutdown_connections 2023-11-08T12:32:41.765 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.758+0000 7f89b4ed5700 1 -- 172.21.15.112:0/1707048869 wait complete. 2023-11-08T12:32:41.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-08T12:32:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff11cfd5700 1 Processor -- start 2023-11-08T12:32:41.963 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff11cfd5700 1 -- start start 2023-11-08T12:32:41.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff11cfd5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff11815c1a0 0x7ff11806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff11cfd5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff11806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff11cfd5700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180adf90 con 0x7ff1180cdeb0 2023-11-08T12:32:41.965 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff11cfd5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff118069bf0 con 0x7ff11815c1a0 2023-11-08T12:32:41.966 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff11cfd5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180ce370 con 0x7ff118070790 2023-11-08T12:32:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff116ffd700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff1180cdeb0 0x7ff118070080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51784/0 (socket says 172.21.15.112:51784) 2023-11-08T12:32:41.967 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.958+0000 7ff116ffd700 1 -- 172.21.15.112:0/3485893804 learned_addr learned my addr 172.21.15.112:0/3485893804 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff117fff700 1 --2- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff11806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1177fe700 1 --2- 172.21.15.112:0/3485893804 >> v2:172.21.15.133:3300/0 conn(0x7ff11815c1a0 0x7ff11806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.968 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1167fc700 1 -- 172.21.15.112:0/3485893804 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085806634 0 0) 0x7ff1180adf90 con 0x7ff1180cdeb0 2023-11-08T12:32:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1167fc700 1 -- 172.21.15.112:0/3485893804 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1000035d0 con 0x7ff1180cdeb0 2023-11-08T12:32:41.969 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1177fe700 1 -- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 msgr2=0x7ff11806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1177fe700 1 --2- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff11806a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1167fc700 1 -- 172.21.15.112:0/3485893804 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1574922743 0 0) 0x7ff1000035d0 con 0x7ff1180cdeb0 2023-11-08T12:32:41.970 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1177fe700 1 -- 172.21.15.112:0/3485893804 >> v1:172.21.15.112:6789/0 conn(0x7ff1180cdeb0 legacy=0x7ff118070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1177fe700 1 -- 172.21.15.112:0/3485893804 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1180cc4a0 con 0x7ff11815c1a0 2023-11-08T12:32:41.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff117fff700 1 --2- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff11806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:41.971 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1177fe700 1 --2- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 0x7ff11806c8b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff108009850 tx=0x7ff108009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46498fbe75d35743 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.972 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1167fc700 1 -- 172.21.15.112:0/3485893804 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c001690 con 0x7ff11815c1a0 2023-11-08T12:32:41.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1167fc700 1 -- 172.21.15.112:0/3485893804 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff108004030 con 0x7ff11815c1a0 2023-11-08T12:32:41.973 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.962+0000 7ff1167fc700 1 -- 172.21.15.112:0/3485893804 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080043e0 con 0x7ff11815c1a0 2023-11-08T12:32:41.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 msgr2=0x7ff11806c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 0x7ff11806c8b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff108009850 tx=0x7ff108009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:41.974 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3485893804 shutdown_connections 2023-11-08T12:32:41.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff11806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3485893804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 0x7ff11806c8b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.975 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3485893804 >> 172.21.15.112:0/3485893804 conn(0x7ff1180b0f80 msgr2=0x7ff1180ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:41.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3485893804 shutdown_connections 2023-11-08T12:32:41.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3485893804 wait complete. 2023-11-08T12:32:41.976 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 Processor -- start 2023-11-08T12:32:41.978 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.966+0000 7ff11cfd5700 1 -- start start 2023-11-08T12:32:41.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff118155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1180cdeb0 0x7ff1180b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.979 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 0x7ff11806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118159b00 con 0x7ff1180cdeb0 2023-11-08T12:32:41.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180b1d80 con 0x7ff11815c1a0 2023-11-08T12:32:41.980 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180b17c0 con 0x7ff118070790 2023-11-08T12:32:41.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1180cdeb0 0x7ff1180b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1180cdeb0 0x7ff1180b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52038/0 (socket says 172.21.15.112:52038) 2023-11-08T12:32:41.981 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 -- 172.21.15.112:0/3430457950 learned_addr learned my addr 172.21.15.112:0/3430457950 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:41.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff1177fe700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff118155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.982 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff117fff700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 0x7ff11806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 -- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 msgr2=0x7ff118155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff118155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 -- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 msgr2=0x7ff11806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:41.983 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 0x7ff11806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:41.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 -- 172.21.15.112:0/3430457950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110009a70 con 0x7ff1180cdeb0 2023-11-08T12:32:41.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff116ffd700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1180cdeb0 0x7ff1180b3f60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff10c001eb0 tx=0x7ff10c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.984 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff0fffff700 1 -- 172.21.15.112:0/3430457950 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c005d90 con 0x7ff1180cdeb0 2023-11-08T12:32:41.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff0fffff700 1 -- 172.21.15.112:0/3430457950 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c0070d0 con 0x7ff1180cdeb0 2023-11-08T12:32:41.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1080094b0 con 0x7ff1180cdeb0 2023-11-08T12:32:41.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff0fffff700 1 -- 172.21.15.112:0/3430457950 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c007480 con 0x7ff1180cdeb0 2023-11-08T12:32:41.985 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.970+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11806cdf0 con 0x7ff1180cdeb0 2023-11-08T12:32:41.986 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.974+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1180cc780 con 0x7ff1180cdeb0 2023-11-08T12:32:41.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.974+0000 7ff0fffff700 1 -- 172.21.15.112:0/3430457950 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7ff10c019030 con 0x7ff1180cdeb0 2023-11-08T12:32:41.987 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.974+0000 7ff0fffff700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff104064ee0 0x7ff104067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:41.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.974+0000 7ff0fffff700 1 -- 172.21.15.112:0/3430457950 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff10c080f30 con 0x7ff1180cdeb0 2023-11-08T12:32:41.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.974+0000 7ff1177fe700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff104064ee0 0x7ff104067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:41.988 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.978+0000 7ff1177fe700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff104064ee0 0x7ff104067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff1080090b0 tx=0x7ff108008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:41.989 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:41.982+0000 7ff0fffff700 1 -- 172.21.15.112:0/3430457950 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7ff10c04a400 con 0x7ff1180cdeb0 2023-11-08T12:32:42.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.154+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff11815c570 con 0x7ff104064ee0 2023-11-08T12:32:42.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.158+0000 7ff0fffff700 1 -- 172.21.15.112:0/3430457950 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff11815c570 con 0x7ff104064ee0 2023-11-08T12:32:42.165 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff104064ee0 msgr2=0x7ff104067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff104064ee0 0x7ff104067390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff1080090b0 tx=0x7ff108008030 comp rx=0 tx=0).stop 2023-11-08T12:32:42.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1180cdeb0 msgr2=0x7ff1180b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.166 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1180cdeb0 0x7ff1180b3f60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff10c001eb0 tx=0x7ff10c00ca30 comp rx=0 tx=0).stop 2023-11-08T12:32:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 shutdown_connections 2023-11-08T12:32:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7ff104064ee0 0x7ff104067390 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.167 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff11815c1a0 0x7ff11806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1180cdeb0 0x7ff1180b3f60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 --2- 172.21.15.112:0/3430457950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff118070790 0x7ff118155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.168 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 >> 172.21.15.112:0/3430457950 conn(0x7ff1180b0f80 msgr2=0x7ff1180ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:42.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 shutdown_connections 2023-11-08T12:32:42.169 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.162+0000 7ff11cfd5700 1 -- 172.21.15.112:0/3430457950 wait complete. 2023-11-08T12:32:42.170 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 4 to deep-scrub 2023-11-08T12:32:42.187 INFO:tasks.ceph:Scrubbing osd.5 2023-11-08T12:32:42.188 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:42.367 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.362+0000 7f51ef356700 1 Processor -- start 2023-11-08T12:32:42.368 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.362+0000 7f51ef356700 1 -- start start 2023-11-08T12:32:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ef356700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e806a380 0x7f51e80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.370 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ef356700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e8070490 con 0x7f51e80cb0b0 2023-11-08T12:32:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ef356700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e814a740 con 0x7f51e814a370 2023-11-08T12:32:42.371 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ef356700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8070160 con 0x7f51e806a380 2023-11-08T12:32:42.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f51e80cb0b0 0x7f51e8070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51800/0 (socket says 172.21.15.112:51800) 2023-11-08T12:32:42.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 -- 172.21.15.112:0/1026202150 learned_addr learned my addr 172.21.15.112:0/1026202150 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:42.373 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ec8f1700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e806a380 0x7f51e80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535971433 0 0) 0x7f51e8070490 con 0x7f51e80cb0b0 2023-11-08T12:32:42.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d40035d0 con 0x7f51e80cb0b0 2023-11-08T12:32:42.374 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24361460 0 0) 0x7f51e814a740 con 0x7f51e814a370 2023-11-08T12:32:42.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e8070490 con 0x7f51e814a370 2023-11-08T12:32:42.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3469966970 0 0) 0x7f51d40035d0 con 0x7f51e80cb0b0 2023-11-08T12:32:42.375 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e806a380 msgr2=0x7f51e80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:42.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e806a380 0x7f51e80b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 >> v1:172.21.15.133:6789/0 conn(0x7f51e814a370 legacy=0x7f51e8164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8164bc0 con 0x7f51e80cb0b0 2023-11-08T12:32:42.376 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4028111948 0 0) 0x7f51e00019f0 con 0x7f51e80cb0b0 2023-11-08T12:32:42.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 >> v1:172.21.15.112:6789/0 conn(0x7f51e80cb0b0 legacy=0x7f51e8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51d4003be0 0x7f51d4003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.377 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4004870 0x7f51d4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d4005220 0x7f51d400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8070160 con 0x7f51d4005220 2023-11-08T12:32:42.378 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d400c100 con 0x7f51d4004870 2023-11-08T12:32:42.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d400c290 con 0x7f51d4003be0 2023-11-08T12:32:42.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d4005220 0x7f51d400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.379 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed0f2700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51d4003be0 0x7f51d4003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.380 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ec8f1700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4004870 0x7f51d4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 -- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51d4003be0 msgr2=0x7f51d4003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:42.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51d4003be0 0x7f51d4003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.383 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 -- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4004870 msgr2=0x7f51d4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:42.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4004870 0x7f51d4004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.366+0000 7f51ed8f3700 1 -- 172.21.15.112:0/1026202150 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40035d0 con 0x7f51d4005220 2023-11-08T12:32:42.384 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ed8f3700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d4005220 0x7f51d400ba30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f51e000a710 tx=0x7f51d40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c943c60bdbf866b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:42.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e00070d0 con 0x7f51d4005220 2023-11-08T12:32:42.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0007230 con 0x7f51d4005220 2023-11-08T12:32:42.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51dffff700 1 -- 172.21.15.112:0/1026202150 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e00075e0 con 0x7f51d4005220 2023-11-08T12:32:42.385 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ef356700 1 -- 172.21.15.112:0/1026202150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d4005220 msgr2=0x7f51d400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ef356700 1 --2- 172.21.15.112:0/1026202150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51d4005220 0x7f51d400ba30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f51e000a710 tx=0x7f51d40058a0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ed8f3700 1 -- 172.21.15.112:0/1026202150 reap_dead start 2023-11-08T12:32:42.386 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ef356700 1 -- 172.21.15.112:0/1026202150 shutdown_connections 2023-11-08T12:32:42.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ef356700 1 -- 172.21.15.112:0/1026202150 >> 172.21.15.112:0/1026202150 conn(0x7f51e806bfc0 msgr2=0x7f51e806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:42.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ef356700 1 -- 172.21.15.112:0/1026202150 shutdown_connections 2023-11-08T12:32:42.387 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.370+0000 7f51ef356700 1 -- 172.21.15.112:0/1026202150 wait complete. 2023-11-08T12:32:42.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 Processor -- start 2023-11-08T12:32:42.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 -- start start 2023-11-08T12:32:42.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4005220 0x7f51e8164130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.388 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51e813f1d0 0x7f51e81f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e8140730 0x7f51e81412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8147160 con 0x7f51e813f1d0 2023-11-08T12:32:42.389 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e81402a0 con 0x7f51d4005220 2023-11-08T12:32:42.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8142100 con 0x7f51e8140730 2023-11-08T12:32:42.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51e813f1d0 0x7f51e81f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.390 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51e813f1d0 0x7f51e81f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52060/0 (socket says 172.21.15.112:52060) 2023-11-08T12:32:42.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 -- 172.21.15.112:0/3552697923 learned_addr learned my addr 172.21.15.112:0/3552697923 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:42.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ed8f3700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e8140730 0x7f51e81412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ed0f2700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4005220 0x7f51e8164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.391 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 -- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e8140730 msgr2=0x7f51e81412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51e8140730 0x7f51e81412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 -- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4005220 msgr2=0x7f51e8164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.392 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51d4005220 0x7f51e8164130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 -- 172.21.15.112:0/3552697923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8165180 con 0x7f51e813f1d0 2023-11-08T12:32:42.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ec8f1700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51e813f1d0 0x7f51e81f67c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51d8011830 tx=0x7f51d8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:42.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8015870 con 0x7f51e813f1d0 2023-11-08T12:32:42.393 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80159d0 con 0x7f51e813f1d0 2023-11-08T12:32:42.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e8164ea0 con 0x7f51e813f1d0 2023-11-08T12:32:42.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8015d80 con 0x7f51e813f1d0 2023-11-08T12:32:42.394 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.374+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e80b2060 con 0x7f51e813f1d0 2023-11-08T12:32:42.395 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.378+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51e80726c0 con 0x7f51e813f1d0 2023-11-08T12:32:42.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.378+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f51d801b030 con 0x7f51e813f1d0 2023-11-08T12:32:42.396 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ddffb700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51cc064ee0 0x7f51cc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f51d80823d0 con 0x7f51e813f1d0 2023-11-08T12:32:42.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ed0f2700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51cc064ee0 0x7f51cc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ddffb700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f51cc06b7f0 0x7f51cc06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.397 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51cc06e2f0 con 0x7f51cc06b7f0 2023-11-08T12:32:42.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51d8082740 con 0x7f51e813f1d0 2023-11-08T12:32:42.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ed8f3700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f51cc06b7f0 0x7f51cc06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ed0f2700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51cc064ee0 0x7f51cc067390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007fd0 tx=0x7f51e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:42.398 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.382+0000 7f51ed8f3700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f51cc06b7f0 0x7f51cc06dc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:42.399 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.386+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== osd.5 v2:172.21.15.133:6800/35800 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f51cc06e2f0 con 0x7f51cc06b7f0 2023-11-08T12:32:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.402+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 --> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51e8164670 con 0x7f51cc06b7f0 2023-11-08T12:32:42.408 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.402+0000 7f51ddffb700 1 -- 172.21.15.112:0/3552697923 <== osd.5 v2:172.21.15.133:6800/35800 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f51e8164670 con 0x7f51cc06b7f0 2023-11-08T12:32:42.409 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:42.409 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:42.410 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:42.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f51cc06b7f0 msgr2=0x7f51cc06dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.133:6800/35800,v1:172.21.15.133:6801/35800] conn(0x7f51cc06b7f0 0x7f51cc06dc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.411 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51cc064ee0 msgr2=0x7f51cc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51cc064ee0 0x7f51cc067390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007fd0 tx=0x7f51e4009040 comp rx=0 tx=0).stop 2023-11-08T12:32:42.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51e813f1d0 msgr2=0x7f51e81f67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.412 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 --2- 172.21.15.112:0/3552697923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51e813f1d0 0x7f51e81f67c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51d8011830 tx=0x7f51d8011b40 comp rx=0 tx=0).stop 2023-11-08T12:32:42.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ed8f3700 1 -- 172.21.15.112:0/3552697923 reap_dead start 2023-11-08T12:32:42.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 shutdown_connections 2023-11-08T12:32:42.413 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 >> 172.21.15.112:0/3552697923 conn(0x7f51e806bfc0 msgr2=0x7f51e80cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:42.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 shutdown_connections 2023-11-08T12:32:42.414 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.406+0000 7f51ef356700 1 -- 172.21.15.112:0/3552697923 wait complete. 2023-11-08T12:32:42.434 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-08T12:32:42.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f992178b700 1 Processor -- start 2023-11-08T12:32:42.610 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f992178b700 1 -- start start 2023-11-08T12:32:42.611 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f992178b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f991c1604b0 0x7f991c0b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f992178b700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0ce430 con 0x7f991c160880 2023-11-08T12:32:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f992178b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0cbcd0 con 0x7f991c0b2240 2023-11-08T12:32:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f992178b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c0cb710 con 0x7f991c1604b0 2023-11-08T12:32:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f99127fc700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f991c160880 0x7f991c0b1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51806/0 (socket says 172.21.15.112:51806) 2023-11-08T12:32:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f99127fc700 1 -- 172.21.15.112:0/3160909069 learned_addr learned my addr 172.21.15.112:0/3160909069 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f991affd700 1 --2- 172.21.15.112:0/3160909069 >> v2:172.21.15.133:3300/0 conn(0x7f991c1604b0 0x7f991c0b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f991a7fc700 1 -- 172.21.15.112:0/3160909069 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625504495 0 0) 0x7f9904001110 con 0x7f991c160880 2023-11-08T12:32:42.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f991affd700 1 -- 172.21.15.112:0/3160909069 >> v1:172.21.15.133:6789/0 conn(0x7f991c0b2240 legacy=0x7f991c0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f991affd700 1 -- 172.21.15.112:0/3160909069 >> v1:172.21.15.112:6789/0 conn(0x7f991c160880 legacy=0x7f991c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.615 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.606+0000 7f991affd700 1 -- 172.21.15.112:0/3160909069 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0cb9f0 con 0x7f991c1604b0 2023-11-08T12:32:42.616 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f991affd700 1 --2- 172.21.15.112:0/3160909069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c0b3670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f990c009d90 tx=0x7f990c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14dbefda93507bb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:42.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f991a7fc700 1 -- 172.21.15.112:0/3160909069 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00e070 con 0x7f991c1604b0 2023-11-08T12:32:42.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f991a7fc700 1 -- 172.21.15.112:0/3160909069 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c00bbd0 con 0x7f991c1604b0 2023-11-08T12:32:42.617 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f991a7fc700 1 -- 172.21.15.112:0/3160909069 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c012430 con 0x7f991c1604b0 2023-11-08T12:32:42.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f992178b700 1 -- 172.21.15.112:0/3160909069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 msgr2=0x7f991c0b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f992178b700 1 --2- 172.21.15.112:0/3160909069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c0b3670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f990c009d90 tx=0x7f990c00b330 comp rx=0 tx=0).stop 2023-11-08T12:32:42.618 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f992178b700 1 -- 172.21.15.112:0/3160909069 shutdown_connections 2023-11-08T12:32:42.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f992178b700 1 --2- 172.21.15.112:0/3160909069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c0b3670 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f992178b700 1 -- 172.21.15.112:0/3160909069 >> 172.21.15.112:0/3160909069 conn(0x7f991c0ccb30 msgr2=0x7f991c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:42.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f992178b700 1 -- 172.21.15.112:0/3160909069 shutdown_connections 2023-11-08T12:32:42.619 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.610+0000 7f992178b700 1 -- 172.21.15.112:0/3160909069 wait complete. 2023-11-08T12:32:42.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 Processor -- start 2023-11-08T12:32:42.620 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 -- start start 2023-11-08T12:32:42.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f991c0b2240 0x7f991c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.622 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c160880 0x7f991c1632c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0c9040 con 0x7f991c0b2240 2023-11-08T12:32:42.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0c9fa0 con 0x7f991c1604b0 2023-11-08T12:32:42.623 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.614+0000 7f992178b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0c8430 con 0x7f991c160880 2023-11-08T12:32:42.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f991c0b2240 0x7f991c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f991c0b2240 0x7f991c0c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52070/0 (socket says 172.21.15.112:52070) 2023-11-08T12:32:42.624 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 -- 172.21.15.112:0/1049102087 learned_addr learned my addr 172.21.15.112:0/1049102087 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:42.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f99127fc700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991bfff700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c160880 0x7f991c1632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.625 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 -- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c160880 msgr2=0x7f991c1632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c160880 0x7f991c1632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 -- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 msgr2=0x7f991c154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.626 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 -- 172.21.15.112:0/1049102087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c009a70 con 0x7f991c0b2240 2023-11-08T12:32:42.627 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f99127fc700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:42.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f991affd700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f991c0b2240 0x7f991c0c94d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f990c000f80 tx=0x7f990c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:42.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f9913fff700 1 -- 172.21.15.112:0/1049102087 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c01b8d0 con 0x7f991c0b2240 2023-11-08T12:32:42.629 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f9913fff700 1 -- 172.21.15.112:0/1049102087 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c020070 con 0x7f991c0b2240 2023-11-08T12:32:42.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f9913fff700 1 -- 172.21.15.112:0/1049102087 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c01bcb0 con 0x7f991c0b2240 2023-11-08T12:32:42.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c0cef10 con 0x7f991c0b2240 2023-11-08T12:32:42.630 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c0cec30 con 0x7f991c0b2240 2023-11-08T12:32:42.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.618+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0cb240 con 0x7f991c0b2240 2023-11-08T12:32:42.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.622+0000 7f9913fff700 1 -- 172.21.15.112:0/1049102087 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f990c01c400 con 0x7f991c0b2240 2023-11-08T12:32:42.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.622+0000 7f9913fff700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98fc064ee0 0x7f98fc067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:42.631 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.622+0000 7f9913fff700 1 -- 172.21.15.112:0/1049102087 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f990c022070 con 0x7f991c0b2240 2023-11-08T12:32:42.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.622+0000 7f99127fc700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98fc064ee0 0x7f98fc067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:42.632 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.622+0000 7f99127fc700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98fc064ee0 0x7f98fc067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f991c15bd00 tx=0x7f9904007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:42.634 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.630+0000 7f9913fff700 1 -- 172.21.15.112:0/1049102087 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f990c0526e0 con 0x7f991c0b2240 2023-11-08T12:32:42.812 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.806+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f991c0c9180 con 0x7f98fc064ee0 2023-11-08T12:32:42.813 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f9913fff700 1 -- 172.21.15.112:0/1049102087 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9904005d10 con 0x7f98fc064ee0 2023-11-08T12:32:42.816 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98fc064ee0 msgr2=0x7f98fc067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98fc064ee0 0x7f98fc067390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f991c15bd00 tx=0x7f9904007e70 comp rx=0 tx=0).stop 2023-11-08T12:32:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f991c0b2240 msgr2=0x7f991c0c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f991c0b2240 0x7f991c0c94d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f990c000f80 tx=0x7f990c004af0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.817 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 shutdown_connections 2023-11-08T12:32:42.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f98fc064ee0 0x7f98fc067390 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c160880 0x7f991c1632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.818 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c1604b0 0x7f991c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 --2- 172.21.15.112:0/1049102087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f991c0b2240 0x7f991c0c94d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 >> 172.21.15.112:0/1049102087 conn(0x7f991c0ccb30 msgr2=0x7f991c0c2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:42.819 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 shutdown_connections 2023-11-08T12:32:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:42.810+0000 7f992178b700 1 -- 172.21.15.112:0/1049102087 wait complete. 2023-11-08T12:32:42.820 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 5 to deep-scrub 2023-11-08T12:32:42.837 INFO:tasks.ceph:Scrubbing osd.6 2023-11-08T12:32:42.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:43.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.010+0000 7f621c66d700 1 Processor -- start 2023-11-08T12:32:43.015 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.010+0000 7f621c66d700 1 -- start start 2023-11-08T12:32:43.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621c66d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6214153620 0x7f621415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621c66d700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62140b0fa0 con 0x7f621406b410 2023-11-08T12:32:43.018 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621c66d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621415cc00 con 0x7f6214159610 2023-11-08T12:32:43.019 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621c66d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621415dc00 con 0x7f6214153620 2023-11-08T12:32:43.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621ac0a700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f621406b410 0x7f62140b16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51810/0 (socket says 172.21.15.112:51810) 2023-11-08T12:32:43.020 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621ac0a700 1 -- 172.21.15.112:0/995627058 learned_addr learned my addr 172.21.15.112:0/995627058 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:43.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621a409700 1 --2- 172.21.15.112:0/995627058 >> v2:172.21.15.133:3300/0 conn(0x7f6214153620 0x7f621415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f6219407700 1 -- 172.21.15.112:0/995627058 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195091268 0 0) 0x7f62140b0fa0 con 0x7f621406b410 2023-11-08T12:32:43.021 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f6219407700 1 -- 172.21.15.112:0/995627058 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62000035d0 con 0x7f621406b410 2023-11-08T12:32:43.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621a409700 1 -- 172.21.15.112:0/995627058 >> v1:172.21.15.133:6789/0 conn(0x7f6214159610 legacy=0x7f621406ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f6219407700 1 -- 172.21.15.112:0/995627058 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419899732 0 0) 0x7f621415cc00 con 0x7f6214159610 2023-11-08T12:32:43.022 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621a409700 1 -- 172.21.15.112:0/995627058 >> v1:172.21.15.112:6789/0 conn(0x7f621406b410 legacy=0x7f62140b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621a409700 1 -- 172.21.15.112:0/995627058 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621415a1d0 con 0x7f6214153620 2023-11-08T12:32:43.023 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f621a409700 1 --2- 172.21.15.112:0/995627058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214153620 0x7f621415d6c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6210009850 tx=0x7f6210009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ac074803753cc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.024 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f6219407700 1 -- 172.21.15.112:0/995627058 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210011830 con 0x7f6214153620 2023-11-08T12:32:43.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f6219407700 1 -- 172.21.15.112:0/995627058 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210011990 con 0x7f6214153620 2023-11-08T12:32:43.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.014+0000 7f6219407700 1 -- 172.21.15.112:0/995627058 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210011d40 con 0x7f6214153620 2023-11-08T12:32:43.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.018+0000 7f621c66d700 1 -- 172.21.15.112:0/995627058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214153620 msgr2=0x7f621415d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.025 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.018+0000 7f621c66d700 1 --2- 172.21.15.112:0/995627058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214153620 0x7f621415d6c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6210009850 tx=0x7f6210009b60 comp rx=0 tx=0).stop 2023-11-08T12:32:43.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.018+0000 7f621c66d700 1 -- 172.21.15.112:0/995627058 shutdown_connections 2023-11-08T12:32:43.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.018+0000 7f621c66d700 1 --2- 172.21.15.112:0/995627058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214153620 0x7f621415d6c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.026 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.018+0000 7f621c66d700 1 -- 172.21.15.112:0/995627058 >> 172.21.15.112:0/995627058 conn(0x7f621406bfc0 msgr2=0x7f621406c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.018+0000 7f621c66d700 1 -- 172.21.15.112:0/995627058 shutdown_connections 2023-11-08T12:32:43.027 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.018+0000 7f621c66d700 1 -- 172.21.15.112:0/995627058 wait complete. 2023-11-08T12:32:43.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 Processor -- start 2023-11-08T12:32:43.029 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 -- start start 2023-11-08T12:32:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f621406b410 0x7f621414c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6214153620 0x7f621414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.030 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214159610 0x7f62140cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621414c840 con 0x7f621406b410 2023-11-08T12:32:43.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6214151bb0 con 0x7f6214159610 2023-11-08T12:32:43.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621414dc40 con 0x7f6214153620 2023-11-08T12:32:43.031 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f621406b410 0x7f621414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f621406b410 0x7f621414c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52080/0 (socket says 172.21.15.112:52080) 2023-11-08T12:32:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 -- 172.21.15.112:0/3558263974 learned_addr learned my addr 172.21.15.112:0/3558263974 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:43.032 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621ac0a700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214159610 0x7f62140cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f6219c08700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6214153620 0x7f621414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 -- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6214153620 msgr2=0x7f621414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6214153620 0x7f621414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.033 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 -- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214159610 msgr2=0x7f62140cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214159610 0x7f62140cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 -- 172.21.15.112:0/3558263974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100094b0 con 0x7f621406b410 2023-11-08T12:32:43.034 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621ac0a700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6214159610 0x7f62140cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f6219c08700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6214153620 0x7f621414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:32:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621a409700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f621406b410 0x7f621414c300 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f621406d0a0 tx=0x7f6210004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.035 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621001ab70 con 0x7f621406b410 2023-11-08T12:32:43.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621001f070 con 0x7f621406b410 2023-11-08T12:32:43.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621001b430 con 0x7f621406b410 2023-11-08T12:32:43.036 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621415cec0 con 0x7f621406b410 2023-11-08T12:32:43.037 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.022+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621415a4b0 con 0x7f621406b410 2023-11-08T12:32:43.038 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.026+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f621415d1a0 con 0x7f621406b410 2023-11-08T12:32:43.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.026+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f6210035070 con 0x7f621406b410 2023-11-08T12:32:43.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.026+0000 7f620affd700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f61f8064ee0 0x7f61f8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.039 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.026+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f62100839d0 con 0x7f621406b410 2023-11-08T12:32:43.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.030+0000 7f6219c08700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f61f8064ee0 0x7f61f8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.030+0000 7f620affd700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f61f806b7f0 0x7f61f806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.040 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.030+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 --> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61f806e2f0 con 0x7f61f806b7f0 2023-11-08T12:32:43.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.030+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6210083e10 con 0x7f621406b410 2023-11-08T12:32:43.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.030+0000 7f621ac0a700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f61f806b7f0 0x7f61f806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.030+0000 7f6219c08700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f61f8064ee0 0x7f61f8067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6214153f10 tx=0x7f6204009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.041 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.030+0000 7f621ac0a700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f61f806b7f0 0x7f61f806dc20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.042 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.034+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== osd.6 v2:172.21.15.133:6816/35802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f61f806e2f0 con 0x7f61f806b7f0 2023-11-08T12:32:43.056 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.050+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 --> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62140726c0 con 0x7f61f806b7f0 2023-11-08T12:32:43.057 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.050+0000 7f620affd700 1 -- 172.21.15.112:0/3558263974 <== osd.6 v2:172.21.15.133:6816/35802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f62140726c0 con 0x7f61f806b7f0 2023-11-08T12:32:43.057 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:43.058 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:43.058 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f61f806b7f0 msgr2=0x7f61f806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.133:6816/35802,v1:172.21.15.133:6817/35802] conn(0x7f61f806b7f0 0x7f61f806dc20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.062 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f61f8064ee0 msgr2=0x7f61f8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f61f8064ee0 0x7f61f8067390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6214153f10 tx=0x7f6204009040 comp rx=0 tx=0).stop 2023-11-08T12:32:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f621406b410 msgr2=0x7f621414c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 --2- 172.21.15.112:0/3558263974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f621406b410 0x7f621414c300 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f621406d0a0 tx=0x7f6210004770 comp rx=0 tx=0).stop 2023-11-08T12:32:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621ac0a700 1 -- 172.21.15.112:0/3558263974 reap_dead start 2023-11-08T12:32:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 shutdown_connections 2023-11-08T12:32:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 >> 172.21.15.112:0/3558263974 conn(0x7f621406bfc0 msgr2=0x7f6214069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 shutdown_connections 2023-11-08T12:32:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.054+0000 7f621c66d700 1 -- 172.21.15.112:0/3558263974 wait complete. 2023-11-08T12:32:43.084 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-08T12:32:43.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.250+0000 7f83c16c3700 1 Processor -- start 2023-11-08T12:32:43.256 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.250+0000 7f83c16c3700 1 -- start start 2023-11-08T12:32:43.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.250+0000 7f83c16c3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83bc15c410 0x7f83bc160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.257 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83c16c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc0b1240 0x7f83bc0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83c16c3700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc0b1bc0 con 0x7f83bc0cf2a0 2023-11-08T12:32:43.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83c16c3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc0ca740 con 0x7f83bc15c410 2023-11-08T12:32:43.258 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83c16c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc161020 con 0x7f83bc0b1240 2023-11-08T12:32:43.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83baffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83bc15c410 0x7f83bc160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83baffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83bc15c410 0x7f83bc160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.112:37682/0 (socket says 172.21.15.112:37682) 2023-11-08T12:32:43.260 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83baffd700 1 -- 172.21.15.112:0/3899211047 learned_addr learned my addr 172.21.15.112:0/3899211047 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83bb7fe700 1 --2- 172.21.15.112:0/3899211047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc0b1240 0x7f83bc0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83bb7fe700 1 -- 172.21.15.112:0/3899211047 >> v2:172.21.15.133:3300/0 conn(0x7f83bc15c410 msgr2=0x7f83bc160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83bb7fe700 1 --2- 172.21.15.112:0/3899211047 >> v2:172.21.15.133:3300/0 conn(0x7f83bc15c410 0x7f83bc160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.261 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83b9ffb700 1 -- 172.21.15.112:0/3899211047 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285507024 0 0) 0x7f83bc0b1bc0 con 0x7f83bc0cf2a0 2023-11-08T12:32:43.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83bb7fe700 1 -- 172.21.15.112:0/3899211047 >> v1:172.21.15.112:6789/0 conn(0x7f83bc0cf2a0 legacy=0x7f83bc069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83bb7fe700 1 -- 172.21.15.112:0/3899211047 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0ca9e0 con 0x7f83bc0b1240 2023-11-08T12:32:43.262 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83baffd700 1 --2- 172.21.15.112:0/3899211047 >> v2:172.21.15.133:3300/0 conn(0x7f83bc15c410 0x7f83bc160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-08T12:32:43.263 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83bb7fe700 1 --2- 172.21.15.112:0/3899211047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc0b1240 0x7f83bc0b1680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009d90 tx=0x7f83b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c3430a43bfb502b server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83b9ffb700 1 -- 172.21.15.112:0/3899211047 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400e070 con 0x7f83bc0b1240 2023-11-08T12:32:43.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83b9ffb700 1 -- 172.21.15.112:0/3899211047 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400bb20 con 0x7f83bc0b1240 2023-11-08T12:32:43.264 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.254+0000 7f83b9ffb700 1 -- 172.21.15.112:0/3899211047 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4012430 con 0x7f83bc0b1240 2023-11-08T12:32:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 -- 172.21.15.112:0/3899211047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc0b1240 msgr2=0x7f83bc0b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 --2- 172.21.15.112:0/3899211047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc0b1240 0x7f83bc0b1680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009d90 tx=0x7f83b400b330 comp rx=0 tx=0).stop 2023-11-08T12:32:43.265 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 -- 172.21.15.112:0/3899211047 shutdown_connections 2023-11-08T12:32:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 --2- 172.21.15.112:0/3899211047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc0b1240 0x7f83bc0b1680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 --2- 172.21.15.112:0/3899211047 >> v2:172.21.15.133:3300/0 conn(0x7f83bc15c410 0x7f83bc160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.266 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 -- 172.21.15.112:0/3899211047 >> 172.21.15.112:0/3899211047 conn(0x7f83bc0cc240 msgr2=0x7f83bc0cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:43.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 -- 172.21.15.112:0/3899211047 shutdown_connections 2023-11-08T12:32:43.267 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 -- 172.21.15.112:0/3899211047 wait complete. 2023-11-08T12:32:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 Processor -- start 2023-11-08T12:32:43.269 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.258+0000 7f83c16c3700 1 -- start start 2023-11-08T12:32:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc0b1240 0x7f83bc149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc0cf2a0 0x7f83bc15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.270 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc15c410 0x7f83bc15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0c40f0 con 0x7f83bc0b1240 2023-11-08T12:32:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc14adf0 con 0x7f83bc0cf2a0 2023-11-08T12:32:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc147b50 con 0x7f83bc15c410 2023-11-08T12:32:43.271 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc0b1240 0x7f83bc149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc0b1240 0x7f83bc149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52096/0 (socket says 172.21.15.112:52096) 2023-11-08T12:32:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 -- 172.21.15.112:0/398638665 learned_addr learned my addr 172.21.15.112:0/398638665 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:43.272 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83ba7fc700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc0cf2a0 0x7f83bc15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83bb7fe700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc15c410 0x7f83bc15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 -- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc15c410 msgr2=0x7f83bc15cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc15c410 0x7f83bc15cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.273 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 -- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc0cf2a0 msgr2=0x7f83bc15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc0cf2a0 0x7f83bc15c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 -- 172.21.15.112:0/398638665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009570 con 0x7f83bc0b1240 2023-11-08T12:32:43.274 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83ba7fc700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc0cf2a0 0x7f83bc15c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:43.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83baffd700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc0b1240 0x7f83bc149ec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebe0 tx=0x7f83ac009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83a37fe700 1 -- 172.21.15.112:0/398638665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00c910 con 0x7f83bc0b1240 2023-11-08T12:32:43.275 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83a37fe700 1 -- 172.21.15.112:0/398638665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00ca70 con 0x7f83bc0b1240 2023-11-08T12:32:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83a37fe700 1 -- 172.21.15.112:0/398638665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00cde0 con 0x7f83bc0b1240 2023-11-08T12:32:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b4009a70 con 0x7f83bc0b1240 2023-11-08T12:32:43.276 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.262+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc0cdb90 con 0x7f83bc0b1240 2023-11-08T12:32:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.266+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc0cacc0 con 0x7f83bc0b1240 2023-11-08T12:32:43.277 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.266+0000 7f83a37fe700 1 -- 172.21.15.112:0/398638665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f83ac019030 con 0x7f83bc0b1240 2023-11-08T12:32:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.266+0000 7f83a37fe700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83a8064f10 0x7f83a80673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.266+0000 7f83a37fe700 1 -- 172.21.15.112:0/398638665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f83ac081a90 con 0x7f83bc0b1240 2023-11-08T12:32:43.278 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.266+0000 7f83ba7fc700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83a8064f10 0x7f83a80673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.270+0000 7f83ba7fc700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83a8064f10 0x7f83a80673c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f83bc160920 tx=0x7f83b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.279 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.274+0000 7f83a37fe700 1 -- 172.21.15.112:0/398638665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f83ac04fd70 con 0x7f83bc0b1240 2023-11-08T12:32:43.451 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.446+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f83bc0cde70 con 0x7f83a8064f10 2023-11-08T12:32:43.452 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.446+0000 7f83a37fe700 1 -- 172.21.15.112:0/398638665 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83bc0cde70 con 0x7f83a8064f10 2023-11-08T12:32:43.454 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83a8064f10 msgr2=0x7f83a80673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83a8064f10 0x7f83a80673c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f83bc160920 tx=0x7f83b0009040 comp rx=0 tx=0).stop 2023-11-08T12:32:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc0b1240 msgr2=0x7f83bc149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.455 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc0b1240 0x7f83bc149ec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebe0 tx=0x7f83ac009e90 comp rx=0 tx=0).stop 2023-11-08T12:32:43.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 shutdown_connections 2023-11-08T12:32:43.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f83a8064f10 0x7f83a80673c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.456 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc15c410 0x7f83bc15cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc0cf2a0 0x7f83bc15c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 --2- 172.21.15.112:0/398638665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83bc0b1240 0x7f83bc149ec0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.457 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 >> 172.21.15.112:0/398638665 conn(0x7f83bc0cc240 msgr2=0x7f83bc0b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:43.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 shutdown_connections 2023-11-08T12:32:43.458 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.450+0000 7f83c16c3700 1 -- 172.21.15.112:0/398638665 wait complete. 2023-11-08T12:32:43.459 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 6 to deep-scrub 2023-11-08T12:32:43.476 INFO:tasks.ceph:Scrubbing osd.7 2023-11-08T12:32:43.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-08T12:32:43.658 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.654+0000 7f51fda8a700 1 Processor -- start 2023-11-08T12:32:43.659 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.654+0000 7f51fda8a700 1 -- start start 2023-11-08T12:32:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51f80b0d30 0x7f51f8140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.662 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51f815e7c0 0x7f51f80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f8141d60 con 0x7f51f8141220 2023-11-08T12:32:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f815ec40 con 0x7f51f80b0d30 2023-11-08T12:32:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f8141670 con 0x7f51f815e7c0 2023-11-08T12:32:43.663 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f77fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51f80b0d30 0x7f51f8140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51effff700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f51f8141220 0x7f51f815e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51820/0 (socket says 172.21.15.112:51820) 2023-11-08T12:32:43.664 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51effff700 1 -- 172.21.15.112:0/2358591832 learned_addr learned my addr 172.21.15.112:0/2358591832 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:43.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f7fff700 1 --2- 172.21.15.112:0/2358591832 >> v2:172.21.15.133:3300/0 conn(0x7f51f815e7c0 0x7f51f80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f77fe700 1 -- 172.21.15.112:0/2358591832 >> v2:172.21.15.133:3300/0 conn(0x7f51f815e7c0 msgr2=0x7f51f80cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:43.666 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f77fe700 1 --2- 172.21.15.112:0/2358591832 >> v2:172.21.15.133:3300/0 conn(0x7f51f815e7c0 0x7f51f80cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f77fe700 1 -- 172.21.15.112:0/2358591832 >> v1:172.21.15.112:6789/0 conn(0x7f51f8141220 legacy=0x7f51f815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f77fe700 1 -- 172.21.15.112:0/2358591832 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f815a790 con 0x7f51f80b0d30 2023-11-08T12:32:43.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f77fe700 1 --2- 172.21.15.112:0/2358591832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f8140ce0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f51f8158360 tx=0x7f51e8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172769c3dc84380f server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.667 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f6ffd700 1 -- 172.21.15.112:0/2358591832 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8011830 con 0x7f51f80b0d30 2023-11-08T12:32:43.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f6ffd700 1 -- 172.21.15.112:0/2358591832 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8011990 con 0x7f51f80b0d30 2023-11-08T12:32:43.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51f6ffd700 1 -- 172.21.15.112:0/2358591832 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8011d40 con 0x7f51f80b0d30 2023-11-08T12:32:43.668 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- 172.21.15.112:0/2358591832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 msgr2=0x7f51f8140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 --2- 172.21.15.112:0/2358591832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f8140ce0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f51f8158360 tx=0x7f51e8009b30 comp rx=0 tx=0).stop 2023-11-08T12:32:43.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- 172.21.15.112:0/2358591832 shutdown_connections 2023-11-08T12:32:43.669 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 --2- 172.21.15.112:0/2358591832 >> v2:172.21.15.133:3300/0 conn(0x7f51f815e7c0 0x7f51f80cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 --2- 172.21.15.112:0/2358591832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f8140ce0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- 172.21.15.112:0/2358591832 >> 172.21.15.112:0/2358591832 conn(0x7f51f806bfc0 msgr2=0x7f51f806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:43.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- 172.21.15.112:0/2358591832 shutdown_connections 2023-11-08T12:32:43.670 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.658+0000 7f51fda8a700 1 -- 172.21.15.112:0/2358591832 wait complete. 2023-11-08T12:32:43.674 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.662+0000 7f51fda8a700 1 Processor -- start 2023-11-08T12:32:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.662+0000 7f51fda8a700 1 -- start start 2023-11-08T12:32:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51fda8a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f813b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.675 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51fda8a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51f8141220 0x7f51f81569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51fda8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51f815e7c0 0x7f51f8140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51fda8a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81521b0 con 0x7f51f80b0d30 2023-11-08T12:32:43.676 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51fda8a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8156ef0 con 0x7f51f815e7c0 2023-11-08T12:32:43.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51fda8a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f813da50 con 0x7f51f8141220 2023-11-08T12:32:43.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.677 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52124/0 (socket says 172.21.15.112:52124) 2023-11-08T12:32:43.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 -- 172.21.15.112:0/3460244165 learned_addr learned my addr 172.21.15.112:0/3460244165 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:43.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51effff700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51f8141220 0x7f51f81569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.678 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f7fff700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51f815e7c0 0x7f51f8140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 -- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51f8141220 msgr2=0x7f51f81569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51f8141220 0x7f51f81569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 -- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51f815e7c0 msgr2=0x7f51f8140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.679 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51f815e7c0 0x7f51f8140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 -- 172.21.15.112:0/3460244165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e80094b0 con 0x7f51f80b0d30 2023-11-08T12:32:43.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51effff700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51f8141220 0x7f51f81569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:43.680 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.666+0000 7f51f77fe700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f813b660 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f51e80090b0 tx=0x7f51e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.670+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8004480 con 0x7f51f80b0d30 2023-11-08T12:32:43.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.670+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e801f070 con 0x7f51f80b0d30 2023-11-08T12:32:43.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.670+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f815ad30 con 0x7f51f80b0d30 2023-11-08T12:32:43.681 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.670+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003900 con 0x7f51f80b0d30 2023-11-08T12:32:43.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.670+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f815aa50 con 0x7f51f80b0d30 2023-11-08T12:32:43.682 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.670+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51f815b010 con 0x7f51f80b0d30 2023-11-08T12:32:43.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.670+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f51e802a020 con 0x7f51f80b0d30 2023-11-08T12:32:43.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51f4ff9700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51d8064ee0 0x7f51d8067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f51e80838d0 con 0x7f51f80b0d30 2023-11-08T12:32:43.684 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51f4ff9700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7f51d806b7f0 0x7f51d806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 --> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51d806e2f0 con 0x7f51d806b7f0 2023-11-08T12:32:43.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51e8083d10 con 0x7f51f80b0d30 2023-11-08T12:32:43.685 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51effff700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51d8064ee0 0x7f51d8067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51f7fff700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7f51d806b7f0 0x7f51d806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51effff700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51d8064ee0 0x7f51d8067390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f51e0007fd0 tx=0x7f51e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.674+0000 7f51f7fff700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7f51d806b7f0 0x7f51d806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.686 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.678+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== osd.7 v2:172.21.15.133:6824/35803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f51d806e2f0 con 0x7f51d806b7f0 2023-11-08T12:32:43.699 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.694+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 --> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51f81522f0 con 0x7f51d806b7f0 2023-11-08T12:32:43.700 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.694+0000 7f51f4ff9700 1 -- 172.21.15.112:0/3460244165 <== osd.7 v2:172.21.15.133:6824/35803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f51f00083a0 con 0x7f51d806b7f0 2023-11-08T12:32:43.701 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2023-11-08T12:32:43.701 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T12:32:43.702 INFO:teuthology.orchestra.run.smithi112.stdout:} 2023-11-08T12:32:43.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.694+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7f51d806b7f0 msgr2=0x7f51d806dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.694+0000 7f51fda8a700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.133:6824/35803,v1:172.21.15.133:6825/35803] conn(0x7f51d806b7f0 0x7f51d806dc20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.703 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51d8064ee0 msgr2=0x7f51d8067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f51d8064ee0 0x7f51d8067390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f51e0007fd0 tx=0x7f51e0009040 comp rx=0 tx=0).stop 2023-11-08T12:32:43.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 msgr2=0x7f51f813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.704 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 --2- 172.21.15.112:0/3460244165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51f80b0d30 0x7f51f813b660 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f51e80090b0 tx=0x7f51e8004770 comp rx=0 tx=0).stop 2023-11-08T12:32:43.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51f7fff700 1 -- 172.21.15.112:0/3460244165 reap_dead start 2023-11-08T12:32:43.705 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 shutdown_connections 2023-11-08T12:32:43.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 >> 172.21.15.112:0/3460244165 conn(0x7f51f806bfc0 msgr2=0x7f51f815bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:43.706 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 shutdown_connections 2023-11-08T12:32:43.708 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.698+0000 7f51fda8a700 1 -- 172.21.15.112:0/3460244165 wait complete. 2023-11-08T12:32:43.728 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-08T12:32:43.908 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.902+0000 7f1faec62700 1 Processor -- start 2023-11-08T12:32:43.909 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.902+0000 7f1faec62700 1 -- start start 2023-11-08T12:32:43.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1faec62700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1fa80b42d0 0x7f1fa80cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1faec62700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1fa8069bf0 0x7f1fa80d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.911 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1faec62700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa806a1b0 con 0x7f1fa815c1a0 2023-11-08T12:32:43.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1faec62700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80ccf70 con 0x7f1fa80b42d0 2023-11-08T12:32:43.912 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1faec62700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa806a490 con 0x7f1fa8069bf0 2023-11-08T12:32:43.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fac9fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1fa815c1a0 0x7f1fa80b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.112:37584/0 (socket says 172.21.15.112:37584) 2023-11-08T12:32:43.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fac9fe700 1 -- 172.21.15.112:0/2952752308 learned_addr learned my addr 172.21.15.112:0/2952752308 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:43.914 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa7fff700 1 --2- 172.21.15.112:0/2952752308 >> v2:172.21.15.112:3300/0 conn(0x7f1fa80b42d0 0x7f1fa80cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fada00700 1 --2- 172.21.15.112:0/2952752308 >> v2:172.21.15.133:3300/0 conn(0x7f1fa8069bf0 0x7f1fa80d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa77fe700 1 -- 172.21.15.112:0/2952752308 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995888768 0 0) 0x7f1fa806a1b0 con 0x7f1fa815c1a0 2023-11-08T12:32:43.915 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa77fe700 1 -- 172.21.15.112:0/2952752308 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f980035d0 con 0x7f1fa815c1a0 2023-11-08T12:32:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa7fff700 1 -- 172.21.15.112:0/2952752308 >> v2:172.21.15.133:3300/0 conn(0x7f1fa8069bf0 msgr2=0x7f1fa80d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa7fff700 1 --2- 172.21.15.112:0/2952752308 >> v2:172.21.15.133:3300/0 conn(0x7f1fa8069bf0 0x7f1fa80d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa7fff700 1 -- 172.21.15.112:0/2952752308 >> v1:172.21.15.133:6789/0 conn(0x7f1fa815c1a0 legacy=0x7f1fa80b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.916 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa7fff700 1 -- 172.21.15.112:0/2952752308 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa806a770 con 0x7f1fa80b42d0 2023-11-08T12:32:43.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.906+0000 7f1fa7fff700 1 --2- 172.21.15.112:0/2952752308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa80cca30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80b11d0 tx=0x7f1f94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8444eba000814f78 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1fa77fe700 1 -- 172.21.15.112:0/2952752308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94011830 con 0x7f1fa80b42d0 2023-11-08T12:32:43.917 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1fa77fe700 1 -- 172.21.15.112:0/2952752308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f94011990 con 0x7f1fa80b42d0 2023-11-08T12:32:43.918 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1fa77fe700 1 -- 172.21.15.112:0/2952752308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94011d20 con 0x7f1fa80b42d0 2023-11-08T12:32:43.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 -- 172.21.15.112:0/2952752308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 msgr2=0x7f1fa80cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 --2- 172.21.15.112:0/2952752308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa80cca30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80b11d0 tx=0x7f1f94009b30 comp rx=0 tx=0).stop 2023-11-08T12:32:43.919 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 -- 172.21.15.112:0/2952752308 shutdown_connections 2023-11-08T12:32:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 --2- 172.21.15.112:0/2952752308 >> v2:172.21.15.133:3300/0 conn(0x7f1fa8069bf0 0x7f1fa80d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 --2- 172.21.15.112:0/2952752308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa80cca30 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.920 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 -- 172.21.15.112:0/2952752308 >> 172.21.15.112:0/2952752308 conn(0x7f1fa80cebc0 msgr2=0x7f1fa80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:43.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 -- 172.21.15.112:0/2952752308 shutdown_connections 2023-11-08T12:32:43.921 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.910+0000 7f1faec62700 1 -- 172.21.15.112:0/2952752308 wait complete. 2023-11-08T12:32:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.914+0000 7f1faec62700 1 Processor -- start 2023-11-08T12:32:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.914+0000 7f1faec62700 1 -- start start 2023-11-08T12:32:43.923 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fa8069bf0 0x7f1fa815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa815eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa815c1a0 0x7f1fa815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.924 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81f1fd0 con 0x7f1fa80b42d0 2023-11-08T12:32:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80cb730 con 0x7f1fa815c1a0 2023-11-08T12:32:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80cba10 con 0x7f1fa8069bf0 2023-11-08T12:32:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa815eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.925 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa815eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52140/0 (socket says 172.21.15.112:52140) 2023-11-08T12:32:43.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 -- 172.21.15.112:0/3681620531 learned_addr learned my addr 172.21.15.112:0/3681620531 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:43.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fac9fe700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fa8069bf0 0x7f1fa815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.926 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fada00700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa815c1a0 0x7f1fa815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 -- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fa8069bf0 msgr2=0x7f1fa815a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fa8069bf0 0x7f1fa815a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.927 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 -- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa815c1a0 msgr2=0x7f1fa815f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa815c1a0 0x7f1fa815f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 -- 172.21.15.112:0/3681620531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940094b0 con 0x7f1fa80b42d0 2023-11-08T12:32:43.928 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fada00700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa815c1a0 0x7f1fa815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-08T12:32:43.929 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa7fff700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa815eb30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009b70 tx=0x7f1f94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa57fa700 1 -- 172.21.15.112:0/3681620531 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94004480 con 0x7f1fa80b42d0 2023-11-08T12:32:43.930 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa57fa700 1 -- 172.21.15.112:0/3681620531 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9401f070 con 0x7f1fa80b42d0 2023-11-08T12:32:43.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa80cfd10 con 0x7f1fa80b42d0 2023-11-08T12:32:43.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1fa57fa700 1 -- 172.21.15.112:0/3681620531 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940038c0 con 0x7f1fa80b42d0 2023-11-08T12:32:43.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.918+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa806aa50 con 0x7f1fa80b42d0 2023-11-08T12:32:43.931 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.922+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa815c570 con 0x7f1fa80b42d0 2023-11-08T12:32:43.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.922+0000 7f1fa57fa700 1 -- 172.21.15.112:0/3681620531 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f1f9402a020 con 0x7f1fa80b42d0 2023-11-08T12:32:43.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.926+0000 7f1fa57fa700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f8c064ee0 0x7f1f8c067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:43.932 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.926+0000 7f1fa57fa700 1 -- 172.21.15.112:0/3681620531 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1f940832e0 con 0x7f1fa80b42d0 2023-11-08T12:32:43.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.926+0000 7f1fac9fe700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f8c064ee0 0x7f1f8c067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:43.933 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.926+0000 7f1fac9fe700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f8c064ee0 0x7f1f8c067390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0011e0 tx=0x7f1f9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:43.935 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:43.930+0000 7f1fa57fa700 1 -- 172.21.15.112:0/3681620531 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f1f94051570 con 0x7f1fa80b42d0 2023-11-08T12:32:44.107 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.102+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fa80726c0 con 0x7f1f8c064ee0 2023-11-08T12:32:44.108 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.102+0000 7f1fa57fa700 1 -- 172.21.15.112:0/3681620531 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1fa80726c0 con 0x7f1f8c064ee0 2023-11-08T12:32:44.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f8c064ee0 msgr2=0x7f1f8c067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f8c064ee0 0x7f1f8c067390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0011e0 tx=0x7f1f9c009040 comp rx=0 tx=0).stop 2023-11-08T12:32:44.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 msgr2=0x7f1fa815eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.111 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa815eb30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009b70 tx=0x7f1f94004770 comp rx=0 tx=0).stop 2023-11-08T12:32:44.112 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 shutdown_connections 2023-11-08T12:32:44.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f1f8c064ee0 0x7f1f8c067390 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa815c1a0 0x7f1fa815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.113 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fa80b42d0 0x7f1fa815eb30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 --2- 172.21.15.112:0/3681620531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fa8069bf0 0x7f1fa815a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 >> 172.21.15.112:0/3681620531 conn(0x7f1fa80cebc0 msgr2=0x7f1fa80b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:44.114 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 shutdown_connections 2023-11-08T12:32:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.106+0000 7f1faec62700 1 -- 172.21.15.112:0/3681620531 wait complete. 2023-11-08T12:32:44.115 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 7 to deep-scrub 2023-11-08T12:32:44.136 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:32:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.302+0000 7f703359e700 1 Processor -- start 2023-11-08T12:32:44.309 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.302+0000 7f703359e700 1 -- start start 2023-11-08T12:32:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f703415c640 0x7f70340d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:44.310 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034071aa0 0x7f703406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703359e700 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703406c600 con 0x7f7034069e00 2023-11-08T12:32:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703406cef0 con 0x7f703415c640 2023-11-08T12:32:44.311 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70340722f0 con 0x7f7034071aa0 2023-11-08T12:32:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f703415c640 0x7f70340d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f7032d9d700 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7034069e00 0x7f70340d0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51824/0 (socket says 172.21.15.112:51824) 2023-11-08T12:32:44.313 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f7032d9d700 1 -- 172.21.15.112:0/543521297 learned_addr learned my addr 172.21.15.112:0/543521297 (peer_addr_for_me v1:172.21.15.112:0/0) 2023-11-08T12:32:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f7031d9b700 1 --2- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034071aa0 0x7f703406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703259c700 1 -- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034071aa0 msgr2=0x7f703406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:32:44.314 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703259c700 1 --2- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034071aa0 0x7f703406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703259c700 1 -- 172.21.15.112:0/543521297 >> v1:172.21.15.112:6789/0 conn(0x7f7034069e00 legacy=0x7f70340d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703259c700 1 -- 172.21.15.112:0/543521297 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703415ca10 con 0x7f703415c640 2023-11-08T12:32:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703259c700 1 --2- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 0x7f70340d31e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7024009d90 tx=0x7f702400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13eeae92e6540597 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:44.315 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703159a700 1 -- 172.21.15.112:0/543521297 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400e070 con 0x7f703415c640 2023-11-08T12:32:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703159a700 1 -- 172.21.15.112:0/543521297 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400bb20 con 0x7f703415c640 2023-11-08T12:32:44.316 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.306+0000 7f703159a700 1 -- 172.21.15.112:0/543521297 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024012430 con 0x7f703415c640 2023-11-08T12:32:44.317 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 -- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 msgr2=0x7f70340d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 --2- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 0x7f70340d31e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7024009d90 tx=0x7f702400b330 comp rx=0 tx=0).stop 2023-11-08T12:32:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 -- 172.21.15.112:0/543521297 shutdown_connections 2023-11-08T12:32:44.318 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 --2- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034071aa0 0x7f703406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 --2- 172.21.15.112:0/543521297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 0x7f70340d31e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 -- 172.21.15.112:0/543521297 >> 172.21.15.112:0/543521297 conn(0x7f70340b6520 msgr2=0x7f7034071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 -- 172.21.15.112:0/543521297 shutdown_connections 2023-11-08T12:32:44.319 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.310+0000 7f703359e700 1 -- 172.21.15.112:0/543521297 wait complete. 2023-11-08T12:32:44.320 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 Processor -- start 2023-11-08T12:32:44.321 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 -- start start 2023-11-08T12:32:44.322 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034069e00 0x7f703409bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7034071aa0 0x7f703415e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 0x7f703415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:44.323 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703415d660 con 0x7f7034071aa0 2023-11-08T12:32:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703415d940 con 0x7f703415c640 2023-11-08T12:32:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.314+0000 7f703359e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703415dc20 con 0x7f7034069e00 2023-11-08T12:32:44.324 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7034071aa0 0x7f703415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7034071aa0 0x7f703415e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52142/0 (socket says 172.21.15.112:52142) 2023-11-08T12:32:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 -- 172.21.15.112:0/2324573757 learned_addr learned my addr 172.21.15.112:0/2324573757 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:32:44.325 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7032d9d700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 0x7f703415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f703259c700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034069e00 0x7f703409bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 -- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034069e00 msgr2=0x7f703409bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.326 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034069e00 0x7f703409bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 -- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 msgr2=0x7f703415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 0x7f703415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.327 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 -- 172.21.15.112:0/2324573757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024009a70 con 0x7f7034071aa0 2023-11-08T12:32:44.328 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7031d9b700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7034071aa0 0x7f703415e700 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f702800e840 tx=0x7f702800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7022ffd700 1 -- 172.21.15.112:0/2324573757 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70280095a0 con 0x7f7034071aa0 2023-11-08T12:32:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7022ffd700 1 -- 172.21.15.112:0/2324573757 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028013680 con 0x7f7034071aa0 2023-11-08T12:32:44.329 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f7022ffd700 1 -- 172.21.15.112:0/2324573757 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70280139f0 con 0x7f7034071aa0 2023-11-08T12:32:44.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703406c830 con 0x7f7034071aa0 2023-11-08T12:32:44.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.318+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7034072010 con 0x7f7034071aa0 2023-11-08T12:32:44.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.322+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703406cb10 con 0x7f7034071aa0 2023-11-08T12:32:44.330 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.322+0000 7f7022ffd700 1 -- 172.21.15.112:0/2324573757 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7f7028019030 con 0x7f7034071aa0 2023-11-08T12:32:44.331 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.326+0000 7f7022ffd700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7014064ee0 0x7f7014067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:32:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.326+0000 7f7022ffd700 1 -- 172.21.15.112:0/2324573757 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7028081ad0 con 0x7f7034071aa0 2023-11-08T12:32:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.326+0000 7f703259c700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7014064ee0 0x7f7014067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:32:44.332 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.326+0000 7f703259c700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7014064ee0 0x7f7014067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7024014040 tx=0x7f7024011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:32:44.336 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.330+0000 7f7022ffd700 1 -- 172.21.15.112:0/2324573757 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7f702804fd60 con 0x7f7034071aa0 2023-11-08T12:32:44.503 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.498+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7034073cb0 con 0x7f7014064ee0 2023-11-08T12:32:44.510 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.506+0000 7f7022ffd700 1 -- 172.21.15.112:0/2324573757 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70210 (secure 0 0 0) 0x7f7034073cb0 con 0x7f7014064ee0 2023-11-08T12:32:44.511 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:32:44.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.506+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7014064ee0 msgr2=0x7f7014067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7014064ee0 0x7f7014067390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7024014040 tx=0x7f7024011000 comp rx=0 tx=0).stop 2023-11-08T12:32:44.514 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7034071aa0 msgr2=0x7f703415e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:32:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7034071aa0 0x7f703415e700 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f702800e840 tx=0x7f702800eb50 comp rx=0 tx=0).stop 2023-11-08T12:32:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 shutdown_connections 2023-11-08T12:32:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7f7014064ee0 0x7f7014067390 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.515 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703415c640 0x7f703415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7034071aa0 0x7f703415e700 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 --2- 172.21.15.112:0/2324573757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7034069e00 0x7f703409bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:32:44.516 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 >> 172.21.15.112:0/2324573757 conn(0x7f70340b6520 msgr2=0x7f70340b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:32:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 shutdown_connections 2023-11-08T12:32:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:32:44.510+0000 7f703359e700 1 -- 172.21.15.112:0/2324573757 wait complete. 2023-11-08T12:32:44.517 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:32:44.535 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2023-11-08T12:32:42.814472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":94952,"kb_used_data":8232,"kb_used_omap":0,"kb_used_meta":86656,"kb_avail":754879768,"statfs":{"total":773094113280,"available":772996882432,"internally_reserved":0,"allocated":8429568,"data_stored":4570720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":88735744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.905509"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:33.571404+0000","last_change":"2023-11-08T12:27:48.536128+0000","last_active":"2023-11-08T12:32:33.571404+0000","last_peered":"2023-11-08T12:32:33.571404+0000","last_clean":"2023-11-08T12:32:33.571404+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:32:33.571404+0000","last_undegraded":"2023-11-08T12:32:33.571404+0000","last_fullsized":"2023-11-08T12:32:33.571404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:02:09.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:36.254631+0000","last_change":"2023-11-08T12:27:48.537941+0000","last_active":"2023-11-08T12:32:36.254631+0000","last_peered":"2023-11-08T12:32:36.254631+0000","last_clean":"2023-11-08T12:32:36.254631+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:32:36.254631+0000","last_undegraded":"2023-11-08T12:32:36.254631+0000","last_fullsized":"2023-11-08T12:32:36.254631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.912189+0000","last_change":"2023-11-08T12:27:48.737952+0000","last_active":"2023-11-08T12:32:32.912189+0000","last_peered":"2023-11-08T12:32:32.912189+0000","last_clean":"2023-11-08T12:32:32.912189+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:32:32.912189+0000","last_undegraded":"2023-11-08T12:32:32.912189+0000","last_fullsized":"2023-11-08T12:32:32.912189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:40:06.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:36.251447+0000","last_change":"2023-11-08T12:27:48.739616+0000","last_active":"2023-11-08T12:32:36.251447+0000","last_peered":"2023-11-08T12:32:36.251447+0000","last_clean":"2023-11-08T12:32:36.251447+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:32:36.251447+0000","last_undegraded":"2023-11-08T12:32:36.251447+0000","last_fullsized":"2023-11-08T12:32:36.251447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:33.430557+0000","last_change":"2023-11-08T12:27:48.538477+0000","last_active":"2023-11-08T12:32:33.430557+0000","last_peered":"2023-11-08T12:32:33.430557+0000","last_clean":"2023-11-08T12:32:33.430557+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:32:33.430557+0000","last_undegraded":"2023-11-08T12:32:33.430557+0000","last_fullsized":"2023-11-08T12:32:33.430557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:23:21.882826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.916260+0000","last_change":"2023-11-08T12:27:48.535568+0000","last_active":"2023-11-08T12:32:32.916260+0000","last_peered":"2023-11-08T12:32:32.916260+0000","last_clean":"2023-11-08T12:32:32.916260+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:32:32.916260+0000","last_undegraded":"2023-11-08T12:32:32.916260+0000","last_fullsized":"2023-11-08T12:32:32.916260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:24:20.962548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.911196+0000","last_change":"2023-11-08T12:27:48.540027+0000","last_active":"2023-11-08T12:32:32.911196+0000","last_peered":"2023-11-08T12:32:32.911196+0000","last_clean":"2023-11-08T12:32:32.911196+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:32:32.911196+0000","last_undegraded":"2023-11-08T12:32:32.911196+0000","last_fullsized":"2023-11-08T12:32:32.911196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:46:07.897497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:33.431153+0000","last_change":"2023-11-08T12:27:48.537097+0000","last_active":"2023-11-08T12:32:33.431153+0000","last_peered":"2023-11-08T12:32:33.431153+0000","last_clean":"2023-11-08T12:32:33.431153+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:32:33.431153+0000","last_undegraded":"2023-11-08T12:32:33.431153+0000","last_fullsized":"2023-11-08T12:32:33.431153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:47.509170+0000","last_clean_scrub_stamp":"2023-11-08T12:27:47.509170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:47:49.111972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":208,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-11-08T12:32:32.911319+0000","last_change":"2023-11-08T12:27:42.820473+0000","last_active":"2023-11-08T12:32:32.911319+0000","last_peered":"2023-11-08T12:32:32.911319+0000","last_clean":"2023-11-08T12:32:32.911319+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:32:32.911319+0000","last_undegraded":"2023-11-08T12:32:32.911319+0000","last_fullsized":"2023-11-08T12:32:32.911319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:27:41.284190+0000","last_clean_scrub_stamp":"2023-11-08T12:27:41.284190+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T21:47:04.781093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476800,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9980,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361860,"statfs":{"total":96636764160,"available":96626544640,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.123},"min":{"1min":0.64700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.508,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.161,"15min":1.1140000000000001},"min":{"1min":0.72199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5509999999999999,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":0.95199999999999996}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.175,"15min":1.159},"min":{"1min":0.80300000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5289999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.097},{"interface":"front","average":{"1min":1.206,"5min":1.1379999999999999,"15min":1.1180000000000001},"min":{"1min":0.76300000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5269999999999999,"5min":1.851,"15min":1.851},"last":1.258}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.093,"15min":1.0669999999999999},"min":{"1min":0.77100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.266,"15min":1.268},"min":{"1min":0.86099999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.2010000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3200000000000001,"15min":1.3360000000000001},"min":{"1min":1.004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.601,"5min":5.601,"15min":5.601},"last":1.149},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.90300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5349999999999999,"5min":1.73,"15min":1.73},"last":0.92000000000000004}]},{"osd":4,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2669999999999999,"15min":1.3129999999999999},"min":{"1min":0.87,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6579999999999999,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3200000000000001,"15min":1.3600000000000001},"min":{"1min":1.016,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.6619999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.401}]},{"osd":5,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2549999999999999,"15min":1.2809999999999999},"min":{"1min":0.82799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9039999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.129},{"interface":"front","average":{"1min":1.377,"5min":1.427,"15min":1.4590000000000001},"min":{"1min":0.94499999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.857,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.5049999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.429,"15min":1.4730000000000001},"min":{"1min":0.93000000000000005,"5min":0.752,"15min":0.752},"max":{"1min":1.633,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3899999999999999,"15min":1.4319999999999999},"min":{"1min":0.94099999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8200000000000001,"5min":2.121,"15min":2.121},"last":1.298}]}]},{"osd":4,"up_from":16,"seq":68719476800,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":14268,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94357572,"statfs":{"total":96636764160,"available":96622153728,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.01,"15min":0.999},"min":{"1min":0.66200000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.755},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0820000000000001,"15min":1.0620000000000001},"min":{"1min":0.70599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.589,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.284}]},{"osd":1,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.165,"15min":1.1619999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1459999999999999,"15min":1.1890000000000001},"min":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.542,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.163}]},{"osd":2,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2,"15min":1.2150000000000001},"min":{"1min":0.83699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7230000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1659999999999999,"15min":1.1859999999999999},"min":{"1min":0.72299999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5469999999999999,"5min":3.129,"15min":3.129},"last":0.98199999999999998}]},{"osd":3,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.196,"15min":1.216},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5069999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2709999999999999,"15min":1.3089999999999999},"min":{"1min":0.91000000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.548,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.3999999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.196,"15min":1.2809999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.2150000000000001,"15min":1.2190000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6919999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.123}]},{"osd":6,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.347,"15min":1.3799999999999999},"min":{"1min":0.73999999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6459999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.3640000000000001,"15min":1.4139999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7969999999999999,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.1879999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:31:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3700000000000001,"15min":1.405},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7849999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.405,"15min":1.4399999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.837,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.246}]}]},{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.101,"15min":1.141},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4770000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.556},{"interface":"front","average":{"1min":1.095,"5min":1.147,"15min":1.167},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.482,"5min":1.7,"15min":1.7},"last":1.385}]},{"osd":1,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.03,"15min":1.044},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5409999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.288},{"interface":"front","average":{"1min":1.091,"5min":1.0600000000000001,"15min":1.05},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.585,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.998}]},{"osd":2,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.121,"15min":1.121},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.2130000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5109999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.4219999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.415,"5min":1.984,"15min":1.984},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.244,"15min":1.26},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5860000000000001,"5min":2.137,"15min":2.137},"last":1.613}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.218,"15min":1.2749999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.4770000000000001,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1950000000000001,"15min":1.2370000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6719999999999999,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Wed Nov 8 12:31:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2649999999999999,"15min":1.2789999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.7430000000000001,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.222,"15min":1.258},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7010000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.222}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.347,"15min":1.361},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.762,"5min":1.956,"15min":1.956},"last":1.667},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3700000000000001,"15min":1.4099999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.786,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.351}]}]},{"osd":5,"up_from":15,"seq":64424509502,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9916,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361924,"statfs":{"total":96636764160,"available":96626610176,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.5680000000000001,"15min":2},"min":{"1min":1.0149999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6160000000000001,"5min":20.099,"15min":20.099},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.6000000000000001,"15min":2.0670000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5469999999999999,"5min":21.238,"15min":21.238},"last":0.98799999999999999}]},{"osd":1,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.139,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.512,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.234},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2949999999999999,"15min":1.5049999999999999},"min":{"1min":0.74399999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4470000000000001,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":1.5009999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.45,"15min":1.6950000000000001},"min":{"1min":1.091,"5min":0.745,"15min":0.745},"max":{"1min":1.6519999999999999,"5min":11.843,"15min":11.843},"last":1.131},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.4830000000000001,"15min":1.7370000000000001},"min":{"1min":0.79300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.754,"5min":11.907,"15min":11.907},"last":1.3700000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.274,"15min":1.387},"min":{"1min":0.98299999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.5249999999999999,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.046},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3560000000000001,"15min":1.4770000000000001},"min":{"1min":0.84599999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.8500000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.6930000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.21,"15min":1.214},"min":{"1min":0.85399999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.6519999999999999,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.264,"15min":1.286},"min":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.571,"5min":2.073,"15min":2.073},"last":1.766}]},{"osd":6,"last update":"Wed Nov 8 12:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.242,"15min":1.296},"min":{"1min":0.71799999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.631,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3660000000000001,"15min":1.3839999999999999},"min":{"1min":1.097,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.661,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.641}]},{"osd":7,"last update":"Wed Nov 8 12:31:48 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.5329999999999999,"15min":1.754},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6799999999999999,"5min":8.109,"15min":8.109},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.5389999999999999,"15min":1.657},"min":{"1min":1.2150000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.1240000000000001,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.8400000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361668,"statfs":{"total":96636764160,"available":96626348032,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88600000000000001,"15min":0.96799999999999997},"min":{"1min":0.60499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.113,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93300000000000005,"15min":0.97599999999999998},"min":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.349,"5min":1.53,"15min":1.53},"last":0.96799999999999997}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.155,"5min":1.51,"15min":1.51},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.004,"15min":1.0900000000000001},"min":{"1min":0.64100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.502,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.71299999999999997}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0980000000000001,"15min":1.2050000000000001},"min":{"1min":0.61199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.365,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.58799999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.294,"5min":1.972,"15min":1.972},"last":0.62}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1859999999999999,"15min":1.24},"min":{"1min":0.80500000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.359,"5min":1.837,"15min":1.837},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.2829999999999999,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6799999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.056}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.244,"15min":1.294},"min":{"1min":0.84999999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.46,"5min":1.897,"15min":1.897},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.359,"15min":1.4590000000000001},"min":{"1min":0.89700000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.599,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.2390000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.2829999999999999,"15min":1.335},"min":{"1min":0.86599999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.653,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2949999999999999,"15min":1.3300000000000001},"min":{"1min":0.94899999999999995,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4390000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.1020000000000001}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.389,"15min":1.45},"min":{"1min":0.98999999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.7210000000000001,"5min":2.194,"15min":2.194},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.419,"15min":1.488},"min":{"1min":1.04,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.512,"5min":2.472,"15min":2.472},"last":1.226}]}]},{"osd":1,"up_from":15,"seq":64424509503,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10044,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361796,"statfs":{"total":96636764160,"available":96626479104,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.95999999999999996,"15min":0.98699999999999999},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.2009999999999996,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":5.0190000000000001,"5min":5.0190000000000001,"15min":5.0190000000000001},"last":1.1439999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98499999999999999,"15min":1.0289999999999999},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.26,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0960000000000001,"15min":1.1299999999999999},"min":{"1min":0.68999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.4990000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0960000000000001,"15min":1.1180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.546,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":1.0800000000000001},"min":{"1min":0.53600000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":1.4399999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.242,"15min":1.272},"min":{"1min":0.88400000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.2889999999999999,"15min":1.3240000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.573,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.5549999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3620000000000001,"15min":1.4059999999999999},"min":{"1min":0.97299999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.8730000000000002,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.345,"15min":1.4410000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.7190000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.0920000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:31:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3380000000000001,"15min":1.3680000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.3660000000000001,"15min":1.403},"min":{"1min":1.077,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":1.3819999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:31:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.476,"15min":1.5249999999999999},"min":{"1min":1.0349999999999999,"5min":0.874,"15min":0.874},"max":{"1min":4.8230000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.3799999999999999,"15min":1.456},"min":{"1min":1.0600000000000001,"5min":0.996,"15min":0.996},"max":{"1min":1.5680000000000001,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.6060000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.95699999999999996,"15min":1.0940000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4099999999999999,"5min":6.54,"15min":6.54},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98799999999999999,"15min":1.1120000000000001},"min":{"1min":0.66100000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.339,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94499999999999995,"15min":1.014},"min":{"1min":0.63900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.3700000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0229999999999999,"15min":1.0589999999999999},"min":{"1min":0.66700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":3.069,"15min":3.069},"last":1.012}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.0840000000000001},"min":{"1min":0.60399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.4530000000000001,"5min":2.673,"15min":2.673},"last":1.276},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2090000000000001,"15min":1.361},"min":{"1min":0.72099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4870000000000001,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.048}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":1.034,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.7290000000000001,"5min":2.927,"15min":2.927},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3280000000000001,"15min":1.4039999999999999},"min":{"1min":0.97799999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6339999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.7}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3109999999999999,"15min":1.399},"min":{"1min":0.996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.802,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.643},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.401,"15min":1.5269999999999999},"min":{"1min":1.0860000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.5169999999999999,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.444}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4419999999999999,"15min":1.5660000000000001},"min":{"1min":0.94899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.615,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.49},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.395,"15min":1.5049999999999999},"min":{"1min":1.0469999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.597,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.7769999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.4239999999999999,"15min":1.5169999999999999},"min":{"1min":1.2649999999999999,"5min":0.871,"15min":0.871},"max":{"1min":1.6779999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.4350000000000001,"15min":1.5589999999999999},"min":{"1min":1.115,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.875,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.74}]}]},{"osd":2,"up_from":14,"seq":60129542207,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9980,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361860,"statfs":{"total":96636764160,"available":96626544640,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.341,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.746},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84799999999999998,"15min":0.872},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.157,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.089,"15min":1.123},"min":{"1min":0.77900000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.534,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.55600000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.4750000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.59899999999999998}]},{"osd":3,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94099999999999995,"15min":0.96699999999999997},"min":{"1min":0.58599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1779999999999999,"5min":1.837,"15min":1.837},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.0700000000000001,"15min":1.1180000000000001},"min":{"1min":0.79600000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.708,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1739999999999999,"15min":1.1910000000000001},"min":{"1min":0.83399999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.619,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.2989999999999999,"15min":1.367},"min":{"1min":0.92100000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.669,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.5700000000000001}]},{"osd":5,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.323,"15min":1.3859999999999999},"min":{"1min":1.0089999999999999,"5min":0.879,"15min":0.879},"max":{"1min":1.7909999999999999,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.262,"15min":1.3200000000000001},"min":{"1min":0.92100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.524,"5min":3.052,"15min":3.052},"last":1.4139999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3160000000000001,"15min":1.3740000000000001},"min":{"1min":0.96699999999999997,"5min":0.753,"15min":0.753},"max":{"1min":2.0110000000000001,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.353,"15min":1.409},"min":{"1min":1.0469999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8620000000000001,"5min":2.254,"15min":2.254},"last":1.107}]},{"osd":7,"last update":"Wed Nov 8 12:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":1.0149999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.752,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.4199999999999999,"15min":1.4670000000000001},"min":{"1min":1.1970000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.948,"5min":3.5,"15min":3.5},"last":1.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:32:44.540 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.541 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.541 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.541 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.542 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.542 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.543 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.543 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T12:27:47.509170+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=47, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.543 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T12:27:41.284190+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=27, tm_sec=41, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=12, tm_min=32, tm_sec=37, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T12:32:44.544 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T12:33:04.545 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T12:33:04.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.725+0000 7fcee8c12700 1 Processor -- start 2023-11-08T12:33:04.731 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.725+0000 7fcee8c12700 1 -- start start 2023-11-08T12:33:04.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.725+0000 7fcee8c12700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcee4160710 0x7fcee40cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:04.733 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.725+0000 7fcee8c12700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcee4070790 0x7fcee4164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:04.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.725+0000 7fcee8c12700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40ad6c0 con 0x7fcee40cc860 2023-11-08T12:33:04.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.725+0000 7fcee8c12700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee406b1c0 con 0x7fcee4070790 2023-11-08T12:33:04.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.725+0000 7fcee8c12700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40adc60 con 0x7fcee4160710 2023-11-08T12:33:04.734 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcee4070790 0x7fcee4164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:04.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcee4070790 0x7fcee4164250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34592/0 (socket says 172.21.15.112:34592) 2023-11-08T12:33:04.735 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 -- 172.21.15.112:0/325098492 learned_addr learned my addr 172.21.15.112:0/325098492 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:33:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 -- 172.21.15.112:0/325098492 >> v2:172.21.15.133:3300/0 conn(0x7fcee4160710 msgr2=0x7fcee40cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:33:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 --2- 172.21.15.112:0/325098492 >> v2:172.21.15.133:3300/0 conn(0x7fcee4160710 0x7fcee40cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.737 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 -- 172.21.15.112:0/325098492 >> v1:172.21.15.133:6789/0 conn(0x7fcee40cc860 legacy=0x7fcee4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:33:04.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 -- 172.21.15.112:0/325098492 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee406b3d0 con 0x7fcee4070790 2023-11-08T12:33:04.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee3fff700 1 --2- 172.21.15.112:0/325098492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4070790 0x7fcee4164250 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fcee4072ed0 tx=0x7fcedc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4375c095419735dd server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:04.738 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee2ffd700 1 -- 172.21.15.112:0/325098492 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc00e070 con 0x7fcee4070790 2023-11-08T12:33:04.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee2ffd700 1 -- 172.21.15.112:0/325098492 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc003a40 con 0x7fcee4070790 2023-11-08T12:33:04.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee2ffd700 1 -- 172.21.15.112:0/325098492 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc003df0 con 0x7fcee4070790 2023-11-08T12:33:04.739 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 -- 172.21.15.112:0/325098492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4070790 msgr2=0x7fcee4164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:04.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 --2- 172.21.15.112:0/325098492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4070790 0x7fcee4164250 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fcee4072ed0 tx=0x7fcedc00b330 comp rx=0 tx=0).stop 2023-11-08T12:33:04.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 -- 172.21.15.112:0/325098492 shutdown_connections 2023-11-08T12:33:04.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 --2- 172.21.15.112:0/325098492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4070790 0x7fcee4164250 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.740 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 --2- 172.21.15.112:0/325098492 >> v2:172.21.15.133:3300/0 conn(0x7fcee4160710 0x7fcee40cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 -- 172.21.15.112:0/325098492 >> 172.21.15.112:0/325098492 conn(0x7fcee40b0f80 msgr2=0x7fcee40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:33:04.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 -- 172.21.15.112:0/325098492 shutdown_connections 2023-11-08T12:33:04.741 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.729+0000 7fcee8c12700 1 -- 172.21.15.112:0/325098492 wait complete. 2023-11-08T12:33:04.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 Processor -- start 2023-11-08T12:33:04.743 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 -- start start 2023-11-08T12:33:04.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcee4070790 0x7fcee415f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:04.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee40cc860 0x7fcee40c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:04.744 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4160710 0x7fcee415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:04.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4154720 con 0x7fcee4160710 2023-11-08T12:33:04.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee415fdd0 con 0x7fcee40cc860 2023-11-08T12:33:04.745 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee8c12700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40c2880 con 0x7fcee4070790 2023-11-08T12:33:04.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4160710 0x7fcee415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:04.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee3fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4160710 0x7fcee415c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34606/0 (socket says 172.21.15.112:34606) 2023-11-08T12:33:04.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee3fff700 1 -- 172.21.15.112:0/2655849322 learned_addr learned my addr 172.21.15.112:0/2655849322 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:33:04.746 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcedaffd700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee40cc860 0x7fcee40c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:04.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee37fe700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcee4070790 0x7fcee415f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:04.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee3fff700 1 -- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcee4070790 msgr2=0x7fcee415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:04.747 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee3fff700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcee4070790 0x7fcee415f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee3fff700 1 -- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee40cc860 msgr2=0x7fcee40c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.733+0000 7fcee3fff700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee40cc860 0x7fcee40c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee3fff700 1 -- 172.21.15.112:0/2655849322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc009b30 con 0x7fcee4160710 2023-11-08T12:33:04.748 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee3fff700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4160710 0x7fcee415c570 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fcedc004000 tx=0x7fcedc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee0ff9700 1 -- 172.21.15.112:0/2655849322 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0094d0 con 0x7fcee4160710 2023-11-08T12:33:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee0ff9700 1 -- 172.21.15.112:0/2655849322 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc004240 con 0x7fcee4160710 2023-11-08T12:33:04.749 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee40ad8f0 con 0x7fcee4160710 2023-11-08T12:33:04.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee0ff9700 1 -- 172.21.15.112:0/2655849322 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0045f0 con 0x7fcee4160710 2023-11-08T12:33:04.750 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee406b6b0 con 0x7fcee4160710 2023-11-08T12:33:04.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.737+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee4160ae0 con 0x7fcee4160710 2023-11-08T12:33:04.751 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.741+0000 7fcee0ff9700 1 -- 172.21.15.112:0/2655849322 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fcedc004750 con 0x7fcee4160710 2023-11-08T12:33:04.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.741+0000 7fcee0ff9700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcec4064f10 0x7fcec40673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:04.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.741+0000 7fcee0ff9700 1 -- 172.21.15.112:0/2655849322 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcedc082f70 con 0x7fcee4160710 2023-11-08T12:33:04.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.741+0000 7fcee37fe700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcec4064f10 0x7fcec40673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:04.752 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.745+0000 7fcee37fe700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcec4064f10 0x7fcec40673c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fced4009990 tx=0x7fced4009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:04.755 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.749+0000 7fcee0ff9700 1 -- 172.21.15.112:0/2655849322 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fcedc051200 con 0x7fcee4160710 2023-11-08T12:33:04.934 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.929+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 --> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcee4073cb0 con 0x7fcec4064f10 2023-11-08T12:33:04.940 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.933+0000 7fcee0ff9700 1 -- 172.21.15.112:0/2655849322 <== mgr.4101 v2:172.21.15.112:6832/35428 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70303 (secure 0 0 0) 0x7fcee4073cb0 con 0x7fcec4064f10 2023-11-08T12:33:04.942 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:33:04.945 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcec4064f10 msgr2=0x7fcec40673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcec4064f10 0x7fcec40673c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fced4009990 tx=0x7fced4009110 comp rx=0 tx=0).stop 2023-11-08T12:33:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4160710 msgr2=0x7fcee415c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:04.946 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4160710 0x7fcee415c570 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fcedc004000 tx=0x7fcedc004af0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 shutdown_connections 2023-11-08T12:33:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fcec4064f10 0x7fcec40673c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcee4160710 0x7fcee415c570 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.947 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee40cc860 0x7fcee40c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 --2- 172.21.15.112:0/2655849322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcee4070790 0x7fcee415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:04.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.937+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 >> 172.21.15.112:0/2655849322 conn(0x7fcee40b0f80 msgr2=0x7fcee40ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:33:04.948 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.941+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 shutdown_connections 2023-11-08T12:33:04.949 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:04.941+0000 7fcee8c12700 1 -- 172.21.15.112:0/2655849322 wait complete. 2023-11-08T12:33:04.951 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2023-11-08T12:33:04.967 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2023-11-08T12:33:04.821520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":94952,"kb_used_data":8232,"kb_used_omap":0,"kb_used_meta":86656,"kb_avail":754879768,"statfs":{"total":773094113280,"available":772996882432,"internally_reserved":0,"allocated":8429568,"data_stored":4570720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":88735744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003929"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:44.790886+0000","last_change":"2023-11-08T12:32:44.790817+0000","last_active":"2023-11-08T12:32:44.790886+0000","last_peered":"2023-11-08T12:32:44.790886+0000","last_clean":"2023-11-08T12:32:44.790886+0000","last_became_active":"2023-11-08T12:27:48.535782+0000","last_became_peered":"2023-11-08T12:27:48.535782+0000","last_unstale":"2023-11-08T12:32:44.790886+0000","last_undegraded":"2023-11-08T12:32:44.790886+0000","last_fullsized":"2023-11-08T12:32:44.790886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:44.790594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:44.790594+0000","last_clean_scrub_stamp":"2023-11-08T12:32:44.790594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:35:58.750420+0000","scrub_duration":0.0060302389999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:41.376904+0000","last_change":"2023-11-08T12:32:41.376862+0000","last_active":"2023-11-08T12:32:41.376904+0000","last_peered":"2023-11-08T12:32:41.376904+0000","last_clean":"2023-11-08T12:32:41.376904+0000","last_became_active":"2023-11-08T12:27:48.537621+0000","last_became_peered":"2023-11-08T12:27:48.537621+0000","last_unstale":"2023-11-08T12:32:41.376904+0000","last_undegraded":"2023-11-08T12:32:41.376904+0000","last_fullsized":"2023-11-08T12:32:41.376904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:41.376730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:41.376730+0000","last_clean_scrub_stamp":"2023-11-08T12:32:41.376730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T15:35:55.336556+0000","scrub_duration":0.0059236380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:53.465309+0000","last_change":"2023-11-08T12:32:53.465247+0000","last_active":"2023-11-08T12:32:53.465309+0000","last_peered":"2023-11-08T12:32:53.465309+0000","last_clean":"2023-11-08T12:32:53.465309+0000","last_became_active":"2023-11-08T12:27:48.737360+0000","last_became_peered":"2023-11-08T12:27:48.737360+0000","last_unstale":"2023-11-08T12:32:53.465309+0000","last_undegraded":"2023-11-08T12:32:53.465309+0000","last_fullsized":"2023-11-08T12:32:53.465309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:53.465027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:53.465027+0000","last_clean_scrub_stamp":"2023-11-08T12:32:53.465027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T14:29:15.041384+0000","scrub_duration":0.006478518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:45.397971+0000","last_change":"2023-11-08T12:32:45.397911+0000","last_active":"2023-11-08T12:32:45.397971+0000","last_peered":"2023-11-08T12:32:45.397971+0000","last_clean":"2023-11-08T12:32:45.397971+0000","last_became_active":"2023-11-08T12:27:48.739299+0000","last_became_peered":"2023-11-08T12:27:48.739299+0000","last_unstale":"2023-11-08T12:32:45.397971+0000","last_undegraded":"2023-11-08T12:32:45.397971+0000","last_fullsized":"2023-11-08T12:32:45.397971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:45.397670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:45.397670+0000","last_clean_scrub_stamp":"2023-11-08T12:32:45.397670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:56:04.335879+0000","scrub_duration":0.0059395569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:45.509328+0000","last_change":"2023-11-08T12:32:45.509271+0000","last_active":"2023-11-08T12:32:45.509328+0000","last_peered":"2023-11-08T12:32:45.509328+0000","last_clean":"2023-11-08T12:32:45.509328+0000","last_became_active":"2023-11-08T12:27:48.538115+0000","last_became_peered":"2023-11-08T12:27:48.538115+0000","last_unstale":"2023-11-08T12:32:45.509328+0000","last_undegraded":"2023-11-08T12:32:45.509328+0000","last_fullsized":"2023-11-08T12:32:45.509328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:45.509055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:45.509055+0000","last_clean_scrub_stamp":"2023-11-08T12:32:45.509055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T16:22:14.650893+0000","scrub_duration":0.0063367620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:45.342830+0000","last_change":"2023-11-08T12:32:45.342765+0000","last_active":"2023-11-08T12:32:45.342830+0000","last_peered":"2023-11-08T12:32:45.342830+0000","last_clean":"2023-11-08T12:32:45.342830+0000","last_became_active":"2023-11-08T12:27:48.535258+0000","last_became_peered":"2023-11-08T12:27:48.535258+0000","last_unstale":"2023-11-08T12:32:45.342830+0000","last_undegraded":"2023-11-08T12:32:45.342830+0000","last_fullsized":"2023-11-08T12:32:45.342830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:45.342562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:45.342562+0000","last_clean_scrub_stamp":"2023-11-08T12:32:45.342562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:08:15.478104+0000","scrub_duration":0.0060597450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:48.591753+0000","last_change":"2023-11-08T12:32:48.591657+0000","last_active":"2023-11-08T12:32:48.591753+0000","last_peered":"2023-11-08T12:32:48.591753+0000","last_clean":"2023-11-08T12:32:48.591753+0000","last_became_active":"2023-11-08T12:27:48.539531+0000","last_became_peered":"2023-11-08T12:27:48.539531+0000","last_unstale":"2023-11-08T12:32:48.591753+0000","last_undegraded":"2023-11-08T12:32:48.591753+0000","last_fullsized":"2023-11-08T12:32:48.591753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:48.591390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:48.591390+0000","last_clean_scrub_stamp":"2023-11-08T12:32:48.591390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T18:00:23.454836+0000","scrub_duration":0.0065309330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":76,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:44.486428+0000","last_change":"2023-11-08T12:32:44.486359+0000","last_active":"2023-11-08T12:32:44.486428+0000","last_peered":"2023-11-08T12:32:44.486428+0000","last_clean":"2023-11-08T12:32:44.486428+0000","last_became_active":"2023-11-08T12:27:48.536530+0000","last_became_peered":"2023-11-08T12:27:48.536530+0000","last_unstale":"2023-11-08T12:32:44.486428+0000","last_undegraded":"2023-11-08T12:32:44.486428+0000","last_fullsized":"2023-11-08T12:32:44.486428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T12:32:44.486144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T12:32:44.486144+0000","last_clean_scrub_stamp":"2023-11-08T12:32:44.486144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T12:58:52.017876+0000","scrub_duration":0.0068229959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"75'119","reported_seq":225,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-11-08T12:32:45.638576+0000","last_change":"2023-11-08T12:32:45.638518+0000","last_active":"2023-11-08T12:32:45.638576+0000","last_peered":"2023-11-08T12:32:45.638576+0000","last_clean":"2023-11-08T12:32:45.638576+0000","last_became_active":"2023-11-08T12:27:42.818349+0000","last_became_peered":"2023-11-08T12:27:42.818349+0000","last_unstale":"2023-11-08T12:32:45.638576+0000","last_undegraded":"2023-11-08T12:32:45.638576+0000","last_fullsized":"2023-11-08T12:32:45.638576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'119","last_scrub_stamp":"2023-11-08T12:32:45.638340+0000","last_deep_scrub":"75'119","last_deep_scrub_stamp":"2023-11-08T12:32:45.638340+0000","last_clean_scrub_stamp":"2023-11-08T12:32:45.638340+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-09T13:40:16.987057+0000","scrub_duration":0.014039807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476804,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9980,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361860,"statfs":{"total":96636764160,"available":96626544640,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.153,"15min":1.125},"min":{"1min":0.74099999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4510000000000001,"5min":7.4889999999999999,"15min":7.4889999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.167,"15min":1.1160000000000001},"min":{"1min":0.69899999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.476,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.202}]},{"osd":1,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.161,"15min":1.155},"min":{"1min":0.69799999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.494,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.1419999999999999,"15min":1.1200000000000001},"min":{"1min":0.65900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3720000000000001,"5min":1.851,"15min":1.851},"last":1.29}]},{"osd":2,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1040000000000001,"15min":1.0700000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.6659999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.391},{"interface":"front","average":{"1min":1.202,"5min":1.252,"15min":1.264},"min":{"1min":0.88900000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5600000000000001,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.4450000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2989999999999999,"15min":1.329},"min":{"1min":0.80800000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.702,"5min":5.601,"15min":5.601},"last":1.478},{"interface":"front","average":{"1min":1.24,"5min":1.2190000000000001,"15min":1.2330000000000001},"min":{"1min":0.86799999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.589,"5min":1.73,"15min":1.73},"last":0.91400000000000003}]},{"osd":4,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2370000000000001,"15min":1.3029999999999999},"min":{"1min":0.75900000000000001,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5629999999999999,"5min":3.9119999999999999,"15min":3.9119999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2829999999999999,"15min":1.3480000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.5349999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.359}]},{"osd":5,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.2150000000000001,"15min":1.268},"min":{"1min":0.77800000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4279999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3899999999999999,"15min":1.4470000000000001},"min":{"1min":0.83999999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.5469999999999999,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.5069999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.389,"15min":1.4590000000000001},"min":{"1min":1.0089999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.6120000000000001,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.421},{"interface":"front","average":{"1min":1.329,"5min":1.365,"15min":1.4239999999999999},"min":{"1min":1.095,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7709999999999999,"5min":2.121,"15min":2.121},"last":1.3109999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":14268,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":13376,"kb_avail":94357572,"statfs":{"total":96636764160,"available":96622153728,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13697024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0249999999999999,"15min":1.004},"min":{"1min":0.71199999999999997,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.099,"15min":1.0669999999999999},"min":{"1min":0.81799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.363,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.92100000000000004}]},{"osd":1,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.159,"15min":1.1599999999999999},"min":{"1min":0.70599999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4750000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1379999999999999,"15min":1.1859999999999999},"min":{"1min":0.78500000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4770000000000001,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.97299999999999998}]},{"osd":2,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1910000000000001,"15min":1.212},"min":{"1min":0.85399999999999998,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7190000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.087},{"interface":"front","average":{"1min":1.117,"5min":1.1499999999999999,"15min":1.181},"min":{"1min":0.81699999999999995,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.514,"5min":3.129,"15min":3.129},"last":1.143}]},{"osd":3,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1899999999999999,"15min":1.214},"min":{"1min":0.93400000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5960000000000001,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.393},{"interface":"front","average":{"1min":1.294,"5min":1.264,"15min":1.3069999999999999},"min":{"1min":0.99199999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5940000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.1799999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.145,"15min":1.264},"min":{"1min":0.74199999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.377,"5min":3.2229999999999999,"15min":3.2229999999999999},"last":1.032},{"interface":"front","average":{"1min":1.161,"5min":1.2030000000000001,"15min":1.2150000000000001},"min":{"1min":0.65500000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6299999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":1.214}]},{"osd":6,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.319,"15min":1.371},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4990000000000001,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.3360000000000001,"15min":1.4039999999999999},"min":{"1min":0.91600000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.768,"5min":3.1800000000000002,"15min":3.1800000000000002},"last":1.28}]},{"osd":7,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3420000000000001,"15min":1.3959999999999999},"min":{"1min":0.94699999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5649999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.387,"15min":1.4339999999999999},"min":{"1min":1.099,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.907,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.254}]}]},{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.099,"15min":1.141},"min":{"1min":0.90900000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.419},{"interface":"front","average":{"1min":1.177,"5min":1.147,"15min":1.167},"min":{"1min":0.73199999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4650000000000001,"5min":1.7,"15min":1.7},"last":1.379}]},{"osd":1,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.58799999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4770000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0669999999999999,"15min":1.052},"min":{"1min":0.68700000000000006,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.629,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.155}]},{"osd":2,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.1479999999999999,"15min":1.1299999999999999},"min":{"1min":0.86399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.575,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.204,"15min":1.2130000000000001},"min":{"1min":0.95099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.603,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.208}]},{"osd":3,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1739999999999999,"15min":1.214},"min":{"1min":0.85799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.496,"5min":1.984,"15min":1.984},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2290000000000001,"15min":1.2549999999999999},"min":{"1min":0.97999999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.613,"5min":2.137,"15min":2.137},"last":1.395}]},{"osd":4,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1970000000000001,"15min":1.268},"min":{"1min":0.95999999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5289999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1559999999999999,"15min":1.224},"min":{"1min":0.70699999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.55,"5min":3.4100000000000001,"15min":3.4100000000000001},"last":1.228}]},{"osd":5,"last update":"Wed Nov 8 12:32:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.246,"15min":1.272},"min":{"1min":0.84899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.55,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1870000000000001,"15min":1.2470000000000001},"min":{"1min":0.751,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6539999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.1259999999999999}]},{"osd":6,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3400000000000001,"15min":1.359},"min":{"1min":0.89400000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6859999999999999,"5min":1.956,"15min":1.956},"last":1.472},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.349,"15min":1.403},"min":{"1min":0.90000000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.7150000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3500000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9916,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361924,"statfs":{"total":96636764160,"available":96626610176,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.3380000000000001,"15min":1.9239999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4910000000000001,"5min":20.099,"15min":20.099},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.3700000000000001,"15min":1.99},"min":{"1min":0.71599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4410000000000001,"5min":21.238,"15min":21.238},"last":1.3460000000000001}]},{"osd":1,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.103,"15min":1.1930000000000001},"min":{"1min":0.67200000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.5649999999999999,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.2,"15min":1.474},"min":{"1min":0.86399999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5009999999999999,"5min":8.0630000000000006,"15min":8.0630000000000006},"last":0.98699999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.319,"15min":1.651},"min":{"1min":0.84199999999999997,"5min":0.745,"15min":0.745},"max":{"1min":1.585,"5min":11.843,"15min":11.843},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.3460000000000001,"15min":1.6919999999999999},"min":{"1min":0.752,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.659,"5min":11.907,"15min":11.907},"last":1.1890000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.381,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":1.492},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2889999999999999,"15min":1.4550000000000001},"min":{"1min":0.78900000000000003,"5min":0.751,"15min":0.751},"max":{"1min":1.6930000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.2709999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:32:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1879999999999999,"15min":1.2070000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5289999999999999,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.24,"15min":1.278},"min":{"1min":0.67700000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.766,"5min":2.073,"15min":2.073},"last":1.4710000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:32:55 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2050000000000001,"15min":1.284},"min":{"1min":0.72599999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6060000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.876},{"interface":"front","average":{"1min":1.179,"5min":1.323,"15min":1.3700000000000001},"min":{"1min":0.92700000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.641,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.29}]},{"osd":7,"last update":"Wed Nov 8 12:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.415,"15min":1.7150000000000001},"min":{"1min":0.89400000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.8740000000000001,"5min":8.109,"15min":8.109},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.4550000000000001,"15min":1.629},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8400000000000001,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.4279999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361668,"statfs":{"total":96636764160,"available":96626348032,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84799999999999998,"15min":0.95599999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.167,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.92700000000000005,"15min":0.97399999999999998},"min":{"1min":0.54300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.341,"5min":1.53,"15min":1.53},"last":1.022}]},{"osd":1,"last update":"Wed Nov 8 12:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.85299999999999998,"15min":0.88900000000000001},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":1.077},"min":{"1min":0.62,"5min":0.376,"15min":0.376},"max":{"1min":1.5509999999999999,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.1699999999999999}]},{"osd":2,"last update":"Wed Nov 8 12:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0469999999999999,"15min":1.1879999999999999},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.47,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.95799999999999996,"15min":1.0029999999999999},"min":{"1min":0.61199999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.361,"5min":1.972,"15min":1.972},"last":0.94899999999999995}]},{"osd":4,"last update":"Wed Nov 8 12:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.179,"15min":1.2370000000000001},"min":{"1min":0.875,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7310000000000001,"5min":1.837,"15min":1.837},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.2589999999999999,"15min":1.3220000000000001},"min":{"1min":0.73699999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.704,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.292}]},{"osd":5,"last update":"Wed Nov 8 12:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.214,"15min":1.284},"min":{"1min":0.754,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6830000000000001,"5min":1.897,"15min":1.897},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.3149999999999999,"15min":1.444},"min":{"1min":0.77100000000000002,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.788,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.2230000000000001}]},{"osd":6,"last update":"Wed Nov 8 12:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.268,"15min":1.3300000000000001},"min":{"1min":0.83799999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.835,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.141},{"interface":"front","average":{"1min":1.25,"5min":1.276,"15min":1.3240000000000001},"min":{"1min":0.83599999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8169999999999999,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.103}]},{"osd":7,"last update":"Wed Nov 8 12:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.3580000000000001,"15min":1.4399999999999999},"min":{"1min":0.88,"5min":0.875,"15min":0.875},"max":{"1min":1.915,"5min":2.194,"15min":2.194},"last":1.306},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.383,"15min":1.476},"min":{"1min":1.0720000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.7250000000000001,"5min":2.472,"15min":2.472},"last":1.2649999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10044,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361796,"statfs":{"total":96636764160,"available":96626479104,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:32:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.92300000000000004,"15min":0.97499999999999998},"min":{"1min":0.47799999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2230000000000001,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":1.198},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0409999999999999,"15min":1.05},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5369999999999999,"5min":5.0190000000000001,"15min":5.0190000000000001},"last":1.171}]},{"osd":2,"last update":"Wed Nov 8 12:32:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.96999999999999997,"15min":1.024},"min":{"1min":0.68100000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.353,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0760000000000001,"15min":1.1240000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4990000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.2929999999999999}]},{"osd":3,"last update":"Wed Nov 8 12:32:44 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.085,"15min":1.1140000000000001},"min":{"1min":0.70999999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.552,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":1.02},{"interface":"front","average":{"1min":0.998,"5min":0.98599999999999999,"15min":1.0720000000000001},"min":{"1min":0.57999999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7589999999999999,"5min":3.73,"15min":3.73},"last":0.83899999999999997}]},{"osd":4,"last update":"Wed Nov 8 12:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2370000000000001,"15min":1.27},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.1720000000000002,"5min":3.766,"15min":3.766},"last":1.244},{"interface":"front","average":{"1min":1.601,"5min":1.341,"15min":1.341},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":7.6230000000000002,"5min":7.6230000000000002,"15min":7.6230000000000002},"last":1.45}]},{"osd":5,"last update":"Wed Nov 8 12:32:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.3149999999999999,"15min":1.391},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.458,"5min":4.8620000000000001,"15min":4.8620000000000001},"last":1.135},{"interface":"front","average":{"1min":1.175,"5min":1.282,"15min":1.4199999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7130000000000001,"5min":3.8679999999999999,"15min":3.8679999999999999},"last":1.272}]},{"osd":6,"last update":"Wed Nov 8 12:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.327,"15min":1.3640000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1419999999999999,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.331},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3520000000000001,"15min":1.3979999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.3149999999999999,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":1.357}]},{"osd":7,"last update":"Wed Nov 8 12:32:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4330000000000001,"15min":1.5109999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5740000000000001,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.347,"15min":1.4450000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8120000000000001,"5min":2.8599999999999999,"15min":2.8599999999999999},"last":1.3819999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15296,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356544,"statfs":{"total":96636764160,"available":96621101056,"internally_reserved":0,"allocated":1499136,"data_stored":1014116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.871,"15min":1.0649999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.133,"5min":6.54,"15min":6.54},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92700000000000005,"15min":1.091},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.3460000000000001,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":1.4410000000000001}]},{"osd":2,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.90600000000000003,"15min":1.0009999999999999},"min":{"1min":0.51500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.359,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.997,"15min":1.0509999999999999},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.53,"5min":3.069,"15min":3.069},"last":1.3200000000000001}]},{"osd":3,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":1.069},"min":{"1min":0.55800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.276,"5min":2.673,"15min":2.673},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1359999999999999,"15min":1.3360000000000001},"min":{"1min":0.68000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.512,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.3009999999999999}]},{"osd":4,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2509999999999999,"15min":1.369},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.4850000000000001,"5min":2.927,"15min":2.927},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.28,"15min":1.3879999999999999},"min":{"1min":0.83199999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7509999999999999,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.675}]},{"osd":5,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.248,"15min":1.3779999999999999},"min":{"1min":0.80800000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.643,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.329,"15min":1.5029999999999999},"min":{"1min":0.93500000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.577,"5min":3.0270000000000001,"15min":3.0270000000000001},"last":1.246}]},{"osd":6,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.381,"15min":1.5449999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.595,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.387},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3520000000000001,"15min":1.49},"min":{"1min":0.98699999999999999,"5min":0.872,"15min":0.872},"max":{"1min":1.7769999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":1.532}]},{"osd":7,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.373,"15min":1.5},"min":{"1min":0.88700000000000001,"5min":0.871,"15min":0.871},"max":{"1min":1.6359999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.603},{"interface":"front","average":{"1min":1.206,"5min":1.3520000000000001,"15min":1.5309999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.74,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":1.478}]}]},{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9980,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361860,"statfs":{"total":96636764160,"available":96626544640,"internally_reserved":0,"allocated":905216,"data_stored":423748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2330000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85099999999999998,"15min":0.873},"min":{"1min":0.55800000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2330000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.878}]},{"osd":1,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0860000000000001,"15min":1.1220000000000001},"min":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.526,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.92800000000000005,"15min":0.92500000000000004},"min":{"1min":0.59899999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.452,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.92600000000000005,"15min":0.96199999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2010000000000001,"5min":1.837,"15min":1.837},"last":1.228},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.056,"15min":1.1140000000000001},"min":{"1min":0.61099999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5720000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.198}]},{"osd":4,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1639999999999999,"15min":1.1879999999999999},"min":{"1min":0.90600000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.446,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.343},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2609999999999999,"15min":1.3540000000000001},"min":{"1min":0.95299999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.5700000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.1419999999999999}]},{"osd":5,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3009999999999999,"15min":1.379},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.7410000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":1.254},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2430000000000001,"15min":1.3140000000000001},"min":{"1min":0.93600000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4830000000000001,"5min":3.052,"15min":3.052},"last":1.27}]},{"osd":6,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2849999999999999,"15min":1.363},"min":{"1min":0.84499999999999997,"5min":0.753,"15min":0.753},"max":{"1min":1.4970000000000001,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.337,"15min":1.403},"min":{"1min":1.077,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.8420000000000001,"5min":2.254,"15min":2.254},"last":1.3939999999999999}]},{"osd":7,"last update":"Wed Nov 8 12:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3280000000000001,"15min":1.3979999999999999},"min":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.619,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.169},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3919999999999999,"15min":1.458},"min":{"1min":0.86899999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.625,"5min":3.5,"15min":3.5},"last":1.369}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T12:33:04.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-08T12:33:05.136 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.129+0000 7fdd88c2f700 1 Processor -- start 2023-11-08T12:33:05.137 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.129+0000 7fdd88c2f700 1 -- start start 2023-11-08T12:33:05.140 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd88c2f700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdd8415e190 0x7fdd840cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd88c2f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd84161560 0x7fdd84069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd88c2f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd84070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.141 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd88c2f700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840708d0 con 0x7fdd8415e190 2023-11-08T12:33:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd88c2f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8415e560 con 0x7fdd84161560 2023-11-08T12:33:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd88c2f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8406be80 con 0x7fdd8406ff10 2023-11-08T12:33:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd837fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdd8415e190 0x7fdd840cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.142 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd837fe700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdd8415e190 0x7fdd840cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34622/0 (socket says 172.21.15.112:34622) 2023-11-08T12:33:05.143 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd837fe700 1 -- 172.21.15.112:0/3647843126 learned_addr learned my addr 172.21.15.112:0/3647843126 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:33:05.144 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd83fff700 1 --2- 172.21.15.112:0/3647843126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd84070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.133+0000 7fdd7affd700 1 --2- 172.21.15.112:0/3647843126 >> v2:172.21.15.133:3300/0 conn(0x7fdd84161560 0x7fdd84069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd837fe700 1 -- 172.21.15.112:0/3647843126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 msgr2=0x7fdd84070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:33:05.145 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd837fe700 1 --2- 172.21.15.112:0/3647843126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd84070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd837fe700 1 -- 172.21.15.112:0/3647843126 >> v2:172.21.15.133:3300/0 conn(0x7fdd84161560 msgr2=0x7fdd84069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:33:05.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd837fe700 1 --2- 172.21.15.112:0/3647843126 >> v2:172.21.15.133:3300/0 conn(0x7fdd84161560 0x7fdd84069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.146 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd837fe700 1 -- 172.21.15.112:0/3647843126 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840ce330 con 0x7fdd8415e190 2023-11-08T12:33:05.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd7affd700 1 --2- 172.21.15.112:0/3647843126 >> v2:172.21.15.133:3300/0 conn(0x7fdd84161560 0x7fdd84069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:33:05.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd837fe700 1 --2- 172.21.15.112:0/3647843126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd8415e190 0x7fdd840cdc50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fdd840c55a0 tx=0x7fdd74009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9bf6a57e4fc234 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:05.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd82ffd700 1 -- 172.21.15.112:0/3647843126 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7400b8a0 con 0x7fdd8415e190 2023-11-08T12:33:05.147 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd82ffd700 1 -- 172.21.15.112:0/3647843126 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7400ba00 con 0x7fdd8415e190 2023-11-08T12:33:05.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd82ffd700 1 -- 172.21.15.112:0/3647843126 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7400bd90 con 0x7fdd8415e190 2023-11-08T12:33:05.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3647843126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd8415e190 msgr2=0x7fdd840cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.148 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3647843126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd8415e190 0x7fdd840cdc50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fdd840c55a0 tx=0x7fdd74009bf0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3647843126 shutdown_connections 2023-11-08T12:33:05.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3647843126 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd84070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3647843126 >> v2:172.21.15.133:3300/0 conn(0x7fdd84161560 0x7fdd84069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.149 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3647843126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd8415e190 0x7fdd840cdc50 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3647843126 >> 172.21.15.112:0/3647843126 conn(0x7fdd840cf280 msgr2=0x7fdd840cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:33:05.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3647843126 shutdown_connections 2023-11-08T12:33:05.150 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.137+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3647843126 wait complete. 2023-11-08T12:33:05.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 Processor -- start 2023-11-08T12:33:05.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 -- start start 2023-11-08T12:33:05.153 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd840c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd8415e190 0x7fdd840c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd84161560 0x7fdd8414a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c8590 con 0x7fdd84161560 2023-11-08T12:33:05.154 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c7bf0 con 0x7fdd8415e190 2023-11-08T12:33:05.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.141+0000 7fdd88c2f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c7ed0 con 0x7fdd8406ff10 2023-11-08T12:33:05.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd84161560 0x7fdd8414a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.155 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd84161560 0x7fdd8414a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34636/0 (socket says 172.21.15.112:34636) 2023-11-08T12:33:05.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 -- 172.21.15.112:0/3255039549 learned_addr learned my addr 172.21.15.112:0/3255039549 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:33:05.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd837fe700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd840c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.156 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd7affd700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd8415e190 0x7fdd840c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 -- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 msgr2=0x7fdd840c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd840c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 -- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd8415e190 msgr2=0x7fdd840c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.157 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd8415e190 0x7fdd840c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 -- 172.21.15.112:0/3255039549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74009570 con 0x7fdd84161560 2023-11-08T12:33:05.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd83fff700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd84161560 0x7fdd8414a5d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c007e40 tx=0x7fdd7c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:05.158 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00ed30 con 0x7fdd84161560 2023-11-08T12:33:05.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd840afc70 con 0x7fdd84161560 2023-11-08T12:33:05.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c014420 con 0x7fdd84161560 2023-11-08T12:33:05.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0147d0 con 0x7fdd84161560 2023-11-08T12:33:05.159 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd840af990 con 0x7fdd84161560 2023-11-08T12:33:05.160 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.145+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd840aff50 con 0x7fdd84161560 2023-11-08T12:33:05.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.149+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fdd7c012050 con 0x7fdd84161560 2023-11-08T12:33:05.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.149+0000 7fdd80ff9700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdd64064f10 0x7fdd640673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.149+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fdd7c082340 con 0x7fdd84161560 2023-11-08T12:33:05.161 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.149+0000 7fdd837fe700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdd64064f10 0x7fdd640673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.162 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.149+0000 7fdd837fe700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdd64064f10 0x7fdd640673c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000c00 tx=0x7fdd74008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:05.163 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.157+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fdd7c050550 con 0x7fdd84161560 2023-11-08T12:33:05.335 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.329+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fdd84073d20 con 0x7fdd84161560 2023-11-08T12:33:05.346 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.337+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdd7c050550 con 0x7fdd84161560 2023-11-08T12:33:05.347 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.337+0000 7fdd80ff9700 1 -- 172.21.15.112:0/3255039549 <== mon.0 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fdd7c0590c0 con 0x7fdd84161560 2023-11-08T12:33:05.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.341+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdd64064f10 msgr2=0x7fdd640673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.341+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdd64064f10 0x7fdd640673c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000c00 tx=0x7fdd74008030 comp rx=0 tx=0).stop 2023-11-08T12:33:05.349 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.341+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd84161560 msgr2=0x7fdd8414a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.341+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd84161560 0x7fdd8414a5d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c007e40 tx=0x7fdd7c00e3c0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.350 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 shutdown_connections 2023-11-08T12:33:05.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fdd64064f10 0x7fdd640673c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd84161560 0x7fdd8414a5d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.351 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd8415e190 0x7fdd840c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 --2- 172.21.15.112:0/3255039549 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd8406ff10 0x7fdd840c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 >> 172.21.15.112:0/3255039549 conn(0x7fdd840cf280 msgr2=0x7fdd8415ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:33:05.352 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 shutdown_connections 2023-11-08T12:33:05.353 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.345+0000 7fdd88c2f700 1 -- 172.21.15.112:0/3255039549 wait complete. 2023-11-08T12:33:05.372 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-08T12:33:05.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-08T12:33:05.550 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.545+0000 7fe03a7c3700 1 Processor -- start 2023-11-08T12:33:05.551 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.545+0000 7fe03a7c3700 1 -- start start 2023-11-08T12:33:05.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.545+0000 7fe03a7c3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe034160710 0x7fe0340cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.553 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.545+0000 7fe03a7c3700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0340cc860 0x7fe034070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe034069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe034070a60 con 0x7fe0340cc860 2023-11-08T12:33:05.554 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03406b1c0 con 0x7fe034160710 2023-11-08T12:33:05.555 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340ad6c0 con 0x7fe0340705c0 2023-11-08T12:33:05.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0340cc860 0x7fe034070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.556 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe0340cc860 0x7fe034070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59224/0 (socket says 172.21.15.112:59224) 2023-11-08T12:33:05.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 -- 172.21.15.112:0/2130428004 learned_addr learned my addr 172.21.15.112:0/2130428004 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:33:05.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe039fc2700 1 --2- 172.21.15.112:0/2130428004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe034069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe0397c1700 1 --2- 172.21.15.112:0/2130428004 >> v2:172.21.15.133:3300/0 conn(0x7fe034160710 0x7fe0340cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.557 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 -- 172.21.15.112:0/2130428004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 msgr2=0x7fe034069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:33:05.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 --2- 172.21.15.112:0/2130428004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe034069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 -- 172.21.15.112:0/2130428004 >> v2:172.21.15.133:3300/0 conn(0x7fe034160710 msgr2=0x7fe0340cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-08T12:33:05.558 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 --2- 172.21.15.112:0/2130428004 >> v2:172.21.15.133:3300/0 conn(0x7fe034160710 0x7fe0340cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 -- 172.21.15.112:0/2130428004 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0340adc60 con 0x7fe0340cc860 2023-11-08T12:33:05.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe038fc0700 1 --2- 172.21.15.112:0/2130428004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe034070080 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe034072ed0 tx=0x7fe024009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31357c389842412 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:05.559 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe02bfff700 1 -- 172.21.15.112:0/2130428004 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024011830 con 0x7fe0340cc860 2023-11-08T12:33:05.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe02bfff700 1 -- 172.21.15.112:0/2130428004 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe024011990 con 0x7fe0340cc860 2023-11-08T12:33:05.560 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe02bfff700 1 -- 172.21.15.112:0/2130428004 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024011d40 con 0x7fe0340cc860 2023-11-08T12:33:05.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 -- 172.21.15.112:0/2130428004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 msgr2=0x7fe034070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.561 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/2130428004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe034070080 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe034072ed0 tx=0x7fe024009bf0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 -- 172.21.15.112:0/2130428004 shutdown_connections 2023-11-08T12:33:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/2130428004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe034069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/2130428004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe034070080 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/2130428004 >> v2:172.21.15.133:3300/0 conn(0x7fe034160710 0x7fe0340cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.549+0000 7fe03a7c3700 1 -- 172.21.15.112:0/2130428004 >> 172.21.15.112:0/2130428004 conn(0x7fe0340b0f80 msgr2=0x7fe0340ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:33:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.553+0000 7fe03a7c3700 1 -- 172.21.15.112:0/2130428004 shutdown_connections 2023-11-08T12:33:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.553+0000 7fe03a7c3700 1 -- 172.21.15.112:0/2130428004 wait complete. 2023-11-08T12:33:05.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.553+0000 7fe03a7c3700 1 Processor -- start 2023-11-08T12:33:05.564 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.553+0000 7fe03a7c3700 1 -- start start 2023-11-08T12:33:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe0340b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe03414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.566 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe034160710 0x7fe03415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe034149690 con 0x7fe0340cc860 2023-11-08T12:33:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03414aaf0 con 0x7fe034160710 2023-11-08T12:33:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe034149ee0 con 0x7fe0340705c0 2023-11-08T12:33:05.567 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe03414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe03414af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59236/0 (socket says 172.21.15.112:59236) 2023-11-08T12:33:05.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 -- 172.21.15.112:0/89467830 learned_addr learned my addr 172.21.15.112:0/89467830 (peer_addr_for_me v2:172.21.15.112:0/0) 2023-11-08T12:33:05.568 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe0397c1700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe0340b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 -- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 msgr2=0x7fe0340b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe0340b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe039fc2700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe034160710 0x7fe03415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.569 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 -- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe034160710 msgr2=0x7fe03415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe034160710 0x7fe03415d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 -- 172.21.15.112:0/89467830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024009570 con 0x7fe0340cc860 2023-11-08T12:33:05.570 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe0397c1700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe0340b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:33:05.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe039fc2700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe034160710 0x7fe03415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-08T12:33:05.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe038fc0700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe03414af80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe024009860 tx=0x7fe024004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:05.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe029ffb700 1 -- 172.21.15.112:0/89467830 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240044d0 con 0x7fe0340cc860 2023-11-08T12:33:05.571 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe029ffb700 1 -- 172.21.15.112:0/89467830 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe02401f070 con 0x7fe0340cc860 2023-11-08T12:33:05.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03406b6b0 con 0x7fe0340cc860 2023-11-08T12:33:05.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe029ffb700 1 -- 172.21.15.112:0/89467830 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024003920 con 0x7fe0340cc860 2023-11-08T12:33:05.572 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.557+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03406b3d0 con 0x7fe0340cc860 2023-11-08T12:33:05.573 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.561+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0340ad8f0 con 0x7fe0340cc860 2023-11-08T12:33:05.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.561+0000 7fe029ffb700 1 -- 172.21.15.112:0/89467830 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) v1 ==== 83959+0+0 (secure 0 0 0) 0x7fe02400f050 con 0x7fe0340cc860 2023-11-08T12:33:05.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.561+0000 7fe029ffb700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe018064ee0 0x7fe018067390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-08T12:33:05.574 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.561+0000 7fe029ffb700 1 -- 172.21.15.112:0/89467830 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe024021070 con 0x7fe0340cc860 2023-11-08T12:33:05.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.565+0000 7fe0397c1700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe018064ee0 0x7fe018067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-08T12:33:05.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.565+0000 7fe0397c1700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe018064ee0 0x7fe018067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe030009ed0 tx=0x7fe03000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-08T12:33:05.575 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.565+0000 7fe029ffb700 1 -- 172.21.15.112:0/89467830 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+168943 (secure 0 0 0) 0x7fe024051730 con 0x7fe0340cc860 2023-11-08T12:33:05.777 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.769+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe034073cb0 con 0x7fe0340cc860 2023-11-08T12:33:05.778 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.773+0000 7fe029ffb700 1 -- 172.21.15.112:0/89467830 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fe024015de0 con 0x7fe0340cc860 2023-11-08T12:33:05.779 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-11-08T12:33:05.779 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1052378971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1052378971},{"type":"v1","addr":"172.21.15.112:6835","nonce":1052378971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6049,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/811101360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":811101360},{"type":"v1","addr":"172.21.15.133:6833","nonce":811101360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6055,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/431090806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":431090806},{"type":"v1","addr":"172.21.15.133:6835","nonce":431090806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3706057712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3706057712},{"type":"v1","addr":"172.21.15.112:6837","nonce":3706057712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-11-08T12:33:05.781 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.773+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe018064ee0 msgr2=0x7fe018067390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe018064ee0 0x7fe018067390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe030009ed0 tx=0x7fe03000b040 comp rx=0 tx=0).stop 2023-11-08T12:33:05.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 msgr2=0x7fe03414af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-08T12:33:05.782 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe03414af80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe024009860 tx=0x7fe024004770 comp rx=0 tx=0).stop 2023-11-08T12:33:05.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 shutdown_connections 2023-11-08T12:33:05.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:6832/35428,v1:172.21.15.112:6833/35428] conn(0x7fe018064ee0 0x7fe018067390 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.783 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe034160710 0x7fe03415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0340cc860 0x7fe03414af80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 --2- 172.21.15.112:0/89467830 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0340705c0 0x7fe0340b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-08T12:33:05.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 >> 172.21.15.112:0/89467830 conn(0x7fe0340b0f80 msgr2=0x7fe0340af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-08T12:33:05.784 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 shutdown_connections 2023-11-08T12:33:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2023-11-08T12:33:05.777+0000 7fe03a7c3700 1 -- 172.21.15.112:0/89467830 wait complete. 2023-11-08T12:33:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 35 2023-11-08T12:33:05.806 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-08T12:33:05.806 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-08T12:33:05.807 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-08T12:33:05.807 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:05.827 INFO:tasks.ceph.mds.a:Stopped 2023-11-08T12:33:05.828 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-08T12:33:05.828 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:05.895 INFO:tasks.ceph.mds.c:Stopped 2023-11-08T12:33:05.896 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-08T12:33:05.896 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:05.916 INFO:tasks.ceph.mds.b:Stopped 2023-11-08T12:33:05.917 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-08T12:33:05.917 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:05.983 INFO:tasks.ceph.mds.d:Stopped 2023-11-08T12:33:05.984 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-08T12:33:05.984 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-08T12:33:05.985 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:08.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:08.280 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:11.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-08T12:33:12.086 INFO:tasks.ceph.osd.0:Stopped 2023-11-08T12:33:12.087 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-08T12:33:12.087 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:12.187 INFO:tasks.ceph.osd.1:Stopped 2023-11-08T12:33:12.187 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-08T12:33:12.188 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:17.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-08T12:33:17.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-08T12:33:18.291 INFO:tasks.ceph.osd.2:Stopped 2023-11-08T12:33:18.292 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-08T12:33:18.292 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:23.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-08T12:33:23.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-08T12:33:24.394 INFO:tasks.ceph.osd.3:Stopped 2023-11-08T12:33:24.395 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-08T12:33:24.396 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:29.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-08T12:33:29.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-08T12:33:30.498 INFO:tasks.ceph.osd.4:Stopped 2023-11-08T12:33:30.499 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-08T12:33:30.499 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:30.591 INFO:tasks.ceph.osd.5:Stopped 2023-11-08T12:33:30.592 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-08T12:33:30.592 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:34.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-08T12:33:34.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-08T12:33:36.694 INFO:tasks.ceph.osd.6:Stopped 2023-11-08T12:33:36.695 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-08T12:33:36.695 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:38.352 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:38.359 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:40.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-08T12:33:40.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-08T12:33:42.797 INFO:tasks.ceph.osd.7:Stopped 2023-11-08T12:33:42.798 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-08T12:33:42.798 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-08T12:33:42.799 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:42.866 INFO:tasks.ceph.mgr.y:Stopped 2023-11-08T12:33:42.867 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-08T12:33:42.868 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:42.941 INFO:tasks.ceph.mgr.x:Stopped 2023-11-08T12:33:42.941 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-08T12:33:42.942 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-08T12:33:42.942 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:42.976 INFO:tasks.ceph.mon.a:Stopped 2023-11-08T12:33:42.977 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-08T12:33:42.977 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:43.008 INFO:tasks.ceph.mon.b:Stopped 2023-11-08T12:33:43.008 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-08T12:33:43.009 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T12:33:43.083 INFO:tasks.ceph.mon.c:Stopped 2023-11-08T12:33:43.084 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-08T12:33:43.084 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-11-08T12:33:43.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:33:43.137 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-08T12:33:43.368 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:33:43.369 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-08T12:33:43.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:33:43.544 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-08T12:33:43.749 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:33:43.749 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-08T12:33:43.932 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:33:43.932 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-08T12:33:44.165 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:33:44.166 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-08T12:33:44.329 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:33:44.330 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-08T12:33:44.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:33:44.512 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-08T12:33:44.664 INFO:tasks.ceph:Archiving mon data... 2023-11-08T12:33:44.665 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/data/mon.a.tgz 2023-11-08T12:33:44.666 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2023-11-08T12:33:44.684 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.OAPsuoGFLb 2023-11-08T12:33:44.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OAPsuoGFLb 2023-11-08T12:33:44.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.OAPsuoGFLb 2023-11-08T12:33:44.962 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.OAPsuoGFLb is 438KB 2023-11-08T12:33:45.043 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.OAPsuoGFLb 2023-11-08T12:33:45.062 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/data/mon.b.tgz 2023-11-08T12:33:45.062 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-11-08T12:33:45.081 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.PVc5G25zhQ 2023-11-08T12:33:45.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.PVc5G25zhQ 2023-11-08T12:33:45.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.PVc5G25zhQ 2023-11-08T12:33:45.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-08T12:33:45.394 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.PVc5G25zhQ is 566KB 2023-11-08T12:33:45.472 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.PVc5G25zhQ 2023-11-08T12:33:45.493 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/data/mon.c.tgz 2023-11-08T12:33:45.494 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-11-08T12:33:45.556 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.fbP3Kye29S 2023-11-08T12:33:45.557 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fbP3Kye29S 2023-11-08T12:33:45.768 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.fbP3Kye29S 2023-11-08T12:33:45.868 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.fbP3Kye29S is 567KB 2023-11-08T12:33:45.904 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.fbP3Kye29S 2023-11-08T12:33:45.922 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-08T12:33:45.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-08T12:33:45.930 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-08T12:33:46.003 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-08T12:33:46.003 DEBUG:teuthology.orchestra.run.smithi112:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-08T12:33:46.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-08T12:33:46.053 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-08T12:33:46.094 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-08T12:33:46.108 INFO:tasks.ceph:Archiving crash dumps... 2023-11-08T12:33:46.110 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/remote/smithi112/crash 2023-11-08T12:33:46.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-08T12:33:46.157 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/remote/smithi133/crash 2023-11-08T12:33:46.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-08T12:33:46.199 INFO:tasks.ceph:Shutting down logrotate 2023-11-08T12:33:46.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:46.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:46.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:46.359 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-08T12:33:46.389 INFO:tasks.ceph:Compressing logs... 2023-11-08T12:33:46.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-08T12:33:46.408 DEBUG:teuthology.orchestra.run.smithi133:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-08T12:33:51.002 INFO:tasks.ceph:Archiving logs... 2023-11-08T12:33:51.003 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/remote/smithi112/log 2023-11-08T12:33:51.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-08T12:33:51.881 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/remote/smithi133/log 2023-11-08T12:33:51.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-08T12:33:52.437 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-08T12:33:52.446 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-08T12:33:52.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-08T12:33:52.454 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-08T12:33:52.556 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-08T12:33:52.566 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-08T12:33:52.566 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T12:33:52.574 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T12:33:52.611 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2023-11-08T12:33:52.612 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2023-11-08T12:33:52.612 INFO:teuthology.orchestra.run.smithi112.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 64 377 0.098 -1.381 0.325 2023-11-08T12:33:52.612 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.100 0.121 0.394 2023-11-08T12:33:52.613 INFO:teuthology.orchestra.run.smithi112.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.124 -0.142 0.329 2023-11-08T12:33:52.613 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-08T12:33:52.616 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-11-08T12:33:52.617 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-11-08T12:33:52.617 INFO:teuthology.orchestra.run.smithi133.stdout:*hv01.front.sepi 44.4.53.2 2 u 42 64 377 0.089 0.887 0.623 2023-11-08T12:33:52.617 INFO:teuthology.orchestra.run.smithi133.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 377 0.125 1.646 0.514 2023-11-08T12:33:52.618 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.118 1.710 0.477 2023-11-08T12:33:52.618 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-08T12:33:52.619 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-08T12:33:52.630 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-08T12:33:52.630 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-08T12:33:52.640 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-08T12:33:52.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-08T12:33:52.659 INFO:teuthology.task.internal:Duration was 1190.926653 seconds 2023-11-08T12:33:52.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-08T12:33:52.669 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-08T12:33:52.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-08T12:33:52.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-08T12:33:52.830 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-08T12:33:52.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2023-11-08T12:33:52.831 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-08T12:33:52.866 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-11-08T12:33:52.867 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-08T12:33:52.903 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-08T12:33:52.904 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-08T12:33:52.915 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-08T12:33:53.009 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-08T12:33:53.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-08T12:33:53.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-08T12:33:53.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-08T12:33:53.137 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-08T12:33:53.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-08T12:33:53.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-08T12:33:53.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-08T12:33:53.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-08T12:33:53.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-08T12:33:53.266 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2023-11-08T12:33:53.296 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-11-08T12:33:53.335 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-08T12:33:53.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:33:53.363 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-08T12:33:53.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T12:33:53.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-08T12:33:53.409 INFO:teuthology.task.internal:Transferring archived files... 2023-11-08T12:33:53.410 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/remote/smithi112 2023-11-08T12:33:53.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-08T12:33:53.455 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947/remote/smithi133 2023-11-08T12:33:53.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-08T12:33:53.498 INFO:teuthology.task.internal:Removing archive directory... 2023-11-08T12:33:53.499 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-08T12:33:53.506 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-08T12:33:53.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-08T12:33:53.573 INFO:teuthology.task.internal:Not uploading archives. 2023-11-08T12:33:53.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-08T12:33:53.584 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-08T12:33:53.584 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-08T12:33:53.592 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-08T12:33:53.609 INFO:teuthology.orchestra.run.smithi112.stdout: 1048617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 8 12:33 /home/ubuntu/cephtest 2023-11-08T12:33:53.624 INFO:teuthology.orchestra.run.smithi133.stdout: 1048602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 8 12:33 /home/ubuntu/cephtest 2023-11-08T12:33:53.631 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-08T12:33:53.642 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-08T12:33:53.661 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T12:33:53.689 DEBUG:teuthology.nuke:shortname: smithi112 2023-11-08T12:33:53.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T12:33:53.713 DEBUG:teuthology.nuke:shortname: smithi133 2023-11-08T12:33:53.713 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T12:33:53.717 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 12:04:30.860348', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-08T12:33:53.740 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-08_12:02:26-fs-wip-neesingh-testing-54557-distro-default-smithi/7451947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 12:04:30.858920', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-08T12:33:53.764 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-08T12:33:53.765 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T12:33:53.794 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-08T12:33:53.794 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:33:53.815 INFO:teuthology.orchestra.console.smithi133:Power off 2023-11-08T12:33:53.816 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T12:33:53.826 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-08T12:33:53.837 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-11-08T12:33:53.838 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:33:53.861 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-08T12:33:57.827 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:33:57.863 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:33:57.938 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-08T12:33:57.974 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-08T12:34:01.941 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:34:01.975 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:34:02.051 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-08T12:34:02.089 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-11-08T12:34:02.152 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-08T12:34:06.091 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T12:34:06.201 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-11-08T12:34:06.302 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-11-08T12:34:06.407 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3b796cfe2969fb2f2d017e8146dccc1ef582e837 client.1-kernel-sha1: 3b796cfe2969fb2f2d017e8146dccc1ef582e837 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1190.9266531467438 failure_reason: 'Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d60efb6c32284fe89e7244a5d815b395 status: fail success: false 2023-11-08T12:34:06.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T12:34:06.484 INFO:teuthology.run:FAIL